Hostname: page-component-745bb68f8f-l4dxg Total loading time: 0 Render date: 2025-01-07T18:15:15.364Z Has data issue: false hasContentIssue false
  • English
  • Français

Linear Relations among k Sets of Variables

Published online by Cambridge University Press:  01 January 2025

John P. Van de Geer
John P. Van de Geer*
Affiliation:
Department of Data Theory, University of Leiden, Netherlands
*
Requests for reprints should be sent to John P. Van de Geer, Department of Data Theory, University of Leiden, Middelstegracht 4, 2312 TW Leiden, The Netherlands.
Get access Rights & Permissions [Opens in a new window]

Abstract

A family of solutions for linear relations among k sets of variables is proposed. It is shown how these solutions apply for k = 2, and how they can be generalized from there to k ≥ 3.

The family of solutions depends on three independent choices: (i) to what extent a solution may be influenced by differences in variances of components within each set; (ii) to what extent the sets may be differentially weighted with respect to their contribution to the solution—including orthogonality constraints; (iii) whether or not individual sets of variables may be replaced by an orthogonal and unit normalized basis.

Solutions are compared with respect to their optimality properties. For each solution the appropriate stationary equations are given. For one example it is shown how the determinantal equation of the stationary equations can be interpreted.

Keywords

canonical correlationlinear relations between setsmultiple regressionredundancy analysisridge regression
Type
Original Paper
Information
Psychometrika , Volume 49 , Issue 1 , March 1984 , pp. 79 - 94
Copyright
Copyright © 1984 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Reference Notes

Dauxois, J., and Pousse, A. (1976). Les analyses factorielles en calcul des probabilités et en statistique: essai d'étude synthétique. Toulouse; Ph.D. Thesis, Université de Toulouse.Google Scholar
Ten Berge, J. M. F. (1977). Optimizing factorial invariance. Groningen; Ph.D. Thesis, University of Groningen.Google Scholar

References

DeSarbo, W. S. (1981). Canonical/redundancy factorial analysis. Psychometrika, 46, 307–329.CrossRefGoogle Scholar
Guttman, L. (1953). Image theory and the structure of quantitative variables. Psychometrika, 18, 277–296.CrossRefGoogle Scholar
Hoerl, A. E., and Kennard, R. W. (1970). Ridge regression. Biased estimation for nonorthogonal problems. Technometrics, 12, 55–67.CrossRefGoogle Scholar
Hoerl, A. E., and Kennard, R. W. (1970). Ridge regression: applications to nonorthogonal problems. Technometrics, 12, 67–82.Google Scholar
Horst, P. (1961). Relations amongm sets of measures. Psychometrika, 26, 129–149.CrossRefGoogle Scholar
Horst, P. (1965). Factorial analysis of data matrices, New York: Holt, Rinehart and Winston.Google Scholar
Johansson, J. K. (1981). An extension of Wollenberg's redundancy analysis. Psychometrika, 46, 93–104.CrossRefGoogle Scholar
Kettenring, J. R. (1971). Canonical analysis of several sets of variables. Biometrika, 58, 433–451.CrossRefGoogle Scholar
Kristof, W. (1971). Orthogonal inter-battery factor analysis. Psychometrika, 32, 199–227.CrossRefGoogle Scholar
Tucker, L. R. (1958). An inter-battery method of factor analysis. Psychometrika, 23, 111–136.CrossRefGoogle Scholar
Van de Geer, J. P. (1971). Introduction to multivariate analysis for the social sciences, San Francisco: Freeman and Company.Google Scholar
Van den Wollenberg, A. L. (1977). Redundancy analysis: an alternative for canonical correlation analysis. Psychometrika, 42, 207–220.CrossRefGoogle Scholar