Hostname: page-component-cd9895bd7-mkpzs Total loading time: 0 Render date: 2025-01-04T03:46:43.060Z Has data issue: false hasContentIssue false

On the Statistical Treatment of Residuals in Factor Analysis

Published online by Cambridge University Press:  01 January 2025

K. G. Jöreskog*
Affiliation:
University of Uppsala, Sweden

Abstract

A method for estimation in factor analysis is presented. The method is based on the assumption that the residual (specific and error) variances are proportional to the reciprocal values of the diagonal elements of the inverted covariance (correlation) matrix. The estimation is performed by a modification of Whittle's least squares technique. The method is independent of the unit of scoring in the tests. Applications are given in the form of nine reanalyses of data of various kinds found in earlier literature.

Type
Original Paper
Copyright
Copyright © 1962 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

*

The writer wishes to thank Prof. H. Wold, Dr. E. Lyttkens, and Dr. P. Whittle for valuable comments and suggestions.

References

Anderson, T. W. Some scaling models and estimation procedures in the latent class model. In Grenander, U. (Eds.), Probability and statistics: the Harald Cramér volume. New York: Wiley, 1959, 938.Google Scholar
Bargmann, R. A study of independence and dependence in multivariate normal analysis. Univ. North Carolina, Inst. Statist. Mimeo. Ser. No. 186, 1957.Google Scholar
Bartlett, M. S. Tests of significance in factor analysis. Brit. J. Psychol. (Statist. Sect.), 1950, 3, 7785.CrossRefGoogle Scholar
Bartlett, M. S. A further note on tests of significance in factor analysis. Brit. J. Psychol. (Statist. Sect.), 1951, 4, 12.CrossRefGoogle Scholar
Bartlett, M. S. The effect of standardization on an approximation in factor analysis. Biometrika, 1951, 38, 337344.Google Scholar
Bechtoldt, H. P. An empirical study of the factor analysis stability hypothesis. Psychometrika, 1961, 26, 405432.CrossRefGoogle Scholar
Bellman, R. Introduction to matrix analysis, New York: McGraw-Hill, 1960.Google Scholar
Burt, C. The distribution and relations of educational abilities, London: P. S. King, 1917.Google Scholar
Chapman, R. L. The MacQuarrie test for mechanical ability. Psychometrika, 1948, 13, 175179.CrossRefGoogle ScholarPubMed
Cramér, H. Mathematical methods of statistics, Princeton: Princeton Univ. Press, 1945.Google Scholar
Davis, F. B. Fundamental factors of comprehension in reading. Psychometrika, 1944, 9, 185197.CrossRefGoogle Scholar
Denton, J. C. and Taylor, C. W. A factor analysis of mental abilities and personality traits. Psychometrika, 1955, 20, 7581.CrossRefGoogle Scholar
Dwyer, P. S. The evaluation of multiple and partial correlation coefficients from the factorial matrix. Psychometrika, 1940, 5, 211232.CrossRefGoogle Scholar
Givens, W. A method of computing eigenvalues and eigenvectors suggested by classical results on symmetric matrices. National Bureau of Standards, Applied Mathematics Series 29, 1953, 117122.Google Scholar
Greenstadt, J. The determination of the characteristic roots of a matrix by the Jacobi method. In Ralston, A. and Wilf, H. S. (Eds.), Mathematical methods for digital computers, New York: Wiley, 1960.Google Scholar
Guttman, L. Multiple rectilinear prediction and the resolution into components. Psychometrika, 1940, 5, 7579.CrossRefGoogle Scholar
Guttman, L. Image theory for the structure of quantitative variates. Psychometrika, 1953, 18, 277296.CrossRefGoogle Scholar
Guttman, L. “Best possible systematic estimates of communalities. Psychometrika, 1956, 21, 273285.CrossRefGoogle Scholar
Harman, H. Modern factor analysis, Chicago: Univ. Chicago Press, 1960.Google Scholar
Hotelling, H. Analysis of a complex of variables into principal components. J. educ. Psychol., 1933, 24, 417441.CrossRefGoogle Scholar
Kaiser, H. F. The varimax criterion for analytic rotation in factor analysis. Psychometrika, 1958, 23, 187200.CrossRefGoogle Scholar
Lawley, D. N. The estimation of factor loadings by the method of maximum likelihood. Proc. Roy. Soc. Edinburgh, 1940, 60, 6482.CrossRefGoogle Scholar
Lawley, D. N. Further investigations in factor estimation. Proc. Roy. Soc. Edinburgh, 1942, 61, 176185.Google Scholar
Lawley, D. N. The application of the maximum likelihood method to factor analysis. Brit. J. Psychol., 1943, 33, 172175.Google Scholar
Lawley, D. N. A modified method of estimation in factor analysis and some large sample results. In Uppsala Symposium on Psychological Factor Analysis, 17–19 March 1953. Nordisk Psykologi's Monograph Series No. 3, Almqvist-Wiksell, Stockholm, 1953.Google Scholar
Lawley, D. N. A statistical examination of the centroid method. Proc. Roy. Soc. Edinburgh, 1955, 64, 175189.Google Scholar
Ledermann, W. On a shortened method of estimation of mental factors by regression. Psychometrika, 1939, 4, 109116.CrossRefGoogle Scholar
Neuhaus, J. O. and Wrigley, C. The quartimax method: An analytical approach to orthogonal simple structure. Brit. J. statist. Psychol., 1954, 7, 8191.CrossRefGoogle Scholar
Orden, A. Matrix inversion and related topics by direct methods. In Ralston, A. and Wilf, H. S. (Eds.), Mathematical methods for digital computers, New York: Wiley, 1960.Google Scholar
Pemberton, C. The closure factors related to other cognitive processes. Psychometrika, 1952, 17, 267288.CrossRefGoogle Scholar
Rao, C. R. Estimation and tests of significance in factor analysis. Psychometrika, 1955, 20, 93111.CrossRefGoogle Scholar
Rimoldi, H. J. A. Study of some factors related to intelligence. Psychometrika, 1948, 13, 2746.CrossRefGoogle ScholarPubMed
Rippe, D. D. Application of a large sampling criterion to some sampling problems in factor analysis. Psychometrika, 1953, 18, 191205.CrossRefGoogle Scholar
Thomson, G. H. Hotelling's method modified to give Spearman'sg. J. educ. Psychol., 1934, 25, 366374.CrossRefGoogle Scholar
Thurstone, L. L. Multiple-factor analysis, Chicago: Univ. Chicago Press, 1947.Google Scholar
Whittle, P. On principal components and least square methods of factor analysis. Skandinavisk Aktuarietidskrift, 1952, 35, 223239.Google Scholar
Young, G. Maximum likelihood estimation and factor analysis. Psychometrika, 1941, 6, 4953.CrossRefGoogle Scholar