Hostname: page-component-745bb68f8f-g4j75 Total loading time: 0 Render date: 2025-01-08T22:01:28.107Z Has data issue: false hasContentIssue false
  • English
  • Français

An EM Algorithm for Fitting Two-Level Structural Equation Models

Published online by Cambridge University Press:  01 January 2025

Jiajuan Liang  and
Peter M. Bentler
Jiajuan Liang
Affiliation:
University of New Haven, School of Business
Peter M. Bentler*
Affiliation:
University of California, Los Angeles
*
Requests for reprints should be sent to Peter M. Bentler, University of California, Los Angeles, Department of Psychology, Box 951563, Los Angeles, CA 90095-1563. E-mail: bentler@ucla.edu
Get access Rights & Permissions [Opens in a new window]

Abstract

Maximum likelihood is an important approach to analysis of two-level structural equation models. Different algorithms for this purpose have been available in the literature. In this paper, we present a new formulation of two-level structural equation models and develop an EM algorithm for fitting this formulation. This new formulation covers a variety of two-level structural equation models. As a result, the proposed EM algorithm is widely applicable in practice. A practical example illustrates the performance of the EM algorithm and the maximum likelihood statistic.

Keywords

Chi-square statisticmean and covariance structuresEM algorithmmaximum likelihoodmultivariate normal distributiontwo-level structural equation models
Type
Theory And Methods
Information
Psychometrika , Volume 69 , Issue 1 , March 2004 , pp. 101 - 122
Copyright
Copyright © 2004 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

We are thankful to the reviewers for their constructive comments that have led to significant improvement on the first version of this paper. Special thanks are due to the reviewer who suggested a comparison with the LISREL program in the saturated means model, and provided its setup and output. This work was supported by National Institute on Drug Abuse grants DA01070, DA00017, and a UNH 2002 Summer Faculty Fellowship.

References

Anderson, T.W. (1984). An Introduction to Multivariate Statistical Analysis 2nd ed., New York: John Wiley & SonsGoogle Scholar
Bentler, P.M. (2003). EQS 6 Structural Equations Program Manual. Encino, CA: Multivariate SoftwareGoogle Scholar
Bentler, P.M., & Weeks, D.G. (1980). Linear structural equations with latent variables. Psychometrika, 45, 289–308CrossRefGoogle Scholar
Boyles, R.A. (1983). On the convergence of the EM algorithm. Journal of the Royal Statistical Society, Series B, 45, 47–50CrossRefGoogle Scholar
Dempster, A.P., Laird, N.M., & Rubin, D.B. (1977). Maximum likelihood from incomplete data via EM algorithm (with discussion). Journal of the Royal Statistical Society, Series B, 39, 1–38CrossRefGoogle Scholar
Du Toit, M., & du Toit, S. (2001). Interactive LISREL: User's Guide. Scientific Software International, Inc.Google Scholar
Du Toit, S., & du Toit, M. (2002). Multilevel structural equation modeling. In: de Leeuw, J. & Kreft, I. (Eds.), Handbook of Quantitative Multilevel Analysis (Chapter 13); Kluver Publications. (In press)Google Scholar
Goldstein, H., McDonald, P.R. (1988). A general model for the analysis of multilevel data. Psychometrika, 53, 455–467CrossRefGoogle Scholar
Hoadley, B. (1971). Asymptotic properties of maximum likelihood estimators for the independent not identically distributed case. Annals of Mathematical Statistics, 42, 1977–1991CrossRefGoogle Scholar
Hox, J.J. (1993). Factor analysis of multilevel data. Gauging the Muthén model. In Oud, J.H.L., van Blokland-Vogelesang, R.A.W. (Eds.), Advances in Longitudinal and Multilevel Analysis in the Behavioural Sciences (pp. 141–156). Nijmegen, NL: ITSGoogle Scholar
Hox, J.J., Maas, C.J.M. (2001). The accuracy of multilevel structural equation modeling with pseudobalanced groups and small samples. Structural Equation Modeling, 8, 157–174CrossRefGoogle Scholar
Jamshidian, M., & Jennrich, R.I. (1993). Conjugate gradient acceleration of the EM algorithm. Journal of the American Statistical Association, 88, 221–228CrossRefGoogle Scholar
Jamshidian, M., & Jennrich, R.I. (1997). Acceleration of the EM algorithm by using Quasi-Newton methods. Journal of the Royal Statistical Society, Series B, 59, 569–587CrossRefGoogle Scholar
Lange, K. (1995). A gradient algorithm locally equivalent to the EM algorithm. Journal of the Royal Statistical Society, Series B, 57, 425–437CrossRefGoogle Scholar
Lange, K. (1995). A Quasi-Newton acceleration of the EM algorithm. Statistica Sinica, 5, 1–18Google Scholar
Lee, S.Y. (1990). Multilevel analysis of structural equation models. Biometrika, 77, 763–772CrossRefGoogle Scholar
Lee, S.Y., & Poon, W.Y. (1998). Analysis of two-level structural equation models via EM type algorithms. Statistica Sinica, 8, 749–766Google Scholar
Longford, N.T., & Muthén, B.O. (1992). Factor analysis for clustered observations. Psychometrika, 57, 581–597CrossRefGoogle Scholar
McDonald, R.P. (1993). A general model for two-level data with responses missing at random. Psychometrika, 58, 575–585CrossRefGoogle Scholar
McDonald, R.P. (1994). The bilevel reticular action model for path analysis with latent variables. Sociological Methods & Research, 22, 399–413CrossRefGoogle Scholar
McDonald, R.P., & Goldstein, H. (1989). Balanced versus unbalanced designs for linear structural relations in two-level data. British Journal of Mathematical and Statistical Psychology, 42, 215–232CrossRefGoogle Scholar
McLachlan, G.J., & Krishnan, T. (1997). The EM Algorithm and Extensions. New York: John Wiley and SonsGoogle Scholar
Muthén, B.O. (1989). Latent variable modeling in heterogeneous populations. Psychometrika, 54, 557–585CrossRefGoogle Scholar
Muthén, B.O. (1990). Mean and covariance structure analysis of hierarchical data. UCLA Statistics Series, #62.Google Scholar
Muthén, B.O. (1991). Multilevel factor analysis of class and student achievement components. Journal of Educational Measurement, 28, 338–354CrossRefGoogle Scholar
Muthén, B.O. (1994). Multilevel covariance structure analysis. Sociological Methods & Research, 22, 376–398CrossRefGoogle Scholar
Muthén, B.O. (1997). Latent variable modeling of longitudinal and multilevel data. In Raftery, A. (Eds.), Sociological Methodology (pp. 453–481). Boston: BlackwellGoogle Scholar
Muthén, L.K., & Muthén, B.O. (1998). Mplus User's Guide. Los Angeles: Muthén & MuthénGoogle Scholar
Muthén, B.O., & Satorra, A. (1989). Multilevel aspects of varying parameters for the factor analysis of nonnormal likert variables. In Bock, R.D. (Eds.), Multilevel Analysis of Educational Data (pp. 87–99). San Diego, CA: Academic PressGoogle Scholar
Raudenbush, S.W. (1995). Maximum likelihood estimation for unbalanced multilevel covariance structure models via the EM algorithm. British Journal of Mathematical and Statistical Psychology, 48, 359–370CrossRefGoogle Scholar
Wu, C.F.J. (1983). On the convergence properties of the EM algorithm. Annals of Statistics, 11, 95–103CrossRefGoogle Scholar
Yung, Y.-F., & Bentler, P.M. (1999). On added information for ML factor analysis with mean and covariance structures. Journal of Educational and Behavioral Statistics, 24, 1–20CrossRefGoogle Scholar