Hostname: page-component-cd9895bd7-p9bg8 Total loading time: 0 Render date: 2025-01-04T04:32:25.663Z Has data issue: false hasContentIssue false

The Sufficient and Necessary Condition for the Identifiability and Estimability of the DINA Model

Published online by Cambridge University Press:  01 January 2025

Yuqi Gu
Affiliation:
University of Michigan
Gongjun Xu*
Affiliation:
University of Michigan
*
Correspondence should be made to Gongjun Xu, Department of Statistics, University of Michigan, 456 West Hall, 1085 South University, Ann Arbor, MI 48109, USA. Email: gongjun@umich.edu

Abstract

Cognitive diagnosis models (CDMs) are useful statistical tools in cognitive diagnosis assessment. However, as many other latent variable models, the CDMs often suffer from the non-identifiability issue. This work gives the sufficient and necessary condition for identifiability of the basic DINA model, which not only addresses the open problem in Xu and Zhang (Psychometrika 81:625–649, 2016) on the minimal requirement for identifiability, but also sheds light on the study of more general CDMs, which often cover DINA as a submodel. Moreover, we show the identifiability condition ensures the consistent estimation of the model parameters. From a practical perspective, the identifiability condition only depends on the Q-matrix structure and is easy to verify, which would provide a guideline for designing statistically valid and estimable cognitive diagnosis tests.

Type
Original Paper
Copyright
Copyright © 2018 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

Electronic supplementary material The online version of this article (https://doi.org/10.1007/s11336-018-9619-8) contains supplementary material, which is available to authorized users.

References

Casella, G., & Berger, R. L., (2002). Statistical inference. Duxbury Pacific Grove, CA, 2 edition.Google Scholar
Chen, Y., Liu, J., Xu, G., Ying, Z. (2015). Statistical analysis of Q\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$Q$$\end{document}-matrix based diagnostic classification models. Journal of the American Statistical Association, 110, 850866.CrossRefGoogle Scholar
Chiu, C.-Y., Douglas, J. A., Li, X. (2009). Cluster analysis for cognitive diagnosis: Theory and applications. Psychometrika, 74, 633665.CrossRefGoogle Scholar
de la Torre, J. (2011). The generalized DINA model framework. Psychometrika, 76, 179199.CrossRefGoogle Scholar
DeCarlo, L. T. (2011). On the analysis of fraction subtraction data: The DINA model, classification, class sizes, and the Q-matrix. Applied Psychological Measurement, 35, 826.CrossRefGoogle Scholar
DiBello, L. V., Stout, W. F., Roussos, L. A. (1995). Unified cognitive psychometric diagnostic assessment likelihood-based classification techniques. In Nichols, P. D., Chipman, S. F., Brennan, R. L. (Eds), Cognitively diagnostic assessment, Hillsdale, NJ: Erlbaum Associates 361390.Google Scholar
Fang, G., Liu, J., & Ying, Z. (2017). On the identifiability diagnostic classification models. arXiv Preprint.Google Scholar
Gabrielsen, A. (1978). Consistency and identifiability. Journal of Econometrics, 8(2), 261263.CrossRefGoogle Scholar
Goodman, L. A. (1974). Exploratory latent structure analysis using both identifiable and unidentifiable models. Biometrika, 61, 215231.CrossRefGoogle Scholar
Henson, R. A., Templin, J. L., Willse, J. T. (2009). Defining a family of cognitive diagnosis models using log-linear models with latent variables. Psychometrika, 74, 191210.CrossRefGoogle Scholar
Junker, B. W., Sijtsma, K. (2001). Cognitive assessment models with few assumptions, and connections with nonparametric item response theory. Applied Psychological Measurement, 25, 258272.CrossRefGoogle Scholar
Koopmans, T. C., Reiersøl, O. (1950). The identification of structural characteristics. Annals of Mathematical Statistics, 21, 165181.CrossRefGoogle Scholar
Liu, J., Xu, G., Ying, Z. (2013). Theory of self-learning Q-matrix. Bernoulli, 19 5A17901817.CrossRefGoogle ScholarPubMed
Maris, G., Bechger, T. M. (2009). Equivalent diagnostic classification models. Measurement, 7, 4146.Google Scholar
McHugh, R. B. (1956). Efficient estimation and local identification in latent class analysis. Psychometrika, 21, 331347.CrossRefGoogle Scholar
Rothenberg, T. J. (1971). Identification in parametric models. Econometrica, 39, 577591.CrossRefGoogle Scholar
Tatsuoka, C. (2009). Diagnostic models as partially ordered sets. Measurement, 7, 4953.Google Scholar
Tatsuoka, K. K. (1983). Rule space: An approach for dealing with misconceptions based on item response theory. Journal of Educational Measurement, 20, 345354.CrossRefGoogle Scholar
Templin, J. L., Henson, R. A. (2006). Measurement of psychological disorders using cognitive diagnosis models. Psychological Methods, 11, 287305.CrossRefGoogle ScholarPubMed
von Davier, M. (2005). A general diagnostic model applied to language testing data, Princeton, NJ: Educational Testing Service.CrossRefGoogle Scholar
von Davier, M. (2014). The DINA model as a constrained general diagnostic model: Two variants of a model equivalency. British Journal of Mathematical and Statistical Psychology, 67(1), 4971.CrossRefGoogle Scholar
Wang, S., Douglas, J. (2015). Consistency of nonparametric classification in cognitive diagnosis. Psychometrika, 80(1), 85100.CrossRefGoogle ScholarPubMed
Xu, G. (2017). Identifiability of restricted latent class models with binary responses. The Annals of Statistics, 45, 675707.CrossRefGoogle Scholar
Xu, G., & Shang, Z. (2017). Identifying latent structures in restricted latent class models. Journal of the American Statistical Association, (accepted).Google Scholar
Xu, G., Zhang, S. (2016). Identifiability of diagnostic classification models. Psychometrika, 81, 625649.CrossRefGoogle ScholarPubMed
Supplementary material: File

Gu and Xu Supplementary material

Gu and Xu Supplementary material
Download Gu and Xu Supplementary material(File)
File 206.6 KB