Hostname: page-component-745bb68f8f-v2bm5 Total loading time: 0 Render date: 2025-02-12T04:20:28.321Z Has data issue: false hasContentIssue false
  • English
  • Français

When are Item Response Models Consistent with Observed Data?

Published online by Cambridge University Press:  01 January 2025

Paul W. Holland
Paul W. Holland*
Affiliation:
Educational Testing Service
*
Requests for reprints should be sent to Paul W. Holland, Division of Measurement, Statistics, and Data Analysis Research, Educational Testing Service, Princeton, New Jersey 08541.
Get access Rights & Permissions [Opens in a new window]

Abstract

The problem of deciding whether a set of mental test data is consistent with any one of a large class of item response models is considered. The “classical” assumption of locla independence is weakened to a new condition, local nonnegative dependence (LND). Necessary and sufficient conditions are derived for a LND item response model to fit a set of data. This leads to a condition that a set of data must satisfy if it is to be representable by any item response model that assumes both local independence and monotone item characteristic curves. An example is given to show that LND is strictly weaker than local independence. Thus rejection of LND models implies rejection of all item response models that assume local independence for a given set of data.

Keywords

latent-trait modelslocal independenceitem-characteristic curves
Type
Original Paper
Information
Psychometrika , Volume 46 , Issue 1 , March 1981 , pp. 79 - 92
Copyright
Copyright © 1981 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

This research was supported in part by Grant NIE-G-78-0157 to ETS from the NIE, by the Program Statistics Research Project, and by TOEFL Program Research. I would like to thank Dr. Douglas Jones of ETS for stimulating discussions during the early stages of this research, Dr. Frederick Lord of ETS for his encouragement of this work and comments on earlier drafts of this paper and Professor Robert Berk of Rutgers University for pointing out that conditions (a), (b) and (c) of Theorem 2 were also sufficient for LND and Monotonicity. Dr. Donald Alderman of ETS provided financial support for the development of a computer program to apply these results to data from the TOEFL program.

References

Birnbaum, A. Some latent trait models and their use in inferring an examinee's ability (Part 5). In Lord, F., Novick, M. (Eds.), Statistical theories of mental test scores, 1947, Reading, Massachusetts: Addison-Wesley.Google Scholar
Bock, D. & Lieberman, M. Fitting a response model for n dichotomously scored items. Psychometrika, 1970, 35, 179–197.CrossRefGoogle Scholar
Lawley, D. N. On problems connected with item selection and test construction. Proceedings of the Royal Society of Edinburgh, 1947, 61, 273–287.Google Scholar
Lazarsfeld, P. The algebra of dichotomous systems. In Solomon, H. (Eds.), Studies in item analysis and prediction, 1961, Stanford, California: Stanford University Press.Google Scholar
Lazarsfeld, P. & Henry, N. Latent structure analysis, 1968, Boston: Houghton-Mifflin.Google Scholar
Lord, F. A theory of test scores. Psychometric Monographs, 1952, 7.Google Scholar
Lord, F. An application of confidence intervals and of maximum likelihood to the estimation of an examinee's ability. Psychometrika, 1953, 18, 57–76.CrossRefGoogle Scholar
Lord, F. & Novick, M. Statistical theories of mental tests, 1968, Reading, Massachusetts: Addison-Wesley.Google Scholar
Rasch, G. Probabilistic models for some intelligence and attainment tests, 1960, Copenhagen: Neilson & Lydiche.Google Scholar
Tucker, L. Maximum validity of a test with equivalent items. Psychometrika, 1946, 11, 1–13.CrossRefGoogle ScholarPubMed