Hostname: page-component-745bb68f8f-f46jp Total loading time: 0 Render date: 2025-01-07T19:39:01.247Z Has data issue: false hasContentIssue false

Estimating True-Score Distributions in Psychological Testing (an Empirical Bayes Estimation Problem)

Published online by Cambridge University Press:  01 January 2025

Frederic M. Lord*
Affiliation:
Educational Testing Service

Abstract

The following problem is considered: Given that the frequency distribution of the errors of measurement is known, determine or estimate the distribution of true scores from the distribution of observed scores for a group of examinees. Typically this problem does not have a unique solution. However, if the true-score distribution is “smooth,” then any two smooth solutions to the problem will differ little from each other. Methods for finding smooth solutions are developed a) for a population and b) for a sample of examinees. The results of a number of tryouts on actual test data are summarized.

Type
Original Paper
Copyright
Copyright © 1969 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

*

The writer wishes to thank Diana Lees and Virginia Lennon, who wrote the computer programs, carried out some of the mathematical derivations, and helped with other important aspects of the work. This work was supported in part by contract Nonr-2752(00) between the Office of Naval Research and Educational Testing Service. Reproduction, translation, use and disposal in whole or in part by or for the United States Government is permitted.

References

Aitkin, A. C., & Gonin, H. T. On fourfold sampling with and without replacement. Proceedings of the Royal Society of Edinburgh, 1935, 55, 114125.CrossRefGoogle Scholar
Deely, J. J., & Kruse, R. L. Construction of sequences estimating the mixing distribution. The Annals of Mathematical Statistics, 1968, 39, 286288.CrossRefGoogle Scholar
Eisenberg, H. B., Geoghagen, R. R. M., & Walsh, J. E.. A general probability model for binomial events with application to surgical mortality. Biometrics, 1963, 19, 152157.CrossRefGoogle Scholar
Jordan, C. Calculus of finite differences, 2nd ed., New York: Chelsea, 1947.Google Scholar
Kendall, M. G., & Stuart, A. The advanced theory of statistics, 1958, New York: Hafner.Google Scholar
Kenneth, P., & Taylor, G. E. Solution of variational problems with bounded control variables by means of the generalized Newton-Raphson method. In Lavi, A. & Vogl, T. (Eds.), Recent advances in optimization techniques, 1966, New York: Wiley.Google Scholar
Leitmann, G. Variational problems with bounded control variables. In Leitmann, G. (Eds.), Optimization techniques. New York: Academic Press. 1962, 171204.Google Scholar
Lord, F. M. A theory of test scores. Psychometric Monograph, 1952, No. 7.Google Scholar
Lord, F. M. A strong true-score theory, with applications. Psychometrika, 1965, 30, 239270.CrossRefGoogle Scholar
Lord, F. M. Estimating item characteristic curves without knowledge of their mathematical form, 1968, Princeton, N. J.: Educational Testing Service.CrossRefGoogle Scholar
Lord, F. M., & Lees, Dinan Estimating true-score distributions for mental tests (Methods 12, 14, 15), 1967, Princeton, N. J.: Educational Testing Service.Google Scholar
Lord, F. M., & Lees, Diana Estimating true-score distributions for mental tests (Method 16), 1967, Princeton, N. J.: Educational Testing Service.CrossRefGoogle Scholar
Lord, F. M., & Novick, M. R. Statistical theories of mental test scores, 1968, Reading, Mass.: Addison-Wesley.Google Scholar
Maritz, J. S. Smooth empirical Bayes estimation for one-parameter discrete distributions. Biometrika, 1966, 53, 417429.CrossRefGoogle Scholar
Pars, L. A. An introduction to the calculus of variations, 1962, London: Heinemann.Google Scholar
Phillips, D. L. A technique for the numerical solution of certain integral equations of the first kind. Journal of the Association for Computing Machinery, 1962, 9, 8497.CrossRefGoogle Scholar
Rao, C. R. Linear statistical inference and its applications, 1965, New York: Wiley.Google Scholar
Riordan, J. An introduction to combinatorial analysis, 1958, New York: Wiley.Google Scholar
Robbins, H. An empirical Bayes approach to statistics. Proceedings of the Third Berkeley Symposium on Mathematical Statistics and Probability. Berkeley: University of California Press. 1956, 157163.Google Scholar
Robbins, H. The empirical Bayes approach to testing statistical hypotheses. Review of the International Statistical Institute, 1963, 31(2), 195208.CrossRefGoogle Scholar
Robbins, H. The empirical Bayes approach to statistical decision problems. The Annals of Mathematical Statistics, 1964, 35, 120.CrossRefGoogle Scholar
Skellam, J. G. A probability distribution derived from the binomial distribution by regarding the probability of success as variable between sets of trials. Journal of the Royal Statistical Society, Series B, 1948, 10, 257261.CrossRefGoogle Scholar
Tikhonov, A. N. Regularization of incorrectly posed problems. Soviet Mathematics Doklady, 1963, 4, 16241627.Google Scholar
Tricomi, F. G. Integral equations, 1957, New York: Interscience.Google Scholar
Twomey, S. On the numerical solution of Fredholm integral equations of the first kind by the inversion of the linear system produced by quadrature. Journal of the Association for Computing Machinery, 1963, 10, 97101.CrossRefGoogle Scholar
Walsh, J. E. Corrections to two papers concerned with binomial events. Sankhyā, 1963, 25, 427427.Google Scholar