Hostname: page-component-5f745c7db-f9j5r Total loading time: 0 Render date: 2025-01-06T06:04:33.593Z Has data issue: true hasContentIssue false

Sampling Fluctuations Resulting from the Sampling of Test Items

Published online by Cambridge University Press:  01 January 2025

Frederic M. Lord*
Affiliation:
Educational Testing Service

Abstract

Sampling fluctuations resulting from the sampling of test items rather than of examinees are discussed. It is shown that the Kuder-Richardson reliability coefficients actually are measures of this type of sampling fluctuation. Formulas for certain standard errors are derived; in particular, a simple formula is given for the standard error of measurement of an individual examinee's score. A common misapplication of the Wilks-Votaw criterion for parallel tests is pointed out. It is shown that the Kuder-Richardson formula-21 reliability coefficient should be used instead of the formula-20 coefficient in certain common practical situations.

Type
Original Paper
Copyright
Copyright © 1955 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

*

Most of the work reported here was carried out under contract with the Office of Naval Research. The writer is indebted to Professor S. S. Wilks, who has checked over certain critical portions of a draft of this paper.

References

Cramér, H. Mathematical methods of statistics. Princeton Univ. Press, 1946.Google Scholar
Cronbach, L. J. Coefficient alpha and the internal structure of tests. Psychometrika, 1951, 16, 297334CrossRefGoogle Scholar
Gulliksen, H. Theory of mental tests, New York: Wiley, 1950CrossRefGoogle Scholar
Hooke, R. Sampling from a matrix, with applications to the theory of testing. Statistical Research Group, Princeton University. Memorandum Report 53, 1953. (Dittoed.)Google Scholar
Kendall, M. G. The advanced theory of statistics, London: Charles Griffin and Co., 1948Google Scholar
Kuder, G. F. and Richardson, M. W. The theory of the estimation of test reliability. Psychometrika, 1937, 2, 151160CrossRefGoogle Scholar
Mood, A. M. Introduction to the theory of statistics, New York: McGraw-Hill, 1950Google Scholar
Peters, C. C. and Van Voorhis, W. R. Statistical procedures and their mathematical bases, New York: McGraw-Hill, 1940CrossRefGoogle Scholar
Tucker, L. R. A note on the estimation of test reliability by the Kuder-Richardson formula (20). Psychometrika, 1949, 14, 117119CrossRefGoogle ScholarPubMed
Votaw, D. F. Jr. Testing compound symmetry in a normal multivariate distribution. Ann. math. Stat., 1948, 19, 447473CrossRefGoogle Scholar
Wilks, S. S. Sample criteria for testing equality of means, equality of variances, and equality of covariances in a normal multivariate distribution. Ann. math. Stat., 1946, 17, 257281CrossRefGoogle Scholar