Hostname: page-component-745bb68f8f-grxwn Total loading time: 0 Render date: 2025-01-07T18:09:44.607Z Has data issue: false hasContentIssue false

Maximizing Test Validity by Item Selection

Published online by Cambridge University Press:  01 January 2025

Harold Webster*
Affiliation:
Mellon Foundation Vassar College

Abstract

The exact condition for discarding k items from a test in order to obtain a residual test with higher validity is derived. A proof that validity always increases is given for the case k = 1. The lack of uniqueness of maximum validity when achieved by use of the condition is discussed. With the use of additional restrictions on items to be included in the initial test, a practical test construction procedure which has several advantages over previous methods is developed. The homogeneity of tests constructed by the method is discussed, and applications are given.

Type
Original Paper
Copyright
Copyright © 1956 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Adorno, T. W., Frenkel-Brunswik, Else, Levinson, D. J., and Sanford, R. N.. The authoritarian personality, New York: Harper, 1950Google Scholar
Cronbach, L. J. Coefficient α and the internal structure of tests. Psychometrika, 1951, 16, 297334CrossRefGoogle Scholar
Fisher, R. A. The precision of discriminant functions. Ann. Eugen., Lond., 1940, 10, 422429CrossRefGoogle Scholar
Flanagan, J. C. A short method of selecting the best combination of test items for a particular purpose. Psychol. Bull., 1936, 33, 603604Google Scholar
Flanagan, J. C. The effectiveness of short methods for calculating correlation coefficients. Psychol. Bull., 1952, 49, 342348CrossRefGoogle ScholarPubMed
Gleser, G. C., and DuBois, P. H. A successive approximation method of maximizing test validity. Psychometrika, 1951, 16, 129139CrossRefGoogle Scholar
Guilford, J. P. Psychometric methods 2nd Ed., New York: McGraw-Hill, 1954Google Scholar
Gulliksen, H. Theory of mental tests, New York: Wiley, 1950CrossRefGoogle Scholar
Horst, P. Item selection by means of a maximizing function. Psychometrika, 1936, 1, 229244CrossRefGoogle Scholar
Hotelling, H. Relations between two sets of variates. Biometrika, 1936, 28, 321377CrossRefGoogle Scholar
Loevinger, Jane, Gleser, Goldine C., and DuBois, P. H.. Maximizing the discriminating power of a multiple-score test. Psychometrika, 1953, 18, 309317CrossRefGoogle Scholar
Lord, F. M. Sampling fluctuations resulting from the sampling of test items. Psychometrika, 1955, 20, 122CrossRefGoogle Scholar
Richardson, M. W., and Adkins, Dorothy C.. A rapid method of selecting test items. J. educ. Psychol., 1938, 29, 547552CrossRefGoogle Scholar
Toops, H. A. The L-method. Psychometrika, 1941, 6, 249266CrossRefGoogle Scholar
Tukey, J. W. Unsolved problems of experimental statistics. J. Amer. statist. Assoc., 1954, 49, 706731Google Scholar
Webster, H. Approximating maximum test validity by a non-parametric method. Psychometrika, 1953, 18, 207211CrossRefGoogle Scholar