Hostname: page-component-745bb68f8f-f46jp Total loading time: 0 Render date: 2025-01-07T18:24:23.647Z Has data issue: false hasContentIssue false

Optimal Choice of Rater Terms I: Theory

Published online by Cambridge University Press:  01 January 2025

Janet Dixon Elashoff*
Affiliation:
Harvard University

Abstract

How can an investigator choose a good team of raters to use for measuring a continuous variable when each available rater produces only dichotomous responses? We formulate an underlying model, define an index of goodness for rater teams in terms of average mean square error of the estimate, develop a new estimator and derive the optimal rater terms. The optimal raters have characteristic curves which are linear in form and satisfy the requirements for a Guttman scale.

Type
Original Paper
Copyright
Copyright © 1969 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

*

This research was supported in part by the author's predoctoral fellowship from the National Institutes of Health and by National Science Foundation Grant GS-341, National institutes of Health Grants FR-3 and FR-122.

Now at Stanford University.

References

Brogden, H. E. New problems for old solutions. Psychometrika, 1961, 22, 301309CrossRefGoogle Scholar
Elashoff, J. D. Optimal choice of rater teams. Unpublished Ph.D. Thesis, 1966.Google Scholar
Ferguson, G. A. Item selection by the constant process. Psychometrika, 1942, 7, 1929CrossRefGoogle Scholar
Ferguson, G. A. On the theory of test discrimination. Psychometrika, 1949, 14, 6168CrossRefGoogle ScholarPubMed
Guttman, L. et al. The basis for scalogram analysis. In Stouffer, S. A. et al (Eds.), Measurement and Prediction, 1950, Princeton: Princeton, University PressGoogle Scholar
Lord, F. M. An application of confidence intervals and of maximum likelihood to the estimation of an examinee's ability. Psychometrika, 1953, 18, 5776CrossRefGoogle Scholar
Sitgreaves, R. Optimal test design in a special testing situation. In Solomon, H., Studies in Item Analysis and Prediction. Stanford University Press, 1961. (a)Google Scholar
Sitgreaves, R. Further contributions to the theory of test design. In Solomon, H., Studies in Item Analysis and Prediction. Stanford University Press, 1961. (b)Google Scholar
Thurlow, W. R. Direct measures of discriminations among individuals performed by psychological tests. Journal of Psychology, 1950, 29, 281314CrossRefGoogle Scholar