Hostname: page-component-745bb68f8f-mzp66 Total loading time: 0 Render date: 2025-01-07T19:24:07.406Z Has data issue: false hasContentIssue false

Maximizing the Coefficient of Generalizability in Multi-Facet Decision Studies

Published online by Cambridge University Press:  01 January 2025

J. Arthur Woodward
Affiliation:
Texas Christian University
George W. Joe
Affiliation:
Texas Christian University

Abstract

For random-model, fully-crossed, two- and three-facet experimental designs the following two problems were considered. First, equations were developed for determining the optimal number of conditions of a facet for maximizing the coefficient of generalizability under the constraint that the total number of observations per subject is constant. Second, the problem of determining the minimum number of observations per subject for a specified generalizability coefficient is solved for the two-facet crossed design.

Type
Original Paper
Copyright
Copyright © 1973 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Angoff, W. H. Test reliability and effective test length. Psychometrika, 1953, 18, 114CrossRefGoogle Scholar
Cronbach, L. J., Rajaratnam, N., and Gleser, G. C. Theory of generalizability: A liberalization of reliability theory. British Journal of Statistical Psychology, 1963, 16, 137163CrossRefGoogle Scholar
Cronbach, L. J., Gleser, G. C., Nanda, H., and Rajaratnam, N. The dependability of behavioral measurements, 1972, New York: WileyGoogle Scholar
Endler, N. S., Hunt, J McV, Rosenstein, A. J. An S-R inventory of anxiousness. Psychological Monographs, 1962, 76, 1717CrossRefGoogle Scholar
Endler, N. S., and Hunt, J McV S-R inventories of hostility and comparisons of the proportions of variance from persons, responses, and situations for hostility and anxiousness. Journal of Personality and Social Psychology, 1968, 9, 309315CrossRefGoogle ScholarPubMed
Gleser, G. C., Cronbach, L. J., and Rajaratnam, N. Generalizability of scores influenced by multiple sources of variance. Psychometrika, 1965, 30, 395418CrossRefGoogle ScholarPubMed
Gulliksen, H. Theory of mental tests, 1950, New York: WileyCrossRefGoogle Scholar
Kristof, W. On the theory of a set of tests which differ only in length. Psychometrika, 1971, 36, 207225CrossRefGoogle Scholar
Lindquist, E. F. Design and analysis of experiments in psychology and education, 1953, Boston: Houghton MifflinGoogle Scholar
Lord, F. M., and Novick, M. R. Statistical theories of mental test scores, 1968, Reading, Mass.: Addison-WesleyGoogle Scholar
Rajaratnam, N. Reliability formulas for independent decision data when reliability data are matched. Psychometrika, 1960, 25, 261271CrossRefGoogle Scholar
Rajaratnam, N., Cronbach, L. J., and Gleser, G. C. Generalizability of stratified-parallel tests. Psychometrika, 1965, 30, 3956CrossRefGoogle ScholarPubMed
Woodbury, M. A. On the standard length of a test. Psychometrika, 1951, 16, 103106CrossRefGoogle Scholar
Woodbury, M. A., and Lord, F. M. The most reliable composite with a specified true score. British Journal of Statistical Psychology, 1956, 9, 2128CrossRefGoogle Scholar