Hostname: page-component-745bb68f8f-f46jp Total loading time: 0 Render date: 2025-01-07T18:13:31.436Z Has data issue: false hasContentIssue false
  • English
  • Français

Generalizability of Scores Influenced by Multiple Sources of Variance

Published online by Cambridge University Press:  01 January 2025

Goldine C. Gleser ,
Lee J. Cronbach  and
Nageswari Rajaratnam
Goldine C. Gleser
Affiliation:
University of Illinois*
Lee J. Cronbach
Affiliation:
University of Illinois*
Nageswari Rajaratnam
Affiliation:
University of Illinois*
Get access Rights & Permissions [Opens in a new window]

Abstract

Generalizability theory concerns the adequacy with which a “universe” score can be inferred from a set of observations. In this paper the theory is applied to a universe in which observations are classifiable according to two independent variable aspects of the measuring procedure. Several types of universe scores are developed and the variance components ascertained for each type. The composition of expected observed-score variance and the adequacy of inference to a particular type of universe score is a function of the procedure used in gathering data. A generalizability study provides estimates of variance components which can be used in designing an efficient procedure for a particular decision purpose.

Type
Original Paper
Information
Psychometrika , Volume 30 , Issue 4 , December 1965 , pp. 395 - 418
Copyright
Copyright © 1965 Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

*

This study was conducted under Grant M-1839 from the National Institute of Mental Health while the authors were on the staff of the University of Illinois. Dr. Rajaratnam shared responsibility for the technical report of July, 1961 on which this paper is based. The present revision was made subsequent to her death in 1963. The present addresses of the other authors are: Goldine C. Gleser, Department of Psychiatry, Central Clinic, Cincinatti, 29, Ohio; Lee J. Cronbach, School of Education, Stanford University.

References

Burt, C. Test reliability estimated by analysis of variance. Brit. J. statist. Psychol., 1955, 8, 103–118.CrossRefGoogle Scholar
Cornfield, J. and Tukey, J. W. Average values of mean squares in factorials. Ann. math. Statist., 1956, 27, 907–949.CrossRefGoogle Scholar
Cronbach, L. J. Test reliability: its meaning and determination. Psychometrika, 1947, 12, 1–16.CrossRefGoogle Scholar
Cronbach, L. J., Rajaratnam, N., and Gleser, G. C. Theory of generalizability: a liberalization of reliability theory. Brit. J. statist. Psychol., 1963, 16, 137–163.CrossRefGoogle Scholar
Cronbach, L. J., Gleser, G. C., and Rajaratnam, N. Generalizability of stratified-parallel tests. Psychometrika, 1965, 30, 39–56.Google Scholar
Endler, N. S., Hunt, J. M., and Rosenstein, A. J. An S-R inventory of anxiousness. Psychol. Monogr., 1962, No. 536.CrossRefGoogle Scholar
Endler, N. S. and Hunt, J. M. Sources of behavioral variance as measured by the S-R inventory of anxiousness. Mimeographed (December, 1964).Google Scholar
Gulliksen, H. The content reliability of a test. Psychometrika, 1936, 1, 189–194.CrossRefGoogle Scholar
Guttman, L. The principal components of scalable attitudes. In Lazarsfeld, P. F. (Eds.), Mathematical thinking in the social sciences, Glencoe, Ill.: Free Press, 1954.Google Scholar
Lindquist, E. F. Design and analysis of experiments in psychology and education, Boston: Houghton Mifflin, 1953.Google Scholar
Mahmoud, A. F. Test reliability in terms of factor theory. Brit. J. statist. Psychol., 1955, 8, 119–135.CrossRefGoogle Scholar
Medley, D. M. and Mitzel, H. E. Measuring classroom behavior by systematic observation. In Gage, N. L. (Eds.), Handbook of research on teaching. Chicago: Rand-McNally, 1963, 247–328.Google Scholar
Moonan, W. J. Computational illustrations of the internal and external consistency analysis of examination responses. J. exp. Educ., 1957, 25, 181–190.CrossRefGoogle Scholar
Stanley, J. C. Analysis of three-way orthogonal classifications, with applications to rater bias and trait independence. Unpublished manuscript, 1959.Google Scholar
Thorndike, R. L. Research problems and techniques. Report No. 3, AAF Aviation Psychol. Program Research Reports. U. S. Government Printing Office, 1947.CrossRefGoogle Scholar