Hostname: page-component-cd9895bd7-jn8rn Total loading time: 0 Render date: 2025-01-06T02:11:05.050Z Has data issue: false hasContentIssue false

Empirical Bayes Estimation of Coefficients in the General Linear Model from Data of Deficient Rank

Published online by Cambridge University Press:  01 January 2025

Henry I. Braun*
Affiliation:
Educational Testing Service
Douglas H. Jones
Affiliation:
Educational Testing Service
Donald B. Rubin
Affiliation:
Educational Testing Service
Dorothy T. Thayer
Affiliation:
Educational Testing Service
*
Reprint requests should be addressed to Henry I. Braun, Ph.D., Educational Testing Service 21-T, Princeton, New Jersey 08541.

Abstract

Empirical Bayes methods are shown to provide a practical alternative to standard least squares methods in fitting high dimensional models to sparse data. An example concerning prediction bias in educational testing is presented as an illustration.

Type
Original Paper
Copyright
Copyright © 1983 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

The authors would like to thank the referees for several useful comments.

The analysis of the data discussed in this report was part of a study funded jointly by the Graduate Management Admission Council and Educational Testing Service.

References

Braun, H. I. & Jones, D. H. The Graduate Management Admission Test: Prediction bias study, Princeton, N.J.: Educational Testing Service, 1981.Google Scholar
Dempster, A. P., Laird, N. M. & Rubin, D. B. Maximum likelihood from incomplete data via the EM algorithm. The Journal of the Royal Statistical Society, B, 1977, 39(1), 138.CrossRefGoogle Scholar
Dempster, A. P., Rubin, D. B. & Tsutakawa, R. K. Estimation in covariance components models. Journal of the American Statistical Association, 1981, 76(374), 341353.CrossRefGoogle Scholar
DuMouchel, W. H. & Harris, J. E. Bayes and empirical Bayes methods for combining cancer experiments in man and other species. Journal of the American Statistical Association, 1983, in press.Google Scholar
Efron, B. & Morris, C. Combining possibly related estimation problems. The Journal of the Royal Statistical Society, B, 1973, 35(3), 311319.CrossRefGoogle Scholar
Lindley, D. V. & Smith, A. F. M. Bayes estimates for the linear model. Journal of the Royal Statistical Society, B, 1972, 34, 141.CrossRefGoogle Scholar
Mosteller, F. & Tukey, J. W. Data analysis and regression, Reading, MA.: Addison-Wesley Publishing Company, 1978.Google Scholar
Novick, M. R., Jackson, P. H., Thayer, D. T., & Cole, N. S. Estimating multiple regression in m groups: a cross-validation study. The British Journal of Mathematical and Statistical Psychology, 1972, 25, 3350.CrossRefGoogle Scholar
Rolph, J. E., Williams, A. P., & Laniear, A. L. Predicting minority and majority medical student performance on the National Board exams (R-2029-HEW), Santa Monica, CA.: Rand Corporation, 1978.Google Scholar
Rubin, D. B. Using empirical Bayes techniques in the law school validity studies. Journal of the American Statistical Association, 1980, 75, 801827.CrossRefGoogle Scholar
Shigemasu, K. Development and validation for simplified m-groups regression model. Journal of Educational Statistics, 1976, 1, 157180.CrossRefGoogle Scholar