Hostname: page-component-745bb68f8f-hvd4g Total loading time: 0 Render date: 2025-01-07T18:52:16.639Z Has data issue: false hasContentIssue false

A Bayesian Nonparametric Approach to Test Equating

Published online by Cambridge University Press:  01 January 2025

George Karabatsos*
Affiliation:
University of Illinois-Chicago
Stephen G. Walker
Affiliation:
University of Kent
*
Requests for reprints should be sent to George Karabatsos, College of Education, University of Illinois-Chicago, 1040 W. Harrison St. (MC 147), Chicago, IL 60607, USA. E-mail: georgek@uic.edu

Abstract

A Bayesian nonparametric model is introduced for score equating. It is applicable to all major equating designs, and has advantages over previous equating models. Unlike the previous models, the Bayesian model accounts for positive dependence between distributions of scores from two tests. The Bayesian model and the previous equating models are compared through the analysis of data sets famous in the equating literature. Also, the classical percentile-rank, linear, and mean equating models are each proven to be a special case of a Bayesian model under a highly-informative choice of prior distribution.

Type
Theory and Methods
Copyright
Copyright © 2008 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle. In Petrov, B., Csaki, F. (Eds.), Second international symposium on information theory (pp. 267281). Budapest: Academiai Kiado.Google Scholar
Angoff, W. (1971). Scales, norms, and equivalent scores. In Thorndike, R. (Eds.), Educational measurement (pp. 508600). (2nd ed.). Washington: American Council on Education.Google Scholar
Blackwell, D., MacQueen, J. (1973). Ferguson distributions via Polya urn schemes. Annals of Statistics, 1, 353355.CrossRefGoogle Scholar
Dalal, S., Hall, W. (1983). Approximating priors by mixtures of natural conjugate priors. Journal of the Royal Statistical Society, Series B, 45, 278286.CrossRefGoogle Scholar
De Iorio, M., Müller, P., Rosner, G., MacEachern, S. (2004). An ANOVA model for dependent random measures. Journal of the American Statistical Association, 99, 205215.CrossRefGoogle Scholar
Diaconis, P., Ylvisaker, D. (1985). Conjugate priors for exponential families. Annals of Statistics, 7, 269281.Google Scholar
Efron, B., Tibshirani, R. (1993). An introduction to the bootstrap, New York: Chapman & Hall.CrossRefGoogle Scholar
Ferguson, T. (1973). A Bayesian analysis of some nonparametric problems. Annals of Statistics, 1, 209230.CrossRefGoogle Scholar
Hjort, N., Petrone, S. (2007). Nonparametric quantile inference using Dirichlet processes. In Nair, V. (Eds.), Advances in statistical modeling and inference: essays in honor of Kjell Doksum, Singapore: World Scientific. Chap. 23Google Scholar
Holland, P., Thayer, D. (2000). Univariate and bivariate loglinear models for discrete test score distributions. Journal of Educational and Behavioral Statistics, 25, 133183.CrossRefGoogle Scholar
Joe, H. (1997). Multivariate models and dependence concepts, (2nd ed.). Boca Raton: Chapman and Hall/CRC.Google Scholar
Karabatsos, G., & Walker, S. (2007). A Bayesian nonparametric approach to test equating. Presented at the national council of measurement in education, Chicago, April 2007.Google Scholar
Karabatsos, G., & Walker, S. (2009, to appear). Coherent psychometric modeling with Bayesian nonparametrics. British Journal of Mathematical and Statistical Psychology.CrossRefGoogle Scholar
Kolen, M., Brennan, R. (2004). Test equating, scaling, and linking: methods and practices, (2nd ed.). New York: Springer.CrossRefGoogle Scholar
Lorentz, G. (1953). Bernstein polynomials, Toronto: University of Toronto Press.Google Scholar
Müller, P., Quintana, F. (2004). Nonparametric Bayesian data analysis. Statistical Science, 19, 95110.CrossRefGoogle Scholar
Müller, P., Quintana, F.A., Rosner, G. (2004). A method for combining inference across related nonparametric Bayesian models. Journal of the Royal Statistical Society, Series B, 66, 735749.CrossRefGoogle Scholar
Petrone, S. (1999). Random Bernstein polynomials. Scandinavian Journal of Statistics, 26, 373393.CrossRefGoogle Scholar
Sethuraman, J. (1994). A constructive definition of Dirichlet priors. Statistica Sinica, 4, 639650.Google Scholar
Von Davier, A., Holland, P., Thayer, D. (2004). The kernel method of test equating, New York: Springer.CrossRefGoogle Scholar
Walker, S. (2004). New approaches to Bayesian consistency. Annals of Statistics, 32, 20282043.CrossRefGoogle Scholar
Walker, S., Muliere, P. (2003). A bivariate Dirichlet process. Statistics and Probability Letters, 64, 17.CrossRefGoogle Scholar
Walker, S., Damien, P., Laud, P., Smith, A. (1999). Bayesian nonparametric inference for random distributions and related functions. Journal of the Royal Statistical Society, Series B, 61, 485527.CrossRefGoogle Scholar
Walker, S., Lijoi, A., Prünster, I. (2007). On rates of convergence for posterior distributions in infinite-dimensional models. Annals of Statistics, 35, 738746.CrossRefGoogle Scholar