Hostname: page-component-745bb68f8f-d8cs5 Total loading time: 0 Render date: 2025-01-07T19:03:10.480Z Has data issue: false hasContentIssue false

A Bayesian Semiparametric Item Response Model with Dirichlet Process Priors

Published online by Cambridge University Press:  01 January 2025

Kei Miyazaki
Affiliation:
Department of Cognitive and Behavioral Science, The University of Tokyo
Takahiro Hoshino*
Affiliation:
Graduate School of Economics, Nagoya University
*
Requests for reprints should be sent to Takahiro Hoshino, Graduate School of Economics, Nagoya University, Furo-cho, Chikusa-ku, Nagoya, 464-8601, Japan. E-mail: bayesian@jasmine.ocn.ne.jp

Abstract

In Item Response Theory (IRT), item characteristic curves (ICCs) are illustrated through logistic models or normal ogive models, and the probability that examinees give the correct answer is usually a monotonically increasing function of their ability parameters. However, since only limited patterns of shapes can be obtained from logistic models or normal ogive models, there is a possibility that the model applied does not fit the data. As a result, the existing method can be rejected because it cannot deal with various item response patterns.

To overcome these problems, we propose a new semiparametric IRT model using a Dirichlet process mixture logistic distribution. Our method does not rely on assumptions but only requires that the ICCs be a monotonically nondecreasing function; that is, our method can deal with more types of item response patterns than the existing methods, such as the one-parameter normal ogive models or the two- or three-parameter logistic models.

We conducted two simulation studies whose results indicate that the proposed method can express more patterns of shapes for ICCs and can estimate the ability parameters more accurately than the existing parametric and nonparametric methods. The proposed method has also been applied to Facial Expression Recognition data with noteworthy results.

Type
Theory and Methods
Copyright
Copyright © 2009 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Albert, J.H. (1992). Bayesian estimation of normal ogive item response curves using Gibbs sampling. Journal of Educational Statistics, 17, 251269CrossRefGoogle Scholar
Ansari, A., Iyengar, R. (2006). Semiparametric Thurstonian models for recurrent choices: A Bayesian analysis. Psychometrika, 71(4), 631657CrossRefGoogle Scholar
Béguin, A.A., Glas, C.A.W. (2001). MCMC estimation and some fit analysis of multidimensional IRT models. Psychometrika, 66, 541562CrossRefGoogle Scholar
Bock, R.D. (1997). The nominal categories model. In van der Linden, W.M., Hambleton, R.K. (Eds.), Handbook of modern item response theory (pp. 3349). Berlin: SpringerCrossRefGoogle Scholar
Bock, R.D., Zimowski, M.F. (1997). Multiple group IRT. In van der Linden, W.M., Hambleton, R.K. (Eds.), Handbook of modern item response theory (pp. 433448). Berlin: SpringerCrossRefGoogle Scholar
Bush, C.A., MacEashern, S.N. (1996). A semiparametric Bayesian model for randomised block designs. Biometrica, 83, 275285CrossRefGoogle Scholar
Diebolt, J., Robert, C.P. (1994). Estimation of finite mixture distributions through Bayesian sampling. Journal of the Royal Statistical Society, Series B, 56(2), 363375CrossRefGoogle Scholar
Duncan, K.A., MacEachern, S.N. (2008). Nonparametric Bayesian modelling for item response. Statistical Modelling, 8(1), 4166CrossRefGoogle Scholar
Dunson, D.B. (2006). Bayesian dynamic modeling of latent trait distributions. Biostatistics, 7, 551568CrossRefGoogle ScholarPubMed
Dunson, D.B., Pillai, N., Park, J. (2007). Bayesian density regression. Journal of the Royal Statistical Society, Series B, 69, 163183CrossRefGoogle Scholar
Ferguson, T.S. (1973). A Bayesian analysis of some nonparametric problems. Annals of Statistics, 1, 209230CrossRefGoogle Scholar
Hoshino, T. (2009). Dirichlet process mixtures of structural equation modeling and direct calculation of posterior probabilities of the numbers of components. Psychometrika (accepted for publication).Google Scholar
Ishwaran, H., James, L.F. (2001). Gibbs sampling methods for Stick-Breaking priors. Journal of the American Statistical Association, 96, 161173CrossRefGoogle Scholar
Ishwaran, H., James, L.F. (2002). Approximate Dirichlet process computing in finite normal mixtures: Smoothing and prior information. Journal of Computational and Graphical Statistics, 11, 508532CrossRefGoogle Scholar
Ishwaran, H., Zarepour, M. (2000). Markov Chain Monte Carlo in approximate Dirichlet and beta two-parameter process hierarchical models. Biometrika, 87, 371390CrossRefGoogle Scholar
Ishwaran, H., Zarepour, M. (2002). Dirichlet prior sieves in finite normal mixtures. Statistica Sinica, 12, 941963Google Scholar
Ishwaran, H., James, L.F., Sun, J. (2001). Bayesian model selection in finite mixtures by marginal density decompositions. Journal of the American Statistical Association, 96, 13161332CrossRefGoogle Scholar
Junker, B.W., Sijtsma, K. (2001). Cognitive assessment models with few assumptions, and connections with nonparametric item response theory. Applied Psychological Measurement, 25(3), 258272CrossRefGoogle Scholar
Kleinman, K.P., Ibrahim, J.G. (1998). A semiparametric Bayesian approach to the random effects model. Biometrika, 54, 921938CrossRefGoogle Scholar
Ramsey, J.O. (1991). Kernel smoothing approaches to nonparametric item characteristic curve estimation. Psychometrika, 56, 611630CrossRefGoogle Scholar
Ramsey, J.O., Winsberg, S. (1991). Maximum marginal likelihood estimation for semiparametric item analysis. Psychometrika, 56, 365379CrossRefGoogle Scholar
Reckase, M.D. (1985). The difficulty of test items that measure more than one ability. Applied Psychological Measurement, 9(4), 401412CrossRefGoogle Scholar
Reckase, M.D., Mackinly, R.L. (1991). The discriminating power of items that measure more than one dimension. Applied Psychological Measurement, 15(4), 361373CrossRefGoogle Scholar
Robert, C.P., Mengersen, K.L. (1999). Reparameterisation issues in mixture modelling and their bearing on MCMC algorithms. Computational Statistics and Data Analysis, 29, 325343CrossRefGoogle Scholar
Rost, J. (1990). Rasch models in latent classes: An integration of two approaches to item analysis. Applied Psychological Measurement, 14(3), 271282CrossRefGoogle Scholar
Sethuraman, J. (1994). A constructive definition of Dirichlet priors. Statistica Sinica, 4, 639650Google Scholar
Sijtsma, K., & Molenaar, I.W. (2002). Introduction to nonparametric item response theory. Sage.CrossRefGoogle Scholar
Stephens, M. (2000). Dealing with label switching in mixture models. Journal of the Royal Statistical Society, Series B, 62(4), 795809CrossRefGoogle Scholar
Suzuki, A., Hoshino, T., Shigemasu, K. (2006). Measuring individual differences in sensitivities to basic emotions in faces. Cognition, 99, 327353CrossRefGoogle ScholarPubMed
von Davier, M. (2006). Introduction to Rasch measurement. Applied Psychological Measurement, 30(5), 443446CrossRefGoogle Scholar
von Davier, M., Rost, J. (1995). Mixture distribution Rasch models. In Fischer, G.H., Molenaar, I.W. (Eds.), Rasch models—Foundations, recent developments, and applications (pp. 257268). New York: SpringerGoogle Scholar
Walker, S.G., Damien, P., Laud, P.W., Smith, A.F.M. (1999). Bayesian nonparametric inference for random distributions and related functions. Journal of the Royal Statistical Society, Series B, 61, 485527CrossRefGoogle Scholar