Hostname: page-component-745bb68f8f-cphqk Total loading time: 0 Render date: 2025-01-08T16:58:41.514Z Has data issue: false hasContentIssue false
  • English
  • Français

A Bayesian Procedure for Mastery Decisions based on Multivariate Normal Test Data

Published online by Cambridge University Press:  01 January 2025

Huynh Huynh
Huynh Huynh*
Affiliation:
University of South Carolina
*
Requests for reprints should be sent to Huynh Huynh, College of Education, University of South Carolina, Columbia, SC 29208.
Get access Rights & Permissions [Opens in a new window]

Abstract

A Bayesian framework for making mastery/nonmastery decisions based on multivariate test data is described in this study. Overall, mastery is granted (or denied) if the posterior expected loss associated with such action is smaller than the one incurred by the denial (or grant) of mastery. An explicit form for the cutting contour which separates mastery and nonmastery states in the test score space is given for multivariate normal test scores and for a constant loss ratio. For multiple cutting scores in the true ability space, the test score cutting contour will resemble the boundary defined by multiple test cutting scores when the test reliabilities are reasonably close to unity. For tests with low reliabilities, decisions may very well be based simply on a suitably chosen composite score.

Keywords

mastery testingtesting for selectioncutting contourmultivariate decisionsBayesian decisionserror of measurementtest score fallibility
Type
Original Paper
Information
Psychometrika , Volume 47 , Issue 3 , September 1982 , pp. 309 - 319
Copyright
Copyright © 1982 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

This work was performed pursuant to Grant NIE-G-78-0087 with the National Institute of Education, Department of Health, Education, and Welfare, Huynh Huynh, Principal Investigator. Points of view or opinions stated do not necessarily reflect NIE positions or policy and no official endorsement should be inferred. The assistance of Joseph C. Saunders is gratefully acknowledged. The author is indebted to an anonymous referee who pointed out several computational errors in the earlier versions of the paper.

References

Anderson, T. W. An introduction to multivariate statistical analysis, 1958, New York: McGraw-Hill.Google Scholar
Ferguson, T. S. Mathematical statistics: A decision-theoretic approach, 1967, New York: Academic Press.Google Scholar
Huynh, H. Statistical consideration of mastery scores. Psychometrika, 1976, 41, 65–78.CrossRefGoogle Scholar
Huynh, H. Two simple classes of mastery scores based on the beta-binomial model. Psychometrika, 1977, 42, 601–608.CrossRefGoogle Scholar
Huynh, H. A class of passing scores based on the bivariate normal model. Proceedings of the American Statistical Association (Social Statistics Section), 1979.Google Scholar
Huynh, H. A nonrandomized minimax solution for passing scores in the binomial error model. Psychometrika, 1980, 45, 167–182.CrossRefGoogle Scholar
IMSL Library 1. Houston: International Mathematical and Statistical Libraries, 1977.Google Scholar
van der Linden, W. J. & Mellenbergh, G. J. Optimal cutting scores using a linear loss function. Applied Psychological Measurement, 1977, 1, 593–599.CrossRefGoogle Scholar
Lord, F. M. Cutting scores and errors of measurement. Psychometrika, 1962, 27, 19–30.CrossRefGoogle Scholar
Milton, R. C. Computer evaluation of the multivariate normal integral. Technometrics, 1972, 14, 881–889.CrossRefGoogle Scholar
Swaminathan, H., Hambleton, R. K. & Algina, J. A Bayesian decision-theoretic procedure for use with criterion-referenced tests. Journal of Educational Measurement, 1975, 12, 87–98.CrossRefGoogle Scholar
Tihansky, D. P. Property of the bivariate normal cumulative distribution, Report P4400, 1970, Santa Monica, California: Rand Corporation.Google Scholar
Wald, A. Statistical decision functions, 1950, New York: John Wiley & Sons.Google Scholar
Wilcox, R. R. A note on the length and passing score of a mastery test. Journal of Educational Statistics, 1976, 1, 359–364.CrossRefGoogle Scholar