Hostname: page-component-5f745c7db-tvc9f Total loading time: 0 Render date: 2025-01-06T22:11:54.435Z Has data issue: true hasContentIssue false
  • English
  • Français

On the Use of Heterogeneous Thresholds Ordinal Regression Models to Account for Individual Differences in Response Style

Published online by Cambridge University Press:  01 January 2025

Timothy R. Johnson
Timothy R. Johnson*
Affiliation:
Department of Statistics, University of Idaho
*
Requests for reprints should be sent to Timothy R. Johnson, Department of Statistics, University of Idaho, Moscow, ID 83844-1104, USA. Email: trjohns@uidaho.edu
Get access Rights & Permissions [Opens in a new window]

Abstract

This paper proposes a general approach to accounting for individual differences in the extreme response style in statistical models for ordered response categories. This approach uses a hierarchical ordinal regression modeling framework with heterogeneous thresholds structures to account for individual differences in the response style. Markov chain Monte Carlo algorithms for Bayesian inference for models with heterogeneous thresholds structures are discussed in detail. A simulation and two examples based on ordinal probit models are given to illustrate the proposed methodology. The simulation and examples also demonstrate that failing to account for individual differences in the extreme response style can have adverse consequences for statistical inferences.

Keywords

response styleordinal regressionhierarchical regression modelsprobit modelsBayesian statistics
Type
Theory And Methods
Information
Psychometrika , Volume 68 , Issue 4 , December 2003 , pp. 563 - 583
Copyright
Copyright © 2003 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

The author is grateful to Ulf Böckenholt, an associate editor, and three anonymous reviewers for helpful comments, and Kristine Kuhn and Kshiti Joshi for providing the data.

References

Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle. In Petrov, B., Csáki, F. (Eds.), 2nd International Symposium on Information Theory (pp. 267–281). Budapest: Akadémiai Kiadó.Google Scholar
Albert, J., Chib, S. (1993). Bayesian analysis of binary and polychotomous data. Journal of the American Statistical Association, 88, 669–679.CrossRefGoogle Scholar
Albert, J., Chib, S. (1997). Bayesian methods for cumulative, sequential, and two-step ordinal data regression models (Tech. Rep.). Bowling Green, OH: Bowling Green State University, Department of Mathematics and Statistics.Google Scholar
Bachman, J.G., O'Malley, P.M. (1984). Yea-saying, nay-saying, and going to extremes: Black-white differences in response style. Public Opinion Quarterly, 48, 491–509.CrossRefGoogle Scholar
Bachman, J.G., O'Malley, P.M. (1984). Black-white differences in self-esteem: Are they affected by response style?. American Journal of Sociology, 90, 624–639.CrossRefGoogle Scholar
Baumgartner, H., Steenkamp, J.E.M. (2001). Response styles in marketing research: A cross-national investigation. Journal of Marketing Research, 38, 143–156.CrossRefGoogle Scholar
Berg, I.A., Collier, J.S. (1953). Personality and group differences in extreme response sets. Educational and Psychological Measurement, 13, 164–169.CrossRefGoogle Scholar
Böckenholt, U. (2001). Thresholds and intransitivities in pairwise judgments: A multilevel analysis. Journal of Educational and Behavioral Statistics, 26, 269–282.CrossRefGoogle Scholar
Chun, K., Campbell, J.B., Yoo, J. (1974). Extreme response style in cross-cultural research: A reminder. Journal of Cross-Cultural Psychology, 5, 465–480.CrossRefGoogle Scholar
Clarke, I. (2000). Extreme response style in cross-cultural research: An empirical investigation. Journal of Social Behavior and Personality, 15, 137–152.Google Scholar
Cowles, M.K. (1996). Accelerating Markov Chain Monte Carlo convergence for cumulative-link generalized linear models. Statistics and Computing, 6, 101–111.CrossRefGoogle Scholar
Crandall, J.E. (1982). Social interest, extreme response style, and implications for adjustment. Journal of Research in Personality, 16, 82–89.CrossRefGoogle Scholar
Cronbach, L.J. (1946). Response sets and test validity. Educational and Psychological Measurement, 6, 475–494.CrossRefGoogle Scholar
DeGroot, M.H. (1970). Optimal statistical decisions. New York, NY: McGraw-Hill.Google Scholar
Dempster, A.P. (1974). The direct use of likelihood for significance testing. In Barndorff-Nielsen, O., Blaesild, P., Schou, G. (Eds.), Proceedings of the Conference on Foundational Questions in Statistical Inference (pp. 335–352). Aarhus, Denmark: University of Aarhus, Department of Theoretical Statistics.Google Scholar
Dempster, A.P. (1997). The direct use of likelihood for significance testing. Statistics and Computing, 7, 247–252.CrossRefGoogle Scholar
Diggle, P.J., Liang, K., Zeger, S.L. (1994). Analysis of longitudinal data. Oxford: Clarendon Press.Google Scholar
Doornik, J.A. (2001). Ox: An objected-oriented matrix language 4th ed., London: Timberlake Consultants.Google Scholar
Gelfand, A.E. (1996). Model determination using sampling-based methods. In Gilks, W.R., Richardson, S., Spiegelhalter, D.J. (Eds.), Markov Chain Monte Carlo in practice (pp. 145–161). London: Chapman & Hall.Google Scholar
Gelfand, A.E., Smith, A.F.M. (1990). Sampling based approaches to calculating marginal densities. Journal of the American Statistical Association, 85, 398–409.CrossRefGoogle Scholar
Gelman, A. (1996). Inference and monitoring convergence. In Gilks, W.R., Richardson, S., Spiegelhalter, D.J. (Eds.), Markov Chain Monte Carlo in Practice (pp. 131–143). London: Chapman & Hall.Google Scholar
Geman, S., Geman, D. (1984). Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 6, 721–741.CrossRefGoogle ScholarPubMed
Gerardo, M., Gamba, R.J., Marin, B.V. (1992). Extreme response style and acquiescence among Hispanics: The role of acculturation and education. Journal of Cross-Cultural Psychology, 23, 498–509.Google Scholar
Greenleaf, E.A. (1992). Improving rating scale measures by detecting and correcting bias components in some response styles. Journal of Marketing Research, 29, 176–188.CrossRefGoogle Scholar
Greenleaf, E.A. (1992). Measuring extreme response style. Public Opinion Quarterly, 56, 328–351.CrossRefGoogle Scholar
Hamilton, D.L. (1968). Personality attributes associated with extreme response style. Psychological Bulletin, 69, 192–203.CrossRefGoogle ScholarPubMed
Harville, D.A., Mee, R.W. (1984). A mixed model procedure for analyzing ordered categorical data. Biometrics, 40, 393–408.CrossRefGoogle Scholar
Hastings, W.K. (1970). Monte Carlo sampling methods using Markov chains and their applications. Biometrika, 57, 97–109.CrossRefGoogle Scholar
Hedeker, D., Gibbons, R.D. (1994). A random-effects ordinal regression model for multilevel analysis. Biometrics, 50, 933–944.CrossRefGoogle ScholarPubMed
Hedeker, D., Mermelstein, R.J. (1998). A multilevel thresholds of change model for analysis of stages change data. Multivariate Behavioral Research, 33, 427–455.CrossRefGoogle Scholar
Heide, M., Gronhaug, K. (1992). The impact of response styles in surveys: A simulation study. Journal of the Market Research Society, 34, 215–230.Google Scholar
Hui, C.H., Triandis, H.C. (1989). Effects of culture and response format on extreme response style. Journal of Cross-Cultural Psychology, 20, 296–309.CrossRefGoogle Scholar
Jackson, D.N., Messick, S. (1958). Content and style in personality assessment. Psychological Bulletin, 55, 243–252.CrossRefGoogle ScholarPubMed
Jansen, J. (1990). On the statistical analysis of ordinal data when extravariation is present. Applied Statistics, 39, 75–84.CrossRefGoogle Scholar
Johnson, V.E. (1996). On Bayesian analysis of multirater ordinal data. Journal of the American Statistical Association, 91, 42–51.CrossRefGoogle Scholar
Johnson, V.E. (1997). An alternative to traditional GPA for evaluating student performance. Statistical Science, 12, 251–278.CrossRefGoogle Scholar
Kuhn, K.M., & Joshi, K.D. (2002). The reported and revealed importance of job attributes: Gender differences among information systems students. Unpublished manuscript.Google Scholar
Kuhn, K.M., Yockey, M. (2003). Variable pay as a risky choice: Determinants of the relative attractiveness of incentive plans. Organizational Behavior and Human Decision Processes, 90, 323–341.CrossRefGoogle Scholar
Laird, N.M., Ware, J.H. (1982). Random-effects models for longitudinal data. Biometrics, 38, 963–974.CrossRefGoogle ScholarPubMed
Lenk, P., Wedel, M., & Böckenholt, U. (2002). Bayesian estimation of random effects circumplex models subject to prior theory constraints and person-specific scale usage bias. Unpublished manuscript.Google Scholar
Lindley, D.V., Smith, A.F.M. (1972). Bayes estimates for the linear model. Journal of the Royal Statistics Society, 135, 370–384.Google Scholar
McCullagh, P. (1980). Regression models for ordinal data (with discussion). Journal of the Royal Statistical Society, 42, 109–142.CrossRefGoogle Scholar
McKelvey, R.D., Zavoina, W. (1975). A statistical model for the analysis of ordinal level dependent variables. Journal of Mathematical Sociology, 4, 103–120.CrossRefGoogle Scholar
Messick, S. (1991). Psychology and methodology of response styles. In Snow, R.E., Wiley, D.E. (Eds.), Improving inquiry in social science: A volume in honor of Lee J. Cronbach (pp. 161–200). Hillsdale, NJ: Lawrence Erlbaum and Associates.Google Scholar
Metropolis, N., Ulam, S. (1949). The Monte Carlo method. Journal of the American Statistical Association, 44, 335–341.CrossRefGoogle ScholarPubMed
Moustaki, I. (2000). A latent variable model for ordinal variables. Applied Psychological Measurement, 24, 211–223.CrossRefGoogle Scholar
Muraki, E., Carlson, J.E. (1995). Full-information factor analysis for polytomous item responses. Applied Psychological Measurement, 19, 73–90.CrossRefGoogle Scholar
Peterson, B., Harrell, F.E. (1990). Partial proportional odds models for ordinal response variables. Applied Statistics, 39, 205–217.CrossRefGoogle Scholar
Robert, C.P. (1995). Simulation of truncated normal variables. Statistics and Computing, 5, 121–125.CrossRefGoogle Scholar
Rorer, L.G. (1965). The great response-style myth. Psychological Bulletin, 63, 129–156.CrossRefGoogle ScholarPubMed
Rossi, P.E., Gilula, Z., Allenby, G.M. (2001). Overcoming scale usage heterogeneity: A Bayesian hierarchical approach. Journal of the American Statistical Association, 96, 20–31.CrossRefGoogle Scholar
Shi, J., Lee, S. (1997). Bayesian sampling-based approaches for factor analysis modes with continuous and polytomous data. British Journal of Mathematical and Statistical Psychology, 51, 233–252.CrossRefGoogle Scholar
Singelis, T.M., Triandis, H.C., Bhawuk, D.P.S., Gelfand, M.J. (1995). Horizontal and vertical dimensions of individualism and collectivism: A theoretical and measurement refinement. Cross-Cultural Research, 29, 240–275.CrossRefGoogle Scholar
Spiegelhalter, D.J., Best, N.G., Carlin, B.P, van der Linde, A. (2002). Bayesian measures of model complexity and fit. Journal of the Royal Statistical Society, 64, 583–636.CrossRefGoogle Scholar
Stening, B.W., Everett, J.E. (1984). Response styles in a cross-cultural managerial study. Journal of Social Psychology, 122, 141–156.CrossRefGoogle Scholar
Tanner, T.A., Wong, W.H. (1987). The calculation of posterior distributions by data augmentation. Journal of the American Statistical Association, 82, 528–540.CrossRefGoogle Scholar
Tutz, G., Hennevogl, W. (1996). Random effects in ordinal regression models. Computational Statistics and Data Analysis, 22, 537–557.CrossRefGoogle Scholar