Hostname: page-component-745bb68f8f-lrblm Total loading time: 0 Render date: 2025-01-07T18:01:58.830Z Has data issue: false hasContentIssue false

Erratum to: Using the Criterion-Predictor Factor Model to Compute the Probability of Detecting Prediction Bias with Ordinary Least Squares Regression

Published online by Cambridge University Press:  01 January 2025

Steven Andrew Culpepper*
Affiliation:
Department of Statistics, University of Illinois at Urbana-Champaign
*
Requests for reprints should be sent to Steven Andrew Culpepper, Department of Statistics, University of Illinois at Urbana-Champaign, 101 Illini Hall, MC-374, 725 South Wright Street, Champaign, IL 61820, USA. E-mail: sculpepp@illinois.edu
Rights & Permissions [Opens in a new window]

Abstract

Type
Erratum
Copyright
Copyright © 2013 The Psychometric Society

Errata to: PSYCHOMETRIKA, 2012, 77, 561–580 DOI10.1007/s11336-012-9270-8

The Errata includes a corrected figure on the effect of group differences in common factor means and latent slopes on Type I error rates for ordinary least squares tests of intercept differences.

1. Correction to Figure 2

Culpepper (Reference Culpepper2012) examined the performance of ordinary least squares (OLS) as a method for assessing the presence of prediction bias (Millsap, Reference Millsap1997, Reference Millsap1998, Reference Millsap2007; Olivera-Aguilar & Millsap, Reference Olivera-Aguilar and Millsap2013). A seminar student at the University of Minnesota kindly pointed out an error in Figure 2 of Culpepper (Reference Culpepper2012). The error was clerical and the equations in the paper remain unchanged and correct. The purpose of this note is to correct Figure 2 in Culpepper related to the effect of group differences in common factor means (i.e., Δκ) and latent slopes (i.e., ΔΓ) on Type I error rates of OLS tests of group intercept differences.

Recall from Culpepper (Reference Culpepper2012) that Z and Y represented the observed predictor and criterion, respectively, the number of applicants was indicated by n, the proportion in the focal group by p, and P(Z>z ) was the percent of applicants selected in a top-down fashion. Furthermore, the latent measurement model parameters included Δϕ as the difference in group common factor variances, Δξ as the difference in latent prediction error variance, θ z and θ y were the unique factor variances for the predictor and criterion, and the latent measurement intercept and loading was denoted by τ z and λ z for the predictor and τ y and λ y criterion. Figure 1 presents the corrected analytic (and Monte Carlo) Type I errors of tests for intercept differences across values of Δκ and ΔΓ under the assumption of strict invariance with an n= 5,000, p=.8, P(Z>z )=.5, Δϕ=0, Δξ=0, τ z=τ y=.1, λ z=λ y=.8, and Θ z=Θ y=.2. The dots around each of the Type I error curves in Figure 1 are the Monte Carlo estimates using 5,000 replications.

Figure 1. Impact of Δκ and latent slope differences (\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$\beta_{3}^{2}$\end{document}) on Type I error rates for tests of intercept differences. Note. The dots around each curve are Monte Carlo estimates using 5,000 replications.

Figure 1 demonstrates the results pertaining to Millsap (Reference Millsap1997, Reference Millsap1998, Reference Millsap2007) and Equation (30) of Culpepper (Reference Culpepper2012). Figure 1 shows that Type I error rates for intercept tests are larger than the real rejection level of .05 as Δκ increases. For example, the probability of rejecting a true null hypothesis is approximately 50 % when Δκ=1. In this case, larger latent subgroup slope differences (i.e., \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$\beta_{3}^{2}$\end{document}) slightly reduces intercept Type I error rates. In short, Figure 1 demonstrates that OLS is an inadequate method for testing the presence of subgroup intercept differences whenever groups differ in common factor means.

Footnotes

The online version of the original article can be found under doi:10.1007/s11336-012-9270-8.

References

Culpepper, S.A. (2012). Using the criterion-predictor factor model to compute the probability of detecting prediction bias with ordinary least squares regression. Psychometrika, 77, 561580CrossRefGoogle ScholarPubMed
Millsap, R.E. (1997). Invariance in measurement and prediction: Their relationship in the single-factor case. Psychological Methods, 2, 248260CrossRefGoogle Scholar
Millsap, R.E. (1998). Group differences in regression intercepts: Implications for factorial invariance. Multivariate Behavioral Research, 33, 403424CrossRefGoogle ScholarPubMed
Millsap, R.E. (2007). Invariance in measurement and prediction revisited. Psychometrika, 72, 461473CrossRefGoogle Scholar
Olivera-Aguilar, M., Millsap, R. (2013). Statistical power for a simultaneous test of factorial and predictive invariance. Multivariate Behavioral Research, 48, 96116CrossRefGoogle ScholarPubMed
Figure 0

Figure 1. Impact of Δκ and latent slope differences (\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$\beta_{3}^{2}$\end{document}) on Type I error rates for tests of intercept differences. Note. The dots around each curve are Monte Carlo estimates using 5,000 replications.