Hostname: page-component-5f745c7db-6bmsf Total loading time: 0 Render date: 2025-01-06T06:50:52.974Z Has data issue: true hasContentIssue false
  • English
  • Français

Quantile Lower Bounds to Reliability Based on Locally Optimal Splits

Published online by Cambridge University Press:  01 January 2025

Tyler D. Hunt  and
Peter M. Bentler
Tyler D. Hunt*
Affiliation:
University of Utah
Peter M. Bentler
Affiliation:
University of California, Los Angeles
*
Requests for reprints should be sent to Tyler D. Hunt, University of Utah, Salt Lake City, USA. E-mail: tyler.hunt@utah.edu
Get access Rights & Permissions [Opens in a new window]

Abstract

Extending the theory of lower bounds to reliability based on splits given by Guttman (in Psychometrika 53, 63–70, 1945), this paper introduces quantile lower bound coefficients λ4(Q) that refer to cumulative proportions of potential locally optimal “split-half” coefficients that are below a particular point Q in the distribution of split-halves based on different partitions of variables into two sets. Interesting quantile values are Q=0.05,0.50,0.95,1.00 with λ4(0.05)≤λ4(0.50)≤λ4(0.95)≤λ4(1.0). Only the global optimum λ4(1.0), Guttman’s maximal λ4, has previously been considered to be interesting, but in small samples it substantially overestimates population reliability ρ. The three coefficients λ4(0.05), λ4(0.50), and λ4(0.95) provide new lower bounds to reliability. The smallest, λ4(0.05), provides the most protection against capitalizing on chance associations, and thus overestimation, λ4(0.50) is the median of these coefficients, while λ4(0.95) tends to overestimate reliability, but also exhibits less bias than previous estimators. Computational theory, algorithm, and publicly available code based in R are provided to compute these coefficients. Simulation studies evaluate the performance of these coefficients and compare them to coefficient alpha and the greatest lower bound under several population reliability structures.

Keywords

reliabilitysplit halflower boundslambda 4
Type
Original Paper
Information
Psychometrika , Volume 80 , Issue 1 , March 2015 , pp. 182 - 195
Copyright
Copyright © 2013 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Bentler, P.M. (1972). A lower-bound method for the dimension-free measurement of internal consistency. Social Science Research, 1, 343–357.CrossRefGoogle Scholar
Bentler, P.M., & Woodward, J.A. (1980). Inequalities among lower bounds to reliability: with applications to test construction and factor analysis. Psychometrika, 45, 249–267.CrossRefGoogle Scholar
Bentler, P.M., & Woodward, J.A. (1983). The greatest lower bound to reliability. In Wainer, H., & Messick, S. (Eds.), Principals of modern psychological measurement: a festschrift for Frederic M. Lord (pp. 237–253). Hillsdale: Erlbaum.Google Scholar
Brusco, M.J., Singh, R., & Steinley, D. (2009). Variable neighborhood search heuristics for selecting a subset of variables in principal component analysis. Psychometrika, 74, 705–726.CrossRefGoogle Scholar
Callender, J.C., & Osburn, H.G. (1977). A method for maximizing split-half reliability coefficients. Educational & Psychological Measurement, 37, 819–826.CrossRefGoogle Scholar
Chatterjee, A. (2011). Asymptotic properties of sample quantiles from a finite population. Annals of the Institute of Statistical Mathematics, 63, 157–179.CrossRefGoogle Scholar
Cronbach, L.J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297–334.CrossRefGoogle Scholar
Cronbach, L.J. (1988). Internal consistency of tests: analyses old and new. Psychometrika, 53, 63–70.CrossRefGoogle Scholar
Floudas, C.A., & Gounaris, C.E. (2009). A review of recent advances in global optimization. Journal of Global Optimization, 45, 3–38.CrossRefGoogle Scholar
Guttman, L.A. (1945). A basis for analyzing test-retest reliability. Psychometrika, 10, 255–282.CrossRefGoogle ScholarPubMed
Hunt, T. (2012). Lambda4: estimation techniques for the reliability estimate: maximized Lambda4. R package version 2.0. http://cran.r-project.org/web/packages/Lambda4/index.html.Google Scholar
Jackson, P.H. (1979). A note on the relation between coefficient alpha and Guttman’s “split-half” lower bounds. Psychometrika, 44, 251–252.CrossRefGoogle Scholar
Jackson, P.H., & Agunwamba, C.C. (1977). Lower bounds for the reliability of the total score on a test composed of non-homogeneous items: I. Algebraic lower bounds. Psychometrika, 42, 567–578.CrossRefGoogle Scholar
Li, L., & Bentler, P.M. (2011). The greatest lower bound to reliability: corrected and resampling estimators. Modeling and Data Analysis, 1, 87–104.Google Scholar
Moltner, A., & Revelle, W. (2012). glb.algebraic {psych}. Find the greatest lower bound to reliability. R Graphical Manual. http://rgm2.lab.nig.ac.jp/RGM2/func.php?rd_id=psych:glb.algebraic.Google Scholar
Novick, M.R. (1966). The axioms and principal results of classical test theory. Journal of Mathematical Psychology, 3, 1–18.CrossRefGoogle Scholar
Novick, M.R., & Lewis, C.L. (1967). Coefficient alpha and the reliability of measurements. Psychometrika, 32, 1–13.CrossRefGoogle Scholar
Osburn, H.G. (2000). Coefficient alpha and related internal consistency reliability coefficients. Psychological Methods, 5, 343–355.CrossRefGoogle ScholarPubMed
R Development Core Team (2011). R: a language and environment for statistical computing. Vienna: R Foundation for Statistical Computing. http://www.R-project.org.Google Scholar
Revelle, W. (2008). psych: Procedures for psychological, psychometric, and personality research. R package version 1.0-51. http://cran.r-project.org/web/packages/psych/index.html.Google Scholar
Revelle, W., & Zinbarg, R.E. (2009). Coefficients alpha, beta, omega, and the glb: comments on Sijtsma. Psychometrika, 74(1), 145–154.CrossRefGoogle Scholar
Shapiro, A. (1982). Rank reducibility of a symmetric matrix and sampling theory of minimum trace factor analysis. Psychometrika, 47, 187–199.CrossRefGoogle Scholar
Shapiro, A., & ten Berge, J.M.F. (2000). The asymptotic bias of minimum trace factor analysis, with applications to the greatest lower bound to reliability. Psychometrika, 65, 413–425.CrossRefGoogle Scholar
Sijtsma, K. (2009). On the use, the misuse, and the very limited usefulness of Cronbach’s alpha. Psychometrika, 65, 23–28.Google Scholar
ten Berge, J.M.F., Snijders, T.A.B., & Zegers, F.E. (1981). Computational aspects of the greatest lower bound to reliability and constrained minimum trace factor analysis. Psychometrika, 46, 201–213.CrossRefGoogle Scholar
ten Berge, J.M.F., & Sočan, G. (2004). The greatest lower bound to the reliability of a test and the hypothesis of unidimensionality. Psychometrika, 69, 613–625.CrossRefGoogle Scholar
Verhelst, N.D. (1998). Estimating the reliability of a test from a single test administration (Measurement and Research Department Report No. 98-2). Arnhem: CITO.Google Scholar
Wolsey, L.A. (1998). Integer programming. New York: Wiley.Google Scholar
Woodhouse, B., & Jackson, P.H. (1977). Lower bounds for the reliability of a test composed of nonhomogeneous items II: a search procedure to locate the greatest lower bound. Psychometrika, 42, 579–591.CrossRefGoogle Scholar
Woodward, J.A., & Bentler, P.M. (1978). A statistical lower-bound to population reliability. Psychological Bulletin, 85, 1323–1326.CrossRefGoogle ScholarPubMed
Yuan, K.H., & Bentler, P. (2002). On the robustness of the normal-theory based asymptotic distributions of three reliability coefficient estimates. Psychometrika, 67(2), 251–259.CrossRefGoogle Scholar