Hostname: page-component-745bb68f8f-f46jp Total loading time: 0 Render date: 2025-01-07T18:40:51.019Z Has data issue: false hasContentIssue false
  • English
  • Français

Remarks on the Test of Significance for the Method of Paired Comparisons

Published online by Cambridge University Press:  01 January 2025

R. Darrell Bock
R. Darrell Bock*
Affiliation:
University of Chicago†
Get access Rights & Permissions [Opens in a new window]

Abstract

A three-component model for comparative judgment which allows for individual differences in preference is proposed. An implication of the model is that errors in the observed proportions due to sampling individuals in paired comparisons experiments are correlated. By neglecting this correlation, Mosteller's test for the method of paired comparisons tends to accept falsely the goodness of fit of the Case V solution. It is shown that bounds may be set for the correlation effect which make a valid test possible in some cases and provide useful standard errors for the estimated affective values.

Type
Original Paper
Information
Psychometrika , Volume 23 , Issue 4 , December 1958 , pp. 323 - 334
Copyright
Copyright © 1958 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

*

Preparation of this paper has been supported in part by the Quartermaster Food and Container Institute for the Armed Forces. Views and conclusions expressed herein are those of the author and do not necessarily reflect the views or endorsement of the Department of Defense. Comments of one of the reviewers, which substantially improved an earlier version of this paper, are gratefully acknowledged.

†

Now at the University of North Carolina.

References

Bliss, C. I., Greenwood, M. L., and White, E. S. A rankit analysis of paired comparisons for measuring the effects of sprays on flavor. Biometrics, 1956, 12, 381–403.CrossRefGoogle Scholar
Bradley, R. A. and Terry, M. E. The rank analysis of incomplete block designs. I. The method of paired comparisons. Biometrika, 1952, 39, 324–345.Google Scholar
Cramer, H. Mathematical methods of statistics, Princeton: Princeton Univ. Press, 1951.Google Scholar
Finney, D. J. Statistical method in biological assay, London: Griffin, 1952.Google Scholar
Guttman, L. An approach for quantifying paired comparisons and rank order. Ann. math. Statist., 1946, 17, 144–163.CrossRefGoogle Scholar
Kendall, M. G. The advanced theory of statistics. Vol. I, London: Griffin, 1948.Google Scholar
Mosteller, F. Remarks on the method of paired comparisons: III. A test of significance for paired comparisons when equal standard deviation and equal correlations are assumed. Psychometrika, 1951, 16, 207–218.Google Scholar
Pearson, K. Tables for statisticians and biometricians. Part II, London: Univ. London, 1931.Google Scholar
Thurstone, L. L. The method of paired comparisons for social values. J. abnorm. soc. Psychol., 1927, 21, 384–400.CrossRefGoogle Scholar
Walsh, J. E. Concerning the effect of intraclass correlation on certain significance tests. Ann. math. Statist., 1947, 18, 88–96.CrossRefGoogle Scholar