Hostname: page-component-5f745c7db-szhh2 Total loading time: 0 Render date: 2025-01-06T06:53:10.109Z Has data issue: true hasContentIssue false
  • English
  • Français

A General Procedure for Obtaining Paired Comparisons from Multiple Rank Orders

Published online by Cambridge University Press:  01 January 2025

Harold Gulliksen  and
Ledyard R Tucker
Harold Gulliksen
Affiliation:
Princeton University and Educational Testing Service
Ledyard R Tucker
Affiliation:
Princeton University and Educational Testing Service
Get access Rights & Permissions [Opens in a new window]

Abstract

From a theoretical point of view, paired comparisons and the law of comparative judgment provide an excellent approach to the problem of psychological measurement. However, if a reasonably large number of stimuli are to be investigated, paired comparisons become extremely time-consuming and fatiguing to the subjects. A balanced incomplete block design, requiring multiple rank order judgments for each subject, provides an efficient experimental method for obtaining paired comparisons judgments. Features of the analysis proposed for this design are discussed in detail. A program for the analysis is available for the IBM 650 electronic computer.

Type
Original Paper
Information
Psychometrika , Volume 26 , Issue 2 , June 1961 , pp. 173 - 183
Copyright
Copyright © 1961 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

*

Prepared in connection with research done under Office of Naval Research Contract Nonr 1858-(15), Project Designation NR 150-088, and National Science Foundation Grant G-3407. Reproduction of any part of this material is permitted for any purpose of the United States Government.

†

Now at the University of Illinois.

References

Benson, P. Increasing the predictive efficiency of preference counts from paired comparison of personality traits. Educ. psychol. Measmt, 1958, 18, 283–291.CrossRefGoogle Scholar
Bradley, R. A. and Terry, M. E. Rank analysis of incomplete block designs. The method of paired comparisons. Biometrika, 1952, 39, 324–345.Google Scholar
Calvin, L. D. Doubly balanced incomplete block designs for experiments in which the treatment effects are correlated. Biometrics, 1954, 10, 61–88.CrossRefGoogle Scholar
Cochran, W. G. and Cox, G. M. Experimental designs (2nd ed.), New York: Wiley, 1957.Google Scholar
Coombs, C. A method for the study of interstimulus similarity. Psychometrika, 1954, 19, 183–194.CrossRefGoogle Scholar
Dunkel, H. B. General education in the humanities, Washington: Amer. Counc. Educ., 1947.Google Scholar
Durbin, J. Incomplete blocks in ranking experiments. Brit. J. Psychol., Statist. Sect., 1951, 4, 85–90.CrossRefGoogle Scholar
Hall, J. and Jones, D. C. Social grading of occupations. Brit. J. Sociol., 1950, 1, 31–55.CrossRefGoogle Scholar
Kendall, M. G. Rank correlation methods (2nd ed.), London: Griffin, 1955.Google Scholar
Gulliksen, H. A least squares solution for paired comparisons with incomplete data. Psychometrika, 1956, 21, 125–134.CrossRefGoogle Scholar
Gulliksen, H. An IBM 650 program for a complete paired comparisons schedule (Parcoplet 2-21). Tech. Rep. ONR contract Nonr 1858(15). (AnAppendix to this technical report gives details on this program, including input-output formats and operating directions for this program which is recorded in the IBM 650 Program Library—file no. 6.0.045.).Google Scholar
Gulliksen, H. and Tucker, L. R. An IBM 650 program for paired comparisons from balanced incomplete blocks—a 6–31 design (Parcobib 6–31), Princeton, N. J.: Educ. Testing Serv., 1959.Google Scholar
Torgerson, W. S. Theory and methods of scaling, New York: Wiley, 1958.Google Scholar