Hostname: page-component-78c5997874-xbtfd Total loading time: 0 Render date: 2024-11-10T08:10:30.829Z Has data issue: false hasContentIssue false

Comparing the Classification of Subjects by Two Independent Judges

Published online by Cambridge University Press:  29 January 2018

A. E. Maxwell*
Affiliation:
Institute of Psychiatry, University of London

Extract

In a typical classification problem each subject in a sample of N subjects is allocated to one or other of k exhaustive and mutually exclusive categories. For example, a sample of families may be classified into social-class groupings in accordance with the Registrar General's classification based on the occupation of the father or father substitute. Or a sample of psychiatric patients may be classified into one or other of the diagnostic categories recommended by the W.H.O. Now it occasionally happens that the same sample of subjects is classified, for a given set of categories, independently by two different agents. For example in the Plowden Reports, Appendix 3 Table 29, a sample of children is classified into types of secondary school, Grammar, Comprehensive, Technical, etc., on the one hand according to the parent's ambition for their children and on the other hand according to the type of school in which the children were eventually placed. In situations such as the latter a k k classification table evolves in which, when the categories are arranged in the same order, the matches between the two separate classifications appear in the cells of the main diagonal of the table and the mismatches appear in the off-diagonal cells (see Table I below). The question then arises as to how to compare the two separate classifications and to measure in quantitative terms the degree of agreement between them.

Type
Research Article
Copyright
Copyright © Royal College of Psychiatrists, 1970 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Anderson, T. W. (1962). Introduction to Multivariate Statistical Analysis. New York & London: Wiley & Sons, Inc.Google Scholar
Everitt, B. S. (1968). ‘Moments of the statistics kappa and weighted kappa.’ Brit. J. math & stat. Psychol., 21, 97103.Google Scholar
McNemar, Q. (1962). Psychological Statistics, 3rd Ed. New York & London: Wiley & Sons, Inc.Google Scholar
Plowdbn Report (1967). A Report of the Central Advisory Council for Education (England). Vol. II., London: H.M.S.O.Google Scholar
Spitzer, R. L., Cohen, J., Fleiss, J. L., and Endicott, J. (1967). ‘Quantification of agreement in psychiatric diagnosis.’ Arch. gen. Psychiat., 17, 83–7.CrossRefGoogle ScholarPubMed
Submit a response

eLetters

No eLetters have been published for this article.