Interrater reliability of the Hamilton Rating Scale for Depression

Interrater reliability of the Dutch version of the Hamilton Rating Scale for Depression (HRSD 17 items) was investigated. Although sufficient, a kappa of .65, found for all raters, was not very high. Specifically item 2 (feelings of guilt) and item 11 (psychic anxiety) seemed difficult to judge. The most experienced raters achieved the highest kappas as well on the total score of the HRSD.

It is concluded that this version of the HRSD, if administered by experienced raters, is a reasonably reliable instrument to obtain a certain ‘cut-off score (for instance in-exclusion criterium) as well as to measure the change in severity of the depression during treatment.

Home health care today is challenged by a shift from an acute to a chronic health-care model, moving the focus of care from the hospital to home-care setting. This increased focus on care at home emphasizes the need for an efficient, effective, and transparent management of home health care. However, it is not precisely known what home-care nurses do; what kind of care is received by patients; what the performance of home nurses is; and what the impact of the increasing need for home nursing is on the current and future role of home nurses. In this respect, it is necessary to gain a clear insight into the activity profile of home nurses, but there is no gold standard to measure their activities. This study reports on the development and psychometric testing of the ‘24-hour recall instrument for home nursing’ to measure the activity profile of home nurses. Five home nurses in Belgium, simultaneously with the researcher, registered the performed activities in a total of 69 patients, using the 24-h recall instrument for home nursing. The validity and the interrater reliability of this instrument were high: the proportions that observed agreement were very high; the strength of kappa agreement was substantial to almost perfect; the prevalence index showed great variety; and the bias index was low. The findings in this study support the validity evidence based on test content and the interrater reliability of the 24-h recall instrument. This instrument can help to shape practice and policy by making the home nursing profession more transparent: a clear insight into the kind of care that is provided by home nurses and is received by the patients in primary care contributes to the development of a clear definition of the role of home nurses in health care.

This study examined the interrater reliability of neuropsychological diagnoses produced by clinical neuropsychologists across 4 medical centers. These diagnoses were based on evaluations using a comprehensive battery of commonly used neuropsychological test instruments, interview, history and medical chart review. The diagnoses of individual neuropsychologists were compared to those made by members of an external review panel for each patient evaluated. Patients were first diagnosed as showing cognitive impairment versus no cognitive impairment. If a patient was diagnosed as impaired, a specific neuropsychological diagnosis was assigned. The diagnostic classification for cognitive impairment was moderately reliable [κ = .48 ± s.e.(κ) = .062]. The interrater reliability for specific diagnoses was in the fair to good range [κ = .44 ± s.e.(κ) = .029]. These levels of reliability are comparable to those found for other psychiatric and neurologic specialties and for medical diagnoses made by other health care disciplines. (JINS, 2002, 8, 555–565.)

The interrater reliability and concurrent validity of two methods of scoring the ensemble-averaged impedance cardiogram were evaluated. Impedance cardiographic and electrocardiographic signals were recorded from 40 undergraduate men and women during a baseline rest period and a vocal mental arithmetic task period. Recordings were scored by four raters using a conventional method, involving ensemble averaging after careful editing of beat-to-beat waveforms, and a streamlined method, involving ensemble averaging without beat-to-beat editing. Intraclass correlations for interrater reliability exceeded .92, whereas intraclass correlations for concurrent validity exceeded .97, indicating excellent agreement between raters and scoring methods for all cardiac measures. The streamlined method was significantly faster than the conventional method. The results indicate that variations in beat-to-beat editing do not constitute a serious source of error in the ensemble-averaged impedance cardiogram and support the interrater reliability and concurrent validity of the two scoring methods.