Skip to main content Accessibility help

We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.

Close cookie message
×
  1. Home
  2. Search

Refine search

Refine search

Access:
Content type:
Publication date:
Apply   From and To filters
Subject: Show more
Journals Show more
Publishers: Show more
Societies Show more
Series: Show more
Collections: Show more

Actions for selected content:

Select all | Deselect all
  • View selected items
  • Export citations
  • Download PDF (zip)
  • Save to Kindle
  • Save to Dropbox
  • Save to Google Drive

Save Search

You can save your searches here and later view and run them again in "My saved searches".

Please provide a title, maximum of 40 characters.
Cancel
×

5 results

  • Applying generalizability theory to examine assessments of subjective cognitive complaints: whose reports should we rely on – participant versus informant?

  • Q. C. Truong, C. Choo, K. Numbers, A. G. Merkin, H. Brodaty, N. A. Kochan, P. S. Sachdev, V. L. Feigin, O. N. Medvedev
  • Journal:
    International Psychogeriatrics / Volume 34 / Issue 12 / December 2022
    Published online by Cambridge University Press:
    13 April 2021, pp. 1023-1033
  • Objectives:

    This study aimed to apply the generalizability theory (G-theory) to investigate dynamic and enduring patterns of subjective cognitive complaints (SCC), and reliability of two widely used SCC assessment tools.

    Design:

    G-theory was applied to assessment scales using longitudinal measurement design with five assessments spanning 10 years of follow-up.

    Setting:

    Community-dwelling older adults aged 70–90 years and their informants, living in Sydney, Australia, participated in the longitudinal Sydney Memory and Ageing Study.

    Participants:

    The sample included 232 participants aged 70 years and older, and 232 associated informants. Participants were predominantly White Europeans (97.8%). The sample of informants included 76 males (32.8%), 153 females (65.9%), and their age ranged from 27 to 86 years, with a mean age of 61.3 years (SD = 14.38).

    Measurements:

    The Memory Complaint Questionnaire (MAC-Q) and the Informant Questionnaire on Cognitive Decline in the Elderly (IQCODE).

    Results:

    The IQCODE demonstrated strong reliability in measuring enduring patterns of SCC with G = 0.86. Marginally acceptable reliability of the 6-item MAC-Q (G = 0.77–0.80) was optimized by removing one item resulting in G = 0.80–0.81. Most items of both assessments were measuring enduring SCC with exception of one dynamic MAC-Q item. The IQCODE significantly predicted global cognition scores and risk of dementia incident across all occasions, while MAC-Q scores were only significant predictors on some occasions.

    Conclusions:

    While both informants’ (IQCODE) and self-reported (MAC-Q) SCC scores were generalizable across sample population and occasions, self-reported (MAC-Q) scores may be less accurate in predicting cognitive ability and diagnosis of each individual.

  • Meta-analysis of DSM alcohol use disorder criteria severities: structural consistency is only ‘skin deep’

  • S. P. Lane, D. Steinley, K. J. Sher
  • Journal:
    Psychological Medicine / Volume 46 / Issue 8 / June 2016
    Published online by Cambridge University Press:
    28 March 2016, pp. 1769-1784
  • Background

    Item response theory (IRT) analyses of alcohol use disorder (AUD) and other psychological disorders are a predominant method for assessing overall and individual criterion severity for psychiatric diagnosis. However, no investigation has established the consistency of the relative criteria severities across different samples.

    Method

    PubMed/Medline, PsycINFO, Web of Science and ProQuest databases were queried for entries relating to alcohol use and IRT. Study data were extracted using a standardized data entry sheet. Consistency of reported criteria severities across studies was analysed using generalizability theory to estimate generalized intraclass correlations (ICCs).

    Results

    A total of 451 citations were screened and 34 papers (30 unique samples) included in the research synthesis. The AUD criteria set exhibited low consistency in the ordering of criteria using both traditional [ICC = 0.16, 95% confidence interval (CI) 0.06–0.56] and generalized (ICC = 0.18, 95% CI 0.15–0.21) approaches. These results were partially accounted for by previously studied factors such as age and type of sample (e.g. clinical v. community), but the largest source of unreliability was the diagnostic instrument employed.

    Conclusions

    Despite the robust finding of unidimensional structure of AUDs, inconsistency in the relative severities across studies suggests low replicability, challenging the generalizability of findings from any given study. Explicit modeling of well-studied factors like age and sample type is essential and increases the generalizability of findings. Moreover, while the development of structured diagnostic interviews is considered a landmark contribution toward improving psychiatric research, variability across instruments has not been fully appreciated and is substantial.

  • Chapter twenty-four - Missing Data Analysis

  • from Part three - Data Analytic Strategies
  • Edited by Harry T. Reis, University of Rochester, New York, Charles M. Judd, University of Colorado Boulder
  • Book:
    Handbook of Research Methods in Social and Personality Psychology
    Published online:
    05 June 2014
    Print publication:
    24 February 2014, pp 627-652

  • Summary

    This chapter focuses on what has become known as the psychometric or nonrepresentational approach to measurement. It considers the issues traditionally discussed under the heading of reliability, and reviews several still persistent definitions or types of reliability coefficients. The chapter discusses the problems and misuses of coefficient alpha, the most commonly used psychometric index in social-personality psychology. It suggests the generalizability theory as a broader and more heuristic perspective. The chapter examines issues related to construct validation. It also considers the construct validation as the crucial issue in psychological measurement and includes a broad range of validity evidence, focusing on convergent and discriminant aspects. The chapter describes model testing in construct validation and scale construction. It also focuses on the measurement models in structural equation modeling. The chapter reviews three classical strategies (external criterion, rational-intuitive, and internal-factor analytic) and also suggests an integrated model adopting the construct-oriented approach.

  • G Theory and the reliability of psychophysiological measures: A tutorial

  • FRANCESCO DI NOCERA, FABIO FERLAZZO, VALENTINA BORGHI
  • Journal:
    Psychophysiology / Volume 38 / Issue 5 / September 2001
    Published online by Cambridge University Press:
    25 September 2001, pp. 796-806
    Print publication:
    September 2001

  • For some years, the limits of classic reliability theory have been recognized in favor of the Generalizability Theory, which deals simultaneously with multiple sources of error. This measurement model can be particularly useful when applied to research in cognitive psychophysiology. Indeed, studies in this field often deal with estimated measures whose reliability is rarely taken into account. In this paper, we report two generalizability studies in order to investigate the usefulness of G theory in providing information about the reliability of experimental results. The first was carried out on P300 measured during an oddball task, and the second was carried out on ERPs recorded during a recognition memory task. As expected, results showed that P300 modulation was more reliable than ERP memory modulation. This suggests that G theory can be a useful tool to estimate the reliability of psychophysiological findings, complementing and extending results from conventional analyses.

  • How many nights are enough? The short-term stability of sleep parameters in elderly insomniacs and normal sleepers

  • WILLIAM K. WOHLGEMUTH, JACK D. EDINGER, ANA I. FINS, ROBERT J. SULLIVAN
  • Journal:
    Psychophysiology / Volume 36 / Issue 2 / March 1999
    Published online by Cambridge University Press:
    01 March 1999, pp. 233-244
    Print publication:
    March 1999

  • Temporal stability is an important fundamental quality when measuring sleep parameters, yet it has been infrequently assessed. Generalizability theory was used to estimate the short-term temporal stability of five variables commonly used to characterize insomnia: sleep onset latency, total sleep time, wake after sleep onset, time in bed, and sleep efficiency. Estimates were calculated for 32 elderly primary insomniacs and 32 elderly normal sleepers, both in the lab and at home, using both sleep logs and polysomnography (PSG). A week of recording using either PSG or sleep logs was typically sufficient to achieve adequate stability (defined as G coefficient of at least 0.80) with some notable exceptions: (a) when using log-derived measures with insomniacs, a 3-week average was necessary for wake after sleep onset and (b) more than a 2-week average was necessary for sleep onset latency. Because of the substantial commitment involved in the physiological recording of sleep, alternative forms of aggregation are considered with the intent of improving temporal stability.