Hostname: page-component-78c5997874-mlc7c Total loading time: 0 Render date: 2024-11-11T09:10:10.707Z Has data issue: false hasContentIssue false
  • English
  • Français

Person-fit feedback on inconsistent symptom reports in clinical depression care

Published online by Cambridge University Press:  27 November 2017

Rob B. K. Wanders ,
Rob R. Meijer ,
Henricus G. Ruhé ,
Sjoerd Sytema ,
Klaas J. Wardenaar  and
Peter de Jonge
Rob B. K. Wanders*
Affiliation:
Interdisciplinary Center Psychopathology and Emotion regulation (ICPE), University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
Rob R. Meijer
Affiliation:
Department of Psychometrics and Statistics, University of Groningen, Groningen, The Netherlands
Henricus G. Ruhé
Affiliation:
Department of Psychiatry, Mood and Anxiety Disorders, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
Sjoerd Sytema
Affiliation:
Interdisciplinary Center Psychopathology and Emotion regulation (ICPE), University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
Klaas J. Wardenaar
Affiliation:
Interdisciplinary Center Psychopathology and Emotion regulation (ICPE), University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
Peter de Jonge
Affiliation:
Interdisciplinary Center Psychopathology and Emotion regulation (ICPE), University of Groningen, University Medical Center Groningen, Groningen, The Netherlands Department of Developmental Psychology, University of Groningen, Groningen, The Netherlands
*
Author for correspondence: Rob B. K. Wanders, E-mail: r.b.k.wanders@umcg.nl
Get access Rights & Permissions [Opens in a new window]

Abstract

Background

Depressive patients can present with complex and different symptom patterns in clinical care. Of these, some may report patterns that are inconsistent with typical patterns of depressive symptoms. This study aimed to evaluate the validity of person-fit statistics to identify inconsistent symptom reports and to assess the clinical usefulness of providing clinicians with person-fit score feedback during depression assessment.

Methods

Inconsistent symptom reports on the Inventory of Depressive Symptomatology Self-Report (IDS-SR) were investigated quantitatively with person-fit statistics for both intake and follow-up measurements in the Groningen University Center of Psychiatry (n = 2036). Subsequently, to investigate the causes and clinical usefulness of on-the-fly person-fit alerts, qualitative follow-up assessments were conducted with three psychiatrists about 20 of their patients that were randomly selected.

Results

Inconsistent symptom reports at intake (12.3%) were predominantly characterized by reporting of severe symptoms (e.g. psychomotor slowing) without mild symptoms (e.g. irritability). Person-fit scores at intake and follow-up were positively correlated (r = 0.45). Qualitative interviews with psychiatrists resulted in an explanation for the inconsistent response behavior (e.g. complex comorbidity, somatic complaints, and neurological abnormalities) for 19 of 20 patients. Psychiatrists indicated that if provided directly after the assessment, a person-fit alert would have led to new insights in 60%, and be reason for discussion with the patient in 75% of the cases.

Conclusions

Providing clinicians with automated feedback when inconsistent symptom reports occur is informative and can be used to support clinical decision-making.

Keywords

Decision support techniquesdepressioninconsistent symptom reportsperson fitself-report
Type
Original Articles
Information
Psychological Medicine , Volume 48 , Issue 11 , August 2018 , pp. 1844 - 1852
Copyright
Copyright © Cambridge University Press 2017 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Conijn, JM, Emons, WH, De Jong, K and Sijtsma, K (2015). Detecting and explaining aberrant responding to the outcome questionnaire-45. Assessment 22, 513–524.Google Scholar
Conijn, JM, Spinhoven, P, Meijer, RR and Lamers, F (2016). Person misfit on the inventory of depressive symptomatology: low quality self-report or true atypical symptom profile? International Journal of Methods in Psychiatric Research. doi: 10.1002/mpr.1548.Google Scholar
Conijn, JM, van der Ark, LA and Spinhoven, P (2017). Satisficing in mental health care patients: the effect of cognitive symptoms on self-report data quality. Assessment. doi: 1073191117714557.Google Scholar
Conrad, KJ, Bezruczko, N, Chan, YF, Riley, B, Diamond, G and Dennis, ML (2010). Screening for atypical suicide risk with person fit statistics among people presenting to alcohol and other drug treatment. Drug and Alcohol Dependence 106, 92–100.Google Scholar
Drasgow, F, Levine, MV and Williams, EA (1985). Appropriateness measurement with polychotomous item response models and standardized indices. British Journal of Mathematical and Statistical Psychology 38, 67–86.Google Scholar
Embretson, SE and Reise, SP (2000). Item Response Theory for Psychologists. Lawrence Erlbaum: Mahwah, NJ.Google Scholar
Embretson, SE and Reise, SP (in press). Item Response Theory. Routledge Taylor & Francis: New York, NY.Google Scholar
Ferrando, PJ (2015). Assessing person fit in typical-response measures. In Handbook of Item Response Theory Modeling: Applications to Typical Performance Assessment (ed. Reise, S.P. and Revicki, D. A.), pp. 128–155. Routledge: New York, NY.Google Scholar
Ferrando, PJ and Lorenzo, U (2000). WPerfit: a program for computing parametric person-fit statistics and plotting person response curves. Educational and Psychological Measurement 60, 479–487.Google Scholar
Groenewold, NA, Doornbos, B, Zuidersma, M, et al. (2013). Comparing cognitive and somatic symptoms of depression in myocardial infarction patients and depressed patients in primary and mental health care. Plos One 8, e53859.Google Scholar
Lambert, MJ and Shimokawa, K (2011). Collecting client feedback. Psychotherapy 48, 72–79.Google Scholar
Liu, MT and Yu, PT (2011). Aberrant learning achievement detection based on person-fit statistics in personalized e-learning systems. Journal of Educational Technology and Society 14, 107–120.Google Scholar
Marianti, S, Fox, JP, Avetisyan, M, Veldkamp, BP and Tijmstra, J (2014). Testing for aberrant behavior in response time modeling. Journal of Educational and Behavioral Statistics 39, 426–451.Google Scholar
Meijer, RR (2003). Diagnostic item score patterns on a test using IRT based person-fit statistics. Psychological Methods 8, 72–87.Google Scholar
Meijer, RR, Egberink, IJL, Emons, WHM and Sijtsma, K (2008). Detection and validation of unscalable item score patterns using item response theory: an illustration with Harter's Self-Perception Profile for Children. Journal of Personality Assessment 90, 227–238.Google Scholar
Meijer, RR, Niessen, ASM and Tendeiro, JN (2016). A practical guide to check the consistency of item response patterns in clinical research through person-fit statistics examples and a computer program. Assessment 23, 52–62.Google Scholar
Meijer, RR and Sijtsma, K (2001). Methodology review: evaluating person fit. Applied Psychological Measurement 25, 107–135.Google Scholar
Pallant, JF and Tennant, A (2007). An introduction to the Rasch measurement model: an example using the Hospital Anxiety and Depression Scale (HADS). British Journal of Clinical Psychology 46, 1–18.Google Scholar
Penninx, BWJH, Beekman, ATF, Smit, JH, Zitman, FG, Nolen, WA, Spinhoven, P, Cuijpers, P, De Jong, PJ, Van Marwijk, HWJ, Assendelft, WJJ, Van Der Meer, K, Verhaak, P, Wensing, M, De Graaf, R, Hoogendijk, WJ, Ormel, J and Van Dyck, R (2008). The Netherlands Study of Depression and Anxiety (NESDA): rationale, objectives and methods. International Journal of Methods in Psychiatric Research 17, 121–140.Google Scholar
Puschner, B, Steffen, S, Slade, M, Kaliniecka, H, Maj, M, Fiorillo, A, Munk-Jørgensen, P, Larsen, JI, Égerházi, A, Nemes, Z, Rössler, W, Kawohl, W and Becker, T (2010). Clinical decision making and outcome in routine care for people with severe mental illness (CEDAR): study protocol. BMC Psychiatry 10, 90.Google Scholar
Reise, SP and Waller, NG (2009). Item response theory and clinical measurement. Annual Review of Clinical Psychology 5, 27–48.Google Scholar
Rizopoulos, D (2006). Ltm: an R package for latent variable modeling and item response theory analyses. Journal of Statistical Software 17, 1–25.Google Scholar
Rupp, AA (2013). A systematic review of the methodology for person fit research in item response theory: lessons about generalizability of inferences from the design of simulation studies. Psychological Test Assessment Modeling 55, 3–38.Google Scholar
Rush, AJ, Gullion, CM, Basco, MR, Jarrett, RB and Trivedi, MH (1996). The Inventory of Depressive Symptomatology (IDS): psychometric properties. Psychological Medicine 26, 477–486.Google Scholar
Samejima, F (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph Supplement 34, 100.Google Scholar
Tendeiro, JN, Meijer, RR and Niessen, ASM (2016). Perfit: an R package for person-fit analysis in IRT. Journal of Statistical Software 74, 1–27.Google Scholar
Thomas, ML (2011). The value of item response theory in clinical assessment: a review. Assessment 18, 291–307.Google Scholar
Van Herk, H, Poortinga, YH and Verhallen, TM (2004). Response styles in rating scales: evidence of method bias in data from six EU countries. Journal of Cross-Cultural Psychology 35, 346–360.Google Scholar
Wanders, RBK, Wardenaar, KJ, Kessler, RC, Penninx, BWJH, Meijer, RR and De Jonge, P (2015 b). Differential reporting of depressive symptoms across distinct clinical subpopulations: what difference does it make? Journal of Psychosomatic Research 78, 130–136.Google Scholar
Wanders, RBK, Wardenaar, KJ, Penninx, BWJH, Meijer, RR and De Jonge, P (2015 a). Data-driven atypical profiles of depressive symptoms: identification and validation in a large cohort. Journal of Affective Disorders 180, 36–43.Google Scholar
Wardenaar, KJ, Wanders, RBK, Roest, AM, Meijer, RR and De Jonge, P (2015). What does the beck depression inventory measure in myocardial infarction patients? A psychometric approach using item response theory and person-fit. International Journal of Methods in Psychiatric Research 24, 130–142.Google Scholar
Woods, CM, Oltmanns, TF and Turkheimer, E (2008). Detection of aberrant responding on a personality scale in a military sample: an application of evaluating person fit with two-level logistic regression. Psychological Assessment 20, 159–168.Google Scholar
Supplementary material: PDF

Wanders et al supplementary material 1

Wanders et al supplementary material

Download Wanders et al supplementary material 1(PDF)
PDF 1.3 MB