Hostname: page-component-78c5997874-4rdpn Total loading time: 0 Render date: 2024-11-10T04:08:10.879Z Has data issue: false hasContentIssue false
  • English
  • Français

Equivalency of the diagnostic accuracy of the PHQ-8 and PHQ-9: a systematic review and individual participant data meta-analysis

Published online by Cambridge University Press:  12 July 2019

Yin Wu ,
Brooke Levis ,
Kira E. Riehm ,
Nazanin Saadat ,
Alexander W. Levis ,
Marleine Azar ,
Danielle B. Rice ,
Jill Boruff ,
Pim Cuijpers  and
Simon Gilbody
...Show all authors
Yin Wu
Affiliation:
Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada Department of Psychiatry, McGill University, Montréal, Québec, Canada Department of Epidemiology, Biostatistics and Occupational Health, McGill University, Montréal, Québec, Canada
Brooke Levis
Affiliation:
Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada Department of Epidemiology, Biostatistics and Occupational Health, McGill University, Montréal, Québec, Canada
Kira E. Riehm
Affiliation:
Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
Nazanin Saadat
Affiliation:
Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
Alexander W. Levis
Affiliation:
Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
Marleine Azar
Affiliation:
Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada
Danielle B. Rice
Affiliation:
Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada Department of Psychology, McGill University, Montréal, Québec, Canada
Jill Boruff
Affiliation:
Schulich Library of Physical Sciences, Life Sciences, and Engineering, McGill University, Montreal, Quebec, Canada
Pim Cuijpers
Affiliation:
Department of Clinical, Neuro and Developmental Psychology, Amsterdam Public Health Research Institute, Vrije Universiteit, Amsterdam, the Netherlands
Simon Gilbody
Affiliation:
Hull York Medical School and the Department of Health Sciences, University of York, Heslington, York, UK
John P.A. Ioannidis
Affiliation:
Department of Medicine, Department of Health Research and Policy, Department of Biomedical Data Science, Department of Statistics, Stanford University, Stanford, California, USA
Lorie A. Kloda
Affiliation:
Library, Concordia University, Montréal, Québec, Canada
Dean McMillan
Affiliation:
Hull York Medical School and the Department of Health Sciences, University of York, Heslington, York, UK
Scott B. Patten
Affiliation:
Department of Community Health Sciences, University of Calgary, Calgary, Alberta, Canada Hotchkiss Brain Institute and O'Brien Institute for Public Health, University of Calgary, Calgary, Alberta, Canada
Ian Shrier
Affiliation:
Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada Department of Epidemiology, Biostatistics and Occupational Health, McGill University, Montréal, Québec, Canada
Roy C. Ziegelstein
Affiliation:
Department of Medicine, Johns Hopkins University School of Medicine, Baltimore, Maryland, USA
Dickens H. Akena
Affiliation:
Department of Psychiatry, Makerere University College of Health Sciences, Kampala, Uganda
Bruce Arroll
Affiliation:
Department of General Practice and Primary Health Care, University of Auckland, Auckland, New Zealand
Liat Ayalon
Affiliation:
Louis and Gabi Weisfeld School of Social Work, Bar Ilan University, Ramat Gan, Israel
Hamid R. Baradaran
Affiliation:
Endocrine Research Center, Institute of Endocrinology and Metabolism, Iran University of Medical Sciences, Tehran, Iran Ageing Clinical & Experimental Research Team, Institute of Applied Health Sciences, School of Medicine, Medical Sciences and Nutrition, University of Aberdeen, Aberdeen, Scotland, UK
Murray Baron
Affiliation:
Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada Department of Medicine, McGill University, Montréal, Québec, Canada
Charles H. Bombardier
Affiliation:
Department of Rehabilitation Medicine, University of Washington, Seattle, Washington, USA
Peter Butterworth
Affiliation:
Centre for Research on Ageing, Health and Wellbeing, Research School of Population Health, The Australian National University, Canberra, Australia Melbourne Institute of Applied Economic and Social Research, University of Melbourne, Melbourne, Australia
Gregory Carter
Affiliation:
Centre for Brain and Mental Health Research, University of Newcastle, New South Wales, Australia
Marcos H. Chagas
Affiliation:
Department of Neurosciences and Behavior, Ribeirão Preto Medical School, University of São Paulo, Ribeirão Preto, Brazil
Juliana C. N. Chan
Affiliation:
Department of Medicine and Therapeutics, Prince of Wales Hospital, The Chinese University of Hong Kong, Hong Kong Special Administrative Region (SAR), China Asia Diabetes Foundation, Prince of Wales Hospital, Hong Kong SAR, China Hong Kong Institute of Diabetes and Obesity, Hong Kong SAR, China
Rushina Cholera
Affiliation:
Department of Pediatrics, University of North Carolina at Chapel Hill School of Medicine, Chapel Hill, North Carolina, USA
Yeates Conwell
Affiliation:
Department of Psychiatry, University of Rochester Medical Center, New York, USA
Janneke M. de Man-van Ginkel
Affiliation:
Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, the Netherlands
Jesse R. Fann
Affiliation:
Department of Psychiatry and Behavioral Sciences, University of Washington, Seattle, Washington, USA
Felix H. Fischer
Affiliation:
Department of Psychosomatic Medicine, Center for Internal Medicine and Dermatology, Charité – Universitätsmedizin Berlin, Berlin, Germany
Daniel Fung
Affiliation:
Department of Child & Adolescent Psychiatry, Institute of Mental Health, Singapore, Singapore Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore Programme in Health Services & Systems Research, Duke-NUS Medical School, Singapore, Singapore
Bizu Gelaye
Affiliation:
Department of Epidemiology, Harvard T. H. Chan School of Public Health, Boston, Massachusetts, USA
Felicity Goodyear-Smith
Affiliation:
Department of General Practice and Primary Health Care, University of Auckland, Auckland, New Zealand
Catherine G. Greeno
Affiliation:
School of Social Work, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
Brian J. Hall
Affiliation:
Global and Community Mental Health Research Group, Department of Psychology, Faculty of Social Sciences, University of Macau, Macau Special Administrative Region, China Department of Health, Behavior, and Society, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland, USA
Patricia A. Harrison
Affiliation:
City of Minneapolis Health Department, Minneapolis, Minnesota, USA
Martin Härter
Affiliation:
Department of Medical Psychology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
Ulrich Hegerl
Affiliation:
Depression Research Center of the German Depression Foundation and Department of Psychiatry, Psychosomatics and Psychotherapy, Goethe University, Frankfurt, Germany
Leanne Hides
Affiliation:
School of Psychology, University of Queensland, Brisbane, Queensland, Australia
Stevan E. Hobfoll
Affiliation:
STAR-Stress, Anxiety & Resilience Consultants, Chicago, Illinois, USA
Marie Hudson
Affiliation:
Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada Department of Medicine, McGill University, Montréal, Québec, Canada
Thomas Hyphantis
Affiliation:
Department of Psychiatry, University of Ioannina, Ioannina, Greece
Masatoshi Inagaki
Affiliation:
Department of Psychiatry, Faculty of Medicine, Shimane University, Shimane, Japan
Nathalie Jetté
Affiliation:
Department of Community Health Sciences, University of Calgary, Calgary, Alberta, Canada Hotchkiss Brain Institute and O'Brien Institute for Public Health, University of Calgary, Calgary, Alberta, Canada Department of Neurology, Icahn School of Medicine at Mount Sinai, New York, New York, USA
Mohammad E. Khamseh
Affiliation:
Endocrine Research Center, Institute of Endocrinology and Metabolism, Iran University of Medical Sciences, Tehran, Iran
Kim M. Kiely
Affiliation:
School of Psychology, University of New South Wales, Sydney, Australia Neuroscience Research Australia, Sydney, Australia
Yunxin Kwan
Affiliation:
Department of Psychological Medicine, Tan Tock Seng Hospital, Singapore, Singapore
Femke Lamers
Affiliation:
Department of Psychiatry, Amsterdam UMC, Vrije Universiteit, Amsterdam Public Health Research Institute, Amsterdam, the Netherlands
Shen-Ing Liu
Affiliation:
Programme in Health Services & Systems Research, Duke-NUS Medical School, Singapore, Singapore Department of Psychiatry, Mackay Memorial Hospital, Taipei, Taiwan Department of Medical Research, Mackay Memorial Hospital, Taipei, Taiwan Department of Medicine, Mackay Medical College, Taipei, Taiwan
Manote Lotrakul
Affiliation:
Department of Psychiatry, Faculty of Medicine, Ramathibodi Hospital, Mahidol University, Bangkok, Thailand
Sonia R. Loureiro
Affiliation:
Department of Neurosciences and Behavior, Ribeirão Preto Medical School, University of São Paulo, Ribeirão Preto, Brazil
Bernd Löwe
Affiliation:
Department of Psychosomatic Medicine and Psychotherapy, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
Anthony McGuire
Affiliation:
Department of Nursing, St. Joseph's College, Standish, Maine, USA
Sherina Mohd-Sidik
Affiliation:
Department of Psychiatry, Faculty of Medicine and Health Sciences, Cancer Resource & Education Centre, Universiti Putra Malaysia, Serdang, Selangor, Malaysia
Tiago N. Munhoz
Affiliation:
Post-graduate Program in Epidemiology, Federal University of Pelotas, Pelotas, RS, Brazil
Kumiko Muramatsu
Affiliation:
Department of Clinical Psychology, Graduate School of Niigata Seiryo University, Niigata, Japan
Flávia L. Osório
Affiliation:
Department of Neurosciences and Behavior, Ribeirão Preto Medical School, University of São Paulo, Ribeirão Preto, Brazil National Institute of Science and Technology, Translational Medicine, Ribeirão Preto, Brazil
Vikram Patel
Affiliation:
Department of Global Health and Social Medicine, Harvard Medical School, Boston, Massachusetts, USA Department of Global Health and Population, Harvard T.H. Chan School of Public Health, Boston, Massachusetts, USA
Brian W. Pence
Affiliation:
Department of Epidemiology, Gillings School of Global Public Health, The University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
Philippe Persoons
Affiliation:
Department of Adult Psychiatry, University Hospitals Leuven, Leuven, Belgium Department of Neurosciences, Katholieke Universiteit Leuven, Leuven, Belgium
Angelo Picardi
Affiliation:
Centre for Behavioural Sciences and Mental Health, Italian National Institute of Health, Rome, Italy
Katrin Reuter
Affiliation:
Department of Psychiatry and Psychotherapy, University Medical Center Freiburg, Freiburg, Germany
Alasdair G. Rooney
Affiliation:
Division of Psychiatry, Royal Edinburgh Hospital, University of Edinburg, Edinburgh, Scotland, UK
Iná S. Santos
Affiliation:
Post-graduate Program in Epidemiology, Federal University of Pelotas, Pelotas, RS, Brazil
Juwita Shaaban
Affiliation:
Department of Family Medicine, School of Medical Sciences, Universiti Sains Malaysia, Kelantan, Malaysia
Abbey Sidebottom
Affiliation:
Allina Health, Minneapolis, Minnesota, USA
Adam Simning
Affiliation:
Department of Psychiatry, University of Rochester Medical Center, New York, USA
Lesley Stafford
Affiliation:
Centre for Women's Mental Health, Royal Women's Hospital, Parkville, Melbourne, Australia Melbourne School of Psychological Sciences, University of Melbourne, Australia
Sharon Sung
Affiliation:
Department of Child & Adolescent Psychiatry, Institute of Mental Health, Singapore, Singapore Programme in Health Services & Systems Research, Duke-NUS Medical School, Singapore, Singapore
Pei Lin Lynnette Tan
Affiliation:
Department of Psychological Medicine, Tan Tock Seng Hospital, Singapore, Singapore
Alyna Turner
Affiliation:
School of Medicine and Public Health, University of Newcastle, New South Wales, Newcastle, Australia IMPACT Strategic Research Centre, School of Medicine, Deakin University, Geelong, Victoria, Australia
Henk C. van Weert
Affiliation:
Department of General Practice, Amsterdam Institute for General Practice and Public Health, Amsterdam University Medical Centers, location AMC, Amsterdam, the Netherlands
Jennifer White
Affiliation:
Monash University, Melbourne, Australia
Mary A. Whooley
Affiliation:
Department of Epidemiology and Biostatistics, University of California San Francisco, San Francisco, California, USA Department of Medicine, Veterans Affairs Medical Center, San Francisco, California, USA Department of Medicine, University of California San Francisco, San Francisco, California, USA
Kirsty Winkley
Affiliation:
Florence Nightingale Faculty of Nursing, Midwifery & Palliative Care, King's College London, London, UK
Mitsuhiko Yamada
Affiliation:
Department of Neuropsychopharmacology, National Institute of Mental Health, National Center of Neurology and Psychiatry, Ogawa-Higashi, Kodaira, Tokyo, Japan
Andrea Benedetti*
Affiliation:
Department of Epidemiology, Biostatistics and Occupational Health, McGill University, Montréal, Québec, Canada Department of Medicine, McGill University, Montréal, Québec, Canada Respiratory Epidemiology and Clinical Research Unit, McGill University Health Centre, Montréal, Québec, Canada
Brett D. Thombs*
Affiliation:
Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, Québec, Canada Department of Psychiatry, McGill University, Montréal, Québec, Canada Department of Epidemiology, Biostatistics and Occupational Health, McGill University, Montréal, Québec, Canada Department of Psychology, McGill University, Montréal, Québec, Canada Department of Medicine, McGill University, Montréal, Québec, Canada Department of Educational and Counselling Psychology, McGill University, Montréal, Québec, Canada
*
Authors for correspondence: Andrea Benedetti, E-mail: andrea.benedetti@mcgill.ca and Brett D. Thombs, E-mail: brett.thombs@mcgill.ca
Authors for correspondence: Andrea Benedetti, E-mail: andrea.benedetti@mcgill.ca and Brett D. Thombs, E-mail: brett.thombs@mcgill.ca
Get access Rights & Permissions [Opens in a new window]

Abstract

Background

Item 9 of the Patient Health Questionnaire-9 (PHQ-9) queries about thoughts of death and self-harm, but not suicidality. Although it is sometimes used to assess suicide risk, most positive responses are not associated with suicidality. The PHQ-8, which omits Item 9, is thus increasingly used in research. We assessed equivalency of total score correlations and the diagnostic accuracy to detect major depression of the PHQ-8 and PHQ-9.

Methods

We conducted an individual patient data meta-analysis. We fit bivariate random-effects models to assess diagnostic accuracy.

Results

16 742 participants (2097 major depression cases) from 54 studies were included. The correlation between PHQ-8 and PHQ-9 scores was 0.996 (95% confidence interval 0.996 to 0.996). The standard cutoff score of 10 for the PHQ-9 maximized sensitivity + specificity for the PHQ-8 among studies that used a semi-structured diagnostic interview reference standard (N = 27). At cutoff 10, the PHQ-8 was less sensitive by 0.02 (−0.06 to 0.00) and more specific by 0.01 (0.00 to 0.01) among those studies (N = 27), with similar results for studies that used other types of interviews (N = 27). For all 54 primary studies combined, across all cutoffs, the PHQ-8 was less sensitive than the PHQ-9 by 0.00 to 0.05 (0.03 at cutoff 10), and specificity was within 0.01 for all cutoffs (0.00 to 0.01).

Conclusions

PHQ-8 and PHQ-9 total scores were similar. Sensitivity may be minimally reduced with the PHQ-8, but specificity is similar.

Keywords

Depressiondiagnostic accuracyindividual participant data meta-analysismeta-analysisPHQ-8PHQ-9screeningsystematic review
Type
Original Articles
Information
Psychological Medicine , Volume 50 , Issue 8 , June 2020 , pp. 1368 - 1380
Copyright
Copyright © Cambridge University Press 2019

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Allaby, M (2010) Screening for Depression: A Report for the UK National Screening Committee (Revised report). London, United Kingdom: UK National Screening Committee.Google Scholar
American Psychiatric Association (2013) Diagnostic and Statistical Manual of Mental Disorders, 5th Edn.Arlington, VA: American Psychiatric Publishing.Google Scholar
Barrera, TL, Cummings, JP, Armento, M, Cully, JA, Bush Amspoker, A, Wilson, NL, Mallen, MJ, Shrestha, S, Kunik, ME and Stanley, MA (2017) Telephone-delivered cognitive-behavioral therapy for older, rural veterans with depression and anxiety in home-based primary care. Clinical Gerontologist 40, 114–123.10.1080/07317115.2016.1254133CrossRefGoogle ScholarPubMed
Brugha, TS, Bebbington, PE and Jenkins, R (1999) A difference that matters: comparisons of structured and semi-structured psychiatric diagnostic interviews in the general population. Psychological Medicine 29, 1013–1020.10.1017/S0033291799008880CrossRefGoogle ScholarPubMed
Canadian Agency for Drugs and Technologies in Health (2016) PRESS – Peer Review of Electronic Search Strategies: 2015 Guideline Explanation and Elaboration (PRESS E&E). Ottawa: CADTH.Google Scholar
Carter, G and Spittal, MJ (2018) Suicide risk assessment: risk stratification is not accurate enough to be clinically useful and alternative approaches are needed. Crisis 39, 229.CrossRefGoogle Scholar
Corson, K, Gerrity, MS and Dobscha, SK (2004) Screening for depression and suicidality in a VA primary care setting: 2 items are better than 1 item. The American Journal of Managed Care 10, 839–845.Google Scholar
Crawford, MJ, Thana, L, Methuen, C, Ghosh, P, Stanley, SV, Ross, J, Gordon, F, Blair, G and Bajaj, P (2011) Impact of screening for risk of suicide: randomised controlled trial. British Journal of Psychiatry 198, 379–384.CrossRefGoogle ScholarPubMed
Fagerland, MW, Lydersen, S and Laake, P (2014) Recommended tests and confidence intervals for paired binomial proportions. Statistics in Medicine 33, 2850–2875.10.1002/sim.6148CrossRefGoogle ScholarPubMed
Higgins, JP and Thompson, SG (2002) Quantifying heterogeneity in a meta-analysis. Statistics in Medicine 21, 1539–1558.CrossRefGoogle ScholarPubMed
Ishihara, M, Harel, D, Levis, B, Levis, AW, Riehm, KE, Saadat, N, Azar, M, Rice, DB, Sanchez, TA, Chiovitti, MJ and Cuijpers, P (2019). Shortening self-report mental health symptom measures through optimal test assembly methods: development and validation of the Patient Health Questionnaire-Depression-4. Depression and Anxiety 36, 82–92. doi: 10.1002/da.22841.CrossRefGoogle ScholarPubMed
Kroenke, K, Spitzer, RL and Williams, JBW (2001) The PHQ-9: validity of a brief depression severity measure. Journal of General Internal Medicine 16, 606–613.CrossRefGoogle ScholarPubMed
Kroenke, K, Strine, TW, Spitzer, RL, Williams, JB, Berry, JT and Mokdad, AH (2009) The PHQ-8 as a measure of current depression in the general population. Journal of Affective Disorders 114, 163–173.CrossRefGoogle ScholarPubMed
Levis, B, Benedetti, A, Riehm, KE, Saadat, N, Levis, AW, Azar, M, Rice, DB, Chiovitti, MJ, Sanchez, TA, Cuijpers, P and Gilbody, S (2018) Probability of major depression diagnostic classification using semi-structured versus fully structured diagnostic interviews. British Journal of Psychiatry 212, 377–385.10.1192/bjp.2018.54CrossRefGoogle ScholarPubMed
Levis, B, Benedetti, A, Thombs, BD and on behalf of the DEPRESsion Screening Data (DEPRESSD) Collaboration (2019) Accuracy of Patient Health Questionnaire-9 (PHQ-9) for screening to detect major depression: individual participant data meta-analysis. BMJ 365, l1476.CrossRefGoogle ScholarPubMed
Moriarty, AS, Gilbody, S, McMillan, D and Manea, L (2015) Screening and case finding for major depressive disorder using the Patient Health Questionnaire (PHQ-9): a meta-analysis. General Hospital Psychiatry 37, 567–576.CrossRefGoogle ScholarPubMed
Nosen, E and Woody, SR (2008) Chapter 8: diagnostic assessment in research. In McKay, D (ed.), Handbook of Research Methods in Abnormal and Clinical Psychology. Thousand Oaks: Sage, pp. 109–124.Google Scholar
Razykov, I, Ziegelstein, R, Whooley, M and Thombs, BD (2012) The PHQ-9 versus the PHQ-8 – is item 9 useful for assessing suicide risk in coronary artery disease patients? Data from the heart and Soul study. Journal of Psychosomatic Research 73, 163–168.10.1016/j.jpsychores.2012.06.001CrossRefGoogle ScholarPubMed
Rice, DB, Kloda, LA, Levis, B, Qi, B, Kingsland, E and Thombs, BD (2016) Are MEDLINE searches sufficient for systematic reviews and meta-analyses of the diagnostic accuracy of depression screening tools? A review of meta-analyses. Journal of Psychosomatic Research 87, 7–13.10.1016/j.jpsychores.2016.06.002CrossRefGoogle ScholarPubMed
Riley, RD, Dodd, SR, Craig, JV, Thompson, JR and Williamson, PR (2008) Meta-analysis of diagnostic test studies using individual patient data and aggregate data. Statistics in Medicine 27, 6111–6136.10.1002/sim.3441CrossRefGoogle ScholarPubMed
Robins, LN, Wing, J, Wittchen, HU, Helzer, JE, Babor, TF, Burke, J, Farmer, A, Jablenski, A, Pickens, R, Regier, DA and Sartorius, N (1988) The Composite International Diagnostic Interview: an epidemiologic instrument suitable for use in conjunction with different diagnostic systems and in different cultures. Archives of General Psychiatry 45, 1069–1077.CrossRefGoogle ScholarPubMed
Sheehan, DV, Lecrubier, Y, Sheehan, KH, Janavs, J, Weiller, E, Keskiner, A, Schinka, J, Knapp, E, Sheehan, MF and Dunbar, GC (1997) The validity of the Mini International Neuropsychiatric Interview (MINI) according to the SCID-P and its reliability. European Psychiatry 12, 232–241.CrossRefGoogle Scholar
Simon, GE, Rutter, CM, Peterson, D, Oliver, M, Whiteside, U, Operskalski, B and Ludman, EJ (2013) Does response on the PHQ-9 Depression Questionnaire predict subsequent suicide attempt or suicide death? Psychiatric Services 64, 1195–1202.CrossRefGoogle ScholarPubMed
Simon, GE, Coleman, KJ, Rossom, RC, Beck, A, Oliver, M, Johnson, E, Whiteside, U, Operskalski, B, Penfold, RB, Shortreed, SM and Rutter, C (2016) Risk of suicide attempt and suicide death following completion of the Patient Health Questionnaire depression module in community practice. The Journal of Clinical Psychiatry 77, 221–227.10.4088/JCP.15m09776CrossRefGoogle ScholarPubMed
Siu, AL and the US Preventive Services Task Force (USPSTF) (2016) Screening for depression in adults: US preventive services task force recommendation statement. JAMA: The Journal of the American Medical Association 315, 380–387.CrossRefGoogle ScholarPubMed
Suarez, L, Beach, SR, Moore, SV, Mastromauro, CA, Januzzi, JL, Celano, CM, Chang, TE and Huffman, JC (2015) Use of the Patient Health Questionnaire-9 and a detailed suicide evaluation in determining imminent suicidality in distressed patients with cardiac disease. Psychosomatics 56, 181–189.10.1016/j.psym.2014.12.005CrossRefGoogle Scholar
Thombs, BD, Benedetti, A, Kloda, LA, Levis, B, Nicolau, I, Cuijpers, P, Gilbody, S, Ioannidis, JP, McMillan, D, Patten, SB and Shrier, I (2014) The diagnostic accuracy of the Patient Health Questionnaire-2 (PHQ-2), Patient Health Questionnaire-8 (PHQ-8), and Patient Health Questionnaire-9 (PHQ-9) for detecting major depression: protocol for a systematic review and individual patient data meta-analyses. Systematic Reviews 3, 124.10.1186/2046-4053-3-124CrossRefGoogle ScholarPubMed
van der Leeden, R, Busing, FMTA and Meijer, E (1997) Bootstrap Methods For Two-Level Models (Technical report PRM 97-04). Leiden, The Netherlands: Leiden University, Department of Psychology.Google Scholar
van der Leeden, R, Meijer, E and Busing, FMTA (2008) Chapter 11: resampling multilevel models. In Leeuw, J and Meijer, E (eds), Handbook of Multilevel Analysis. New York: Springer, pp. 401–433.CrossRefGoogle Scholar
Walker, E and Nowacki, AS (2011) Understanding equivalence and noninferiority testing. Journal of General Internal Medicine 26, 192–196.CrossRefGoogle ScholarPubMed
Walker, J, Hansen, CH, Butcher, I, Sharma, N, Wall, L, Murray, G and Sharpe, M (2011) Thoughts of death and suicide reported by cancer patients who endorsed the “suicidal thoughts” item of the PHQ-9 during routine screening for depression. Psychosomatics 52, 424–427.10.1016/j.psym.2011.02.003CrossRefGoogle ScholarPubMed
Wells, TS, Horton, JL, LeardMann, CA, Jacobson, IG and Boyko, EJ (2013) A comparison of the PRIME-MD PHQ-9 and PHQ-8 in a large military prospective study, the Millennium Cohort Study. Journal of Affective Disorders 148, 77–83.10.1016/j.jad.2012.11.052CrossRefGoogle Scholar
Whiting, PF, Rutjes, AW, Westwood, ME, Mallett, S, Deeks, JJ, Reitsma, JB, Leeflang, MM, Sterne, JA and Bossuyt, PM (2011) QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Annals of Internal Medicine 155, 529–536.CrossRefGoogle ScholarPubMed
Supplementary material: File

Wu et al. supplementary material

Wu et al. supplementary material 1

Download Wu et al. supplementary material(File)
File 92.6 MB

A correction has been issued for this article:

Equivalency of the diagnostic accuracy of the PHQ-8 and PHQ-9: a systematic review and individual participant data meta-analysis – ERRATUM

Yin Wu , Brooke Levis , Kira E. Riehm , Nazanin Saadat , Alexander W. Levis , Marleine Azar , Danielle B. Rice , Jill Boruff , Pim Cuijpers , Simon Gilbody , John P.A. Ioannidis , Lorie A. Kloda , Dean McMillan , Scott B. Patten , Ian Shrier , Roy C. Ziegelstein , Dickens H. Akena , Bruce Arroll , Liat Ayalon , Hamid R. Baradaran , Murray Baron , Charles H. Bombardier , Peter Butterworth , Gregory Carter , Marcos H. Chagas , Juliana C. N. Chan , Rushina Cholera , Yeates Conwell , Janneke M. de Manvan Ginkel , Jesse R. Fann , Felix H. Fischer , Daniel Fung , Bizu Gelaye , Felicity Goodyear-Smith , Catherine G. Greeno , Brian J. Hall , Patricia A. Harrison , Martin Härter , Ulrich Hegerl , Leanne Hides , Stevan E. Hobfoll , Marie Hudson , Thomas Hyphantis , Masatoshi Inagaki , Nathalie Jetté , Mohammad E. Khamseh , Kim M. Kiely , Yunxin Kwan , Femke Lamers , Shen-Ing Liu , Manote Lotrakul , Sonia R. Loureiro , Bernd Löwe , Anthony McGuire , Sherina Mohd-Sidik , Tiago N. Munhoz , Kumiko Muramatsu , Flávia L. Osório , Vikram Patel , Brian W. Pence , Philippe Persoons , Angelo Picardi , Katrin Reuter , Alasdair G. Rooney , Iná S. Santos , Juwita Shaaban , Abbey Sidebottom , Adam Simning , Lesley Stafford , Sharon Sung , Pei Lin Lynnette Tan , Alyna Turner , Henk C. van Weert , Jennifer White , Mary A. Whooley , Kirsty Winkley , Mitsuhiko Yamada , Andrea Benedetti  and Brett D. Thombs