Hostname: page-component-78c5997874-g7gxr Total loading time: 0 Render date: 2024-11-13T00:52:09.726Z Has data issue: false hasContentIssue false

Association of psychiatric disorders with clinical diagnosis of long COVID in US veterans

Published online by Cambridge University Press:  05 February 2024

Kristen Nishimi*
Affiliation:
Mental Health Service, San Francisco Veterans Affairs Health Care System, San Francisco, CA, USA Department of Psychiatry and Weill Institute for Neurosciences, University of California San Francisco, San Francisco, CA, USA
Thomas C. Neylan
Affiliation:
Mental Health Service, San Francisco Veterans Affairs Health Care System, San Francisco, CA, USA Department of Psychiatry and Weill Institute for Neurosciences, University of California San Francisco, San Francisco, CA, USA Department of Neurology, University of California San Francisco, San Francisco, CA, USA
Daniel Bertenthal
Affiliation:
Mental Health Service, San Francisco Veterans Affairs Health Care System, San Francisco, CA, USA
Karen H. Seal
Affiliation:
Department of Psychiatry and Weill Institute for Neurosciences, University of California San Francisco, San Francisco, CA, USA Integrative Health Service, San Francisco Veterans Affairs Health Care System, San Francisco, CA, USA Department of Medicine, University of California San Francisco, San Francisco, CA, USA
Aoife O'Donovan*
Affiliation:
Mental Health Service, San Francisco Veterans Affairs Health Care System, San Francisco, CA, USA Department of Psychiatry and Weill Institute for Neurosciences, University of California San Francisco, San Francisco, CA, USA
*
Corresponding author: Kristen Nishimi; Email: kristen.nishimi@ucsf.edu; Aoife O'Donovan; Email: aoife.odonovan@ucsf.edu
Corresponding author: Kristen Nishimi; Email: kristen.nishimi@ucsf.edu; Aoife O'Donovan; Email: aoife.odonovan@ucsf.edu
Rights & Permissions [Opens in a new window]

Abstract

Background

Psychiatric disorders may be a risk factor for long COVID, broadly defined as COVID-19 conditions continuing three months post-acute infection. In US Veterans with high psychiatric burden, we examined associations between psychiatric disorders and clinical diagnosis of long COVID.

Methods

We conducted a retrospective cohort study using health records from VA patients with a positive SARS-CoV-2 test from February 2020 to February 2023. Generalized linear models estimated associations between any psychiatric disorder and likelihood of subsequent diagnosis with long COVID (i.e. two or more long COVID clinical codes). Models were adjusted for socio-demographic, medical, and behavioral factors. Secondary models examined individual psychiatric disorders and age-stratified associations.

Results

Among 660 217 VA patients with positive SARS-CoV-2 tests, 56.3% had at least one psychiatric disorder diagnosis and 1.4% were diagnosed with long COVID. Individuals with any psychiatric disorder had higher risk for long COVID diagnosis in models adjusted for socio-demographic factors, vaccination status, smoking, and medical comorbidities (relative risk, RR = 1.28, 95% CI 1.21–1.35), with the strongest associations in younger individuals. Considering specific disorders, depressive, anxiety, and stress-related disorders were associated with increased risk for long COVID diagnoses (RRs = 1.36–1.48), but associations were in the opposite direction for substance use and psychotic disorders (RRs = 0.78–0.88).

Conclusions

Psychiatric disorder diagnoses were associated with increased long COVID diagnosis risk in VA patients, with the strongest associations observed in younger individuals. Improved surveillance, treatment, and prevention for COVID-19 and its long-term sequelae should be considered for individuals with psychiatric conditions.

Type
Original Article
Copyright
Copyright © The Author(s), 2024. Published by Cambridge University Press

Introduction

Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) continues to circulate, with corresponding increases in the number of individuals living with long COVID – a general term for post-acute sequelae of SARS CoV-2 infection (PASC) or post-COVID-19 conditions (PCC) at least three months after SARS-CoV-2 infection onset, lasting at least two months (Soriano, Murthy, Marshall, Relan, & Diaz, Reference Soriano, Murthy, Marshall, Relan and Diaz2022). Prevalence estimates of long COVID vary (2–43%) (Bygdell et al., Reference Bygdell, Leach, Lundberg, Gyll, Martikainen, Santosa and Nyberg2023; Chen et al., Reference Chen, Haupert, Zimmermann, Shi, Fritsche and Mukherjee2022), with some studies estimating that at least 69 million people have had long COVID (Ballering, van Zon, olde Hartman, & Rosmalen, Reference Ballering, van Zon, olde Hartman and Rosmalen2022; Davis, McCorkell, Vogel, & Topol, Reference Davis, McCorkell, Vogel and Topol2023). Nonetheless, we have poor understanding of risk factors for and underlying mechanisms of long COVID, symptoms are often non-specific, and we lack objective diagnostic tests (Choutka, Jansari, Hornig, & Iwasaki, Reference Choutka, Jansari, Hornig and Iwasaki2022). Varied clinical manifestations include prolonged fatigue, shortness of breath, and cognitive dysfunction (Soriano et al., Reference Soriano, Murthy, Marshall, Relan and Diaz2022), and new onset pulmonary, cardiovascular, muscle, or neurological conditions (Bull-Otterson, Reference Bull-Otterson2022; Thaweethai et al., Reference Thaweethai, Jolley, Karlson, Levitan, Levy and McComsey2023). To enable better documentation of this broad and heterogeneous condition, an International Classification of Diseases, Tenth Revision (ICD-10) code U09.9 was released October 2021 (Hill et al., Reference Hill, Mehta, Sharma, Mane, Singh and Xie2023). Long COVID poses a significant threat to population health (Ballouz et al., Reference Ballouz, Menges, Anagnostopoulos, Domenghino, Aschmann, Frei and Puhan2023; O'Mahoney et al., Reference O'Mahoney, Routen, Gillies, Ekezie, Welford, Zhang and Khunti2023), and it is necessary to identify risk factors to inform targeted screening, early detection, and disease management.

Several long COVID risk factors have been identified, including female sex, older age, pre-existing asthma or chronic obstructive pulmonary disease (COPD), high body mass index (BMI), and higher acute disease severity (Vincent, Ofovwe, Gschwandtner, Shergill, & Faruqui, Reference Vincent, Ofovwe, Gschwandtner, Shergill and Faruqui2022; Zeng et al., Reference Zeng, Zhao, Yan, Li, Lu, Liu and Lu2022). However, few studies have examined if pre-existing psychiatric conditions increase long COVID risk. Although the pathophysiology of long COVID is not known (Castanares-Zapatero et al., Reference Castanares-Zapatero, Chalon, Kohn, Dauvrin, Detollenaere, Maertens de Noordhout and Van den Heede2022), psychiatric disorders are associated with physiological, behavioral, and psychosocial factors (Bradford et al., Reference Bradford, Kim, Braxton, Marx, Butterfield and Elbogen2008; Sally Rogers, Anthony, & Lyass, Reference Sally Rogers, Anthony and Lyass2004; Vancampfort et al., Reference Vancampfort, Stubbs, Mitchell, De Hert, Wampers, Ward and Correll2015; Zhang et al., Reference Zhang, Wang, Ye, Zou, Chen, Wang and Zou2023b) that could increase risk for persistent adverse outcomes of infectious diseases like COVID-19. Moreover, studies have linked psychiatric diagnoses with increased risk for COVID-19 infection (Liu et al., Reference Liu, Ni, Yan, Lu, Zhao, Xu and Lu2021; Nishimi, Neylan, Bertenthal, Seal, & O'Donovan, Reference Nishimi, Neylan, Bertenthal, Seal and O'Donovan2022b), and more severe sequelae once infected (Nishimi et al., Reference Nishimi, Neylan, Bertenthal, Dolsen, Seal and O'Donovan2022a; Vai et al., Reference Vai, Mazza, Colli, Foiselle, Allen, Benedetti and Picker2021), compared to those without such conditions. Diagnosing long COVID in patients with psychiatric disorders may be challenging in some cases due to overlapping symptoms such as fatigue, neurocognitive impairment, and sleep disturbance, and due to comorbidities with overlapping symptoms such as autoimmune and cardiovascular disorders (Krantz, Shank, & Goodie, Reference Krantz, Shank and Goodie2022; Momen et al., Reference Momen, Plana-Ripoll, Agerbo, Benros, Børglum, Christensen and McGrath2020; O'Donovan et al., Reference O'Donovan, Cohen, Seal, Bertenthal, Margaretten, Nishimi and Neylan2015).

Emerging evidence has indicated increased risk for long COVID in individuals with psychiatric disorders. A meta-analysis of 634 734 patients examining various risk factors indicated that pre-existing depression and/or anxiety increased long COVID risk by 19% (Tsampasian et al., Reference Tsampasian, Elghazaly, Chattopadhyay, Debski, Naing, Garg and Vassiliou2023). However, in a US Department of Veterans Affairs (VA) health records study through December 2021, pre-existing posttraumatic stress disorder (PTSD), depression, bipolar disorder, and schizophrenia were not associated with ‘long COVID care’ (Ioannou et al., Reference Ioannou, Baraff, Fox, Shahoumian, Hickok, O'Hare and Hynes2022). In contrast, a case–control study of VA patients in May 2021 identified that anxiety, depression, and substance abuse were significant risk factors for long COVID (defined as health sequelae in excess of non-infected controls) (Xie, Bowe, & Al-Aly, Reference Xie, Bowe and Al-Aly2021). Importantly, no prior large-scale studies was designed to focus specifically on psychiatric disorders, which may have led to poor consideration of potential confounders and divergence in results across studies. Moreover, no prior studies have included a broad range of common psychiatric disorders or compared results across disorders, or examined if results differed by age groups.

In the current study, we focused specifically on psychiatric disorders, examining associations between pre-existing psychiatric disorders and long COVID diagnosis among 660 217 VA patients who tested positive for SARS-CoV-2. We hypothesized that individuals with psychiatric disorders would have increased risk of long COVID diagnoses, considering any and specific psychiatric disorders. As long COVID risk may be patterned by age, with mixed evidence of older or middle age increasing risk (Subramanian et al., Reference Subramanian, Nirantharakumar, Hughes, Myles, Williams, Gokhale and Haroon2022; Vincent et al., Reference Vincent, Ofovwe, Gschwandtner, Shergill and Faruqui2022; Zeng et al., Reference Zeng, Zhao, Yan, Li, Lu, Liu and Lu2022), and psychiatric disorder diagnoses tend to be more prevalent among younger v. older veterans (Frueh et al., Reference Frueh, Grubaugh, Acierno, Elhai, Cain and Magruder2007; Seal, Bertenthal, Miner, Sen, & Marmar, Reference Seal, Bertenthal, Miner, Sen and Marmar2007), we performed secondary analyses stratified by age.

Methods

Study participants

This retrospective cohort study included 660 217 individuals who accessed VA healthcare nationwide between 20 February 2020, and 6 February 2023. We restricted to individuals with at least one positive SARS-CoV-2 test recorded in VA clinical notes to assess long COVID in an at-risk population. From 2 288 650 patients who accessed VA healthcare during the study period, 733 455 had a positive SARS-CoV-2 test, 710 860 had at least one VA encounter in the 12 months prior to infection (indicating active healthcare use), 666 449 had a COVID-19 index infection date with at least 90 days of follow-up post-infection (i.e. infected at least 90 days before the end of follow-up; ensuring adequate time to develop long COVID), and 660 217 had complete covariate data. Individuals could have multiple positive SARS-CoV-2 infections; one's first infection reported in VA records was defined as their index infection date. All data came from the VA Corporate Data Warehouse, a database of VA patient administrative and electronic health records (EHR) from inpatient and outpatient facilities, and the VA COVID-19 Shared Data Resource (VA HSR RES 13-457), a database of VA patients with SARS-CoV-2 tests recorded in VA clinical notes. This study was approved by the Committee on Human Research, University of California, San Francisco, and the San Francisco VA Health Care System Human Research Protection Program, and waiver of informed consent was approved for EHR analyses. The authors assert that all procedures contributing to this work comply with the ethical standards of the relevant national and institutional committees on human experimentation and with the Helsinki Declaration of 1975, as revised in 2008.

Measures

Outcome

Long COVID diagnosis was defined as at least two encounters with ICD-10-CM diagnostic code U09.9, ‘Post COVID-19 condition, unspecified’ at any inpatient or outpatient clinical encounter. This operationalization conservatively created a more specific (i.e. fewer false positives) long COVID case measure, and potentially indicated more severe or persistent long COVID sequelae v. a single encounter code.

Primary predictors

Psychiatric disorders included diagnoses of depressive, posttraumatic stress, anxiety, adjustment, alcohol use, substance use, bipolar, psychotic, attention-deficit/hyperactivity (ADHD), dissociative, and eating disorders, identified with ICD-9-CM/ICD-10-CM codes from inpatient or outpatient clinical data in five years preceding the index infection date (Nishimi et al., Reference Nishimi, Neylan, Bertenthal, Seal and O'Donovan2022b). For each individual disorder type, diagnosis was defined as disorder codes from at least two separate encounters (e.g. code F43 for PTSD at two separate encounters), to improve precision and limit misclassification from provisional diagnostic codes (Seal et al., Reference Seal, Bertenthal, Miner, Sen and Marmar2007). We also considered diagnosis of any psychiatric disorder, defined as codes of any psychiatric disorders included from at least two separate encounters (e.g. code F43.1 for PTSD at one encounter and code F33.1 for major depressive disorder (MDD) at another encounter).

Covariates

Socio-demographic covariates included age, sex, and an indicator of combined race and ethnicity. As COVID-19 vaccination may reduce long COVID risk (Al-Aly, Bowe, & Xie, Reference Al-Aly, Bowe and Xie2022), we adjusted for vaccination status as of one's index infection date: unvaccinated (no vaccine shots or less than fully vaccinated), fully vaccinated (completed the full original primary series of two mRNA or one viral vector vaccine), or fully vaccinated and boosted (at least one additional vaccine shot at least 60 days after the primary series). Models also included a random effect of calendar time (quarter of the year starting in Spring 2020 through Spring 2023) at index diagnosis to account for temporal changes in both risk for long COVID across COVID-19 variants (Davis et al., Reference Davis, McCorkell, Vogel and Topol2023) and diagnosis with U09.9 codes over time (McGrath et al., Reference McGrath, Scott, Surinach, Chambers, Benigno and Malhotra2022). Medical comorbidities included obesity (BMI ⩾ 35 closest in time to index infection date) and medical diagnoses in the two years prior to the index infection (see Table 1). Smoking status (current or former smoker, never smoker) was included as behavioral risk factor. All covariates were derived from administrative data or ICD-9-CM/ICD-10-CM codes in EHRs.

Table 1. Distribution of covariates among 660 217 VA patients with positive SARS-CoV-2 tests

COPD, Chronic obstructive pulmonary disease; HIV, Human immunodeficiency virus; VA, U.S. Department of Veteran Affairs.

Analyses

We first examined the distribution of covariates in the sample and by psychiatric disorder. Primary analyses were generalized linear models with Poisson distribution and log link for relative risks (RR) with robust error variance (Zou, Reference Zou2004) for associations between psychiatric diagnoses and long COVID diagnosis. Model 1 adjusted for potential confounders including socio-demographic factors (age [both age and age squared, which best fit the data], sex, race and ethnicity) and time (random effect of calendar quarter). Model 2 additionally adjusted for vaccination status, medical comorbidities, and smoking, which may be confounders or mediators. We examined models for any psychiatric disorder v. none and for each specific individual disorder v. none. To limit imprecise estimates, specific disorder models were only conducted when sample prevalence was ⩾3% (excluding ADHD 2.6%, dissociative disorder 0.4%, and eating disorders 0.4%). To identify whether associations differed by age (Ioannou et al., Reference Ioannou, Baraff, Fox, Shahoumian, Hickok, O'Hare and Hynes2022), secondary analyses included age-stratified models (18-39, 40–64, ⩾65). In sensitivity analyses, we reran models using a more lenient outcome definition, requiring one or more codes of U09.9 at any patient encounter. Lastly, increased healthcare interaction may be associated with higher likelihood of long COVID diagnoses. In additional sensitivity analyses, models adjusted for level of primary care interaction in the year before index infection (0–1, 2–3, 4–6, 7 + primary care visits). Data were prepared with SAS 9.4, analyzed with Stata 17.0, and statistical significance was set a priori at p < 0.05 using two-sided hypothesis tests.

Results

The sample of 660 217 VA patients was 60.1 (s.d. = 16.4) years old on average and 88.0% male (Table 1). Over half (56.3%) the sample had at least one psychiatric disorder diagnosis, which was associated with younger age, female sex, Black or African American race, Hispanic or Latinx ethnicity, vaccination status, and medical comorbidities. The raw prevalence of some medical comorbidities by psychiatric diagnosis was likely confounded by age and therefore departs from prior findings in some cases (e.g. older patients were less likely to have psychiatric diagnoses, but more likely to have cardiovascular disease) (Shen et al., Reference Shen, Mikkelsen, Luitva, Song, Kasela, Aspelund and Valdimarsdóttir2023). By February 2023, 9405 (1.4%) individuals received at least two U09.9 diagnostic codes. As in prior studies (Ioannou et al., Reference Ioannou, Baraff, Fox, Shahoumian, Hickok, O'Hare and Hynes2022), the prevalence of long COVID diagnosis was higher among women (1.8%) v. men (1.4%), and Hispanic or Latinx (3.7%) individuals v. all other racial/ethnic groups (1.0–1.6%). In addition, the prevalence of long COVID diagnosis was higher among middle-aged (40–64 years, 1.8%) and lower among older (older than 65 years, 1.1%) individuals compared to younger adults (18–39 years, 1.5%; RRs = 1.20, 95% CI 1.13–1.27, and 0.73, 95% CI 0.69–0.78, respectively).

Relative to patients with no psychiatric disorders, those with any psychiatric disorder diagnosis had 32% higher risk for a long COVID diagnosis (RR = 1.32, 95% CI 1.24–1.41), adjusting for confounders (Table 2 and Fig. 1). Adjusting for vaccination status, obesity, medical comorbidities, and smoking only slightly attenuated the association (RR = 1.28, 95% CI 1.21–1.35). Most individual psychiatric disorders were associated with elevated risk for long COVID diagnosis, including MDD, PTSD, anxiety, adjustment, and alcohol use disorders. However, bipolar disorder was unassociated with long COVID diagnosis, while substance use and psychotic disorders were associated with lower risk for receiving long COVID diagnoses.

Table 2. Associations between psychiatric disorders and long COVID diagnosis among VA patients with positive SARS-CoV-2 tests, in the full sample and age-stratified

CI, confidence intervals; RR, relative risk; VA, U.S. Department of Veterans Affairs.

Reference group for each model is No Psychiatric Disorders. Outcomes are long COVID diagnosis (U09.9 clinical code at 2 or more encounters).

Model 1: age, age squared, sex, race/ethnicity, and time.

Model 2: Model 1 plus vaccination status, medical comorbidities, and smoking.

Figure 1. Relative risks of long COVID for individual psychiatric disorders among the full sample, confounder adjusted.

Note. RR, relative risk; CI, confidence intervals; reference group for each model is No psychiatric disorders; each individual psychiatric disorder was estimated in a separate model as the primary predictor and adjusted for age, age squared, sex, race/ethnicity, and calendar time of index infection.

In age-stratified models, associations between any psychiatric disorder and several individual disorders (MDD, PTSD, anxiety, adjustment, and alcohol use disorder) with long COVID diagnosis were strongest among younger (age 18–39) patients (Table 2 and Fig. 2). Association for substance use and psychotic disorders varied by age, with both disorders associated with decreased risk of long COVID diagnosis among patients aged 40–64, but unassociated or associated with increased risk in both younger (age 18–39) and older (age ⩾ 65) patients. Associations with bipolar disorder were also patterned by age; bipolar disorder was unassociated with long COVID diagnosis in younger (age < 65) patients, but associated with increased risk in older (age ⩾ 65) patients.

Figure 2. Relative risks of long COVID for individual psychiatric disorders stratified by age, confounder adjusted.

Note. RR = relative risk; CI = confidence intervals; reference group for each model is No psychiatric disorders; each individual psychiatric disorder was estimated in a separate model as the primary predictor and adjusted for age, age squared, sex, race/ethnicity, and calendar time of index infection.

In sensitivity analyses using one or more U09.9 codes, a larger proportion of individuals were classified as having long COVID diagnosis (n = 22 250, 3.4%). Associations were in similar directions but smaller in magnitude compared to primary models (online Supplemental Table S1). When adjusting for level of primary care interaction prior to SARS-CoV-2 infection, estimates were attenuated slightly but most primary findings remained the same (online Supplemental Table 2).

Discussion

Among 660 217 VA patients in this retrospective cohort study, diagnosis of any psychiatric disorder was associated with 32% increased risk for long COVID diagnosis. This association was robust to adjustment for socio-demographics, vaccination, medical conditions, and behavioral factors, and was strongest among younger adults (age 18–39). While individuals with psychiatric disorders appeared to be at increased risk for long COVID diagnoses overall, associations were strongest among younger adults and those with depressive, anxiety, and stress-related conditions. In contrast, individuals with substance use, bipolar, and psychotic disorders had similar or lower risk for long COVID diagnoses than those with no pre-existing psychiatric disorders.

Consistent with our hypotheses, having any pre-existing psychiatric disorder was associated with elevated risk for long COVID diagnosis. Our findings align with a recent meta-analysis that linked depression and/or anxiety with higher risk for long COVID (Tsampasian et al., Reference Tsampasian, Elghazaly, Chattopadhyay, Debski, Naing, Garg and Vassiliou2023), and with other studies associating any psychiatric disorder with increases in U09.9 codes (Hedberg et al., Reference Hedberg, Granath, Bruchfeld, Askling, Sjöholm, Fored and Naucler2023; Thompson et al., Reference Thompson, Williams, Walker, Mitchell, Niedzwiedz, Yang and Steves2022). No prior studies examined whether associations of psychiatric disorders with risk for long COVID differed by age. We found differences in age-stratified analyses, with associations between psychiatric disorders and long COVID diagnosis tending to be strongest among younger (age 18–39) relative to older individuals. Pre-existing psychiatric conditions may be more robustly associated with risk for diagnoses of long COVID among younger adults who are at generally lower risk for physical health problems and comorbid conditions that could mask long COVID. Our current analyses extend the evidence base by focusing on psychiatric disorders explicitly (e.g. including multiple different diagnoses and examining individual disorder effects), including a sample with high psychiatric burden, and focusing on a population at high risk for long COVID by nature of age and comorbidity.

Several individual psychiatric disorders were associated with long COVID diagnosis risk in our study, including MDD, PTSD, anxiety, adjustment, and alcohol use disorder. These disorders share several symptoms related to somatization (sleep disturbance or fatigue) and cognitive impairment, which are also common long COVID symptoms. Among individuals with pre-existing psychiatric disorders, these symptoms could have developed or worsened following COVID-19 illness. Therefore, individuals with psychiatric conditions may have been misdiagnosed as having long COVID based on psychiatric symptoms alone. However, it is also possible that individuals with pre-existing psychiatric diagnoses are less likely to receive long COVID diagnoses because symptoms are attributed to their pre-existing disorders and not to long COVID. Our findings are generally consistent with prior studies assessing ‘any psychiatric disorder’ and some specific disorders, and including a study of PTSD and adjustment disorders with risk for long COVID (Kostev, Smith, Koyanagi, & Jacob, Reference Kostev, Smith, Koyanagi and Jacob2022), but are inconsistent with another VA study (Ioannou et al., Reference Ioannou, Baraff, Fox, Shahoumian, Hickok, O'Hare and Hynes2022). Contradicting findings may be due to different ‘long COVID’ definitions (our definition of multiple U09.9 encounters v. any of four codes related to COVID-19 three months after infection) or study time period (our study included follow-up through February 2023 v. December 2021).

Notably, diagnoses of substance use or psychotic disorders were associated with lower risk for receiving a long COVID diagnosis in our study, consistent with one other case–control study (Hill et al., Reference Hill, Mehta, Sharma, Mane, Singh and Xie2023), and bipolar disorder was unassociated with long COVID risk. These findings are surprising, given prior work indicating that substance use, bipolar, and psychotic disorders are linked with more severe COVID-19 outcomes (Nishimi et al., Reference Nishimi, Neylan, Bertenthal, Dolsen, Seal and O'Donovan2022a; Vai et al., Reference Vai, Mazza, Colli, Foiselle, Allen, Benedetti and Picker2021). One possibility is that some drugs prescribed for psychotic disorders (e.g. second-generation antipsychotics) could be protective against severe COVID-19 outcomes (Poletti et al., Reference Poletti, Vai, Mazza, Zanardi, Lorenzi, Calesella and Benedetti2021). Another possibility is that individuals with substance use, bipolar, or psychotic disorders are less engaged in primary care relative to other disorders, thus fail to have long COVID diagnosed. However, when adjusting for primary care utilization, our associations for these conditions were largely unaffected. Clinicians may also exhibit biases in diagnostic practices, such that they are less likely to attribute non-specific symptoms to long COVID among individuals with substance use, bipolar, or psychotic disorders. Additionally, individuals with these disorders may be unable to self-report long COVID symptoms (e.g. due to masking by complications of the disorder or drug use) or clinicians may mistake symptoms for side effects of medications or non-prescription drugs. Overall, accumulating data indicates that long COVID could be underdiagnosed among individuals with substance use, bipolar, and psychotic disorders. More research should examine potential risk for long COVID manifestations among individuals with these disorders, applying alterative study designs and measures beyond naturalistic clinical diagnoses in EHRs.

Several potential mechanisms may underly associations between psychiatric disorders and long COVID. Most psychiatric conditions are characterized by physiological dysregulations in stress-response systems, chronic low-grade inflammation, and alterations in immune markers (Gibney & Drexhage, Reference Gibney and Drexhage2013; Yuan, Chen, Xia, Dai, & Liu, Reference Yuan, Chen, Xia, Dai and Liu2019). While precise pathogenic mechanisms of long COVID are unclear, hypothesized processes include organ damage, persistent viral reservoirs, reactivation of latent virus, immune dysfunction or autoimmunity, clotting and endothelial abnormality, or microbiota dysbiosis (Altmann, Whettlock, Liu, Arachchillage, & Boyton, Reference Altmann, Whettlock, Liu, Arachchillage and Boyton2023; Davis et al., Reference Davis, McCorkell, Vogel and Topol2023). Several of these systems are altered in individuals with psychiatric conditions, which could predispose them to developing long COVID (Davis et al., Reference Davis, McCorkell, Vogel and Topol2023). Individuals with psychiatric disorders may also exhibit behavioral patterns that increase risk for poor COVID-19 sequelae and long COVID, including smoking, less healthy diet, and poor sleep quality, or have related risk factors such as obesity (Allison et al., Reference Allison, Newcomer, Dunn, Blumenthal, Fabricatore, Daumit and Alpert2009; Chwastiak, Rosenheck, & Kazis, Reference Chwastiak, Rosenheck and Kazis2011). While individuals with and without psychiatric conditions appear to accept vaccination at similar rates (Haderlein, Steers, & Dobalian, Reference Haderlein, Steers and Dobalian2022), and individuals with any psychiatric disorder diagnosis were slightly more likely to be vaccinated in the current study, psychiatric diagnoses may be associated with less robust immune response to vaccination (Xiao et al., Reference Xiao, Gillissie, Lui, Ceban, Teopiz, Gill and McIntyre2022), which could influence vaccination effectiveness and long COVID risk (Byambasuren, Stehlik, Clark, Alcorn, & Glasziou, Reference Byambasuren, Stehlik, Clark, Alcorn and Glasziou2023). Psychosocial factors, spanning healthcare access, social support, and living conditions, may also influence long COVID sequalae in individuals with psychiatric conditions (Bradford et al., Reference Bradford, Kim, Braxton, Marx, Butterfield and Elbogen2008; Sally Rogers et al., Reference Sally Rogers, Anthony and Lyass2004). Psychosocial factors may have complex impacts; for example, individuals with psychiatric disorders may interact more with the healthcare system and thus be more likely to have long COVID detected. In contrast, psychiatric symptoms and comorbidities overlap with long COVID symptoms, which may mask long COVID or make physicians less likely to attribute new onset symptoms to long COVID. Future work should examine biological mechanisms, and explore varied biological, behavioral, and psychosocial influences of long COVID risk.

There are several important limitations to the current study. First, there are inherent challenges in using EHRs for studying long COVID (Zhang et al., Reference Zhang, Honerlaw, Maripuri, Samayamuthu, Beaulieu-Jones, Baig and Brat2023a). There is ambiguity and heterogeneity in diagnostic codes, and we are likely underestimating long COVID cases by relying on U09.9 codes. However, adjustment for calendar time was used to account for differences in both prevalence and change in diagnostic code use over time. Moreover, patterns of long COVID diagnoses are important to consider even independent from the true occurrence of the disorder in the population. Second, diagnostic codes do not capture severity or constellation of long COVID symptoms. We defined the primary outcome as U09.9 codes at two or more encounters, to limit misclassification and potentially indicate more severe or chronic cases. Sensitivity analyses with one or more U09.9 codes indicated similar but weaker associations with psychiatric disorders. Third, the analytic sample included only VA patients with positive SARS-CoV-2 tests in VA clinical records, therefore we are likely excluding other at-risk patients who had COVID-19 that was not recorded at the VA. However, our inclusion restrictions helped to ensure our sample was at risk for long COVID and active in VA care, thus could feasibly have presented with long COVID in VA facilities. Fourth, all data was derived from VA health records, which are limited in terms of detailed demographic, socio-economic, or other confounder information, and includes diagnostic codes that may be imprecise or result in misclassification. Finally, generalizability beyond the sample may be limited, given the majority male sample of only VA patients.

We found that a diagnosis of any psychiatric disorder was associated with increased risk for long COVID diagnosis. Depressive, anxiety, and stress-related disorders were particularly robust risk factors for long COVID diagnosis, and associations were strongest among younger adults. In contrast, substance use and psychotic disorders were associated with lower risk for long COVID diagnoses and bipolar disorder was unassociated with risk, which could indicate missed long COVID diagnoses in individuals with some psychiatric disorders. In sum, understanding risk for long COVID among patients with psychiatric disorders requires consideration of age and specific psychiatric disorder type. Guidelines for diagnosing long COVID may need to be tailored for patients with psychiatric disorders.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/S0033291724000114

Acknowledgements

We acknowledge the efforts of all the contributors to the Veterans Affairs Corporate Data Warehouse and COVID-19 Shared Data Resource (HSR RES 13-457), enabling critical research on the impact of the COVID-19 pandemic in a timely and comprehensive manner. We are grateful to the Veterans for their service.

Funding statement

This work was supported by the Department of Veterans Affairs Office of Academic Affiliations Advanced Fellowship Program in Mental Illness Research and Treatment, the Medical Research Service of the SFVAHCS, and the Department of Veterans Affairs Sierra-Pacific Mental Illness Research, Education, and Clinical Center (MIRECC), the VA Office of Research and Development (KN; IK2CX 002627); the VA Sierra-Pacific MIRECC (DB); UCSF Department of Psychiatry Rapid Award, and UCSF Faculty Resource Fund Award (AOD). The funders had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication. The authors declare no competing interests.

References

Al-Aly, Z., Bowe, B., & Xie, Y. (2022). Long COVID after breakthrough SARS-CoV-2 infection. Nature Medicine, 28, 14611467. https://doi.org/10.1038/s41591-022-01840-0CrossRefGoogle ScholarPubMed
Allison, D. B., Newcomer, J. W., Dunn, A. L., Blumenthal, J. A., Fabricatore, A. N., Daumit, G. L., … Alpert, J. E. (2009). Obesity among those with mental disorders: A national institute of mental health meeting report. American Journal of Preventive Medicine, 36, 341350. https://doi.org/10.1016/j.amepre.2008.11.020CrossRefGoogle ScholarPubMed
Altmann, D. M., Whettlock, E. M., Liu, S., Arachchillage, D. J., & Boyton, R. J. (2023). The immunology of long COVID. Nature Reviews Immunology, 23, 618634. https://doi.org/10.1038/s41577-023-00904-7CrossRefGoogle ScholarPubMed
Ballering, A. V., van Zon, S. K. R., olde Hartman, T. C., & Rosmalen, J. G. M. (2022). Persistence of somatic symptoms after COVID-19 in the Netherlands: An observational cohort study. The Lancet, 400, 452461. https://doi.org/10.1016/S0140-6736(22)01214-4CrossRefGoogle ScholarPubMed
Ballouz, T., Menges, D., Anagnostopoulos, A., Domenghino, A., Aschmann, H. E., Frei, A., … Puhan, M. A. (2023). Recovery and symptom trajectories up to two years after SARS-CoV-2 infection: Population based, longitudinal cohort study. BMJ, 381, e074425. https://doi.org/10.1136/bmj-2022-074425CrossRefGoogle ScholarPubMed
Bradford, D. W., Kim, M. M., Braxton, L. E., Marx, C. E., Butterfield, M., & Elbogen, E. B. (2008). Access to medical care among persons with psychotic and major affective disorders. Psychiatric Services, 59, 847852. https://doi.org/10.1176/ps.2008.59.8.847CrossRefGoogle ScholarPubMed
Bull-Otterson, L. (2022). Post–COVID conditions among adult COVID-19 survivors aged 18–64 and ⩾65 years – United States, march 2020–November 2021. Morbidity and Mortality Weekly Report, 71, 713717. https://doi.org/10.15585/mmwr.mm7121e1CrossRefGoogle Scholar
Byambasuren, O., Stehlik, P., Clark, J., Alcorn, K., & Glasziou, P. (2023). Effect of COVID-19 vaccination on long COVID: Systematic review. BMJ Medicine, 2, e000385. https://doi.org/10.1136/bmjmed-2022-000385CrossRefGoogle ScholarPubMed
Bygdell, M., Leach, S., Lundberg, L., Gyll, D., Martikainen, J., Santosa, A., … Nyberg, F. (2023). A comprehensive characterization of patients diagnosed with post-COVID-19 condition in Sweden 16 months after the introduction of the international classification of diseases tenth revision diagnosis code (U09.9): A population-based cohort study. International Journal of Infectious Diseases, 126, 104113. https://doi.org/10.1016/j.ijid.2022.11.021CrossRefGoogle ScholarPubMed
Castanares-Zapatero, D., Chalon, P., Kohn, L., Dauvrin, M., Detollenaere, J., Maertens de Noordhout, C., … Van den Heede, K. (2022). Pathophysiology and mechanism of long COVID: A comprehensive review. Annals of Medicine, 54, 14731487. https://doi.org/10.1080/07853890.2022.2076901CrossRefGoogle ScholarPubMed
Chen, C., Haupert, S. R., Zimmermann, L., Shi, X., Fritsche, L. G., & Mukherjee, B. (2022). Global prevalence of post-coronavirus disease 2019 (COVID-19) condition or long COVID: A meta-analysis and systematic review. The Journal of Infectious Diseases, 226, 15931607. https://doi.org/10.1093/infdis/jiac136CrossRefGoogle ScholarPubMed
Choutka, J., Jansari, V., Hornig, M., & Iwasaki, A. (2022). Unexplained post-acute infection syndromes. Nature Medicine, 28, 911923. https://doi.org/10.1038/s41591-022-01810-6CrossRefGoogle ScholarPubMed
Chwastiak, L. A., Rosenheck, R. A., & Kazis, L. E. (2011). Association of psychiatric illness and obesity, physical inactivity, and smoking among a national sample of veterans. Psychosomatics, 52, 230236. https://doi.org/10.1016/j.psym.2010.12.009CrossRefGoogle ScholarPubMed
Davis, H. E., McCorkell, L., Vogel, J. M., & Topol, E. J. (2023). Long COVID: Major findings, mechanisms and recommendations. Nature Reviews Microbiology, 21, 133146. https://doi.org/10.1038/s41579-022-00846-2CrossRefGoogle ScholarPubMed
Frueh, B. C., Grubaugh, A. L., Acierno, R., Elhai, J. D., Cain, G., & Magruder, K. M. (2007). Age differences in posttraumatic stress disorder, psychiatric disorders, and healthcare service use among veterans in veterans affairs primary care clinics. The American Journal of Geriatric Psychiatry, 15, 660672. https://doi.org/10.1097/01.JGP.0000260855.42209.31CrossRefGoogle ScholarPubMed
Gibney, S. M., & Drexhage, H. A. (2013). Evidence for a dysregulated immune system in the etiology of psychiatric disorders. Journal of Neuroimmune Pharmacology, 8, 900920. https://doi.org/10.1007/s11481-013-9462-8CrossRefGoogle ScholarPubMed
Haderlein, T. P., Steers, W. N., & Dobalian, A. (2022). Serious mental illness diagnosis and COVID-19 vaccine uptake in the veterans health administration. Psychiatric Services, 73, 918921. https://doi.org/10.1176/appi.ps.202100499CrossRefGoogle ScholarPubMed
Hedberg, P., Granath, F., Bruchfeld, J., Askling, J., Sjöholm, D., Fored, M., … Naucler, P. (2023). Post COVID-19 condition diagnosis: A population-based cohort study of occurrence, associated factors, and healthcare use by severity of acute infection. Journal of Internal Medicine, 293, 246258. https://doi.org/10.1111/joim.13584CrossRefGoogle ScholarPubMed
Hill, E., Mehta, H., Sharma, S., Mane, K., Singh, S. K., Xie, C., … RECOVER Consortium. (2023). Risk factors associated with post-acute sequelae of SARS-CoV-2: An N3C and NIH RECOVER study. BMC Public Health, 23, 2103. https://doi.org/10.1186/s12889-023-16916-wCrossRefGoogle ScholarPubMed
Ioannou, G. N., Baraff, A., Fox, A., Shahoumian, T., Hickok, A., O'Hare, A. M., … Hynes, D. M. (2022). Rates and factors associated with documentation of diagnostic codes for long COVID in the national veterans affairs health care system. JAMA Network Open, 5, e2224359. https://doi.org/10.1001/jamanetworkopen.2022.24359CrossRefGoogle ScholarPubMed
Kostev, K., Smith, L., Koyanagi, A., & Jacob, L. (2022). Prevalence of and factors associated with post-coronavirus disease 2019 (COVID-19) condition in the 12 months after the diagnosis of COVID-19 in adults followed in general practices in Germany. Open Forum Infectious Diseases, 9, ofac333. https://doi.org/10.1093/ofid/ofac333CrossRefGoogle ScholarPubMed
Krantz, D. S., Shank, L. M., & Goodie, J. L. (2022). Post-traumatic stress disorder (PTSD) as a systemic disorder: Pathways to cardiovascular disease. Health Psychology, 41, 651662. https://doi.org/10.1037/hea0001127CrossRefGoogle ScholarPubMed
Liu, L., Ni, S.-Y., Yan, W., Lu, Q.-D., Zhao, Y.-M., Xu, Y.-Y., … Lu, L. (2021). Mental and neurological disorders and risk of COVID-19 susceptibility, illness severity and mortality: A systematic review, meta-analysis and call for action. EClinicalMedicine, 40, 101111. https://doi.org/10.1016/j.eclinm.2021.101111CrossRefGoogle ScholarPubMed
McGrath, L. J., Scott, A. M., Surinach, A., Chambers, R., Benigno, M., & Malhotra, D. (2022). Use of the postacute sequelae of COVID-19 diagnosis code in routine clinical practice in the US. JAMA Network Open, 5, e2235089. https://doi.org/10.1001/jamanetworkopen.2022.35089CrossRefGoogle ScholarPubMed
Momen, N. C., Plana-Ripoll, O., Agerbo, E., Benros, M. E., Børglum, A. D., Christensen, M. K., … McGrath, J. J. (2020). Association between mental disorders and subsequent medical conditions. New England Journal of Medicine, 382, 17211731. https://doi.org/10.1056/NEJMoa1915784CrossRefGoogle ScholarPubMed
Nishimi, K., Neylan, T. C., Bertenthal, D., Dolsen, E. A., Seal, K. H., & O'Donovan, A. (2022a). Post-traumatic stress disorder and risk for hospitalization and death following COVID-19 infection. Translational Psychiatry, 12, 482. https://doi.org/10.1038/s41398-022-02156-wCrossRefGoogle ScholarPubMed
Nishimi, K., Neylan, T. C., Bertenthal, D., Seal, K. H., & O'Donovan, A. (2022b). Association of psychiatric disorders with incidence of SARS-CoV-2 breakthrough infection among vaccinated adults. JAMA Network Open, 5, e227287. https://doi.org/10.1001/jamanetworkopen.2022.7287CrossRefGoogle ScholarPubMed
O'Donovan, A., Cohen, B. E., Seal, K. H., Bertenthal, D., Margaretten, M., Nishimi, K., & Neylan, T. C. (2015). Elevated risk for autoimmune disorders in Iraq and Afghanistan veterans with posttraumatic stress disorder. Biological Psychiatry, 77, 365374. https://doi.org/10.1016/j.biopsych.2014.06.015CrossRefGoogle ScholarPubMed
O'Mahoney, L. L., Routen, A., Gillies, C., Ekezie, W., Welford, A., Zhang, A., … Khunti, K. (2023). The prevalence and long-term health effects of long COVID among hospitalised and non-hospitalised populations: A systematic review and meta-analysis. eClinicalMedicine, 55, 101762. https://doi.org/10.1016/j.eclinm.2022.101762CrossRefGoogle ScholarPubMed
Poletti, S., Vai, B., Mazza, M. G., Zanardi, R., Lorenzi, C., Calesella, F., … Benedetti, F. (2021). A peripheral inflammatory signature discriminates bipolar from unipolar depression: A machine learning approach. Progress in Neuro-Psychopharmacology & Biological Psychiatry, 105, 110136. https://doi.org/10.1016/j.pnpbp.2020.110136CrossRefGoogle ScholarPubMed
Sally Rogers, E., Anthony, W., & Lyass, A. (2004). The nature and dimensions of social support among individuals with severe mental illnesses. Community Mental Health Journal, 40, 437450. https://doi.org/10.1023/B:COMH.0000040657.48759.0eCrossRefGoogle Scholar
Seal, K. H., Bertenthal, D., Miner, C. R., Sen, S., & Marmar, C. (2007). Bringing the war back home: Mental health disorders among 103,788 US veterans returning from Iraq and Afghanistan seen at department of veterans affairs facilities. Archives of Internal Medicine, 167, 476482. https://doi.org/10.1001/archinte.167.5.476CrossRefGoogle Scholar
Shen, Q., Mikkelsen, D. H., Luitva, L. B., Song, H., Kasela, S., Aspelund, T., … Valdimarsdóttir, U. (2023). Psychiatric disorders and subsequent risk of cardiovascular disease: A longitudinal matched cohort study across three countries. eClinicalMedicine, 61, 102063. https://doi.org/10.1016/j.eclinm.2023.102063CrossRefGoogle ScholarPubMed
Soriano, J. B., Murthy, S., Marshall, J. C., Relan, P., & Diaz, J. V. (2022). A clinical case definition of post-COVID-19 condition by a Delphi consensus. The Lancet Infectious Diseases, 22, e102e107. https://doi.org/10.1016/S1473-3099(21)00703-9CrossRefGoogle ScholarPubMed
Subramanian, A., Nirantharakumar, K., Hughes, S., Myles, P., Williams, T., Gokhale, K. M., … Haroon, S. (2022). Symptoms and risk factors for long COVID in non-hospitalized adults. Nature Medicine, 28, Article 8. https://doi.org/10.1038/s41591-022-01909-wCrossRefGoogle ScholarPubMed
Thaweethai, T., Jolley, S. E., Karlson, E. W., Levitan, E. B., Levy, B., McComsey, G. A., … RECOVER Consortium. (2023). Development of a definition of postacute sequelae of SARS-CoV-2 infection. JAMA, 329, 19341946. https://doi.org/10.1001/jama.2023.8823CrossRefGoogle ScholarPubMed
Thompson, E. J., Williams, D. M., Walker, A. J., Mitchell, R. E., Niedzwiedz, C. L., Yang, T. C., … Steves, C. J. (2022). Long COVID burden and risk factors in 10 UK longitudinal studies and electronic health records. Nature Communications, 13, 3582. https://doi.org/10.1038/s41467-022-30836-0CrossRefGoogle ScholarPubMed
Tsampasian, V., Elghazaly, H., Chattopadhyay, R., Debski, M., Naing, T. K. P., Garg, P., … Vassiliou, V. S. (2023). Risk factors associated with post − COVID-19 condition: A systematic review and meta-analysis. JAMA Internal Medicine, 183, 566580. https://doi.org/10.1001/jamainternmed.2023.0750CrossRefGoogle ScholarPubMed
Vai, B., Mazza, M. G., Colli, C. D., Foiselle, M., Allen, B., Benedetti, F., … Picker, L. J. D. (2021). Mental disorders and risk of COVID-19-related mortality, hospitalisation, and intensive care unit admission: A systematic review and meta-analysis. The Lancet Psychiatry, 8, 797812. https://doi.org/10.1016/S2215-0366(21)00232-7CrossRefGoogle ScholarPubMed
Vancampfort, D., Stubbs, B., Mitchell, A. J., De Hert, M., Wampers, M., Ward, P. B., … Correll, C. U. (2015). Risk of metabolic syndrome and its components in people with schizophrenia and related psychotic disorders, bipolar disorder and major depressive disorder: A systematic review and meta-analysis. World Psychiatry, 14, 339347. https://doi.org/10.1002/wps.20252CrossRefGoogle ScholarPubMed
Vincent, A., Ofovwe, O., Gschwandtner, M., Shergill, S., & Faruqui, R. (2022). Psychiatric, neurophysical and neurocognitive sequelae of post-acute COVID-19 syndrome: A systematic review. BJPsych Open, 8, S77. https://doi.org/10.1192/bjo.2022.256CrossRefGoogle Scholar
Xiao, K., Gillissie, E. S., Lui, L. M. W., Ceban, F., Teopiz, K. M., Gill, H., … McIntyre, R. S. (2022). Immune response to vaccination in adults with mental disorders: A systematic review. Journal of Affective Disorders, 304, 6677. https://doi.org/10.1016/j.jad.2022.02.025CrossRefGoogle ScholarPubMed
Xie, Y., Bowe, B., & Al-Aly, Z. (2021). Burdens of post-acute sequelae of COVID-19 by severity of acute infection, demographics and health status. Nature Communications, 12, 6571. https://doi.org/10.1038/s41467-021-26513-3CrossRefGoogle ScholarPubMed
Yuan, N., Chen, Y., Xia, Y., Dai, J., & Liu, C. (2019). Inflammation-related biomarkers in major psychiatric disorders: A cross-disorder assessment of reproducibility and specificity in 43 meta-analyses. Translational Psychiatry, 9, 233. https://doi.org/10.1038/s41398-019-0570-yCrossRefGoogle ScholarPubMed
Zeng, N., Zhao, Y.-M., Yan, W., Li, C., Lu, Q.-D., Liu, L., … Lu, L. (2022). A systematic review and meta-analysis of long term physical and mental sequelae of COVID-19 pandemic: Call for research priority and action. Molecular Psychiatry, 28, 423433. https://doi.org/10.1038/s41380-022-01614-7CrossRefGoogle ScholarPubMed
Zhang, H. G., Honerlaw, J. P., Maripuri, M., Samayamuthu, M. J., Beaulieu-Jones, B. R., Baig, H. S., … Brat, G. A. (2023a). Potential pitfalls in the use of real-world data for studying long COVID. Nature Medicine, 29, 10401043. https://doi.org/10.1038/s41591-023-02274-yCrossRefGoogle ScholarPubMed
Zhang, Y., Wang, J., Ye, Y., Zou, Y., Chen, W., Wang, Z., & Zou, Z. (2023b). Peripheral cytokine levels across psychiatric disorders: A systematic review and network meta-analysis. Progress in Neuro-Psychopharmacology and Biological Psychiatry, 125, 110740. https://doi.org/10.1016/j.pnpbp.2023.110740CrossRefGoogle ScholarPubMed
Zou, G. (2004). A modified Poisson regression approach to prospective studies with binary data. American Journal of Epidemiology, 159, 702706. https://doi.org/10.1093/aje/kwh090CrossRefGoogle ScholarPubMed
Figure 0

Table 1. Distribution of covariates among 660 217 VA patients with positive SARS-CoV-2 tests

Figure 1

Table 2. Associations between psychiatric disorders and long COVID diagnosis among VA patients with positive SARS-CoV-2 tests, in the full sample and age-stratified

Figure 2

Figure 1. Relative risks of long COVID for individual psychiatric disorders among the full sample, confounder adjusted.Note. RR, relative risk; CI, confidence intervals; reference group for each model is No psychiatric disorders; each individual psychiatric disorder was estimated in a separate model as the primary predictor and adjusted for age, age squared, sex, race/ethnicity, and calendar time of index infection.

Figure 3

Figure 2. Relative risks of long COVID for individual psychiatric disorders stratified by age, confounder adjusted.Note. RR = relative risk; CI = confidence intervals; reference group for each model is No psychiatric disorders; each individual psychiatric disorder was estimated in a separate model as the primary predictor and adjusted for age, age squared, sex, race/ethnicity, and calendar time of index infection.

Supplementary material: File

Nishimi et al. supplementary material

Nishimi et al. supplementary material
Download Nishimi et al. supplementary material(File)
File 72.6 KB