Hostname: page-component-78c5997874-xbtfd Total loading time: 0 Render date: 2024-11-13T01:58:46.218Z Has data issue: false hasContentIssue false

Modulation of the functional connectome in major depressive disorder by ketamine therapy

Published online by Cambridge University Press:  03 December 2020

Ashish K. Sahib*
Affiliation:
Department of Neurology, Ahmanson-Lovelace Brain Mapping Center, University of California Los Angeles, Los Angeles, CA, USA
Joana R. Loureiro
Affiliation:
Department of Neurology, Ahmanson-Lovelace Brain Mapping Center, University of California Los Angeles, Los Angeles, CA, USA
Megha Vasavada
Affiliation:
Department of Neurology, Ahmanson-Lovelace Brain Mapping Center, University of California Los Angeles, Los Angeles, CA, USA
Cole Anderson
Affiliation:
Department of Neurology, Ahmanson-Lovelace Brain Mapping Center, University of California Los Angeles, Los Angeles, CA, USA
Antoni Kubicki
Affiliation:
Department of Neurology, Ahmanson-Lovelace Brain Mapping Center, University of California Los Angeles, Los Angeles, CA, USA
Benjamin Wade
Affiliation:
Department of Neurology, Ahmanson-Lovelace Brain Mapping Center, University of California Los Angeles, Los Angeles, CA, USA
Shantanu H. Joshi
Affiliation:
Department of Neurology, Ahmanson-Lovelace Brain Mapping Center, University of California Los Angeles, Los Angeles, CA, USA
Roger P. Woods
Affiliation:
Department of Neurology, Ahmanson-Lovelace Brain Mapping Center, University of California Los Angeles, Los Angeles, CA, USA Department of Psychiatry and Biobehavioral Sciences, University of California Los Angeles, Los Angeles, CA, USA
Eliza Congdon
Affiliation:
Department of Psychiatry and Biobehavioral Sciences, University of California Los Angeles, Los Angeles, CA, USA
Randall Espinoza
Affiliation:
Department of Psychiatry and Biobehavioral Sciences, University of California Los Angeles, Los Angeles, CA, USA
Katherine L. Narr
Affiliation:
Department of Neurology, Ahmanson-Lovelace Brain Mapping Center, University of California Los Angeles, Los Angeles, CA, USA Department of Psychiatry and Biobehavioral Sciences, University of California Los Angeles, Los Angeles, CA, USA
*
Author for correspondence: Ashish K. Sahib, E-mail: asahib@g.ucla.edu
Rights & Permissions [Opens in a new window]

Abstract

Background

Subanesthetic ketamine infusion therapy can produce fast-acting antidepressant effects in patients with major depression. How single and repeated ketamine treatment modulates the whole-brain functional connectome to affect clinical outcomes remains uncharacterized.

Methods

Data-driven whole brain functional connectivity (FC) analysis was used to identify the functional connections modified by ketamine treatment in patients with major depressive disorder (MDD). MDD patients (N = 61, mean age = 38, 19 women) completed baseline resting-state (RS) functional magnetic resonance imaging and depression symptom scales. Of these patients, n = 48 and n = 51, completed the same assessments 24 h after receiving one and four 0.5 mg/kg intravenous ketamine infusions. Healthy controls (HC) (n = 40, 24 women) completed baseline assessments with no intervention. Analysis of RS FC addressed effects of diagnosis, time, and remitter status.

Results

Significant differences (p < 0.05, corrected) in RS FC were observed between HC and MDD at baseline in the somatomotor network and between association and default mode networks. These disruptions in FC in MDD patients trended toward control patterns with ketamine treatment. Furthermore, following serial ketamine infusions, significant decreases in FC were observed between the cerebellum and salience network (SN) (p < 0.05, corrected). Patient remitters showed increased FC between the cerebellum and the striatum prior to treatment that decreased following treatment, whereas non-remitters showed the opposite pattern.

Conclusion

Results support that ketamine treatment leads to neurofunctional plasticity between distinct neural networks that are shown as disrupted in MDD patients. Cortico-striatal-cerebellar loops that encompass the SN could be a potential biomarker for ketamine treatment.

Type
Original Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
Copyright © The Author(s), 2020. Published by Cambridge University Press

Introduction

Pharmacotherapies remain the first line of treatment for major depressive disorder (MDD). However, these medications can take several weeks or longer to be effective (Rush et al., Reference Rush, Trivedi, Wisniewski, Nierenberg, Stewart, Warden and Fava2006) and a third of patients, defined as having treatment resistant depression, will remain refractory to two or more treatment trials (Gaynes et al., Reference Gaynes, Warden, Trivedi, Wisniewski, Fava and Rush2009; Nemeroff, Reference Nemeroff2007). Over the past decade, ketamine has been identified as a rapidly acting antidepressant (Murrough et al., Reference Murrough, Collins, Fields, DeWilde, Phillips, Mathew and Iosifescu2015; Zarate et al., Reference Zarate, Singh, Carlson, Brutsche, Ameli, Luckenbaugh and Manji2006), with robust therapeutic effects occurring within a day of a single infusion in patients with MDD (aan het Rot et al., Reference aan het Rot, Collins, Murrough, Perez, Reich, Charney and Mathew2010; Mathew et al., Reference Mathew, Murrough, aan het Rot, Collins, Reich and Charney2010; Murrough et al., Reference Murrough, Perez, Pillemer, Stern, Parides, aan het Rot and Iosifescu2013). Ketamine is thought to exert its antidepressant effect through N-methyl-d-aspartate (NMDA) receptor antagonism (Berman et al., Reference Berman, Cappiello, Anand, Oren, Heninger, Charney and Krystal2000; Zarate et al., Reference Zarate, Mathews, Ibrahim, Chaves, Marquardt, Ukoh and Luckenbaugh2013) α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid modulation, and/or via involvement of opiate receptors or other neurotransmitter systems (Kraus et al., Reference Kraus, Wasserman, Henter, Acevedo-Diaz, Kadriu and Zarate2019; Kubicki et al., Reference Kubicki, Leaver, Vasavada, Njau, Wade, Joshi and Narr2019). Accordingly, the molecular and cellular mechanisms of ketamine's antidepressant action remain under investigation. Furthermore, since most existing studies of the systems-level neurofunctional effects of ketamine (Evans et al., Reference Evans, Szczepanik, Brutsche, Park, Nugent and Zarate2018; Reed et al., Reference Reed, Nugent, Furey, Szczepanik, Evans and Zarate2018) have examined single infusion only, whether repeated administration of ketamine engages the same or additional functional brain networks is not known.

MDD is characterized by dysfunctional social, emotional, and reward-based processing, with resultant disruptions in mood, anhedonia (reduced capacity to experience pleasure), and impaired cognitive functioning (Diener et al., Reference Diener, Kuehner, Brusniak, Ubl, Wessa and Flor2012; Gotlib & Joormann, Reference Gotlib and Joormann2010). Resting state (RS) networks using functional magnetic resonance imaging (fMRI) have been well studied in MDD (Greicius et al., Reference Greicius, Flores, Menon, Glover, Solvason, Kenna and Schatzberg2007; Kaiser, Andrews-Hanna, Wager, & Pizzagalli, Reference Kaiser, Andrews-Hanna, Wager and Pizzagalli2015). Prior research has largely focused on the default mode network (DMN), which is most active at rest and is involved in self-referential processing and rumination (Hamilton, Farmer, Fogelman, and Gotlib, Reference Hamilton, Farmer, Fogelman and Gotlib2015). However, disturbances in other networks such as salience and cognitive control networks are also reported and proposed to explain depressive symptomology in MDD (Hamilton et al., Reference Hamilton, Farmer, Fogelman and Gotlib2015; Murrough et al., Reference Murrough, Collins, Fields, DeWilde, Phillips, Mathew and Iosifescu2015). Studies that have investigated RS-fMRI changes 24 h post ketamine infusion in MDD have also shown changes in salience and executive control network, suggesting that ketamine normalizes MDD-related dysfunction in these networks (Evans et al., Reference Evans, Szczepanik, Brutsche, Park, Nugent and Zarate2018; Reed et al., Reference Reed, Nugent, Furey, Szczepanik, Evans and Zarate2018). However, of note, earlier RS-fMRI studies of ketamine have primarily employed seed-based approaches, which only consider a subset of functional brain networks (Anand, Li, Wang, Gardner, & Lowe, Reference Anand, Li, Wang, Gardner and Lowe2007; Posner et al., Reference Posner, Hellerstein, Gat, Mechling, Klahr, Wang and Peterson2013). Other studies have adopted atlas-based approaches to identify altered networks at the whole brain network level (Fornito, Zalesky, & Breakspear, Reference Fornito, Zalesky and Breakspear2015; Korgaonkar, Goldstein-Piekarski, Fornito, & Williams, Reference Korgaonkar, Goldstein-Piekarski, Fornito and Williams2019), though this approach is also limited to examining changes in a priori determined atlas-based networks.

Brain networks are generally characterized by a set of brain regions (nodes) and the connections (edges) that link them (Rubinov & Sporns, Reference Rubinov and Sporns2011). Compared to a priori focused seed-based or atlas-based single-network analysis, whole brain RS-fMRI-based connectomics (Cole, Smith, & Beckmann, Reference Cole, Smith and Beckmann2010; Smith et al., Reference Smith, Vidaurre, Beckmann, Glasser, Jenkinson, Miller and Van Essen2013) allow investigation of systems-level treatment effects in depression from the perspective of large-scale brain networks and their complex interactions. Such network modeling can be carried out by parcellating the RS-fMRI into a number of distinct brain regions (nodes) using high-dimensional independent component analysis (ICA), and subsequently estimating the functional connectivity (FC) (i.e. edges) in terms of temporal correlations (Chan, Park, Savalia, Petersen, & Wig, Reference Chan, Park, Savalia, Petersen and Wig2014; Sala-Llonch, Bartres-Faz, & Junque, Reference Sala-Llonch, Bartres-Faz and Junque2015; Smith et al., Reference Smith, Nichols, Vidaurre, Winkler, Behrens, Glasser and Miller2015). The advantage of this method is that it does not require an a priori hypothesis; instead it uses all the information within the data to drive its network estimations. Thus, perturbations in functional networks or the functional connectome relating to antidepressant treatment are rendered more objective and comprehensive. In the current study, we thus used a data-driven approach to investigate the functional connectome of the brain at rest after acute (24 h after first infusion of ketamine) and serial (24 h after receiving four infusions) ketamine treatment in MDD patients. To establish whether treatment-related FC changes normalize toward control values, we also compared FC between controls and MDD patients at baseline. Though employing different methodological approaches, based on previous findings (Abdallah et al., Reference Abdallah, Averill, Collins, Geha, Schwartz, Averill and Murrough2017; Evans et al., Reference Evans, Szczepanik, Brutsche, Park, Nugent and Zarate2018), we hypothesized that the network dysfunction in MDD patients would be normalized after ketamine treatment, particularly across the DMN, somato-motor network (SMN), salience network (SN) and fronto-parietal network (FPN). In addition, we aimed to identify correlates of response for MDD patients who reached remission after serial ketamine infusion and hypothesized that the FC changes (Evans et al., Reference Evans, Szczepanik, Brutsche, Park, Nugent and Zarate2018) in the SN would help characterize response.

Methods and materials

Subjects

Participants included 40 healthy controls (HC) and 61 DSM-5 defined [SCID (First, Williams, Karg, & Spitzer, Reference First, Williams, Karg and Spitzer2015)] individuals with MDD, who met criteria for treatment resistant depression [i.e. failed two adequate antidepressant trials of adequate dose and duration and had been continuously depressed for ≥6 months in the current episode (Gaynes et al., Reference Gaynes, Lux, Gartlehner, Asher, Forman-Hoffman, Green and Lohr2020), all 20–64 years of age]. Subjects were recruited from the Los Angeles area through advertisements, clinician referral, or clinicaltrials.gov (NCT02165449) and received clinical and behavioral assessments and an MRI scan. Patients received a series of four ketamine treatments over a period of 2–3 weeks. Assessments were made at three different time points: (1) initial baseline (TP1) occurring within 1 week of the first treatment (N = 61); (2) 24 h after the first ketamine infusion (TP2, N = 48) and; 24–72 h after the last ketamine infusion (TP3, N = 51) (Fig. 1(a)). Slightly fewer patients received T2 assessments due to limitations in resources for scanning after the first infusion. At each time point, depression severity was assessed using the Hamilton Depression Rating Scale (HDRS), 17-item (First et al., Reference First, Williams, Karg and Spitzer2015; Hamilton, Reference Hamilton1960). Patients whose HDRS score reached ≤7 at the end of treatment (TP3) were considered remitters (Frank et al., Reference Frank, Prien, Jarrett, Keller, Kupfer, Lavori and Weissman1991; Zimmerman, Chelminski, & Posternak, Reference Zimmerman, Chelminski and Posternak2004), whereas the remainder of patients completing four infusions were defined as non-remitters. Demographic and clinical information for all subjects is provided in Table 1.

Fig. 1. (a) Study design illustrating the timing of MRI sessions and clinical assessments relative to ketamine infusions. (b) Processing pipeline to generate the RS functional connectome. High-dimensional group-ICA and network modeling were performed using FSL-MELODIC and FSLNETS tools. z statistics for the full correlation (below the diagonal) and partial correlation (above the diagonal) were computed for the 172 identified nodes. The nodes were reordered according to a hierarchical clustering of the full correlation matrix. The transformed partial correlations were then arranged in the form of a network matrix (netmat), which was used to perform three main analysis: cross-sectional comparisons of HC and MDD at baseline (TP1), longitudinal comparisons of change between baseline and end of serial treatment in patients (TP1 v. TP3), and comparison of changes between treatment remitters v. non-remitters.

Table 1. Patient demographic and clinical information

HDRS, Hamilton Depression Rating Scale; HC, healthy controls; patients with major depressive disorder (MDD) at baseline (TP1); 24 h after the first infusion (TP2) and after fourth infusion (TP3) that included 51 participants.

a Comorbid disorders based on SCID -V.

b Substance use disorder includes several classes of substances including alcohol; caffeine; cannabis; hallucinogens; inhalants; opioids; sedatives, hypnotics or anxiolytics; stimulants; tobacco; and other or unknown substances. However, current substance abuse or dependence (ascertained by laboratory testing) or substance abuse history within the preceding 3-months were exclusionary.

Exclusion criteria for all participants included any unstable medical or neurological condition, current substance abuse, or dependence (ascertained by laboratory testing) or substance abuse history within the preceding 3-months, current or past history of psychosis, schizophrenia, mental retardation, or other developmental disorder, diagnosis of dementia and any contraindication to scanning (e.g. metal implants or claustrophobia). Exclusion criteria for HC also encompassed any current of past psychiatric condition. Prior to treatment, all patients had moderate to severe depressive symptoms as per the HDRS (score ≥17) (Hamilton, Reference Hamilton1960). Patients were also screened to ensure no prior psychotic reactions to medications, alcoholic, or illicit substances in the past, and for other physical or clinical contraindications to ketamine. All subjects provided written informed consent following procedures approved by the University of California, Los Angeles (UCLA) Institutional Review Board (IRB).

Ketamine treatment

Patients receiving ketamine treatment were permitted to remain on approved monoaminergic antidepressant therapy (if unchanged in the preceding 6-weeks) for the duration of the study. Benzodiazepines were discontinued the night before and morning of all study visits (e.g. scan sessions and ketamine infusion session). Patients received infusions 2–3 times a week for a total of four infusions. At each session, performed as an outpatient procedure, a single sub-anesthetic dose (0.5 mg/kg) of ketamine diluted in 60 cm3 normal saline was delivered intravenously via pump over a 40-min period in a private room at the UCLA Clinical Research Center or Resnick Neuropsychiatric Hospital. Vital sign monitoring included blood pressure, pulse oximetry, and respiratory rate recording every 3 min and a continuous cardiac rhythm strip. Mental status monitoring also occurred during ketamine infusion to assess for any untoward behavioral or psychological effects.

MRI data acquisition

A Siemens 3T Prisma MRI system at UCLA's Brain Mapping Center using a 32-channel phased array head coil was used to acquire imaging data. Image acquisition sequences were identical to those used by the Human Connectome Project (HCP) Lifespan studies for Aging and Development (https://www.humanconnectome.org). The structural scans consisted of a T1-weighed (T1w) multi-echo MPRAGE [voxel size (VS) = 0.8 mm isotropic; repetition time (TR) = 2500 ms; echo time (TE) = 1.81:1.79:7.18 ms; inversion time (TI) = 1000 ms; flip angle (34) = 8.0°; acquisition time (TA) = 8:22 min) and a T2-weighted (T2w) acquisition (VS = 0.8 mm isotropic; TR = 3200 ms; TE = 564 ms; TA = 6:35 min], both with real-time motion correction (Tisdall et al., Reference Tisdall, Hess, Reuter, Meintjes, Fischl and van der Kouwe2012). RS-fMRI data (participants were instructed to focus on a fixation cross) were acquired using two runs of a multiband EPI sequence (Ugurbil et al., Reference Ugurbil, Xu, Auerbach, Moeller, Vu, Duarte-Carvajalino and Consortium2013) with opposite phase encoding directions [VS = 2 mm isotropic; TR = 800 ms; TE = 37 ms, FA = 52°, MB accl. factor = 8; phase enc. direction = AP (run1)/PA (run2); TA = 6:41 min (per run)].

MRI data analysis

Anatomical and functional data were visually inspected and minimally preprocessed using the HCP minimal preprocessing pipeline (Glasser et al., Reference Glasser, Sotiropoulos, Wilson, Coalson, Fischl, Andersson and Consortium2013; Smith et al., Reference Smith, Beckmann, Andersson, Auerbach, Bijsterbosch, Douaud and Consortium2013) implemented using the BIDS-App (Gorgolewski et al., Reference Gorgolewski, Alfaro-Almagro, Auer, Bellec, Capota, Chakravarty and Poldrack2017). Structural and functional artifacts were then removed using a modified sICA + FIX [spatial ICA followed by ICA-based X-noiseifier (Griffanti et al., Reference Griffanti, Salimi-Khorshidi, Beckmann, Auerbach, Douaud, Sexton and Smith2014; Salimi-Khorshidi et al., Reference Salimi-Khorshidi, Douaud, Beckmann, Glasser, Griffanti and Smith2014)] that utilized concatenation across runs and phase encoding directions of all the fMRI data within a single scanning session (Glasser et al., Reference Glasser, Coalson, Bijsterbosch, Harrison, Harms, Anticevic and Smith2018). MSMALL alignment was performed to identify and align corresponding cortical locations across subjects based on a combination of cortical folding, thickness, myelination, and RS FC measures (Glasser et al., Reference Glasser, Coalson, Robinson, Hacker, Harwell, Yacoub and Van Essen2016; Robinson et al., Reference Robinson, Jbabdi, Glasser, Andersson, Burgess, Harms and Jenkinson2014; Robinson et al., Reference Robinson, Garcia, Glasser, Chen, Coalson, Makropoulos and Rueckert2018). Images with artifacts remaining after pre-processing, which comprised of one subject not counted in the reported sample size, were excluded from the study. Following preprocessing (Fig. 1(b)), high-dimensional group-ICA (Beckmann & Smith, Reference Beckmann and Smith2004; Kiviniemi et al., Reference Kiviniemi, Starck, Remes, Long, Nikkinen, Haapea and Tervonen2009) was performed to generate a set of nodes or parcels. All the RS-fMRI scans were fed into group-level ICA to parcellate the data into a set of 200 spatially-independent components. These spatial maps were projected onto each subject's RS-fMRI time series data to derive one time series per ICA component per subject [dual regression stage 1 (Filippini et al., Reference Filippini, MacIntosh, Hough, Goodwin, Frisoni, Smith and Mackay2009)]. After rejecting the group-ICA components based on artifactual noise (i.e. relating either to scanning artifacts, or to non-neuronal biophysical processes such as cardiac fluctuations and head motion), 172 components remained (online Supplementary Fig. 1). For each subject, the time series associated with these (D = 172) components were used as nodes to perform network analysis (Smith, Reference Smith2012). A D × D matrix (netmat) of connectivity estimates was generated using the FSLNets toolbox (http://fsl.fmrib.ox.ac.uk/fsl/fslwiki/FSLNets). Network modeling was carried out using partial temporal correlation between node time series. To improve the stability of the connectivity estimates L2 regularization (ρ = 0.1) was applied (Smith et al., Reference Smith, Miller, Salimi-Khorshidi, Webster, Beckmann, Nichols and Woolrich2011). Network matrix or netmat values were converted from Pearson correlation scores (r values) to z statistics using Fisher's transformation. Partial correlation z statistic network matrices were estimated separately for each RS-fMRI run, and then averaged across the runs for each subject, resulting in a single netmat for each subject. The 172 nodes were reordered according to hierarchical clustering of the group-average full correlation netmat using Ward's method implemented in Matlab to generate the functional connectome (Fig. 1(b)). Each subject's partial correlation netmat was unwrapped into a single row and combined across subjects to create a Subject × Edges matrix.

Statistical analysis

The Subject × Edges matrix was used to evaluate group-level analyses including, examination of cross-sectional effects between diagnostic groups at baseline, longitudinal effects of ketamine treatment, and associations between change in neural response occurring after single or serial ketamine treatment and antidepressant response. A two-sample t test with age and sex as regressors of no interest compared cross-sectional differences in netmat between HC and MDD at baseline. To test for longitudinal effects of ketamine treatment, paired t tests compared netmats between time points examined pairwise, evaluating effects of both single (TP1–TP2, n = 48) and serial ketamine treatment (TP1–TP3, n = 51). Using a two-sample t test, we also evaluated differences in FC between remitters and non-remitters at baseline (TP1), and the change in FC (ΔFC) after end of treatment (TP1–TP3) with age and sex as regressors of no interest. The FSL randomize tool with 5000 permutations was used for multiple comparisons (controlling family-wise error, FWE) across all edges. Results that were significant at FWE-corrected p < 0.05 are reported. The network edges that survived statistical significance (FWE p < 0.05) were used in a post-hoc analysis using IBM Statistical Packages for the Social Sciences (SPSS v25) to examine relationship between variations in baseline and change in FC with percent change in clinical scores after serial ketamine (TP1–TP3/TP1). Furthermore, FC values were used as dependent measures to confirm the presence of time-by-remission status interactions employing a general linear mixed model with time (TP1 and TP3) and remitter status (remitter, non-remitter) as fixed factors. A p value of <0.05 was used to establish statistical significance in these post-hoc analyses. To test the longitudinal stability of the FC estimates we also compared the FC in a subsample of HC scanned at two time points over a period of 2 weeks (online Supplementary material).

Results

Demographic and clinical results

Sex did not differ significantly between HC and MDD groups at baseline, but patients were on average ~6 years older, p = 0.01 (Table 1). To control the variance associated with both sex and age, these variables were included as covariates of no interest in the cross-sectional analysis of FC comparing diagnostic groups. In MDD patients, HDRS (F (1.89, 91.81) = 83.77, p < 0.0001) scores showed significant improvement across time (Table 1), and maximum improvement occurred after serial ketamine infusion (TP3). Of the 51 MDD patients who completed serial ketamine infusions, 24 (47%) achieved remission (HDRS < 7).

Cross-sectional effects between HC and MDD at baseline

Using p < 0.05 FWE correction and including age and sex as covariates, FC within the somato-motor (nodes 45 and 44) network was found significantly greater in HC as compared to MDD at baseline (Fig. 2(a)). Mean FC between these nodes at each time point represented in the bar plots indicates that FC in patients trends toward normalization over time with ketamine treatment. In contrast, FC between the ventral attention node (node 25) and the visual node (node 14) was significantly higher in MDD as compared to controls at TP1. As illustrated in the bar plots in Fig. 2b, FC between these nodes significantly reduced with ketamine treatment. Similarly, we also observed higher FC between visual cortex (node 5, encompassing areas V1, V2, and V3) and the DMN node (node 1) in MDD at TP1 that decreased with treatment (Fig. 2(c)). There was no significant difference in in-scanner motion metrics at the cross-sectional level as well as over time in MDD subjects (online Supplementary Fig. 2).

Fig. 2. Cross-sectional effects: controls v. MDD. (a) FC between nodes in the SMN is significantly lower in MDD as compared to controls; node 45: premotor cortex, Brodmann area (BA) 6; node 44: primary motor cortex, BA 4a. (b) FC between association and visual network is significantly higher in MDD as compared to controls; node 25: temporal lobe; node 14: visual cortex V1 BA 17. (c) FC between the visual and DMN is significantly higher in MDD as compared to controls; node 5: visual cortex (V1, V2, V3); node 1: right DMN. The color of the diamond connecting the two nodes represents the sign of the group average (patients + HC at TP1) partial correlation (orange: positive, blue: negative). All images are thresholded at z > 8 for visualization. Bar plots show the mean FC for each of the significant (p < 0.05, FWE-corrected across the netmat) networks for HC and MDD patients at TP1, TP2 and TP3 (*p < 0.05).

Longitudinal effects of ketamine treatment on the functional connectome

The paired t test comparing the whole-brain FC at baseline (TP1) and after the fourth infusion (TP3) showed significant decrease in FC between a node in the cerebellum (node 49) and a node in the SN (node 32) at p < 0.05 FWE correction (Fig. 3). The bar plots show that the average FC between the cerebellum node and the SN node is much higher in MDD patients at baseline (TP1) as compared to controls. Furthermore, this increase in mean FC decreases after the first as well as the fourth infusion of ketamine. No significant differences were found in FC for the paired t test comparing the netmat between TP1 and TP2.

Fig. 3. Effect of ketamine treatment after fourth infusion (TP1 v. TP3). The FC between the cerebellum and the SN was positively correlated and significantly reduced with ketamine treatment; node 49: cerebellar lobule VI; node 32: secondary somatosensory cortex and insula. The color of the diamond connecting the two nodes represents the sign of the group average (patients + HC at TP1) partial correlation (orange: positive, blue: negative). All images are thresholded at z > 8 for visualization. Bar plots show the mean FC between these nodes for HC and MDD at TP1, TP2 and TP3 (*p < 0.05).

FC changes and clinical outcome

At the whole brain level, ΔFC pre-to-post treatment (T1–T3) between remitters and non-remitters showed a significant difference at p < 0.05 FWE correction between a node in the cerebellum (node 126) and a node in the striatum (node 69) (Fig. 4a). No significant differences were observed between remitters and non-remitters at baseline using p < 0.05 FWE correction. However, there was significant time-by-remission (F (1.969) = 3.742, p = 0.027) status interaction of FC between node 126 and 69. The bar plots in Fig. 4b show the average FC reduces over time for remitters, whereas FC for this edge exhibits the opposite trend for non-remitters. When examining average FC for this edge in post-hoc analysis, results also show significantly higher FC for remitters at baseline (TP1) as compared to HC (Fig. 4b). In addition, there was a significant positive correlation between ΔFC at the end of treatment and %HDRS change (TP1–TP3) after the fourth infusion. Finally, there was a significant positive relationship between FC of the cerebellum node and the SN node at baseline (TP1) with change in %HDRS (TP1–TP3) after the fourth infusion.

Fig. 4. Distinct RS connections representing the difference between change in FC (TP1–TP3) for remitters and non-remitters. (a) The FC between the cerebellum node and the node in the striatum along with insula showed the largest change in FC between remitters and non-remitters: node 69: cerebellar left crus 1; node 126: left putamen and insula. The color of the diamond connecting the two nodes represents the sign of the group average (patients + HC at TP1) partial correlation (orange: positive, blue: negative). All images are thresholded at z > 8 for visualization. (b) Bar plots show the mean FC between these nodes for HC, remitters and non-remitters at TP1, TP2 and TP3 (*p < 0.05). (c) ΔFC (TP1–TP3) between the cerebellum and striatum showed a significant positive relationship with %HDRS change (TP1–TP3). (d) Baseline (TP1) FC between the cerebellum and the striatum showed a significant positive relationship with %HDRS change (TP1–TP3).

Discussion

Sub-anesthetic doses of ketamine delivered in either its racemic form of S(+) and R(−) enantiomers (Murrough et al., Reference Murrough, Perez, Pillemer, Stern, Parides, aan het Rot and Iosifescu2013; Zarate et al., Reference Zarate, Mathews, Ibrahim, Chaves, Marquardt, Ukoh and Luckenbaugh2013), or as (S)-ketamine only (Daly et al., Reference Daly, Singh, Fedgchin, Cooper, Lim, Shelton and Drevets2018; Singh et al., Reference Singh, Fedgchin, Daly, Xi, Melman, De Bruecker and Van Nueten2016), can reduce depressive symptoms within hours. However, relatively little is known about its effects on brain function at the systems-level following single or repeated ketamine therapy. Furthermore, MDD patients can vary in their response to ketamine treatment with remission rates varying between 29% and 44% (Wilkinson et al., Reference Wilkinson, Wright, Fasula, Fenton, Griepp, Ostroff and Sanacora2017; Zarate et al., Reference Zarate, Singh, Carlson, Brutsche, Ameli, Luckenbaugh and Manji2006). Whether patterns of FC can predict or elucidate the neurofunctional mechanisms associated with remission following ketamine therapy remains mostly unaddressed. Moreover, previous FC studies in MDD have to date exclusively focused on investigating specific brain networks such that other changes in the functional connectome associated with ketamine may be missed. The current study thus leveraged a data-driven network modeling approach to investigate how single and repeated ketamine administration modulates this functional connectome in MDD. To this end, 172 distinct functional nodes were generated from a high-dimensionality group-ICA that map several large-scale networks including auditory, somatosensory, motor, and visual activity as well as higher cognitive processes like executive function (Suri et al., Reference Suri, Topiwala, Filippini, Zsoldos, Mahmood, Sexton and Ebmeier2017). Using these nodes/networks, distinct RS connections were mapped to generate a functional connectome. Changes in the functional connectome across time in patients, and between controls and MDD patients prior to ketamine infusion were subsequently addressed.

At the cross-sectional level, results revealed that FC within the SMN was positively correlated for controls as compared to MDD patients, where it was anticorrelated. This anticorrelation in the SMN decreased in MDD patients with ketamine treatment. Furthermore, we also showed that the FC between the VN and FPN/association network was positively correlated in MDD patients, whereas it was anticorrelated in HC. These positive correlations between the FPN/association network and VN decreased in MDD patients with ketamine treatment. These findings suggest that the disrupted network connections that we observe in MDD patients at baseline are reaching normative (control) values with ketamine treatment. Specifically, the distinct RS connection that involved the cerebellum and the SN was uniquely coupled with repeated ketamine administration. The FC between these nodes was positively correlated at baseline in MDD and much greater than HC. With repeated ketamine infusion the FC in this network decreased, again trending toward normative values. In terms of clinical response remitters showed increased positive correlation at baseline between the cerebellum and the striatum that significantly decreased with ketamine treatment. But the non-remitters showed an opposite trend that involved the FC to be similar that of controls and increased in strength at the end of ketamine treatment. Overall, these findings suggest that repeated low-dose ketamine treatment normalizes the dysfunction of the SN in MDD. In particular, the cortico-striatal-cerebellar (CSC) loops that encompass the SN could be a potential biomarker for ketamine treatment.

Cross-sectional effects: HC v. MDD

Patients with MDD are known to show reduced FC within and across several brain networks at rest (Yan et al., Reference Yan, Chen, Li, Castellanos, Bai, Bo and Zang2019). Consistent with previous findings, MDD patients at baseline showed lower mean FC in the SMN as compared to controls. This reduced FC within the SMN may be linked with psychomotor retardation, which has been characterized as a key feature of patients with major depression (Buyukdura, McClintock, & Croarkin, Reference Buyukdura, McClintock and Croarkin2011; Iwabuchi et al., Reference Iwabuchi, Krishnadas, Li, Auer, Radua and Palaniyappan2015). A recent study also showed decreased FC in the SMN prior to treatment in MDD, which increased with standard pharmacotherapeutic treatment (Korgaonkar et al., Reference Korgaonkar, Goldstein-Piekarski, Fornito and Williams2019). Although not significant, in the current study we observed a similar effect of FC within this SMN in MDD patients with ketamine treatment. These results suggest that ketamine tends to normalize the dysfunction in this SMN that may be associated with its antidepressant effect. Furthermore, the FC between the VN and the DMN/association network was anticorrelated in controls, whereas MDD patients showed an opposite effect. Prior studies have reported disrupted FC within the VN and the DMN/association networks (Kaiser et al., Reference Kaiser, Andrews-Hanna, Wager and Pizzagalli2015; Yan et al., Reference Yan, Chen, Li, Castellanos, Bai, Bo and Zang2019). Here, for the first time we present disrupted network connectivity across these networks as well. In addition, ketamine is known to modulate metabolism in the occipital cortex (Carlson et al., Reference Carlson, Diazgranados, Nugent, Ibrahim, Luckenbaugh, Brutsche and Drevets2013), and visual cortex activity has been shown to correlate with antidepressant response (Furey et al., Reference Furey, Drevets, Hoffman, Frankel, Speer and Zarate2013). Notably, we have also previously found cerebral blood perfusion changes in primary and secondary visual areas following ketamine therapy to be associated with antidepressant response in an overlapping sample of patients (Sahib et al., Reference Sahib, Loureiro, Vasavada, Kubicki, Joshi, Wang and Narr2020). Similarly, at the end of ketamine treatment we observed a significant modulation of FC between VN and the association network (Fig. 2b) with treatment. These changes showed a trend toward controls, indicating the antidepressant effects of ketamine include restoration of FC.

Ketamine modulation of the functional connectome in MDD

Relative to baseline, 24 h after the fourth infusion of ketamine we observed a significant decrease in FC (Fig. 3) between the node in the dorsal salience (node 32) network (Abdallah et al., Reference Abdallah, Averill, Ramage, Averill, Goktas, Nemati and Consortium2019) and the node in the SMN part of the cerebellum (node 49, Habas et al., Reference Habas, Kamdar, Nguyen, Prater, Beckmann, Menon and Greicius2009). The cerebellum participates in motor as well as non-motor functions (Habas et al., Reference Habas, Kamdar, Nguyen, Prater, Beckmann, Menon and Greicius2009) and MDD pathophysiology affects distinct sub-regions of the cerebellum that communicate with cortical networks, thereby sub-serving several cognitive and mood functions (Depping, Schmitgen, Kubera, & Wolf, Reference Depping, Schmitgen, Kubera and Wolf2018). Furthermore, cerebellar NMDA receptors play a vital role in motor coordination and motor learning (Sanchez-Perez, Llansola, Cauli, & Felipo, Reference Sanchez-Perez, Llansola, Cauli and Felipo2005) and prior studies have shown that NMDA receptor antagonists restore motor activity in mutant nice (Umemori et al., Reference Umemori, Ogura, Tozawa, Mikoshiba, Nishizumi and Yamamoto2003).

Patients with MDD are known to have abnormal functioning of the SN (Kaiser et al., Reference Kaiser, Andrews-Hanna, Wager and Pizzagalli2015; Sheline, Price, Yan, & Mintun, Reference Sheline, Price, Yan and Mintun2010). The SN plays a critical role in switching between task negative network (DMN) and the task positive (FPN) (Menon & Uddin, Reference Menon and Uddin2010). As a result, any abnormalities in the SN can affect several cognitive functions (Koechlin & Summerfield, Reference Koechlin and Summerfield2007; Miller & Cohen, Reference Miller and Cohen2001). In particular, the region (Fig. 3) reported in this study that encompasses the SN is implicated in patients with post-traumatic stress disorder (Abdallah et al., Reference Abdallah, Averill, Ramage, Averill, Goktas, Nemati and Consortium2019). Notably, the dysfunctions associated with the SN in MDD are also found to be normalized with ketamine treatment in prior studies (Abdallah et al., Reference Abdallah, Averill, Collins, Geha, Schwartz, Averill and Murrough2017; Evans et al., Reference Evans, Szczepanik, Brutsche, Park, Nugent and Zarate2018). Although not significant, the mean FC between the node in the cerebellum and the SN in patients with MDD was greater as compared to HC. In accordance with previous ketamine studies (Abdallah et al., Reference Abdallah, Averill, Collins, Geha, Schwartz, Averill and Murrough2017; Evans et al., Reference Evans, Szczepanik, Brutsche, Park, Nugent and Zarate2018), we show that there are disruptions within as well as across the SMN and SN in patients with MDD. This disruption across the SMN and the SN normalizes toward controls (Fig. 3) with repeated ketamine therapy further suggesting that neuroplasticity across these networks contributes to the antidepressant effects of ketamine at the brain systems level. A recent study that employed a data-driven approach of global brain connectivity (GBC) has also shown that early GBC in the SMN predicts response to sertraline treatment (Nemati et al., Reference Nemati, Akiki, Roscoe, Ju, Averill, Fouda and Abdallah2020). Furthermore, a recent study from our group (Sahib Reference Sahib, Loureiro, Vasavada, Kubicki, Wade, Joshi and Narr2020) has also shown that functional plasticity in the SMN after ketamine treatment relates to improvements in depressive symptoms, suggesting modulation of this network plays an important role in therapeutic response.

FC associated with treatment response

Almost half of the patients included in the current study remitted at the end of treatment. Our MDD cohort overall had a significant higher FC of the SN at baseline (Fig. 3). However, on splitting the group based on clinical outcome, only remitters showed a significantly higher FC between the cerebellum node and a node in the striatum. The basal ganglia are essential for reward-based learning (Watabe-Uchida, Eshel, & Uchida, Reference Watabe-Uchida, Eshel and Uchida2017) and imaging studies have also indicated brain regions outside the basal ganglia, including the cerebellum, to be associated with reward processing (Garrison, Erdeniz, & Done, Reference Garrison, Erdeniz and Done2013; Tobler, O'Doherty J, Dolan, & Schultz, Reference Tobler, O'Doherty J, Dolan and Schultz2006). Furthermore, lesions in the cerebellum are associated with impairments in reinforcement-learning (Thoma, Bellebaum, Koch, Schwarz, & Daum, Reference Thoma, Bellebaum, Koch, Schwarz and Daum2008). It should also be noted that the cerebellum and the basal ganglia are interconnected at the sub-cortical level (Bostan, Dum, & Strick, Reference Bostan, Dum and Strick2010; Haines & Dietrichs, Reference Haines and Dietrichs1984; Haines, Dietrichs, Mihailoff, & McDonald, Reference Haines, Dietrichs, Mihailoff and McDonald1997) and increased activity is observed in this circuit across various neurological disorders (Bostan & Strick, Reference Bostan and Strick2018). This CSC loop along with the insula has been shown to be a key neural circuit of the SN (Habas et al., Reference Habas, Kamdar, Nguyen, Prater, Beckmann, Menon and Greicius2009). In line with these findings, compared to controls, remitters in the current study showed significantly higher FC in the CSC loop as compared to controls at baseline, which significantly decreased with ketamine treatment. In contrast, non-remitters showed lower FC as compared to controls that increased with ketamine treatment. In addition, we observed a significant relationship between change in FC in this CSC circuit with improvement in clinical outcome, and baseline FC in this loop could predict end of treatment outcome. Taken together and in line with previous findings, these observations suggest that SN dysfunction in patients with MDD, particularly those more prone to reward-based deficits (CSC loops) might respond better to ketamine treatment and further studies of basal ganglia–cerebellar–cerebral cortical networks could help better understand the pathophysiology of this disorder.

Limitations

Several limitations should be acknowledged for the current investigation. First, the current study was not a randomized clinical trial and did not include an active control condition. A previous study has implicated RS in predicting placebo effects (Sikora et al., Reference Sikora, Heffernan, Avery, Mickey, Zubieta and Pecina2016). However, it is important to note that the focus of this mechanistic clinical trial was to investigate the perturbation of the functional connectome at rest associated with ketamine rather than to address clinical efficacy, and patients serve as their own controls when examining change in FC over time. Furthermore, changes in FC over the course of ketamine treatment related to antidepressant response suggest that these changes are not reflective of placebo effects. Also, a subsample of HC subjects was scanned twice to estimate normative variance in FC over time (online Supplementary material). Notably, none of the edges that were significantly modulated with ketamine treatment showed a change in FC for HC over time in the direction of ketamine treatment (online Supplementary Fig. 3). These results are in line with other studies that demonstrate the patterns of RS brain activity measures are relatively stable across individual control subjects scanned multiple times (Almgren et al., Reference Almgren, Van de Steen, Kuhn, Razi, Friston and Marinazzo2018; Chen et al., Reference Chen, Ross, Zhan, Myers, Chuang, Heishman and Yang2008). Though cross-sectional changes between MDD and HC subjects were investigated to assist with the interpretation of ketamine findings, it is possible that the inclusion of patients with comorbid psychiatric diagnoses as well as the heterogeneity of symptoms among depressed individuals may have influenced the observed results between diagnostic groups. Finally, patient participants were allowed to continue concurrent stable anti-depressant medication, which may have impacted findings.

Conclusion

The use of data-driven functional connectomics to identify brain networks at rest is a major methodological advancement that could translate to improved strategies for diagnosis and for tailoring treatment in patients with MDD. Using this approach our findings provide novel insights into the specific components of large-scale brain networks associated with ketamine therapy. We have identified disrupted FC within the SMN, and between the visual and association networks in MDD patients that normalize with ketamine treatment. Furthermore, we found distinct changes in RS FC in SN networks with respect to ketamine treatment. Finally, in terms of remission, we found greater than normal FC in the CSC loop in patients who remit, which may be a prerequisite mechanism for ketamine treatment. Future studies may expand upon the current findings, including addressing how treatment-related changes in the functional connectome vary in relation to longer term clinical outcomes, and maintenance of therapeutic response.

Supplementary material

The supplementary material for this article can be found at https://doi.org/10.1017/S0033291720004560

Acknowledgements

This study was supported by the National Institute of Mental Health of the National Institutes of Health (Grant Nos. MH110008 [to KLN and RE], MH102743 [to KLN]), and the Muriel Harris Chair in Geriatric Psychiatry (to RE). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. Authors have no disclosures to report. This research was additionally supported by the UCLA Depression Grand Challenge, support for which is provided by the UCLA Office of the Chancellor and philanthropy. ClinicalTrials.gov: biomarkers of fast acting therapies in major depression, https://clinicaltrials.gov/ct2/show/NCT02165449.

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical standards

The authors assert that all procedures contributing to this work comply with the ethical standards of the relevant national and institutional committees on human experimentation and with the Helsinki Declaration of 1975, as revised in 2008

References

aan het Rot, M., Collins, K. A., Murrough, J. W., Perez, A. M., Reich, D. L., Charney, D. S., & Mathew, S. J. (2010). Safety and efficacy of repeated-dose intravenous ketamine for treatment-resistant depression. Biological Psychiatry, 67(2), 139145. doi:10.1016/j.biopsych.2009.08.038.CrossRefGoogle ScholarPubMed
Abdallah, C. G., Averill, L. A., Collins, K. A., Geha, P., Schwartz, J., Averill, C., … Murrough, J. W. (2017). Ketamine treatment and global brain connectivity in Major depression. Neuropsychopharmacology, 42(6), 12101219. doi: 10.1038/npp.2016.186.CrossRefGoogle ScholarPubMed
Abdallah, C. G., Averill, C. L., Ramage, A. E., Averill, L. A., Goktas, S., Nemati, S., … Consortium, S. S. (2019). Salience network disruption in U.S. Army soldiers with posttraumatic stress disorder. Chronic Stress (Thousand Oaks), 3. doi: 10.1177/2470547019850467.Google ScholarPubMed
Almgren, H., Van de Steen, F., Kuhn, S., Razi, A., Friston, K., & Marinazzo, D. (2018). Variability and reliability of effective connectivity within the core default mode network: A multi-site longitudinal spectral DCM study. Neuroimage, 183, 757768. doi: 10.1016/j.neuroimage.2018.08.053.CrossRefGoogle ScholarPubMed
Anand, A., Li, Y., Wang, Y., Gardner, K., & Lowe, M. J. (2007). Reciprocal effects of antidepressant treatment on activity and connectivity of the mood regulating circuit: An FMRI study. Journal of Neuropsychiatry and Clinical Neurosciences, 19(3), 274282. doi: 10.1176/jnp.2007.19.3.274.CrossRefGoogle ScholarPubMed
Beckmann, C. F., & Smith, S. M. (2004). Probabilistic independent component analysis for functional magnetic resonance imaging. IEEE Transactions on Medical Imaging, 23(2), 137152. doi: 10.1109/TMI.2003.822821.CrossRefGoogle ScholarPubMed
Berman, R. M., Cappiello, A., Anand, A., Oren, D. A., Heninger, G. R., Charney, D. S., & Krystal, J. H. (2000). Antidepressant effects of ketamine in depressed patients. Biological Psychiatry, 47(4), 351354. Retrieved from https://www.ncbi.nlm.nih.gov/pubmed/10686270.CrossRefGoogle ScholarPubMed
Bostan, A. C., Dum, R. P., & Strick, P. L. (2010). The basal ganglia communicate with the cerebellum. Proceedings of the National Academy of Sciences of the United States of America, 107(18), 84528456. doi:10.1073/pnas.1000496107.CrossRefGoogle ScholarPubMed
Bostan, A. C., & Strick, P. L. (2018). The basal ganglia and the cerebellum: Nodes in an integrated network. Nature Reviews: Neuroscience, 19(6), 338350. doi: 10.1038/s41583-018-0002-7.CrossRefGoogle Scholar
Buyukdura, J. S., McClintock, S. M., & Croarkin, P. E. (2011). Psychomotor retardation in depression: Biological underpinnings, measurement, and treatment. Progress in Neuro-Psychopharmacology and Biological Psychiatry, 35(2), 395409. doi: 10.1016/j.pnpbp.2010.10.019.CrossRefGoogle ScholarPubMed
Carlson, P. J., Diazgranados, N., Nugent, A. C., Ibrahim, L., Luckenbaugh, D. A., Brutsche, N., … Drevets, W. C. (2013). Neural correlates of rapid antidepressant response to ketamine in treatment-resistant unipolar depression: A preliminary positron emission tomography study. Biological Psychiatry, 73(12), 12131221. doi: 10.1016/j.biopsych.2013.02.008.CrossRefGoogle ScholarPubMed
Chan, M. Y., Park, D. C., Savalia, N. K., Petersen, S. E., & Wig, G. S. (2014). Decreased segregation of brain systems across the healthy adult lifespan. Proceedings of the National Academy of Sciences of the United States of America, 111(46), E4997E5006. doi:10.1073/pnas.1415122111.Google ScholarPubMed
Chen, S., Ross, T. J., Zhan, W., Myers, C. S., Chuang, K. S., Heishman, S. J., … Yang, Y. (2008). Group independent component analysis reveals consistent resting-state networks across multiple sessions. Brain Research, 1239, 141151. doi: 10.1016/j.brainres.2008.08.028.CrossRefGoogle ScholarPubMed
Cole, D. M., Smith, S. M., & Beckmann, C. F. (2010). Advances and pitfalls in the analysis and interpretation of resting-state FMRI data. Frontiers in Systems Neuroscience, 4, 8. doi: 10.3389/fnsys.2010.00008.Google ScholarPubMed
Daly, E. J., Singh, J. B., Fedgchin, M., Cooper, K., Lim, P., Shelton, R. C., … Drevets, W. C. (2018). Efficacy and safety of intranasal esketamine adjunctive to oral antidepressant therapy in treatment-resistant depression: A randomized clinical trial. JAMA Psychiatry, 75(2), 139148. doi: 10.1001/jamapsychiatry.2017.3739.CrossRefGoogle ScholarPubMed
Depping, M. S., Schmitgen, M. M., Kubera, K. M., & Wolf, R. C. (2018). Cerebellar contributions to Major depression. Frontiers in Psychiatry, 9, 634. doi: 10.3389/fpsyt.2018.00634.CrossRefGoogle ScholarPubMed
Diener, C., Kuehner, C., Brusniak, W., Ubl, B., Wessa, M., & Flor, H. (2012). A meta-analysis of neurofunctional imaging studies of emotion and cognition in major depression. Neuroimage, 61(3), 677685. doi: 10.1016/j.neuroimage.2012.04.005.CrossRefGoogle ScholarPubMed
Evans, J. W., Szczepanik, J., Brutsche, N., Park, L. T., Nugent, A. C., & Zarate, C. A. Jr. (2018). Default mode connectivity in major depressive disorder measured up to 10 days after ketamine administration. Biological Psychiatry, 84(8), 582590. doi:10.1016/j.biopsych.2018.01.027.CrossRefGoogle ScholarPubMed
Filippini, N., MacIntosh, B. J., Hough, M. G., Goodwin, G. M., Frisoni, G. B., Smith, S. M., … Mackay, C. E. (2009). Distinct patterns of brain activity in young carriers of the APOE-epsilon4 allele. Proceedings of the National Academy of Sciences of the United States of America, 106(17), 72097214. doi:10.1073/pnas.0811879106.CrossRefGoogle ScholarPubMed
First, M. B., Williams, J. B. W., Karg, R., & Spitzer, R. L. (2015). Structured Clinical Interview for DSM-5–Research Version (SCID-5 for DSM-5, Research Version; SCID-5–RV).Google Scholar
Fornito, A., Zalesky, A., & Breakspear, M. (2015). The connectomics of brain disorders. Nature Reviews: Neuroscience, 16(3), 159172. doi: 10.1038/nrn3901.CrossRefGoogle ScholarPubMed
Frank, E., Prien, R. F., Jarrett, R. B., Keller, M. B., Kupfer, D. J., Lavori, P. W., … Weissman, M. M. (1991). Conceptualization and rationale for consensus definitions of terms in major depressive disorder. Remission, recovery, relapse, and recurrence. Archives of General Psychiatry, 48(9), 851855. doi: 10.1001/archpsyc.1991.01810330075011.CrossRefGoogle Scholar
Furey, M. L., Drevets, W. C., Hoffman, E. M., Frankel, E., Speer, A. M., & Zarate, C. A. Jr. (2013). Potential of pretreatment neural activity in the visual cortex during emotional processing to predict treatment response to scopolamine in major depressive disorder. JAMA Psychiatry, 70(3), 280290. doi:10.1001/2013.jamapsychiatry.60.CrossRefGoogle ScholarPubMed
Garrison, J., Erdeniz, B., & Done, J. (2013). Prediction error in reinforcement learning: A meta-analysis of neuroimaging studies. Neuroscience and Biobehavioral Reviews, 37(7), 12971310. doi: 10.1016/j.neubiorev.2013.03.023.CrossRefGoogle ScholarPubMed
Gaynes, B. N., Lux, L., Gartlehner, G., Asher, G., Forman-Hoffman, V., Green, J., … Lohr, K. N. (2020). Defining treatment-resistant depression. Depression and Anxiety, 37(2), 134145. doi: 10.1002/da.22968..CrossRefGoogle ScholarPubMed
Gaynes, B. N., Warden, D., Trivedi, M. H., Wisniewski, S. R., Fava, M., & Rush, A. J. (2009). What did STAR*D teach us? Results from a large-scale, practical, clinical trial for patients with depression. Psychiatric Services, 60(11), 14391445. doi: 10.1176/ps.2009.60.11.1439.CrossRefGoogle ScholarPubMed
Glasser, M. F., Coalson, T. S., Bijsterbosch, J. D., Harrison, S. J., Harms, M. P., Anticevic, A., … Smith, S. M. (2018). Using temporal ICA to selectively remove global noise while preserving global signal in functional MRI data. Neuroimage, 181, 692717. doi: 10.1016/j.neuroimage.2018.04.076.CrossRefGoogle ScholarPubMed
Glasser, M. F., Coalson, T. S., Robinson, E. C., Hacker, C. D., Harwell, J., Yacoub, E., … Van Essen, D. C. (2016). A multi-modal parcellation of human cerebral cortex. Nature, 536(7615), 171178. doi: 10.1038/nature18933.CrossRefGoogle ScholarPubMed
Glasser, M. F., Sotiropoulos, S. N., Wilson, J. A., Coalson, T. S., Fischl, B., Andersson, J. L., … Consortium, W. U.-M. H. (2013). The minimal preprocessing pipelines for the human connectome project. Neuroimage, 80, 105124. doi: 10.1016/j.neuroimage.2013.04.127.CrossRefGoogle ScholarPubMed
Gorgolewski, K. J., Alfaro-Almagro, F., Auer, T., Bellec, P., Capota, M., Chakravarty, M. M., … Poldrack, R. A. (2017). BIDS Apps: Improving ease of use, accessibility, and reproducibility of neuroimaging data analysis methods. PLoS Computational Biology, 13(3), e1005209. doi: 10.1371/journal.pcbi.1005209.CrossRefGoogle ScholarPubMed
Gotlib, I. H., & Joormann, J. (2010). Cognition and depression: Current status and future directions. Annual Review of Clinical Psychology, 6, 285312. doi: 10.1146/annurev.clinpsy.121208.131305.CrossRefGoogle ScholarPubMed
Greicius, M. D., Flores, B. H., Menon, V., Glover, G. H., Solvason, H. B., Kenna, H., … Schatzberg, A. F. (2007). Resting-state functional connectivity in major depression: Abnormally increased contributions from subgenual cingulate cortex and thalamus. Biological Psychiatry, 62(5), 429437. doi: 10.1016/j.biopsych.2006.09.020.CrossRefGoogle ScholarPubMed
Griffanti, L., Salimi-Khorshidi, G., Beckmann, C. F., Auerbach, E. J., Douaud, G., Sexton, C. E., … Smith, S. M. (2014). ICA-based artefact removal and accelerated fMRI acquisition for improved resting state network imaging. Neuroimage, 95, 232247. doi: 10.1016/j.neuroimage.2014.03.034.CrossRefGoogle ScholarPubMed
Habas, C., Kamdar, N., Nguyen, D., Prater, K., Beckmann, C. F., Menon, V., & Greicius, M. D. (2009). Distinct cerebellar contributions to intrinsic connectivity networks. Journal of Neuroscience, 29(26), 85868594. doi: 10.1523/JNEUROSCI.1868-09.2009.CrossRefGoogle ScholarPubMed
Haines, D. E., & Dietrichs, E. (1984). An HRP study of hypothalamo-cerebellar and cerebello-hypothalamic connections in squirrel monkey (Saimiri sciureus). Journal of Comparative Neurology, 229(4), 559575. doi: 10.1002/cne.902290409.CrossRefGoogle Scholar
Haines, D. E., Dietrichs, E., Mihailoff, G. A., & McDonald, E. F. (1997). The cerebellar-hypothalamic axis: Basic circuits and clinical observations. International Review of Neurobiology, 41, 83107. doi: 10.1016/s0074-7742(08)60348-7.CrossRefGoogle ScholarPubMed
Hamilton, M. (1960). A rating scale for depression. Journal of Neurology, Neurosurgery and Psychiatry, 23, 5662. Retrieved from https://www.ncbi.nlm.nih.gov/pubmed/14399272.CrossRefGoogle ScholarPubMed
Hamilton, J. P., Farmer, M., Fogelman, P., & Gotlib, I. H. (2015). Depressive rumination, the default-mode network, and the dark matter of clinical neuroscience. Biological Psychiatry, 78(4), 224230. doi: 10.1016/j.biopsych.2015.02.020.CrossRefGoogle ScholarPubMed
Iwabuchi, S. J., Krishnadas, R., Li, C., Auer, D. P., Radua, J., & Palaniyappan, L. (2015). Localized connectivity in depression: A meta-analysis of resting state functional imaging studies. Neuroscience and Biobehavioral Reviews, 51, 7786. doi: 10.1016/j.neubiorev.2015.01.006.CrossRefGoogle ScholarPubMed
Kaiser, R. H., Andrews-Hanna, J. R., Wager, T. D., & Pizzagalli, D. A. (2015). Large-scale network dysfunction in major depressive disorder: A meta-analysis of resting-state functional connectivity. JAMA Psychiatry, 72(6), 603611. doi: 10.1001/jamapsychiatry.2015.0071.CrossRefGoogle ScholarPubMed
Kiviniemi, V., Starck, T., Remes, J., Long, X., Nikkinen, J., Haapea, M., … Tervonen, O. (2009). Functional segmentation of the brain cortex using high model order group PICA. Human Brain Mapping, 30(12), 38653886. doi: 10.1002/hbm.20813.CrossRefGoogle ScholarPubMed
Koechlin, E., & Summerfield, C. (2007). An information theoretical approach to prefrontal executive function. Trends in Cognitive Sciences, 11(6), 229235. doi: 10.1016/j.tics.2007.04.005.CrossRefGoogle ScholarPubMed
Korgaonkar, M. S., Goldstein-Piekarski, A. N., Fornito, A., & Williams, L. M. (2019). Intrinsic connectomes are a predictive biomarker of remission in major depressive disorder. Molecular Psychiatry, 25, 15371549. doi: 10.1038/s41380-019-0574-2.CrossRefGoogle ScholarPubMed
Kraus, C., Wasserman, D., Henter, I. D., Acevedo-Diaz, E., Kadriu, B., & Zarate, C. A. Jr. (2019). The influence of ketamine on drug discovery in depression. Drug Discovery Today, 24(10), 20332043. doi: 10.1016/j.drudis.2019.07.007.CrossRefGoogle ScholarPubMed
Kubicki, A., Leaver, A. M., Vasavada, M., Njau, S., Wade, B., Joshi, S. H., … Narr, K. L. (2019). Variations in hippocampal white matter diffusivity differentiate response to electroconvulsive therapy in major depression. Biological Psychiatry Cognitive Neuroscience and Neuroimaging, 4(3), 300309. doi: 10.1016/j.bpsc.2018.11.003.CrossRefGoogle ScholarPubMed
Mathew, S. J., Murrough, J. W., aan het Rot, M., Collins, K. A., Reich, D. L., & Charney, D. S. (2010). Riluzole for relapse prevention following intravenous ketamine in treatment-resistant depression: A pilot randomized, placebo-controlled continuation trial. International Journal of Neuropsychopharmacology, 13(1), 7182. doi: 10.1017/S1461145709000169.CrossRefGoogle ScholarPubMed
Menon, V., & Uddin, L. Q. (2010). Saliency, switching, attention and control: A network model of insula function. Brain Structure and Function, 214(5-6), 655667. doi: 10.1007/s00429-010-0262-0.CrossRefGoogle ScholarPubMed
Miller, E. K., & Cohen, J. D. (2001). An integrative theory of prefrontal cortex function. Annual Review of Neuroscience, 24, 167202. doi: 10.1146/annurev.neuro.24.1.167.CrossRefGoogle ScholarPubMed
Murrough, J. W., Collins, K. A., Fields, J., DeWilde, K. E., Phillips, M. L., Mathew, S. J., … Iosifescu, D. V. (2015). Regulation of neural responses to emotion perception by ketamine in individuals with treatment-resistant major depressive disorder. Translational Psychiatry, 5, e509. doi: 10.1038/tp.2015.10.CrossRefGoogle ScholarPubMed
Murrough, J. W., Perez, A. M., Pillemer, S., Stern, J., Parides, M. K., aan het Rot, M., … Iosifescu, D. V. (2013). Rapid and longer-term antidepressant effects of repeated ketamine infusions in treatment-resistant major depression. Biological Psychiatry, 74(4), 250256. doi: 10.1016/j.biopsych.2012.06.022.CrossRefGoogle ScholarPubMed
Nemati, S., Akiki, T. J., Roscoe, J., Ju, Y., Averill, C. L., Fouda, S., … Abdallah, C. G. (2020). A unique brain connectome fingerprint predates and predicts response to antidepressants. iScience, 23(1), 100800. doi: 10.1016/j.isci.2019.100800.CrossRefGoogle ScholarPubMed
Nemeroff, C. B. (2007). Prevalence and management of treatment-resistant depression. Journal of Clinical Psychiatry, 68(Suppl 8), 1725. Retrieved from https://www.ncbi.nlm.nih.gov/pubmed/17640154.Google ScholarPubMed
Posner, J., Hellerstein, D. J., Gat, I., Mechling, A., Klahr, K., Wang, Z., … Peterson, B. S. (2013). Antidepressants normalize the default mode network in patients with dysthymia. JAMA Psychiatry, 70(4), 373382. doi: 10.1001/jamapsychiatry.2013.455.CrossRefGoogle ScholarPubMed
Reed, J. L., Nugent, A. C., Furey, M. L., Szczepanik, J. E., Evans, J. W., & Zarate, C. A. Jr. (2018). Ketamine normalizes brain activity during emotionally valenced attentional processing in depression. Neuroimage Clinical, 20, 92101. doi:10.1016/j.nicl.2018.07.006.CrossRefGoogle ScholarPubMed
Robinson, E. C., Garcia, K., Glasser, M. F., Chen, Z., Coalson, T. S., Makropoulos, A., … Rueckert, D. (2018). Multimodal surface matching with higher-order smoothness constraints. Neuroimage, 167, 453465. doi: 10.1016/j.neuroimage.2017.10.037.CrossRefGoogle ScholarPubMed
Robinson, E. C., Jbabdi, S., Glasser, M. F., Andersson, J., Burgess, G. C., Harms, M. P., … Jenkinson, M. (2014). MSM: A new flexible framework for multimodal surface matching. Neuroimage, 100, 414426. doi: 10.1016/j.neuroimage.2014.05.069.CrossRefGoogle ScholarPubMed
Rubinov, M., & Sporns, O. (2011). Weight-conserving characterization of complex functional brain networks. Neuroimage, 56(4), 20682079. doi: 10.1016/j.neuroimage.2011.03.069.CrossRefGoogle ScholarPubMed
Rush, A. J., Trivedi, M. H., Wisniewski, S. R., Nierenberg, A. A., Stewart, J. W., Warden, D., … Fava, M. (2006). Acute and longer-term outcomes in depressed outpatients requiring one or several treatment steps: A STAR*D report. American Journal of Psychiatry, 163(11), 19051917. doi: 10.1176/ajp.2006.163.11.1905.CrossRefGoogle ScholarPubMed
Sahib, A. K., Loureiro, J. R. A., Vasavada, M. M., Kubicki, A., Joshi, S. H., Wang, K., … Narr, K. L. (2020). Single and repeated ketamine treatment induces perfusion changes in sensory and limbic networks in major depressive disorder. European Neuropsychopharmacology, 33, 89100. doi: 10.1016/j.euroneuro.2020.01.017.CrossRefGoogle ScholarPubMed
Sahib, A. K., Loureiro, J. R., Vasavada, M. M., Kubicki, A., Wade, B., Joshi, S. H., … Narr, K. L. (2020). Modulation of inhibitory control networks relate to clinical response following ketamine therapy in major depression. Translational Psychiatry, 10(1), 260. doi: 10.1038/s41398-020-00947-7.CrossRefGoogle ScholarPubMed
Sala-Llonch, R., Bartres-Faz, D., & Junque, C. (2015). Reorganization of brain networks in aging: A review of functional connectivity studies. Frontiers in Psychology, 6, 663. doi: 10.3389/fpsyg.2015.00663.CrossRefGoogle ScholarPubMed
Salimi-Khorshidi, G., Douaud, G., Beckmann, C. F., Glasser, M. F., Griffanti, L., & Smith, S. M. (2014). Automatic denoising of functional MRI data: Combining independent component analysis and hierarchical fusion of classifiers. Neuroimage, 90, 449468. doi: 10.1016/j.neuroimage.2013.11.046.CrossRefGoogle Scholar
Sanchez-Perez, A., Llansola, M., Cauli, O., & Felipo, V. (2005). Modulation of NMDA receptors in the cerebellum. II. Signaling pathways and physiological modulators regulating NMDA receptor function. Cerebellum (London, England), 4(3), 162170. doi: 10.1080/14734220510008003.CrossRefGoogle ScholarPubMed
Sheline, Y. I., Price, J. L., Yan, Z., & Mintun, M. A. (2010). Resting-state functional MRI in depression unmasks increased connectivity between networks via the dorsal nexus. Proceedings of the National Academy of Sciences of the United States of America, 107(24), 1102011025. doi:10.1073/pnas.1000446107.CrossRefGoogle ScholarPubMed
Sikora, M., Heffernan, J., Avery, E. T., Mickey, B. J., Zubieta, J. K., & Pecina, M. (2016). Salience network functional connectivity predicts placebo effects in Major depression. Biological Psychiatry Cognitive Neuroscience and Neuroimaging, 1(1), 6876. doi: 10.1016/j.bpsc.2015.10.002.CrossRefGoogle ScholarPubMed
Singh, J. B., Fedgchin, M., Daly, E., Xi, L., Melman, C., De Bruecker, G., … Van Nueten, L. (2016). Intravenous esketamine in adult treatment-resistant depression: A double-blind, double-randomization, placebo-controlled study. Biological Psychiatry, 80(6), 424431. doi: 10.1016/j.biopsych.2015.10.018.CrossRefGoogle ScholarPubMed
Smith, S. M. (2012). The future of FMRI connectivity. Neuroimage, 62(2), 12571266. doi: 10.1016/j.neuroimage.2012.01.022.CrossRefGoogle ScholarPubMed
Smith, S. M., Beckmann, C. F., Andersson, J., Auerbach, E. J., Bijsterbosch, J., Douaud, G., … Consortium, W. U.-M. H. (2013). Resting-state fMRI in the human connectome project. Neuroimage, 80, 144168. doi: 10.1016/j.neuroimage.2013.05.039.CrossRefGoogle ScholarPubMed
Smith, S. M., Miller, K. L., Salimi-Khorshidi, G., Webster, M., Beckmann, C. F., Nichols, T. E., … Woolrich, M. W. (2011). Network modelling methods for FMRI. Neuroimage, 54(2), 875891. doi: 10.1016/j.neuroimage.2010.08.063.CrossRefGoogle ScholarPubMed
Smith, S. M., Nichols, T. E., Vidaurre, D., Winkler, A. M., Behrens, T. E., Glasser, M. F., … Miller, K. L. (2015). A positive-negative mode of population covariation links brain connectivity, demographics and behavior. Nature Neuroscience, 18(11), 15651567. doi: 10.1038/nn.4125.CrossRefGoogle ScholarPubMed
Smith, S. M., Vidaurre, D., Beckmann, C. F., Glasser, M. F., Jenkinson, M., Miller, K. L., … Van Essen, D. C. (2013). Functional connectomics from resting-state fMRI. Trends in Cognitive Sciences, 17(12), 666682. doi: 10.1016/j.tics.2013.09.016.CrossRefGoogle ScholarPubMed
Suri, S., Topiwala, A., Filippini, N., Zsoldos, E., Mahmood, A., Sexton, C. E., … Ebmeier, K. P. (2017). Distinct resting-state functional connections associated with episodic and visuospatial memory in older adults. Neuroimage, 159, 122130. doi: 10.1016/j.neuroimage.2017.07.049.CrossRefGoogle ScholarPubMed
Thoma, P., Bellebaum, C., Koch, B., Schwarz, M., & Daum, I. (2008). The cerebellum is involved in reward-based reversal learning. Cerebellum (London, England), 7(3), 433443. doi: 10.1007/s12311-008-0046-8.CrossRefGoogle ScholarPubMed
Tisdall, M. D., Hess, A. T., Reuter, M., Meintjes, E. M., Fischl, B., & van der Kouwe, A. J. (2012). Volumetric navigators for prospective motion correction and selective reacquisition in neuroanatomical MRI. Magnetic Resonance in Medicine, 68(2), 389399. doi: 10.1002/mrm.23228.CrossRefGoogle ScholarPubMed
Tobler, P. N., O'Doherty J, P., Dolan, R. J., & Schultz, W. (2006). Human neural learning depends on reward prediction errors in the blocking paradigm. Journal of Neurophysiology, 95(1), 301310. doi: 10.1152/jn.00762.2005.CrossRefGoogle ScholarPubMed
Ugurbil, K., Xu, J., Auerbach, E. J., Moeller, S., Vu, A. T., Duarte-Carvajalino, J. M., … Consortium, W. U.-M. H. (2013). Pushing spatial and temporal resolution for functional and diffusion MRI in the human connectome project. Neuroimage, 80, 80104. doi: 10.1016/j.neuroimage.2013.05.012.CrossRefGoogle ScholarPubMed
Umemori, H., Ogura, H., Tozawa, N., Mikoshiba, K., Nishizumi, H., & Yamamoto, T. (2003). Impairment of N-methyl-D-aspartate receptor-controlled motor activity in LYN-deficient mice. Neuroscience, 118(3), 709713. doi: 10.1016/s0306-4522(03)00025-3.CrossRefGoogle ScholarPubMed
Watabe-Uchida, M., Eshel, N., & Uchida, N. (2017). Neural circuitry of reward prediction error. Annual Review of Neuroscience, 40, 373394. doi: 10.1146/annurev-neuro-072116-031109.CrossRefGoogle ScholarPubMed
Wilkinson, S. T., Wright, D., Fasula, M. K., Fenton, L., Griepp, M., Ostroff, R. B., & Sanacora, G. (2017). Cognitive behavior therapy may sustain antidepressant effects of intravenous ketamine in treatment-resistant depression. Psychotherapy and Psychosomatics, 86(3), 162167. doi: 10.1159/000457960.CrossRefGoogle ScholarPubMed
Yan, C. G., Chen, X., Li, L., Castellanos, F. X., Bai, T. J., Bo, Q. J., … Zang, Y. F. (2019). Reduced default mode network functional connectivity in patients with recurrent major depressive disorder. Proceedings of the National Academy of Sciences of the United States of America, 116(18), 90789083. doi: 10.1073/pnas.1900390116.CrossRefGoogle ScholarPubMed
Zarate, C. A. Jr., Mathews, D., Ibrahim, L., Chaves, J. F., Marquardt, C., Ukoh, I., … Luckenbaugh, D. A. (2013). A randomized trial of a low-trapping nonselective N-methyl-D-aspartate channel blocker in major depression. Biological Psychiatry, 74(4), 257264. doi:10.1016/j.biopsych.2012.10.019.CrossRefGoogle ScholarPubMed
Zarate, C. A. Jr., Singh, J. B., Carlson, P. J., Brutsche, N. E., Ameli, R., Luckenbaugh, D. A., … Manji, H. K. (2006). A randomized trial of an N-methyl-D-aspartate antagonist in treatment-resistant major depression. Archives of General Psychiatry, 63(8), 856864. doi:10.1001/archpsyc.63.8.856.CrossRefGoogle ScholarPubMed
Zimmerman, M., Chelminski, I., & Posternak, M. (2004). A review of studies of the Hamilton depression rating scale in healthy controls: Implications for the definition of remission in treatment studies of depression. Journal of Nervous and Mental Disease, 192(9), 595601. doi: 10.1097/01.nmd.0000138226.22761.39.CrossRefGoogle ScholarPubMed
Figure 0

Fig. 1. (a) Study design illustrating the timing of MRI sessions and clinical assessments relative to ketamine infusions. (b) Processing pipeline to generate the RS functional connectome. High-dimensional group-ICA and network modeling were performed using FSL-MELODIC and FSLNETS tools. z statistics for the full correlation (below the diagonal) and partial correlation (above the diagonal) were computed for the 172 identified nodes. The nodes were reordered according to a hierarchical clustering of the full correlation matrix. The transformed partial correlations were then arranged in the form of a network matrix (netmat), which was used to perform three main analysis: cross-sectional comparisons of HC and MDD at baseline (TP1), longitudinal comparisons of change between baseline and end of serial treatment in patients (TP1 v. TP3), and comparison of changes between treatment remitters v. non-remitters.

Figure 1

Table 1. Patient demographic and clinical information

Figure 2

Fig. 2. Cross-sectional effects: controls v. MDD. (a) FC between nodes in the SMN is significantly lower in MDD as compared to controls; node 45: premotor cortex, Brodmann area (BA) 6; node 44: primary motor cortex, BA 4a. (b) FC between association and visual network is significantly higher in MDD as compared to controls; node 25: temporal lobe; node 14: visual cortex V1 BA 17. (c) FC between the visual and DMN is significantly higher in MDD as compared to controls; node 5: visual cortex (V1, V2, V3); node 1: right DMN. The color of the diamond connecting the two nodes represents the sign of the group average (patients + HC at TP1) partial correlation (orange: positive, blue: negative). All images are thresholded at z > 8 for visualization. Bar plots show the mean FC for each of the significant (p < 0.05, FWE-corrected across the netmat) networks for HC and MDD patients at TP1, TP2 and TP3 (*p < 0.05).

Figure 3

Fig. 3. Effect of ketamine treatment after fourth infusion (TP1 v. TP3). The FC between the cerebellum and the SN was positively correlated and significantly reduced with ketamine treatment; node 49: cerebellar lobule VI; node 32: secondary somatosensory cortex and insula. The color of the diamond connecting the two nodes represents the sign of the group average (patients + HC at TP1) partial correlation (orange: positive, blue: negative). All images are thresholded at z > 8 for visualization. Bar plots show the mean FC between these nodes for HC and MDD at TP1, TP2 and TP3 (*p < 0.05).

Figure 4

Fig. 4. Distinct RS connections representing the difference between change in FC (TP1–TP3) for remitters and non-remitters. (a) The FC between the cerebellum node and the node in the striatum along with insula showed the largest change in FC between remitters and non-remitters: node 69: cerebellar left crus 1; node 126: left putamen and insula. The color of the diamond connecting the two nodes represents the sign of the group average (patients + HC at TP1) partial correlation (orange: positive, blue: negative). All images are thresholded at z > 8 for visualization. (b) Bar plots show the mean FC between these nodes for HC, remitters and non-remitters at TP1, TP2 and TP3 (*p < 0.05). (c) ΔFC (TP1–TP3) between the cerebellum and striatum showed a significant positive relationship with %HDRS change (TP1–TP3). (d) Baseline (TP1) FC between the cerebellum and the striatum showed a significant positive relationship with %HDRS change (TP1–TP3).

Supplementary material: File

Sahib et al. supplementary material

Sahib et al. supplementary material

Download Sahib et al. supplementary material(File)
File 8.6 MB