Hostname: page-component-cd9895bd7-7cvxr Total loading time: 0 Render date: 2024-12-27T05:44:20.944Z Has data issue: false hasContentIssue false

Neurotrophins, cytokines, oxidative stress mediators and mood state in bipolar disorder: systematic review and meta-analyses

Published online by Cambridge University Press:  16 August 2018

Tobias Rowland
Affiliation:
IHR Academic Clinical Fellow in Psychiatry, Mental Health and Wellbeing, Warwick Medical School, University of Warwick, UK
Benjamin I. Perry
Affiliation:
NIHR Academic Clinical Fellow in Psychiatry, Mental Health and Wellbeing, Warwick Medical School, University of Warwick, UK
Rachel Upthegrove
Affiliation:
Senior Clinical Lecturer in Psychiatry, Institute of Clinical Sciences, School of Clinical and Experimental Medicine, University of Birmingham, UK
Nicholas Barnes
Affiliation:
Professor of Neuropharmacology, Institute of Clinical Sciences, School of Clinical and Experimental Medicine, University of Birmingham, UK
Jayanta Chatterjee
Affiliation:
Consultant Psychiatrist, Affective Disorders Service, Caludon Centre, Coventry, UK
Daniel Gallacher
Affiliation:
Research Associate in Medical Statistics, WMS Population, Evidence and Technologies, Warwick Medical School, University of Warwick, UK
Steven Marwaha*
Affiliation:
Reader in Psychiatry, Mental Health and Wellbeing, Warwick Medical School, University of Warwick,UK
*
Correspondence: Steven Marwaha, Mental Health and Wellbeing, Warwick Medical School, University of Warwick, Coventry CV4 7AL, UK. Email: s.marwaha@warwick.ac.uk
Rights & Permissions [Opens in a new window]

Abstract

Background

A reliable biomarker signature for bipolar disorder sensitive to illness phase would be of considerable clinical benefit. Among circulating blood-derived markers there has been a significant amount of research into inflammatory markers, neurotrophins and oxidative stress markers.

Aims

To synthesise and interpret existing evidence of inflammatory markers, neurotrophins and oxidative stress markers in bipolar disorder focusing on the mood phase of illness.

Method

Following PRISMA (Preferred Reporting Items for Systematic reviews and Meta-analyses) guidelines, a systematic review was conducted for studies investigating peripheral biomarkers in bipolar disorder compared with healthy controls. We searched Medline, Embase, PsycINFO, SciELO and Web of Science, and separated studies by bipolar mood phase (mania, depression and euthymia). Extracted data on each biomarker in separate mood phases were synthesised using random-effects model meta-analyses.

Results

In total, 53 studies were included, comprising 2467 cases and 2360 controls. Fourteen biomarkers were identified from meta-analyses of three or more studies. No biomarker differentiated mood phase in bipolar disorder individually. Biomarker meta-analyses suggest a combination of high-sensitivity C-reactive protein/interleukin-6, brain derived neurotrophic factor/tumour necrosis factor (TNF)-α and soluble TNF-α receptor 1 can differentiate specific mood phase in bipolar disorder. Several other biomarkers of interest were identified.

Conclusions

Combining biomarker results could differentiate individuals with bipolar disorder from healthy controls and indicate a specific mood-phase signature. Future research should seek to test these combinations of biomarkers in longitudinal studies.

Declaration of interest

None.

Type
Review article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
Copyright © The Royal College of Psychiatrists 2018

Bipolar affective disorder (bipolar disorder) is a relatively common severe mental illness, with worldwide lifetime prevalence of 2.4%,Reference Merikangas, Jin, He, Kessler, Lee and Sampson1 and ranks among the top ten causes of disability worldwide.Reference Krahn2 Currently, diagnosis is based on clinical interview, and in the absence of biological markers this process has been criticised as lacking objectivity and having poor reliability and validity.Reference Saunders, Bilderbeck, Price and Goodwin3 Indeed, initial diagnosis and correct treatment are often delayed by 6–10 years,Reference Baldessarini, Tondo, Baethge, Lepri and Bratti4 in part because of the difficulties of making a clinical diagnosis. This can have a considerable impact upon clinical outcome given that earlier treatment is more effective.Reference Joyce, Thompson and Marwaha5 Circulating blood-derived biomarkers represent potential objective tests that may help to address this clinical need and there has been a surge in relevant research in recent years, particularly within the categories of neurotrophins, inflammatory markers and oxidative stress markers. Moreover, the phase of bipolar illness appears to be related to some biomarker levels,Reference Munkholm, Vinberg and Vedel Kessing6, Reference Fernandes, Molendijk, Kohler, Soares, Leite and Machado-Vieira7 and therefore it is necessary to analyse biomarkers according to mood phase.

Neurotrophins are mediators in the stress response and promote neuronal well-being, influencing neuronal survival, cell proliferation, plasticityReference Green, Raybould, Macgregor, Hyde, Young and O'Donovan8, Reference Lu, Pang and Woo9 and long-term memory.Reference Grande, Fries, Kunz and Kapczinski10 The majority of studies on neurotrophins in bipolar disorder have focused on brain derived neurotrophic factor (BDNF). Six meta-analyses of this dataReference Fernandes, Molendijk, Kohler, Soares, Leite and Machado-Vieira7, Reference Wu, Fan, Zhao, Calabrese and Gao11Reference Munkholm, Vinberg and Kessing14 have found significantly lower levels of BDNF in bipolar disorder compared with healthy controls and people with unipolar depression, and lowered BDNF in bipolar mania and depression.Reference Munkholm, Vinberg and Kessing14 Neuroinflammation within the central nervous system and neuro-humoral pathways (for example the hypothalamic–pituitary–adrenal axis) is linked to mood disorders.Reference Fries, Pfaffenseller, Stertz, Paz, Dargel and Kunz15 Cytokines such as interleukins (ILs), namely IL-2, IL-4, IL-6 and tumour necrosis factor alpha (TNF-α) together with the inflammatory marker c-reactive protein (CRP) have been identified as potentially relevant blood-borne biomarkers in bipolar, and may change in different affective states.Reference Munkholm, Vinberg and Vedel Kessing6, Reference Munkholm, Brauner, Kessing and Vinberg16, Reference Modabbernia, Taslimi, Brietzke and Ashrafi17 The development of the oxidative stress theory of bipolar disorder led to identification of several potential biomarkers such as nitric oxide (NO), thiobarbituric acid reactive substances (TBARS) and lipid peroxidase (LPO). Meta-analyses have found that levels of TBARS, NO and LPO are significantly raised in people with bipolar disorder compared with healthy controls, although participants were not separated by mood phase.Reference Andreazza, Kauer-Sant'anna, Frey, Bond, Kapczinski and Young18, Reference Brown, Andreazza and Young19

In the existing literature, syntheses to date have indicated an effect of mood phase on biomarker levels,Reference Munkholm, Vinberg and Vedel Kessing6, Reference Fernandes, Molendijk, Kohler, Soares, Leite and Machado-Vieira7 but have focused on individual markers or are limited by the small number of studies investigating each mood phase. There is increasing interest in the use of biomarker combinations as diagnostic panels.Reference Haenisch, Cooper, Reif, Kittel-Schneider, Steiner and Leweke20, Reference Le-Niculescu, Kurian, Yehyawi, Dike, Patel and Edenberg21 These have been used in many branches of medicine, such as thyroid disordersReference Dayan22 and in the ‘triple test’ for Down syndrome in pregnancy.Reference Haddow, Palomaki, Knight, Foster and Neveux23 As yet, this is an underutilised paradigm within psychiatric disorders. This systematic review and the meta-analyses therefore aimed to synthesise and interpret existing evidence and present aggregated effect with focus on biomarkers by phase of illness in bipolar disorder. Our objective was to provide preliminary evidence and inform research strategies to deliver selective biomarker signatures for bipolar disorder. As such this evidence synthesis is designed to be exploratory, as opposed to testing particular hypotheses.

Method

Following PRISMA (Preferred Reporting Items for Systematic reviews and Meta-analyses) guidelines,Reference Moher, Liberati, Tetzlaff and Altman24 a systematic review and meta-analyses were conducted for circulating biomarkers in blood or serum of patients with bipolar disorder compared with healthy controls. An initial scoping review was conducted to identify potential biomarkers in bipolar disorder to generate a list of search terms.

We searched Embase (1947–present), Ovid Medline (1946–present), Web of Science (inception–present) SciELO (1998–present) and PsycINFO (1806–present) to 1 February 2017. The first 20 pages of Google Scholar were also searched as recommended in a recent review,Reference Haddaway, Collins, Coughlin and Kirk25 alongside searching references of included studies for search keywords. The following MeSH headings or their equivalent and text terms were used: bipolar disorder, bipolar, ‘antidepressant induced’, mania, manic, depression, depressive, depressive syndrome, euthymia, euthymic grouped with biomarker, predictor, blood, neurotrophin, oxidative stress, brain derived neurotrophic factor, BDNF, cytokine, monoamine, dopamine, homovanillic acid, HVA, interleukin, tumour necrosis factor, TNF, C reactive protein, CRP, TBARS, 3-NT, NO,

Inclusion criteria were:

  1. (a) primary studies evaluating biomarker levels in patients with bipolar disorder (in any mood phase);

  2. (b) bipolar disorder diagnosis confirmed using structured clinical instruments;

  3. (c) patients aged >16 years;

  4. (d) matched healthy control group;

  5. (e) studies in any language;

  6. (f) peer-reviewed papers, alongside searchable conference abstracts and theses;

  7. (g) methods for biomarker assay were validated commercially available assays.

Exclusion criteria were:

  1. (a) studies focusing purely on genetic differences between groups (no measured biomarker);

  2. (b) studies including participants under the age of 16 either in the patient or control group as rates of bipolar disorder are relatively rare below this age, hence diagnostic accuracy in these patients might be reduced

Study selection

Study titles and/or abstracts were screened independently by two authors (B.P., J.C.) applying the inclusion criteria, in order to decide on studies that would be examined in full-text form. Any discrepancies were resolved in consultation with the senior author (S.M.).

Full-text studies were examined independently by two review authors (B.P., J.C.) for final inclusion. Risk of bias was assessed by two authors independently (B.P. and T.R.) using the Newcastle–Ottawa Scale for non-randomised studies.Reference Wells, Shea, O'Connell, Peterson, Welch and Losos26 Disagreement over risk of bias assessment was resolved through involvement of a third senior review author (S.M.). Data were extracted by three reviewers (B.P., J.C. and T.R.). Details included participant characteristics, diagnostic criteria, study design, outcomes measured and data for analysis.

In studies that did not report data from which the mean and standard deviation (s.d.) could be calculated, the corresponding author was contacted to request the original data. If no response was received, or data were unavailable these studies were not included in the meta-analysis but were discussed narratively.

Analysis

The mean and s.d.s for each biomarker, separated into mood phase, were subject to meta-analysis using RevMan 5.3, with mean differences and 95% CIs between cases and controls calculated and displayed in forest plots. The inverse variance method was used where the weight given to each study is the inverse of the variance of the effect estimate. Random-effects models were used to pool data because of substantial clinical and methodological heterogeneity between studies. A meta-analysis was completed if there were two or more separate samples of the same mood phase measuring a given biomarker, although only meta-analyses of three or more studies are used for drawing conclusions and identifying discriminatory biomarkers. A separate sensitivity analysis using only studies sampling patients who were psychotropic medication free (psychotropics defined as antipsychotics, antidepressants, mood stabilisers, hypnotics, anxiolytics) was completed. Publication bias was assessed by use of funnel plots that were assessed for asymmetry in each meta-analysis including ten or more studies, as is recommended for interpretation.Reference Sterne, Sutton, Ioannidis, Terrin, Jones and Lau27, Reference Lau, Ioannidis, Terrin, Schmid and Olkin28

Defining discriminatory biomarkers

We propose that a ‘fully discriminatory’ biomarker for bipolar disorder should be significantly different compared with that found in matched healthy controls in only one mood phase of bipolar disorder, to allow it to discriminate that mood phase. A ‘partially discriminatory’ biomarker should be significantly different from that found in healthy controls in two mood phases of bipolar disorder, allowing it to discriminate the mood phase in which it is not altered from controls.

Results

The search strategy retrieved 6348 studies; 194 full texts were reviewed, and, of these, 62 studies met inclusion criteria.Reference Andreazza, Cassini, Rosa, Leite, de Almeida and Nardin29Reference Yatham, Kapczinski, Andreazza, Trevor Young, Lam and Kauer-Sant'anna90 Thirteen of these studies did not provide data from which the mean and s.d. could be calculated, and the corresponding authors were contacted. Nine studies were unable to provide this data, so were excluded from the meta-analysis but their results are discussed narratively. Subsequently 53 were included in the quantitative synthesis (Fig. 1). Because of the number of biomarkers (n = 14), and our objective to understand their mood phase specificity it was necessary to complete 31 meta-analyses.

Fig. 1 PRISMA (Preferred Reporting Items for Systematic reviews and Meta-analyses) diagram.

Characteristics of the available literature

Supplementary Table 1 (available at https://doi.org/10.1192/bjp.2018.144) outlines the characteristics of the included studies. Of the 53 studies included in meta-analyses, 49 were of case–control design, 3 were prospective cohort studiesReference Jacoby, Munkholm, Vinberg, Pedersen and Kessing50, Reference Li, Zhang, Fan, Yuan, Huang and Chen58, Reference Munkholm, Pedersen, Kessing and Vinberg65 and one was a non-randomised trial.Reference Mackin, Gallagher, Watson, Young and Ferrier64 Baseline data were extracted, and these were treated as case–control studies.

A total of 37 studies investigated patients in a manic or hypomanic phase, 40 investigated patients in a euthymic mood state and 26 investigated depression. The determination of mood phase varied significantly between studies, and the majority used the Young's Mania Rating Scale (YMRS) and Hamilton Rating Scale for Depression (HRSD) to assess symptom severity. The most common biomarker assay used was commercial enzyme-linked immunosorbent assay kits, and the specific rating scales, cut-off points and assays are described in supplementary Table 1.

Participant and clinical features of samples in included studies

The 53 studies included in the meta-analyses included 2467 case participants and 2360 controls, with the number of case participants in each study varying from 10 to 141. There was a slight female predominance overall (55.6%). The mean age across studies was 38.7 years calculated where age data was available, and the mean age within studies ranged from 23 to 65 years. Specific diagnostic criteria, interview tools and main exclusion criteria of studies are detailed in supplementary Table 1. A total of 33 studies specified a diagnosis of bipolar disorder type I, a further 7 studies also included bipolar disorder type II and 1 study investigated patients with rapid-cycling bipolar disorder, including both type I and II bipolar disorder.Reference Munkholm, Pedersen, Kessing and Vinberg65

Most (n = 32) studies explicitly stated that controls were age matched, and 30 also matched for gender. All studies specified controls were free from other psychiatric illnesses, with most having used the Structured Clinical Interview for DSM-IV for this purpose.

Of the case–control studies, 15 followed up participants before and after treatment.Reference Asdemir, Turan, Uysal and Kilic30, Reference Gergerlioglu, Savas, Bulbul, Selek, Uz and Yumru46, Reference Karamustafalioglu, Genc, Kalelioglu, Tasdemir, Umut and Incir52, Reference Kim, Jung, Myint, Kim and Park54Reference Kim, Suh, Kim, Han, Lim and Choi56, Reference Lin, Lee, Lo and Huang59, Reference Loch, Zanetti, de Sousa, Chaim, Serpa and Gattaz61, Reference Selek, Savas, Gergerlioglu, Bulbul, Uz and Yumru71, Reference Tramontina, Andreazza, Kauer-Sant'anna, Stertz, Goi and Chiarani74Reference Tsai, Yang, Kuo, Chen and Leu77, Reference Uyanik, Tuglu, Gorgulu, Kunduracilar and Uyanik79 For the purpose of the meta-analyses the values for biomarkers after treatment were only included where the study had explicitly stated participants were in remission following treatment and had defined the mood phase objectively, and these were analysed as separate case–control studies.Reference Karamustafalioglu, Genc, Kalelioglu, Tasdemir, Umut and Incir52, Reference Liu, Yang, Chou, Chen, Shen and Leu60, Reference Tsai, Chen, Yang, Chen, Lee and Singh75Reference Tsai, Yang, Kuo, Chen and Leu77, Reference Uyanik, Tuglu, Gorgulu, Kunduracilar and Uyanik79

Medication status

Most studies included patients taking medications (for example lithium, anticonvulsants, antipsychotics, antidepressants, benzodiazepines), several of which can affect oxidative stress and cytokine levels.Reference Sen, Duman and Sanacora91Reference Kato, Monji, Mizoguchi, Hashioka, Horikawa and Seki94 Fourteen studies explored patients entirely free from medication for up to 8 weeks prior to the study. These studies also included some patients who were drug naive, but only one study reported only participants who were completely medication naive.Reference Li, Zhang, Fan, Yuan, Huang and Chen58 Three studies included patients receiving electroconvulsive therapy.Reference Karamustafalioglu, Genc, Kalelioglu, Tasdemir, Umut and Incir52, Reference Selek, Savas, Gergerlioglu, Bulbul, Uz and Yumru71, Reference Tramontina, Andreazza, Kauer-Sant'anna, Stertz, Goi and Chiarani74

Risk of bias in included studies

Studies were appraised using the Newcastle–Ottawa Scale,Reference Wells, Shea, O'Connell, Peterson, Welch and Losos26 treating each study as a case–control study for the purpose of the meta-analysis. The results are shown in supplementary Table 2. Studies scored between two and eight of a possible nine, and there was significant variability between studies in all three sections of the assessment. Funnel plots were examined for each meta-analysis with more than ten studies (details available on request from the authors), but were not found to be clearly asymmetrical, although most analyses fell below this threshold. However, this is in keeping with the general findings of the study, which included findings of many publications of negative results for biomarkers.

Study results

We present a summary of the findings of our meta-analyses in Table 1, which includes the number of studies/participants, the corresponding summary effect size and I 2 value for each meta-analysis. Effect sizes >0.8 were regarded as ‘large’ and >0.5 as ‘moderate’.Reference Cohen95 Forest plots are included for biomarkers that were analysed in each mood phase (Fig. 2–4), and forest plots for the remaining biomarkers are included in supplementary Figs 2–24. Several biomarkers of distinct categories, including neuroendocrine markers, were identified but insufficient studies were available in each mood phase to conduct meta-analyses (see supplementary Table 1).

Table 1 Discriminatory and potentially discriminatory biomarkers

BDNF, brain derived neurotrophic factor; ↓, lower in case participants; ↔ , not significantly different from controls; hsCRP, high-sensitivity C-reactive protein; ↑, higher in case participants; IL, interleukin; sTNFR1, soluble tumour necrosis factor (TNF)-α receptor 1; sIL-2R, soluble IL-2 receptor; IFN, interferon.

a. Fewer than three studies therefore analysis not carried out.

Inflammatory mediators

In total, 32 studies investigated levels of inflammatory mediators. High-sensitivity CRP (hsCRP) was found to be elevated in both euthymia (standardised mean difference (SMD) 0.8, 95% CI 0.3 to 1.3, P = 0.002, I 2 = 81%, number of studies (k) = 4, number of participants (n) = 547) and mania (SMD 0.74, 95% CI 0.37 to 1.11, P<0.0001, I 2 = 71%, k = 6, n = 640), but in bipolar depression there was no significant difference from controls (SMD −0.02, 95% CI −0.25 to 0.21, P = 0.86, I 2 = 0%, k = 3, n = 420) (Fig. 2(a)).

Fig. 2 (a) Forest plot of high-sensitivity C-reactive protein (hsCRP) in depression, euthymia and mania compared with healthy controls and (b) forest plot of interleukin (IL)-6 in depression, euthymia and mania compared with healthy controls.

Std, standard.

IL1-RA levels were found to be elevated in mania (SMD 0.45, 95% CI 0.03 to 0.88, P = 0.03, I 2 = 53%, k = 4, n = 399), but not significantly raised in euthymia (SMD 0.33, 95% CI −0.03 to 0.69, P = 0.07, I 2 = 56%, k = 5, n = 469). Only two studies examined IL1-RA in bipolar depression, but levels were not significantly different from controls (supplementary Fig. 2).

IL-6 was found to be increased in mania (SMD 1.07, 95% CI 0.29 to 1.84, P = 0.007, I 2 = 93%, k = 6, n = 695) and euthymia (SMD 0.71, 95% CI 0.07 to 1.34, P = 0.03, I 2 = 92%, k = 6, n = 734) but not significantly elevated in bipolar depression (SMD 0.67, 95% CI −0.08 to 1.42, P = 0.08, I 2 = 91%, k = 6, n = 601) (Fig. 2(b)).

Soluble IL-2 receptor (sIL-2R) were increased in both euthymia (SMD 0.86, 95% CI 0.29–1.44, P = 0.003, I 2 = 78%, k = 3, n = 313) and mania (SMD 1.06, 95% CI 0.66–1.46, P < 0.00001, I 2 = 49%, k = 3, n = 279) (supplementary Fig. 3). There were insufficient studies to perform a meta-analysis for patients with bipolar depression, but one studyReference Bai, Su, Tsai, Wen-Fei, Li and Pei-Chi32 reported increased levels in bipolar depression (P < 0.0001), and anotherReference Breunis, Kupka, Nolen, Suppes, Denicoff and Leverich83 reported increased levels across all mood phases (P < 0.01).

Soluble IL-6 receptor (sIL-6R) was increased in mania (SMD 0.34, 95% CI 0.08–0.6, P = 0.01, I 2 = 0%, k = 3, n = 279) and increased in euthymia (SMD 0.61, 95% CI 0.25–0.97, P = 0.001, I 2 = 56%, k = 4, n = 359) (supplementary Fig. 4). Insufficient studies were available to conduct a meta-analysis for bipolar depression, but one studyReference Bai, Su, Tsai, Wen-Fei, Li and Pei-Chi32 found sIL-6R levels were significantly increased in bipolar depression (P < 0.0001).

TNF-α levels were significantly increased in both mania (SMD 1.74, 95% CI 0.88 to 2.59, P < 0.0001, I 2 = 93%, k = 7, n = 515) and bipolar depression (SMD 2.09, 95% CI 0.82 to 3.36, P < 0.001, I 2 = 94%, k = 6, n = 334) but not significantly different in euthymia (SMD 0.33, 95% CI −0.13 to 0.79, P = 0.16, I 2 = 82%, k = 8, n =  522) (Fig. 3(a)). One small studyReference Ortiz-Dominguez, Hernandez, Berlanga, Gutierrez-Mora, Moreno and Heinze67 led to the particularly large effect sizes in both mania and bipolar depression, and a sensitivity analysis excluding that study reduced the effect size, although the results remained significant and the effect size remained large (SMD >0.8). A further four studies assessed TNF-α levels but were not included in the meta-analysis, shown in supplementary Table 1.

Fig. 3 (a) Forest plot of tumour necrosis factor (TNF)-α in depression, euthymia and mania compared with healthy controls and (b) forest plot of soluble TNF-α receptor 1 (sTNFR1) in depression, euthymia and mania compared with healthy controls.

a. Medication free; b. lithium monotherapy. Std, standard.

Soluble TNF-α receptor 1 (sTNFR1) levels were found to be increased in mania (SMD 0.96, 95% CI 0.43 to 1.49, P = 0.0004, I 2 = 82%, k = 5, n = 609) but not significantly different in euthymia (SMD 0.39, 95% CI −0.21 to 1.0, P = 0.21, I 2 = 91%, k = 7, n = 727) or bipolar depression (SMD 0.46, 95% CI −0.02 to 0.94, P = 0.06, I 2 = 62%, k = 3, n = 479) (Fig. 3(b)).

IL-2, IL-4, IL-10 and interferon (IFN)-γ levels were not found to be different from controls in mania or euthymia (supplementary Figs 5–8). There were too few studies to conduct meta-analyses for bipolar depression for these biomarkers. Individual studies did not find significant differences from controls. For the remaining lammatory markers there were too few studies to conduct meaningful meta-analyses.

Neurotrophins

There were 30 studies investigating neurotrophins. BDNF levels were significantly decreased in both mania (SMD −0.54, 95% CI −1.03 to −0.06, P = 0.03, I 2 = 91%, k = 13, n = 946) and bipolar depression (SMD −0.86, 95% CI −1.38 to −0.34, P < 0.00001, I 2 = 91%, k = 13, n = 949), whereas in euthymia there was no significant difference (SMD 0.12, 95% CI −0.11 to 0.35, P = 0.32, I 2 = 77%, k = 14, n = 1447) (Fig. 4). A further three studies investigated BDNF in euthymia finding decreased levels in some subgroups,Reference Kauer-Sant'Anna, Kapczinski, Andreazza, Bond, Lam and Young86, Reference Monteleone, Serritella, Martiadis and Maj88, Reference Yatham, Kapczinski, Andreazza, Trevor Young, Lam and Kauer-Sant'anna90 but did not provide data to allow inclusion in the meta-analysis, with findings shown in supplementary Table 1.

Fig. 4 Forest plot of brain derived neurotrophic factor (BDNF) in depression, euthymia and mania compared with healthy controls.

a. Early stage; b. Late stage. Std, standard.

Meta-analysis of three studies showed neurotrophin-3 levels were not significantly different from healthy controls in bipolar depression (supplementary Fig. 9). There were insufficient studies to conduct a meta-analysis for the other mood phases.

Oxidative stress markers

Ten studies were available, of which, two investigated TBARS in each mood phase. In both, TBARS was increased in mania and bipolar depression. One found TBARS to be elevated and another decreased in euthymia (supplementary Fig. 10). There were too few studies to conduct meaningful meta-analyses of other oxidative stress markers.

Medication-free subgroup

A subgroup analysis was performed for the 15 studies that investigated biomarkers in patients that were free from all psychotropic medication at the time of assessment, and forest plots are presented in supplementary Figs 11–14. The results in medication-free patients were not found to change significantly from the overall results in each meta-analysis. Meta-analyses with three or more studies were performed for BDNF, IL-4, TNF-α and IFN-γ in patients with mania and BDNF for bipolar depression. There were insufficient studies to complete meta-analyses for any biomarker in euthymia in patients who were medication free.

BDNF was found to be decreased in both mania (SMD −1.16, 95% CI −1.5 to −0.81, P < 0.00001, I 2 = 32%, k = 4, n = 252) and bipolar depression (SMD −1.35, 95% CI −2.11 to −0.6, P = 0.0004, I 2 = 69%, k = 3, n = 251). TNF-α was increased in mania (SMD 3.69, 95% CI 1.28 to 6.09, P = 0.003, I 2 = 96%, k = 3, n = 212). IL−4 and IFN-γ were not found to be significantly different when participants with mania where compared with healthy controls.

Discriminatory biomarkers

There were a sufficient number of studies to analyse five biomarkers across each mood phase of bipolar disorder. sTNFR1 is raised in mania but is not significantly different in bipolar depression or euthymia. BDNF is significantly decreased in both mania and bipolar depression, whereas TNF-α is raised in mania and bipolar depression, and neither are significantly different from levels in controls in euthymia. hsCRP and IL-6 are raised in both euthymia and mania but are not significantly different from controls in bipolar depression. A combination of these biomarkers appears to be differentially altered in each mood phase, as described in Table 2. A summary of the effect sizes of these biomarkers in each mood phase is shown in supplementary Fig. 1.

Table 2 Fully discriminatory biomarker combinations

hsCRP, high-sensitivity C-reactive protein; IL, interleukin; sTNFR1, soluble tumour necrosis factor (TNF)-α receptor 1; BDNF, brain derived neurotrophic factor; ↑, higher in case participants; ↔ , not significantly different from controls; ↓, lower in case participants.

In addition, we present three further biomarkers (IL-1RA, sIL2-R, sIL6-R) (described in Table 1) that require further work in specific mood phases that did not have sufficient studies to be included in a meta-analysis.

Discussion

This systematic review and series of exploratory meta-analyses report results that include neurotrophic, inflammatory and oxidative stress biomarkers, separated by affective state (euthymia, mania, depression) in bipolar disorder. We were able to include 53 studies comprising 2467 participants and 2360 healthy controls, synthesising data on 14 different biomarkers. A combination of hsCRP/IL-6, BDNF/TNF-α and sTNFR1 appear to be differentially altered in each mood phase.

Previous meta-analyses have investigated specific biomarkers in bipolar disorder, including hsCRP, cytokines, BDNF and oxidative stress markers. However, this review is the first to combine multiple circulating blood-derived biomarkers separated by mood phase in bipolar disorder. Important results can be unmasked in this type of finer grain analysis that have the potential to bring translational impact a step closer. This review may help to shape future research strategies to translate biological findings into clinical practice. Increased awareness of the pathophysiological and biochemical differences that separate not only the varied poles present in bipolar disorder, but also those that differentiate bipolar disorder from other affective illnesses such as unipolar depression, may help to facilitate expedited diagnosis and hint towards future pharmacological targets for bipolar disorder.

Main findings: potential discriminatory and non-discriminatory biomarkers

We present a combination of five biomarkers that appear discriminatory based upon our proposed definition. These are hsCRP/IL-6, BDNF/TNF-α and sTNFR1 shown in Table 2. sTNFR1 appears to discriminate mania only, where it is significantly different from controls. Levels of BDNF, hsCRP, IL-6 and TNF-α are able to discriminate either euthymia or depression by being no different in that mood phase in comparison with levels in controls but altered in other mood phases. Both hsCRP and IL-6 discriminate bipolar depression, their levels being no different from controls, whereas BDNF and TNF-α are significantly altered in both mania and depression and not significantly different in euthymia compared with controls, and therefore may be more generalised markers of affective disturbance in bipolar disorder. In our analysis, there were no biomarkers that would individually be able to discriminate each mood phase. However, our findings suggest the combination of hsCRP/IL-6, sTNFR1 with BDNF/TNF-α would meet this criterion.

We also describe three biomarkers that may have the potential to be discriminatory, although further research is required. For example, IL-1RA was raised in mania but not significantly different from lvels in controls in euthymia. The two studies investigating IL-1RA in bipolar depression also found levels not significantly different from controls, and if confirmed in further studies this would support the potential of this marker to discriminate bipolar mania. sIL-2R and sIL-6R may have the potential to be discriminatory although only when combined with other biomarkers, and future research is required of these markers in the bipolar depression phase.

Levels of IL-2, IL-4, IL-10 and IFN-γ were not significantly different from controls in either mania or euthymia, but current study numbers mean no conclusions can be reached regarding levels in bipolar depression; further studies are required. Assessing only patients free from psychotropic medications at the time of biomarker measurement did not affect the significance or direction of the main results, supporting the direction and validity of the main results.

Comparisons with other research

BDNF

This meta-analysis found decreased BDNF levels in both mania and depression, but not euthymia. A particularly large effect size was seen in depression (SMD −0.86) and a moderate effect size in mania (SMD −0.54). In fact, BDNF was the only biomarker in our analysis to be significantly decreased in comparison with healthy controls, in any mood state. These findings are in line with other research into bipolar disorder,Reference Fernandes, Molendijk, Kohler, Soares, Leite and Machado-Vieira7, Reference Lin12, Reference Munkholm, Vinberg and Kessing14 but it is also noteworthy that decreased BDNF is associated with schizophrenia and unipolar depression.Reference Fernandes, Steiner, Berk, Molendijk, Gonzalez-Pinto and Turck96, Reference Molendijk, Spinhoven, Polak, Bus, Penninx and Elzinga97

IL-6, sIL-6R and hsCRP

IL-6, sIL-6R and hsCRP were found to be increased in euthymia and mania, but not in bipolar depression (for sIL-6R insufficient studies were available to conduct a meta-analysis for depression). This may add to the validity of our results as there is evidence linking the inflammatory pathways of these markers; IL-6 is one of the primary cytokines in the inflammatory cascade, which stimulates production of CRP,Reference Maes98 and its proinflammatory action is mediated by its soluble receptor sIL-6R.Reference Hodes, Menard and Russo99

There is relatively strong evidence that hsCRP and IL-6 are raised in unipolar depression,Reference Dowlati, Herrmann, Swardfager, Liu, Sham and Reim100, Reference Haapakoski, Mathieu, Ebmeier, Alenius and Kivimaki101 whereas our results suggest this is not the case in bipolar depression, although it is unclear whether this may be because of methodological differences between studies. Nevertheless, this not only raises the possibility of a useful biomarker to differentiate bipolar disorder from unipolar depression, but points to the differing pathophysiology of the disorders and differences in their respective inflammatory profiles.

TNF-α, sTNFR1 and sTNFR2

TNF-α has been described as one of the primary inflammatory mediators,Reference Berk, Kapczinski, Andreazza, Dean, Giorlando and Maes102 driving production of other cytokines such as IL-6 and CRP,Reference Maes98 all of which were found to be elevated in bipolar mania in our analysis. TNF-α and its soluble receptors have been implicated in neurocognition in bipolar disorder,Reference Doganavsargil-Baysal, Cinemre, Aksoy, Akbas, Metin and Fettahoglu103 and previous meta-analyses have found TNF-α and sTNFR1 elevated in maniaReference Munkholm, Vinberg and Vedel Kessing6 but it remains unclear what role sTNFR1 and sTNFR2 have during the depressive mood phase.

Oxidative stress markers

Oxidative stress markers have been investigated in previous meta-analyses,Reference Andreazza, Kauer-Sant'anna, Frey, Bond, Kapczinski and Young18, Reference Brown, Andreazza and Young19 although these did not separate results by affective state. Oxidative stress markers have been implicated in multiple psychiatric disorders including schizophrenia,Reference Boll, Noto, Bonifacio, Bortolasci, Gadelha and Bressan104 depression, anxiety, dementia and substance misuse.Reference Ng, Berk, Dean and Bush105 TBARS in particular appear to be increased in schizophrenia,Reference Ng, Berk, Dean and Bush105 although not in unipolar depression,Reference Baek and Park106, Reference Spanemberg, Caldieraro, Vares, Wollenhaupt-Aguiar, Kauer-Sant'Anna and Kawamoto107 indicating a possible differential biomarker from bipolar depression if results are confirmed by further studies.

Within-participant differences

Several studies examined changes in biomarkers levels within participants following treatment or a change in mood phase. Findings were generally inconsistent for the biomarkers under investigation; for example, studies showing BDNF levels may increase,Reference Tramontina, Andreazza, Kauer-Sant'anna, Stertz, Goi and Chiarani74 decreaseReference Karamustafalioglu, Genc, Kalelioglu, Tasdemir, Umut and Incir52 or remain unchanged.Reference Jacoby, Munkholm, Vinberg, Pedersen and Kessing50, Reference Lin, Lee, Lo and Huang59, Reference Munkholm, Pedersen, Kessing and Vinberg65 between manic episode and subsequent remission. Some studies went beyond assessment of difference in biomarker level between mood phases, finding that decreases in sIL-2R levels between mania and subsequent remission correlated with an improvement in symptoms.Reference Tsai, Chen, Yang, Chen, Lee and Singh75, Reference Tsai, Yang, Kuo, Chen and Leu77 Individual changes in biomarker levels between mood phases and how this correlates with treatment or clinical improvement is currently understudied.

Interaction of biomarkers

The markers identified in this review are unlikely to be altered in isolation. There is evidence that multiple pathways interact to cause downstream effects. Neuroinflammation appears to cause dysfunction in several neurotransmitter systems and neuronal signalling, whereas proinflammatory cytokines such as TNF-α and Il-6 that this review found to be raised in bipolar mania activate microglia that release reactive oxygen species contributing to oxidative damage, protein aggregation and apoptosis.Reference Berk, Kapczinski, Andreazza, Dean, Giorlando and Maes102 These changes in glial function then decrease production of neurotrophic factors such as BDNF.Reference Maletic and Raison108 These interactive effects may be one reason that a biomarker panel approach may be worthwhile.

Strengths and limitations

This comprehensive systematic review includes a series of exploratory meta-analyses of inflammatory, neurotrophic and oxidative stress markers in bipolar disorder. This review separated the results of each biomarker by mood phase, which not only provides information as to physiological changes, but also reduces the risk of type 2 error where there are true state-related changes in biomarkers. The use of random-effects models in each analysis also adds further validity to the results.

Notwithstanding this, there are several limitations and results should be interpreted with some caution, in part because of the nature of the literature reviewed. The robustness of our results is dependent on the quality of the primary studies, most of which were observational and at significant risk of bias and confounding. The significant methodological heterogeneity between included studies becomes problematic when attempting to use biomarkers as a diagnostic tool in bipolar disorder and means our results and conclusions should be considered tentative. The individual patient characteristics varied greatly between studies, and factors such as body mass index, blood pressure, physical activity and smoking status, which were heterogeneously addressed among studies, can affect biomarker levels.Reference Haack, Hinze-Selch, Fenzel, Kraus, Kuhn and Schuld109Reference Pischon, Hankinson, Hotamisligil, Rifai and Rimm111 Factors such as duration of the illness or mood phase, the specific assay used and whether the biomarker was measured in plasma or serum may also influence biomarker levels.Reference Fernandes, Molendijk, Kohler, Soares, Leite and Machado-Vieira7, Reference Kapczinski, Simões Fernandes, Kauer-Sant'Anna, Gama, Yatham and Berk112 The inclusion of patients with a diagnosis of bipolar disorder type II or hypomania, and variation in the YMRS and HRSD scores used to define mood phases are likely to have contributed to the significant heterogeneity in the results of the meta-analyses and introduced potential confounders. In addition, the definition of ‘healthy controls’ varied considerably. Furthermore, as studies that investigated multiple biomarkers compared these with a single control group, these are repeated in the separate meta-analyses, and any abnormalities in these control groups may be amplified.

Most studies also included both patients taking medicated and those not, and many psychotropics such as lithium, valproate and antipsychotics are known to affect biomarker levels.Reference Sen, Duman and Sanacora91Reference Kato, Monji, Mizoguchi, Hashioka, Horikawa and Seki94 Several studies also reported biomarker levels following successful treatment and remission, and it is unclear if there is a lag time to normalisation of the biomarker. However, including only patients free from psychotropic medications at the time of assessment did not appear to change our main findings.

The biomarkers investigated in this review, particularly pro- and anti-inflammatory cytokinesReference Sigitova, Fisar, Hroudova, Cikankova and Raboch113 may be correlated and we could not account for this in our analysis. Future studies moving towards translation to a clinical test need to account for this.

Mixed states have long been known to occur in bipolar disorder but undoubtedly present a nosological problemReference McIntyre, Soczynska, Cha, Woldeyohannes, Dale and Alsuwaidan114, Reference Miller, Suppes, Mintz, Hellemann, Frye and McElroy115 and as such a major challenge in linking the clinical picture to biomarker levels. We cannot be clear to what extent this phenomenon will have had an impact on the primary studies as well as our results. Although some studies did investigate biomarkers in those with a diagnosis of mixed affective state these were not of sufficient number to conduct meaningful analysis. However, it is likely that especially in older studies, some people diagnosed as having mania or depression may have had a mixed states picture.

The issue of publication bias has been raised in relation to biomarkers in bipolar disorder, with concern that positive results are more likely to be published.Reference Carvalho, Kohler, Fernandes, Quevedo, Miskowiak and Brunoni116 However, in this meta-analysis examination of funnel plots with sufficient number of studies resulted in no obvious asymmetry, and a number of negative results were identified, leading to several findings of biomarkers that appear to be unchanged in bipolar disorder. It is therefore unlikely that an excess of positive results affected the overall results of the meta-analysis. However, as many analyses included too few studies for funnel plots to be meaningfully interpreted, it is unclear if publication bias may be a factor in some of these less extensively investigated markers.

Because of the comprehensive scope of our review and the need to separate results by mood phase, we conducted a considerable number of meta-analyses, and this increases the risk of type 1 error. Applying a correction for multiple testing is likely to exclude biomarkers that are promising but for which there are too few studies. As the purpose of the review was exploratory as opposed to hypothesis testing, we did not correct for multiple testing, and enable readers to understand the full breadth of the extant literature. However, it is important to consider this and therefore exercise caution in weighing and using our findings. Equally, because of the exploratory nature of the review we were unable to prospectively perform a sample size calculation for each biomarker, and therefore it is likely that for some biomarkers the meta-analyses are underpowered as a result of the small number of studies included.

Implications and future directions

The identification of discriminant biomarkers has potentially significant clinical relevance through increasing diagnostic accuracy, monitoring of disease severity, predicting changes in mood phase as well as providing information about the underlying neurobiology of bipolar disorder. Although there remains inconclusive evidence at present, a number of biomarkers show promise in their ability to differentiate mood phases in people with bipolar disorder from healthy controls, and potentially from other mental illnesses that may present similarly to bipolar disorder and thus make clinical diagnosis challenging. This review investigated state-related biomarkers. However, markers such as BDNF and TNF-α are associated with illness duration,Reference Kauer-Sant'Anna, Kapczinski, Andreazza, Bond, Lam and Young86 whereas alterations in IL-6 during childhood are associated with onset of hypomanic symptoms in adulthood.Reference Hayes, Khandaker, Anderson, Mackay, Zammit and Lewis117 Therefore, further investigation is required of how far the identified biomarkers represent longer term markers of illness, as well as markers of mood phase. Prospective cohort studies with repeated measures of these biomarkers are necessary to determine the temporality of biomarker change with mood phase, exclude confounders such as illness duration and medications, and determine the predictive value of such biomarkers.

Finally, the comparisons of our findings with other literature have identified some potential biomarker differences between specific mood phases in bipolar disorder from other major mental illnesses that can present similarly, such as IL-6 in and hsCRP in unipolar and bipolar depression. Further longitudinal research in this area may help to unearth strong candidates for biomarkers that can differentiate bipolar disorder from other psychiatric disorders that have biomarker associations such as unipolar depression and schizophrenia.

In conclusion, this meta-analysis has identified neurotrophic, inflammatory and oxidative stress markers that are altered during different mood phases of bipolar disorder. Most significantly, a combination of hsCRP/IL-6, BDNF/TNF-α and sTNFR1 may offer the potential to differentiate people with bipolar disorder from matched controls specific to bipolar mood phase.

Funding

We wish to acknowledge Medical Research Council grant funding to N.M.B. (grant reference: MR/R006008/1).

Supplementary material

Supplementary material is available online at http://doi.org/10.1192/bjp.2018.144.

Footnotes

*

These authors contributed equally to the work.

References

1Merikangas, KR, Jin, R, He, JP, Kessler, RC, Lee, S, Sampson, NA, et al. Prevalence and correlates of bipolar spectrum disorder in the world mental health survey initiative. Arch Gen Psychiatry 2011; 68: 241–51.Google Scholar
2Krahn, GL. WHO World Report on Disability: a review. Disabil Health J 2011; 4: 141–2.Google Scholar
3Saunders, KE, Bilderbeck, AC, Price, J, Goodwin, GM. Distinguishing bipolar disorder from borderline personality disorder: a study of current clinical practice. Eur Psychiatry 2015; 30: 965–74.Google Scholar
4Baldessarini, RJ, Tondo, L, Baethge, CJ, Lepri, B, Bratti, IM. Effects of treatment latency on response to maintenance treatment in manic-depressive disorders. Bipolar Disord 2007; 9: 386–93.Google Scholar
5Joyce, K, Thompson, A, Marwaha, S. Is treatment for bipolar disorder more effective earlier in illness course? A comprehensive literature review. Int J Bipolar Disord 2016; 4: 19.Google Scholar
6Munkholm, K, Vinberg, M, Vedel Kessing, L. Cytokines in bipolar disorder: a systematic review and meta-analysis. J Affect Disord 2013; 144: 1627.Google Scholar
7Fernandes, BS, Molendijk, ML, Kohler, CA, Soares, JC, Leite, CM, Machado-Vieira, R, et al. Peripheral brain-derived neurotrophic factor (BDNF) as a biomarker in bipolar disorder: a meta-analysis of 52 studies. BMC Med 2015; 13: 289.Google Scholar
8Green, EK, Raybould, R, Macgregor, S, Hyde, S, Young, AH, O'Donovan, MC, et al. Genetic variation of brain-derived neurotrophic factor (BDNF) in bipolar disorder: case-control study of over 3000 individuals from the UK. Br J Psychiatry 2006; 188: 21–5.Google Scholar
9Lu, B, Pang, PT, Woo, NH. The yin and yang of neurotrophin action. Nat Rev Neurosci 2005; 6: 603–14.Google Scholar
10Grande, I, Fries, GR, Kunz, M, Kapczinski, F. The role of BDNF as a mediator of neuroplasticity in bipolar disorder. Psychiatry Investig 2010; 7: 243–50.Google Scholar
11Wu, R, Fan, J, Zhao, J, Calabrese, JR, Gao, K. The relationship between neurotrophins and bipolar disorder. Expert Rev Neurother 2014; 14: 5165.Google Scholar
12Lin, PY. State-dependent decrease in levels of brain-derived neurotrophic factor in bipolar disorder: a meta-analytic study. Neurosci Lett 2009; 466: 139–43.Google Scholar
13Polyakova, M, Stuke, K, Schuemberg, K, Mueller, K, Schoenknecht, P, Schroeter, ML. BDNF as a biomarker for successful treatment of mood disorders: a systematic & quantitative meta-analysis. J Affect Disord 2015; 174: 432–40.Google Scholar
14Munkholm, K, Vinberg, M, Kessing, LV. Peripheral blood brain-derived neurotrophic factor in bipolar disorder: a comprehensive systematic review and meta-analysis. Mol Psychiatry 2016; 21: 216–28.Google Scholar
15Fries, GR, Pfaffenseller, B, Stertz, L, Paz, AV, Dargel, AA, Kunz, M, et al. Staging and neuroprogression in bipolar disorder. Curr Psychiatry Rep 2012; 14: 667–75.Google Scholar
16Munkholm, K, Brauner, JV, Kessing, LV, Vinberg, M. Cytokines in bipolar disorder v. healthy control subjects: a systematic review and meta-analysis. J Psychiatr Res 2013; 47: 1119–33.Google Scholar
17Modabbernia, A, Taslimi, S, Brietzke, E, Ashrafi, M. Cytokine alterations in bipolar disorder: a meta-analysis of 30 studies. Biol Psychiatry 2013; 74: 1525.Google Scholar
18Andreazza, AC, Kauer-Sant'anna, M, Frey, BN, Bond, DJ, Kapczinski, F, Young, LT, et al. Oxidative stress markers in bipolar disorder: a meta-analysis. J Affect Disord 2008; 111: 135–44.Google Scholar
19Brown, NC, Andreazza, AC, Young, LT. An updated meta-analysis of oxidative stress markers in bipolar disorder. Psychiatry Res 2014; 218: 61–8.Google Scholar
20Haenisch, F, Cooper, JD, Reif, A, Kittel-Schneider, S, Steiner, J, Leweke, FM, et al. Towards a blood-based diagnostic panel for bipolar disorder. Brain Behav Immun 2016; 52: 4957.Google Scholar
21Le-Niculescu, H, Kurian, SM, Yehyawi, N, Dike, C, Patel, SD, Edenberg, HJ, et al. Identifying blood biomarkers for mood disorders using convergent functional genomics. Mol Psychiatry 2009; 14: 156–74.Google Scholar
22Dayan, CM. Interpretation of thyroid function tests. Lancet 2001; 357: 619–24.Google Scholar
23Haddow, JE, Palomaki, GE, Knight, GJ, Foster, DL, Neveux, LM. Second trimester screening for Down's syndrome using maternal serum dimeric inhibin A. J Med Screen 1998; 5: 115–9.Google Scholar
24Moher, D, Liberati, A, Tetzlaff, J, Altman, DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med 2009; 151: 264–9.Google Scholar
25Haddaway, NR, Collins, AM, Coughlin, D, Kirk, S. The role of google scholar in evidence reviews and its applicability to grey literature searching. PLoS one 2015; 10: e0138237.Google Scholar
26Wells, GA, Shea, B, O'Connell, D, Peterson, JEA, Welch, V, Losos, M, et al. The Newcastle-Ottawa Scale (NOS) for Assessing the Quality of Nonrandomised Studies in Meta-Analyses. Ottawa Hospital Research Institute, 2000.Google Scholar
27Sterne, JA, Sutton, AJ, Ioannidis, JP, Terrin, N, Jones, DR, Lau, J, et al. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ 2011; 343: d4002.Google Scholar
28Lau, J, Ioannidis, JPA, Terrin, N, Schmid, CH, Olkin, I. The case of the misleading funnel plot. BMJ 2006; 333: 597600.Google Scholar
29Andreazza, AC, Cassini, C, Rosa, AR, Leite, MC, de Almeida, LM, Nardin, P, et al. Serum S100B and antioxidant enzymes in bipolar patients. J Psychiatry Res 2007; 41: 523–9.Google Scholar
30Asdemir, A, Turan, T, Uysal, C, Kilic, E. A potential biomarker for bipolar I disorder: serum arginine vasopressin levels. Anatolian J Psychiatry 2017; 18: 195202.Google Scholar
31Aydemir, O, Cubukcuoglu, Z, Erdin, S, Tas, C, Onur, E, Berk, M. Oxidative stress markers, cognitive functions, and psychosocial functioning in bipolar disorder: an empirical cross-sectional study. Rev Bras Psiquiatr 2014; 36: 293–7.Google Scholar
32Bai, YM, Su, TP, Tsai, SJ, Wen-Fei, C, Li, CT, Pei-Chi, T, et al. Comparison of inflammatory cytokine levels among type I/type II and manic/hypomanic/euthymic/depressive states of bipolar disorder. J Affect Disord 2014; 166: 187–92.Google Scholar
33Barbosa, IG, Huguet, RB, Mendonca, VA, Sousa, LP, Neves, FS, Bauer, ME, et al. Increased plasma levels of soluble TNF receptor I in patients with bipolar disorder. Eur Arch Psychiatry Clin Neurosci 2011; 261: 139–43.Google Scholar
34Barbosa, IG, Morato, IB, Huguet, RB, Rocha, FL, Machado-Vieira, R, Teixeira, AL. Decreased plasma neurotrophin-4/5 levels in bipolar disorder patients in mania. Rev Bras Psiquiatr 2014; 36: 340–3.Google Scholar
35Barbosa, IG, Rocha, NP, Huguet, RB, Ferreira, RA, Salgado, JV, Carvalho, LA, et al. Executive dysfunction in euthymic bipolar disorder patients and its association with plasma biomarkers. J Affect Disord 2012; 137: 151–5.Google Scholar
36Barbosa, IG, Rocha, NP, Miranda, AS, Huguet, RB, Bauer, ME, Reis, HJ, et al. Increased BDNF levels in long-term bipolar disorder patients. Rev Bras Psiquiatr 2013; 35: 67–9.Google Scholar
37Cetin, T, Guloksuz, S, Cetin, EA, Gazioglu, SB, Deniz, G, Oral, ET, et al. Plasma concentrations of soluble cytokine receptors in euthymic bipolar patients with and without subsyndromal symptoms. BMC Psychiatry 2012; 12: 158.Google Scholar
38Cunha, AB, Frey, BN, Andreazza, AC, Goi, JD, Rosa, AR, Goncalves, CA, et al. Serum brain-derived neurotrophic factor is decreased in bipolar disorder during depressive and manic episodes. Neurosci Lett 2006; 398: 215–9.Google Scholar
39de Oliveira, GS, Cereser, KM, Fernandes, BS, Kauer-Sant'Anna, M, Fries, GR, Stertz, L, et al. Decreased brain-derived neurotrophic factor in medicated and drug-free bipolar patients. J Psychiatr Res 2009; 43: 1171–4.Google Scholar
40Dell'Osso, L, Bianchi, C, Del Debbio, A, Roncaglia, I, Veltri, A, Carlini, M, et al. Plasma brain-derived neurotrophic factor in bipolar and unipolar depression. Off J Italian Soc Psychopathol 2010; 16: 138–43.Google Scholar
41Dias, VV, Brissos, S, Frey, BN, Andreazza, AC, Cardoso, C, Kapczinski, F. Cognitive function and serum levels of brain-derived neurotrophic factor in patients with bipolar disorder. Bipolar Disord 2009; 11: 663–71.Google Scholar
42do Prado, CH, Rizzo, LB, Wieck, A, Lopes, RP, Teixeira, AL, Grassi-Oliveira, R, et al. Reduced regulatory T cells are associated with higher levels of Th1/TH17 cytokines and activated MAPK in type 1 bipolar disorder. Psychoneuroendocrinology 2013; 38: 667–76.Google Scholar
43Drexhage, RC, Hoogenboezem, TH, Versnel, MA, Berghout, A, Nolen, WA, Drexhage, HA. The activation of monocyte and T cell networks in patients with bipolar disorder. Brain Behav Immunity 2011; 25: 1206–13.Google Scholar
44Fernandes, BS, Gama, CS, Kauer-Sant'Anna, M, Lobato, MI, Belmonte-de-Abreu, P, Kapczinski, F. Serum brain-derived neurotrophic factor in bipolar and unipolar depression: a potential adjunctive tool for differential diagnosis. J Psychiatr Res 2009; 43: 1200–4.Google Scholar
45Fiedorowicz, JG, Prossin, AR, Johnson, CP, Christensen, GE, Magnotta, VA, Wemmie, JA. Peripheral inflammation during abnormal mood states in bipolar I disorder. J Affect Disord 2015; 187: 172–8.Google Scholar
46Gergerlioglu, HS, Savas, HA, Bulbul, F, Selek, S, Uz, E, Yumru, M. Changes in nitric oxide level and superoxide dismutase activity during antimanic treatment. Prog Neuropsychopharmacol Biol Psychiatry 2007; 31: 697702.Google Scholar
47Guloksuz, S, Cetin, EA, Cetin, T, Deniz, G, Oral, ET, Nutt, DJ. Cytokine levels in euthymic bipolar patients. J Affect Disord 2010; 126: 458–62.Google Scholar
48Hope, S, Dieset, I, Agartz, I, Steen, NE, Ueland, T, Melle, I, et al. Affective symptoms are associated with markers of inflammation and immune activation in bipolar disorders but not in schizophrenia. J Psychiatr Res 2011; 45: 1608–16.Google Scholar
49Huang, TL, Lin, FC. High-sensitivity C-reactive protein levels in patients with major depressive disorder and bipolar mania. Prog Neuropsychopharmacol Biol Psychiatry 2007; 31: 370–2.Google Scholar
50Jacoby, AS, Munkholm, K, Vinberg, M, Pedersen, BK, Kessing, LV. Cytokines, brain-derived neurotrophic factor and C-reactive protein in bipolar I disorder - results from a prospective study. J Affect Disord 2016; 197: 167–74.Google Scholar
51Kapczinski, F, Dal-Pizzol, F, Teixeira, AL, Magalhaes, PV, Kauer-Sant'Anna, M, Klamt, F, et al. Peripheral biomarkers and illness activity in bipolar disorder. J Psychiatr Res 2011; 45: 156–61.Google Scholar
52Karamustafalioglu, N, Genc, A, Kalelioglu, T, Tasdemir, A, Umut, G, Incir, S, et al. Plasma BDNFs level initially and post treatment in acute mania: comparison between ECT and atypical antipsychotic treatment and healthy controls. J Psychopharmacol 2015; 29: 898902.Google Scholar
53Kenna, HA, Reynolds-May, M, Stepanenko, A, Ketter, TA, Hallmayer, J, Rasgon, NL. Blood levels of brain derived neurotrophic factor in women with bipolar disorder and healthy control women. J Affect Disord 2014; 156: 214–8.Google Scholar
54Kim, YK, Jung, HG, Myint, AM, Kim, H, Park, SH. Imbalance between pro-inflammatory and anti-inflammatory cytokines in bipolar disorder. J Affect Disord 2007; 104: 91–5.Google Scholar
55Kim, YK, Myint, AM, Lee, BH, Han, CS, Lee, SW, Leonard, BE, et al. T-helper types 1, 2, and 3 cytokine interactions in symptomatic manic patients. Psychiatry Res 2004; 129: 267–72.Google Scholar
56Kim, YK, Suh, IB, Kim, H, Han, CS, Lim, CS, Choi, SH, et al. The plasma levels of interleukin-12 in schizophrenia, major depression, and bipolar mania: effects of psychotropic drugs. Mol Psychiatry 2002; 7: 1107–14.Google Scholar
57Legros, S, Mendlewicz, J, Wybran, J. Immunoglobulins, autoantibodies and other serum protein fractions in psychiatric disorders. Eur Arch Psychiatry Neurol Sci 1985; 235: 911.Google Scholar
58Li, Z, Zhang, C, Fan, J, Yuan, C, Huang, J, Chen, J, et al. Brain-derived neurotrophic factor levels and bipolar disorder in patients in their first depressive episode: 3-year prospective longitudinal study. Br J Psychiatry 2014; 205: 2935.Google Scholar
59Lin, CC, Lee, CT, Lo, YT, Huang, TL. Brain-derived neurotrophic factor protein and mRNA levels in patients with bipolar mania - a preliminary study. Biomed J 2016; 39: 272–6.Google Scholar
60Liu, HC, Yang, YY, Chou, YM, Chen, KP, Shen, WW, Leu, SJ. Immunologic variables in acute mania of bipolar disorder. J Neuroimmunol 2004; 150: 116–22.Google Scholar
61Loch, AA, Zanetti, MV, de Sousa, RT, Chaim, TM, Serpa, MH, Gattaz, WF, et al. Elevated neurotrophin-3 and neurotrophin 4/5 levels in unmedicated bipolar depression and the effects of lithium. Prog Neuropsychopharmacol Biol Psychiatry 2015; 56: 243–6.Google Scholar
62Lotrich, FE, Butters, MA, Aizenstein, H, Marron, MM, Reynolds, CF 3rd, Gildengers, AG. The relationship between interleukin-1 receptor antagonist and cognitive function in older adults with bipolar disorder. Int J Geriatr Psychiatry 2014; 29: 635–44.Google Scholar
63Machado-Vieira, R, Dietrich, MO, Leke, R, Cereser, VH, Zanatto, V, Kapczinski, F, et al. Decreased plasma brain derived neurotrophic factor levels in unmedicated bipolar patients during manic episode. Biol Psychiatry 2007; 61: 142–4.Google Scholar
64Mackin, P, Gallagher, P, Watson, S, Young, AH, Ferrier, IN. Changes in brain-derived neurotrophic factor following treatment with mifepristone in bipolar disorder and schizophrenia. Aust N Z J Psychiatry 2007; 41: 321–6.Google Scholar
65Munkholm, K, Pedersen, BK, Kessing, LV, Vinberg, M. Elevated levels of plasma brain derived neurotrophic factor in rapid cycling bipolar disorder patients. Psychoneuroendocrinology 2014; 47: 199211.Google Scholar
66O'Brien, SM, Scully, P, Scott, LV, Dinan, TG. Cytokine profiles in bipolar affective disorder: focus on acutely ill patients. J Affect Disord 2006; 90: 263–7.Google Scholar
67Ortiz-Dominguez, A, Hernandez, ME, Berlanga, C, Gutierrez-Mora, D, Moreno, J, Heinze, G, et al. Immune variations in bipolar disorder: phasic differences. Bipolar Disord 2007; 9: 596602.Google Scholar
68Panizzutti, B, Gubert, C, Schuh, AL, Ferrari, P, Bristot, G, Fries, GR, et al. Increased serum levels of eotaxin/CCL11 in late-stage patients with bipolar disorder: an accelerated aging biomarker? J Affect Disord 2015; 182: 64–9.Google Scholar
69Rabie, MA, Mohsen, M, Ibrahim, M, El-Sawy Mahmoud, R. Serum level of brain derived neurotrophic factor (BDNF) among patients with bipolar disorder. J Affect Disord 2014; 162: 6772.Google Scholar
70Rosa, AR, Singh, N, Whitaker, E, de Brito, M, Lewis, AM, Vieta, E, et al. Altered plasma glutathione levels in bipolar disorder indicates higher oxidative stress; a possible risk factor for illness onset despite normal brain-derived neurotrophic factor (BDNF) levels. Psychol Med 2014; 44: 2409–18.Google Scholar
71Selek, S, Savas, HA, Gergerlioglu, HS, Bulbul, F, Uz, E, Yumru, M. The course of nitric oxide and superoxide dismutase during treatment of bipolar depressive episode. J Affect Disord 2008; 107: 8994.Google Scholar
72Su, SC, Sun, MT, Wen, MJ, Lin, CJ, Chen, YC, Hung, YJ. Brain-derived neurotrophic factor, adiponectin, and proinflammatory markers in various subtypes of depression in young men. Int J Psychiatry Med 2011; 42: 211–26.Google Scholar
73Suwalska, A, Sobieska, M, Rybakowski, JK. Serum brain-derived neurotrophic factor in euthymic bipolar patients on prophylactic lithium therapy. Neuropsychobiology 2010; 62: 229–34.Google Scholar
74Tramontina, JF, Andreazza, AC, Kauer-Sant'anna, M, Stertz, L, Goi, J, Chiarani, F, et al. Brain-derived neurotrophic factor serum levels before and after treatment for acute mania. Neurosci Lett 2009; 452: 111–3.Google Scholar
75Tsai, SY, Chen, KP, Yang, YY, Chen, CC, Lee, JC, Singh, VK, et al. Activation of indices of cell-mediated immunity in bipolar mania. Biol Psychiatry 1999; 45: 989–94.Google Scholar
76Tsai, SY, Chung, KH, Wu, JY, Kuo, CJ, Lee, HC, Huang, SH. Inflammatory markers and their relationships with leptin and insulin from acute mania to full remission in bipolar disorder. J Affect Disord 2012; 136: 110–6.Google Scholar
77Tsai, SY, Yang, YY, Kuo, CJ, Chen, CC, Leu, SJ. Effects of symptomatic severity on elevation of plasma soluble interleukin-2 receptor in bipolar mania. J Affect Disord 2001; 64: 185–93.Google Scholar
78Tunca, Z, Ozerdem, A, Ceylan, D, Yalcin, Y, Can, G, Resmi, H, et al. Alterations in BDNF (brain derived neurotrophic factor) and GDNF (glial cell line-derived neurotrophic factor) serum levels in bipolar disorder: the role of lithium. J Affect Disord 2014; 166: 193200.Google Scholar
79Uyanik, V, Tuglu, C, Gorgulu, Y, Kunduracilar, H, Uyanik, MS. Assessment of cytokine levels and hs-CRP in bipolar I disorder before and after treatment. Psychiatry Res 2015; 228: 386–92.Google Scholar
80Versace, A, Andreazza, AC, Young, LT, Fournier, JC, Almeida, JR, Stiffler, RS, et al. Elevated serum measures of lipid peroxidation and abnormal prefrontal white matter in euthymic bipolar adults: toward peripheral biomarkers of bipolar disorder. Mol Psychiatry 2014; 19: 200–8.Google Scholar
81Wadee, AA, Kuschke, RH, Wood, LA, Berk, M, Ichim, L, Maes, M. Serological observations in patients suffering from acute manic episodes. Human psychopharmacology 2002; 17: 175–9.Google Scholar
82Yanik, M, Vural, H, Tutkun, H, Zoroglu, SS, Savas, HA, Herken, H, et al. The role of the arginine-nitric oxide pathway in the pathogenesis of bipolar affective disorder. Eur Arch Psychiatry Clin Neurosci 2004; 254: 43–7.Google Scholar
83Breunis, MN, Kupka, RW, Nolen, WA, Suppes, T, Denicoff, KD, Leverich, GS, et al. High numbers of circulating activated T cells and raised levels of serum IL-2 receptor in bipolar disorder. Biol Psychiatry 2003; 53: 157–65.Google Scholar
84Brietzke, E, Stertz, L, Fernandes, BS, Kauer-Sant'anna, M, Mascarenhas, M, Escosteguy Vargas, A, et al. Comparison of cytokine levels in depressed, manic and euthymic patients with bipolar disorder. J Affect Disord 2009; 116: 214–7.Google Scholar
85De Berardis, D, Conti, CM, Campanella, D, Carano, A, Scali, M, Valchera, A, et al. Evaluation of C-reactive protein and total serum cholesterol in adult patients with bipolar disorder. Int J Immunopathol Pharmacol 2008; 21: 319–24.Google Scholar
86Kauer-Sant'Anna, M, Kapczinski, F, Andreazza, AC, Bond, DJ, Lam, RW, Young, LT, et al. Brain-derived neurotrophic factor and inflammatory markers in patients with early- v. late-stage bipolar disorder. Int J Neuropsychopharmacol 2009; 12: 447–58.Google Scholar
87Kunz, M, Ceresér, KM, Goi, PD, Fries, GR, Teixeira, AL, Fernandes, BS, et al. Serum levels of IL-6, IL-10 and TNF-α in patients with bipolar disorder and schizophrenia: differences in pro- and anti-inflammatory balance. Rev Bras Psiquiatr 2011; 33: 268–74.Google Scholar
88Monteleone, P, Serritella, C, Martiadis, V, Maj, M. Decreased levels of serum brain-derived neurotrophic factor in both depressed and euthymic patients with unipolar depression and in euthymic patients with bipolar I and II disorders. Bipolar Disord 2008; 10: 95100.Google Scholar
89Walz, JC, Magalhaes, PV, Giglio, LM, Cunha, AB, Stertz, L, Fries, GR, et al. Increased serum neurotrophin-4/5 levels in bipolar disorder. J Psychiatr Res 2009; 43: 721–3.Google Scholar
90Yatham, LN, Kapczinski, F, Andreazza, AC, Trevor Young, L, Lam, RW, Kauer-Sant'anna, M. Accelerated age-related decrease in brain-derived neurotrophic factor levels in bipolar disorder. Int J Neuropsychopharmacol 2009; 12: 137–9.Google Scholar
91Sen, S, Duman, R, Sanacora, G. Serum brain-derived neurotrophic factor, depression, and antidepressant medications: meta-analyses and implications. Biol Psychiatry. 2008; 64: 527–32.Google Scholar
92Rybakowski, JK. Response to lithium in bipolar disorder: clinical and genetic findings. ACS Chem Neurosci 2014; 5: 413–21.Google Scholar
93de Sousa, RT, Zarate, CA Jr, Zanetti, MV, Costa, AC, Talib, LL, Gattaz, WF, et al. Oxidative stress in early stage bipolar disorder and the association with response to lithium. J Psychiatr Res 2014; 50: 3641.Google Scholar
94Kato, TA, Monji, A, Mizoguchi, Y, Hashioka, S, Horikawa, H, Seki, Y, et al. Anti-Inflammatory properties of antipsychotics via microglia modulations: are antipsychotics a ‘fire extinguisher’ in the brain of schizophrenia? Mini Rev Med Chem 2011; 11: 56574.Google Scholar
95Cohen, J. Statistical Power Analysis for the Behavioral Sciences. Lawrence Erlbaum Associates, 1988.Google Scholar
96Fernandes, BS, Steiner, J, Berk, M, Molendijk, ML, Gonzalez-Pinto, A, Turck, CW, et al. Peripheral brain-derived neurotrophic factor in schizophrenia and the role of antipsychotics: meta-analysis and implications. Mol Psychiatry 2015; 20: 1108–19.Google Scholar
97Molendijk, ML, Spinhoven, P, Polak, M, Bus, BA, Penninx, BW, Elzinga, BM. Serum BDNF concentrations as peripheral manifestations of depression: evidence from a systematic review and meta-analyses on 179 associations (N=9484). Mol Psychiatry 2014; 19: 791800.Google Scholar
98Maes, M. A review on the acute phase response in major depression. Rev Neurosci 1993; 4: 407–16.Google Scholar
99Hodes, GE, Menard, C, Russo, SJ. Integrating Interleukin-6 into depression diagnosis and treatment. Neurobiol Stress 2016; 4: 1522.Google Scholar
100Dowlati, Y, Herrmann, N, Swardfager, W, Liu, H, Sham, L, Reim, EK, et al. A meta-analysis of cytokines in major depression. Biol Psychiatry 2010; 67: 446–57.Google Scholar
101Haapakoski, R, Mathieu, J, Ebmeier, KP, Alenius, H, Kivimaki, M. Cumulative meta-analysis of interleukins 6 and 1beta, tumour necrosis factor alpha and C-reactive protein in patients with major depressive disorder. Brain Behav Immunity 2015; 49: 206–15.Google Scholar
102Berk, M, Kapczinski, F, Andreazza, AC, Dean, OM, Giorlando, F, Maes, M, et al. Pathways underlying neuroprogression in bipolar disorder: focus on inflammation, oxidative stress and neurotrophic factors. Neurosci Biobehav Rev 2011; 35: 804–17.Google Scholar
103Doganavsargil-Baysal, O, Cinemre, B, Aksoy, UM, Akbas, H, Metin, O, Fettahoglu, C, et al. Levels of TNF-alpha, soluble TNF receptors (sTNFR1, sTNFR2), and cognition in bipolar disorder. Hum Psychopharmacol 2013; 28: 160–7.Google Scholar
104Boll, KM, Noto, C, Bonifacio, KL, Bortolasci, CC, Gadelha, A, Bressan, RA, et al. Oxidative and nitrosative stress biomarkers in chronic schizophrenia. Psychiatry Res 2017; 253: 43–8.Google Scholar
105Ng, F, Berk, M, Dean, O, Bush, AI. Oxidative stress in psychiatric disorders: evidence base and therapeutic implications. Int J Neuropsychopharmacol 2008; 11: 851–76.Google Scholar
106Baek, D, Park, Y. Association between erythrocyte n-3 polyunsaturated fatty acids and biomarkers of inflammation and oxidative stress in patients with and without depression. Prostaglandins Leukot Essent Fatty Acids 2013; 89: 291–6.Google Scholar
107Spanemberg, L, Caldieraro, MA, Vares, EA, Wollenhaupt-Aguiar, B, Kauer-Sant'Anna, M, Kawamoto, SY, et al. Biological differences between melancholic and nonmelancholic depression subtyped by the CORE measure. Neuropsychiatr Dis Treat 2014; 10: 152331.Google Scholar
108Maletic, V, Raison, C. Integrated neurobiology of bipolar disorder. Front Psychiatry 2014; 5: 98.Google Scholar
109Haack, M, Hinze-Selch, D, Fenzel, T, Kraus, T, Kuhn, M, Schuld, A, et al. Plasma levels of cytokines and soluble cytokine receptors in psychiatric patients upon hospital admission: effects of confounding factors and diagnosis. J Psychiatr Res 1999; 33: 407–18.Google Scholar
110Chae, CU, Lee, RT, Rifai, N, Ridker, PM. Blood pressure and inflammation in apparently healthy men. Hypertension 2001; 38: 399403.Google Scholar
111Pischon, T, Hankinson, SE, Hotamisligil, GS, Rifai, N, Rimm, EB. Leisure-time physical activity and reduced plasma levels of obesity-related inflammatory markers. Obes Res 2003; 11: 1055–64.Google Scholar
112Kapczinski, F, Simões Fernandes, B, Kauer-Sant'Anna, M, Gama, CS, Yatham, LN, Berk, M. The concept of staging in bipolar disorder: the role of BDNF and TNF-alpha as biomarkers. Acta Neuropsychiatrica 2009; 21: 272–4.Google Scholar
113Sigitova, E, Fisar, Z, Hroudova, J, Cikankova, T, Raboch, J. Biological hypotheses and biomarkers of bipolar disorder. Psychiatry Clin Neurosci 2017; 71: 77103.Google Scholar
114McIntyre, RS, Soczynska, JK, Cha, DS, Woldeyohannes, HO, Dale, RS, Alsuwaidan, MT, et al. The prevalence and illness characteristics of DSM-5-defined ‘mixed feature specifier’ in adults with major depressive disorder and bipolar disorder: results from the International Mood Disorders Collaborative Project. J Affect Disord 2015; 172: 259–64.Google Scholar
115Miller, S, Suppes, T, Mintz, J, Hellemann, G, Frye, MA, McElroy, SL, et al. Mixed depression in bipolar disorder: prevalence rate and clinical correlates during naturalistic follow-up in the Stanley Bipolar Network. Am J Psychiatry 2016; 173: 1015–23.Google Scholar
116Carvalho, AF, Kohler, CA, Fernandes, BS, Quevedo, J, Miskowiak, KW, Brunoni, AR, et al. Bias in emerging biomarkers for bipolar disorder. Psychol Med 2016; 46: 2287–97.Google Scholar
117Hayes, JF, Khandaker, GM, Anderson, J, Mackay, D, Zammit, S, Lewis, G, et al. Childhood interleukin-6, C-reactive protein and atopic disorders as risk factors for hypomanic symptoms in young adulthood: a longitudinal birth cohort study. Psychol Med 2017; 47: 2333.Google Scholar
Figure 0

Fig. 1 PRISMA (Preferred Reporting Items for Systematic reviews and Meta-analyses) diagram.

Figure 1

Table 1 Discriminatory and potentially discriminatory biomarkers

Figure 2

Fig. 2 (a) Forest plot of high-sensitivity C-reactive protein (hsCRP) in depression, euthymia and mania compared with healthy controls and (b) forest plot of interleukin (IL)-6 in depression, euthymia and mania compared with healthy controls.Std, standard.

Figure 3

Fig. 3 (a) Forest plot of tumour necrosis factor (TNF)-α in depression, euthymia and mania compared with healthy controls and (b) forest plot of soluble TNF-α receptor 1 (sTNFR1) in depression, euthymia and mania compared with healthy controls.a. Medication free; b. lithium monotherapy. Std, standard.

Figure 4

Fig. 4 Forest plot of brain derived neurotrophic factor (BDNF) in depression, euthymia and mania compared with healthy controls.a. Early stage; b. Late stage. Std, standard.

Figure 5

Table 2 Fully discriminatory biomarker combinations

Supplementary material: File

Rowland et al. supplementary material

Rowland et al. supplementary material 1

Download Rowland et al. supplementary material(File)
File 4.5 MB
Submit a response

eLetters

No eLetters have been published for this article.