Scientific scepticism is a position that promotes suspension of judgement by reason until the proposition effects are examined by applying robust empirical methodologies. René Descartes’ (1596–1650) seminal work on doubt laid the foundations of modern research.Reference Ijsseling and Ijsseling1 To quote Descartes, ‘The first rule was never to accept anything as true unless I recognized it to be such: that is, carefully to avoid precipitation and prejudgment and to include nothing in my conclusions unless it presented itself so clearly and distinctly to my mind that there was no occasion to doubt it’.Reference Ijsseling and Ijsseling1 Likewise, influential British thinker Francis Bacon's (1561–1626) outstanding contributions during the scientific revolution were based on the core view that ‘whatever his mind seizes and dwells upon with particular satisfaction is to be held in suspicion’.Reference Ijsseling and Ijsseling1
Categories of study conducted on the impacts of COVID-19 on mental health
The data from the SARS outbreak of 2003 was utilised in the faster determination of the SARS-CoV-2 virus via genomic sequencing, the development of its diagnostics and the implementation of robust strategies for quarantine and isolation.Reference Yang, Peng, Wang, Guan, Jiang and Xu2 After the outbreak of the SARS-CoV-2 (COVID-19) pandemic in late 2019, stringent policies and measures were enforced to curb its spread.
These measures had an impact on the population's mental health and their effects were extensively studied worldwide.Reference Meade3 These studies were broadly divided into four categories: (a) effects of the lockdowns on mental health;Reference Jia, Ayling, Chalder, Massey, Broadbent and Coupland4 (b) direct effects of the SARS-CoV-2 virus (and its variants)Reference Toubiana, Poirault, Corsia, Bajolle, Fourgeaud and Angoulvant5 and the increased risk of incident mental health disorders in survivors of acute SARS-CoV-2 infection, including anxiety disorders, depressive disorders, stress and adjustment disorders, opioid use disorder, other (non-opioid) substance use disorders, neurocognitive decline and sleep disorders;Reference Xie, Xu and Al-Aly6 (c) lasting symptoms post-infection (long COVID);Reference Gupta, Gupta and Esang7 and (d) worsening mental health emergencies secondary to the stress of the pandemic.Reference Yard8 Subsequently, in 2020 numerous published studies associated a range of mixed mental health effects with the pandemic lockdown. These indirect effects were linked to several perpetuating and precipitating factors, including restricted physical activity, heightened perceived risks and parenting stresses.Reference Meade3 A surge in mental health emergency visits was attributed to these factors, self-reports of symptoms of anxiety and depression in adolescents, and externalising disorders among college-aged youth.Reference Feroz, Ali, Ali, Feroz, Meghani and Saleem9,Reference Varma, Junge, Meaklim and Jackson10
Another miscellaneous but highly important category includes studies specifically designed to test unanswered questions and serious limitations in the interpandemic literature. In this category, a prospective longitudinal observational study reported that anxiety and depressive symptoms peaked during the early stages of the first lockdown in England; there was a rapid decline over the subsequent 20-week period. Specific risk groups were also identified as female gender, individuals with lower educational attainment, lower income or pre-existing mental health conditions, and those living alone or with children.Reference Fancourt, Steptoe and Bu11 These types of study highlighted the role of confounding secondary stressors associated with variance in mental health outcomes.
During the initial phase of the pandemic, children, adolescents and young adults were considered less vulnerable to the direct effects of SARS-CoV-2, with very limited morbidity and mortality.Reference Zimmermann and Curtis12 It was not until late 2021 that both the indirect effects and the direct effects of the pandemic, including long COVID, were linked to negative mental health outcomes.Reference Cui, Lu, Weng, Yi and He13 However, further scrutiny through the application of the principles of scientific doubt and critical appraisal has brought to light methodological limitations, bringing under scrutiny the overall validity of these findings.Reference Radtke, Ulyte, Puhan and Kriemler14 There have been serious arguments about small effect sizes and omissions that contributed to a lack of generalisability.Reference Nieto, Navas and Vázquez15 The key issues raised include the lack of a robust longitudinal study design that incorporates individual differences and measures many interacting variables.
Children and young people and COVID-19: a twin study
To address some of these critical questions, Rimfeld et al designed and conducted a study of 4773 twins (mean age of 22 years) in the UK.Reference Rimfeld, Malanchini, Arathimos, Gidziela, Pain and McMillan16 In this sample, they measured and compared mental health symptoms at four distinct time points during the pandemic. Unlike prior studies, this study also accounted for the highly heritable differences in the response to changing environments (the pandemic) due to genetic variations between individuals.
Rimfeld et al measured mental health symptoms using self-reported questionnaires and the CoRonavIruS Health Impact Survey (CRISIS), which also assessed environmental factors germane to the pandemic.Reference Rimfeld, Malanchini, Arathimos, Gidziela, Pain and McMillan16 The genome-wide polygenic scores (GPS) estimated the variance in mental health measures at the four time points. The results were counterintuitive, and the study emphasised remarkable resilience among young adults which negated the effects of adversities during the pandemic. Resilience remains a complex construct with many definitions; however, in this context it is an individual's capacity to identify processes, including interpersonal social processes, that are statistically associated with stronger teams and relationships and, secondarily, the possibility of better outcomes.Reference Southwick, Bonanno, Masten, Panter-Brick and Yehuda17
Although there was a decline in mental health during the initial phase of the lockdown, the participants exhibited no long-term negative effects. These results are contrary to previous findings; the authors emphasised that prior studies only focused on the statistical significance of the mean difference and not the effect size, which may have yielded negative effects. The computation of the standardised mean difference or effect size, often expressed as Cohen's d, is critical in providing a quantitative reflection of the magnitude of the phenomenon.Reference Kelley and Preacher18
The key findings include that individuals with pre-existing mental health conditions were more vulnerable to the effects of the pandemic. Even though the mental health symptoms got worse immediately after the lockdown, they came back to pre-pandemic levels during later stages. Another interesting finding indicated that the genetic correlation was 0.95 for mental health measures before and during the pandemic. This underscores that the genetic factors contributing to individual differences did not change during a pandemic.
Rimfeld et al have both highlighted critical gaps in the previous studies and provided many generalisable findings that could contribute to policy-making and healthcare management. First, equitable study designs are crucial for empirically measuring true estimates of any effect. The difference in the results as compared with the previous studies was due to reasons such as omitted variables bias, small effect size, shorter duration and inter-participant variability. Second, individuals with pre-existing psychiatric illnesses remain the most vulnerable populations, and policymakers need to prioritise making mental healthcare services easily accessible to them. Third, the positive effects of an individual's strengths and resilience factors were underestimated and even omitted in previous studies. Future studies to identify the role of resilience in the context of pandemic-related adversities will help implement population-based measures to better stratify healthcare resources. However, it is important to note that the Rimfeld et al study has many limitations, including the implicit bias of using self-reported questionnaires among predominately White educated young adults in the UK.
The way forward
In the past 2 years, more data have come up that suggest the presence of long COVID symptoms in children, adolescents and young adults.Reference Stephenson, Pinto Pereira, Shafran, de Stavola, Rojas and McOwat19 Similarly, concerns about the validity of these findings are questioned since many with negative test results (reverse transcription polymerase chain reaction) had similar symptomatology of long COVID as those with positive test results.Reference Molteni, Sudre, Canas, Bhopal, Hughes and Antonelli20 The self-limiting long COVID symptoms often remit in 6 weeks; however, long COVID continues to burden the healthcare system and adds to the conundrum.Reference Gurdasani, Akrami, Bradley, Costello, Greenhalgh and Flaxman21 The role of interacting variables such as immunological factors and psychological stress, and their relationship with response to SARS-CoV-2, remains an area of future research. There are many variants of SARS-CoV-2 and differences in mental health sequelae among vaccinated and unvaccinated would inspire a better understanding of variability in responses.
There is compelling evidence from cross-country comparative studies about the effectiveness of non-pharmaceutical interventions (NPIs) to mitigate the spread of COVID-19. Although there was a large effect of the timely closing of both schools and universities, the stay-at-home order had a small effect when a country had already closed its academic institutions and non-essential businesses and banned gatherings.Reference Brauner, Mindermann, Sharma, Johnston, Salvatier and Gavenčiak22 These lessons from the chronology of cross-country implementation of NPI have yielded the roadmap for future strategies and research.
There was an urgent need in 2020 to recognise and understand the mental health impact of the SARS-CoV-2 virus. There were calls for papers from the editorial teams of several journals and literature was freely available without access fees. During the initial phase, many studies provided a broad trend, with many serious gaps in the methodologies. More detailed analysis of these data and better-designed studies provided different findings in subsequent years. In times of misinformation, when the wide reach of unmonitored social media has contributed to vaccine hesitancy, it is imperative to get the messaging right.Reference Garett and Young23 The research and clinical community must adhere to the principles of scientific doubt, with openness about the inherent flaws in study designs, implicit bias and gaps in the level of evidence generated.
Data availability
Data availability is not applicable to this article as no new data were created or analysed in this study.
Funding
This study received no specific grant from any funding agency, commercial or not-for-profit sectors.
Declaration of interest
None.
eLetters
No eLetters have been published for this article.