Introduction
The COVID-19 pandemic posed unprecedented challenges to healthcare systems across the world. Reference Datta, Barrett and Bentzinger1 The World Health Organization (WHO) declared the COVID-19 global pandemic on March 11, 2020, Reference Casassa, Moss and Goldenholz2 forcing many countries to lockdown and restrict their outpatient care, ambulatory testing, and procedures.
Epilepsy is a chronic and debilitating condition requiring regular monitoring of seizure control, as well as the use of anti-seizure medications (ASMs) and their side effects. Reference Subotic, Pricop and Josephson3 The disease burden of epilepsy ranked second among neurologic conditions in terms of disability-adjusted life years by the WHO’s 2010 Global Burden of Disease study. Reference Casassa, Moss and Goldenholz2 At the beginning of the COVID-19 pandemic, health care for individuals with epilepsy changed dramatically, including the increased use of telemedicine, decreased electroencephalogram (EEG) use, limited availability of epilepsy surgery, Reference Lignou, Greenwood, Sheehan and Wolfe4,Reference Kendzerska, Zhu and Gershon5 and a reduction in the new prescription and renewals of ASMs. Reference Antonazzo, Fornari and Maumus-Robert6 In studies conducted in the United Kingdom and the United States during the initial phase of the pandemic, 25%–34% of individuals with epilepsy Reference Casassa, Moss and Goldenholz2,Reference Reilly, Muggeridge and Cross7 and 29% of caregivers Reference Reilly, Muggeridge and Cross7 reported increased perceived seizures; 31% of patients and 20% of caregivers reported difficulties accessing medication; Reference Reilly, Muggeridge and Cross7 and 5% of patients reported stopping or reducing ASMs due to health care access or cost. Reference Casassa, Moss and Goldenholz2 Similarly, the International League Against Epilepsy COVID-19 and Telemedicine Task Force, which aimed to assess the international patient experience during the COVID-19 pandemic, Reference Cross, Kwon and Asadi-Pooya8 found that 23% of people with epilepsy and 28% of caregivers reported increased seizure frequency; difficulty obtaining medication was reported by 20% of individuals with epilepsy and 26% of caregivers; and difficulty with health care access was reported by 28% of individuals with epilepsy and 30% of caregivers. Reference Cross, Kwon and Asadi-Pooya8
However, most of the studies that described the impact of the COVID-19 pandemic on individuals with epilepsy were mainly survey or interview-based, Reference Casassa, Moss and Goldenholz2,Reference Reilly, Muggeridge and Cross7,Reference Beniczky, Husain and Ikeda9 limited by small sample sizes, Reference Subotic, Pricop and Josephson3,Reference Reilly, Muggeridge and Cross7 lacking long-term data (most published evidence is focused on one to four months since the pandemic), Reference Datta, Barrett and Bentzinger1–Reference Subotic, Pricop and Josephson3,Reference Reilly, Muggeridge and Cross7–Reference Beniczky, Husain and Ikeda9 and had limited data on healthcare utilization and mortality. Reference Datta, Barrett and Bentzinger1–Reference Subotic, Pricop and Josephson3,Reference Reilly, Muggeridge and Cross7–Reference Beniczky, Husain and Ikeda9 Importantly, no studies investigated the extent to which pandemic restrictions on non-urgent health services result in increased morbidity and death in individuals with epilepsy during the pandemic. To address these limitations, we conducted a population-based study with the primary objective to describe trends in healthcare utilization and mortality in adults with epilepsy during the first year of the pandemic restrictions compared to similar periods in previous years. As the secondary objective, we investigated the association between changes in non-urgent healthcare services since the pandemic compared to pre-pandemic historical data and adverse health outcomes during the pandemic. We hypothesize that there are lower rates of non-urgent health service use during the pandemic compared to the same periods pre-pandemic. We also hypothesize that periods with lower rates of non-urgent health service use during the pandemic are associated with increased rates of adverse health outcomes compared to the same periods pre-pandemic.
Methods
Study Design
We conducted a retrospective population-based study via open-cohort sampling strategy using Ontario health administrative data, from the most populous province of Canada, on adults with a previous diagnosis of epilepsy during the first year of the COVID-19 pandemic (March 2020–March 2021) and compared their healthcare utilization and mortality to similar periods in the previous years (Jan 2016–Dec 2019).
The use of data in this study was authorized under section 45 of Ontario’s Personal Health Information Protection Act, which does not require review by a Research Ethics Board.
Data Sources
ICES, an independent non-profit institution, houses individual-level high-quality administrative databases on publicly funded services, including outpatient and inpatient visits (emergency department [ED] visits or hospitalizations) and diagnostic testing in Ontario. 10 These databases are regularly updated and validated for accuracy (https://datadictionary.ices.on.ca/Applications/DataDictionary/Default.aspx ). Reference Juurlink, Croxford, Chong, Austin, Tu and Laupacis11,Reference Goel, Williams, Anderson, Blackstien-Hirsch, Fooks and Naylor12 The Registered Persons (RPDB) database contains data on vital statistics and demographics. The Ontario Health Insurance Plan (OHIP) database captures 95% of physician billing. The National Ambulatory Care Reporting System Database (NACRS) records ED visits. The Discharge Abstract Database (DAD) records hospitalizations, and the Canadian Census includes neighborhood socioeconomic details. Ontario Mental Health Reporting System contains information on inpatient mental health admissions. The COVID-19 Integrated Testing Dataset includes all available COVID-19 diagnostic laboratory results in Ontario. These databases were linked using unique encoded identifiers. In Ontario, physician billing codes in response to the COVID-19 pandemic, including virtual visits (phone or video), were implemented on March 14, 2020, and extended until December 1, 2022. 13
Population and Setting
In an open cohort, all adults (18 years and older) Ontario residents with a prior diagnosis of epilepsy between January 2016–March 2021 who were alive at the beginning of each month were considered for inclusion. Prior diagnosis of epilepsy was identified by the presence of one inpatient visit (hospitalization) at any time or two physician claims within 2 years with epilepsy-specific diagnostic codes (ICD-9: 345; ICD-10: G40 or G41; OHIP: 345). Reference Tu, Wang and Jaakkimainen14,15 The open-cohort sampling strategy allows individuals to enter the cohort as they age and leave when they die or move out of the province. We considered March 17, 2020, when the state of emergency was declared in Ontario, Reference By Rodrigues16 as the start of the pandemic. Follow-up continued until March 31, 2021.
Time frame Definitions
Observed versus projected event rates with 95% confidence intervals (CIs) were visualized monthly over the first year of the pandemic. For comparison, similar to our previous study, Reference Kendzerska, Zhu and Pugliese17 four time periods were considered: (i) pre-COVID-19: Jan–Feb 2020; (ii) Wave I: March–May 2020; (iii) Summer lull: June–August 2020; and (iv) Wave II: September 2020–March 2021.
Outcomes
Primary Objective
The primary outcomes were all-cause outpatient visits, relevant diagnostic tests used to work up the etiology of a seizure Reference Smith18 (EEG, sleep studies, magnetic resonance imaging [MRI], and a computerized tomography [CT] scan), all-cause ED visits and hospitalizations (from NACRS and DAD databases), and all-cause mortality (from RPDB database). Outpatient visits were categorized by: (i) total (virtual or in-person) primary care visits, (ii) total (virtual or in-person) visits from other than family medicine specialists, and (ii) total virtual outpatient visits.
Health system costs were considered in the secondary analysis. We estimated costs associated with health care utilization from a public payer’s perspective using the hybrid costing methods developed for Ontario health administrative data (see more details in the Data Supplement). Reference Wodchis, Bushmeneva, Nikitovic and McKillop19 All costs were standardized using health sector-specific consumer price indices to their equivalent 2021 Canadian dollar value. 20
Secondary Objective
All-cause outpatient visits and epilepsy-relevant diagnostic testing were considered non-urgent healthcare services. All-cause ED visits, hospitalization, and mortality were considered separately as adverse health outcomes.
Covariates
Covariates considered were sex, age group (18–24, 25–34, 35–49, 50–64, 65+), residence location (rural vs. urban), neighborhood income quintiles, and mental health status (based on mental health and addictions-related outpatient and inpatient services within the last year; please see details in the Data Supplement).
Statistical Analyses
Primary Objective
We used a similar analytic approach as from our previous study to describe trends in healthcare utilization and mortality. Reference Kendzerska, Zhu and Pugliese17 Briefly, we created a 63-period time series from January 2016 to March 2021 and calculated monthly rates as the number of events per 100,000 people. Autoregressive integrated moving-average (ARIMA) models were used to calculate projected outcome rates using observed monthly rates from similar periods pre-COVID (Jan 2016–Dec 2019). ARIMA models regress observed rates on past observed values, fitting autoregressive and moving-average terms to account for seasonality and other underlying trends and correlation structures. Reference Box, Jenkins and Reinsel21 We used SAS software’s adaption of the United States Census Bureau’s X-13ARIMA-SEATS program (X13) for ARIMA, 22,Reference Dagum23 including its automated model selection feature. Reference Gomez, Maravall, Pefia, Tiao and Tsay24 This algorithm selects the best-fitting model using the Bayesian Information Criterion. 22
We used the best-fitting model for each outcome to project monthly rates for 13 months following February 2020. We considered observed rates outside the projected 95% CIs to be significantly different from projected rates. Reference Kendzerska, Zhu and Gershon5 We presented comparisons between observed and projected monthly rates graphically as a time series and mean rates across the four time periods in tabular form.
We conducted all analyses in the whole sample and stratified by sex and age group (18–24, 25–34, 35–49, 50–64, 65+).
Secondary Objective
To investigate how the pandemic interacted with non-urgent healthcare (outpatient visits and epilepsy-relevant diagnostic testing) and its association with adverse health outcomes (all-cause ED visits, hospitalizations, or death) since the pandemic, we used a two-way statistical interaction term between frequency of non-urgent healthcare services and pandemic. We operationalized non-urgent healthcare utilization as a categorical variable in two steps: (1) calculating the rate of healthcare utilization for each month in the time series and then (2) categorizing months of the time series into quantiles based on these rates to compare months with high vs. lower frequency of healthcare services. The effect of the pandemic was operationalized using a binary indicator: months in the time series from January 2015 to February 2020 were categorized as “pre-COVID,” and all subsequent months were categorized as “post-COVID.” We used contrast statements to compare outcome rates during the “post-COVID” period to the “pre-COVID” period within each quantile of non-urgent healthcare services. Quasi-Poisson models were used to estimate crude and adjusted rate ratios (RRs) for outcomes of interest. Reference Gardner, Mulvey and Shaw25 Significant interactions were explored by calculating RRs for post- vs pre-COVID at each level of frequency of service use. Interaction p-values < 0.05 indicated a significant interaction. Covariates considered in the statistical model were sex, age, rurality, income, and mental health status.
Given that an increase in the frequency of virtual care visits was a pandemic-specific phenomenon, its effect was explored within the pandemic period only.
We performed all data analyses in SAS (version 9.4 using SAS Enterprise guide version 7.15.3) in the secure environment at ICES following Ontario privacy standards.
Results
In March 2020, 98,267 adults had a prior diagnosis of epilepsy: 50,702 (51.6%) male, 24,742 (25.2%) 65 years and older, and 45,782 (46.6%) resided in low-income areas.
Crude rates and rate ratios for outcomes of interest compared to similar periods in previous years are presented in Table 1. Tables 2, 3, and Supplementary Tables 1–11 present observed and projected monthly rates and 95% CI estimated by ARIMA Models. Adjusted rate ratios are presented in Tables 4 and 5. Figures 1 and Supplementary Figures 1–3 present observed versus projected monthly rates for outcomes of interest.
CI=confidence intervals; ED=emergency department; RR=rate ratios.
In bold: statistically significant.
In bold: observed rates outside the projected 95% confidence intervals of projected rates were considered as significantly different.
All models were adjusted for sex, age, rurality, income, and mental health status.
* Reference group: pre-COVID period. Healthcare service use frequency and COVID-19 period interaction were explored using categorical variables. Interactions were unpacked by calculating RRs for the COVID period (post vs. pre) at each level of quantile. Significant interaction p–values indicate one or more significant differences between RRs.
# Exposure frequency was organized into quantiles. The number of quantile groups was dependent on the available variability in exposure rates (exposures with higher variability were allocated more groups up to a maximum of five).
All models were adjusted for sex, age, rurality, income, and mental health status.
* Exposure frequency was organized into quantiles. The number of quantile groups was dependent on the available variability in exposure rates (exposures with higher variability were allocated more groups up to a maximum of five).
All-cause outpatient visits
Compared to similar pre-pandemic periods, both all-cause primary care and specialist visits significantly decreased during Wave I, returned to projected during the Summer Lull, and increased during Wave II: observed rate of all-cause outpatient visit rates (per 100,000 people at risk) 85,535.4 vs projected 76,620.6, 95% CI 71,546.9–82,059.4 (Table 2; Supplementary Figure 1). Virtual care visit rates significantly increased and remained well above projected throughout the first year of the pandemic (Table 2). Sex and age did not influence this pattern (Supplementary Tables 1–3).
Relevant Diagnostic Tests (Supplementary Figure 2)
EEG testing rates significantly decreased during the first year of the pandemic (Table 2) and remained significantly lower than projected during Wave II (observed rate per 100,000 people of 1,348.0 vs projected 1,792.1, 95% CI 1,636.3–1,962.8) overall, but not for individuals at age 25–34 years old for whom rates returned to projected during Summer Lull and Wave II (Supplementary Table 6). Sex did not influence this pattern. Following the same trend, observed rates for sleep studies during Wave I and Summer Lull were significantly lower than projected, but returned to projected during Wave II (observed rate of 184.1 vs projected 208.15, 95% CI: 179.03–242.00) for all, but not for individuals at age 50–64 years old for whom rates remained significantly lower than projected throughout all periods studied (Table 2, Supplementary Table 5). Sex did not influence this pattern.
During Wave I and Summer Lull, rates for MRI significantly decreased and returned to projected during Wave II (observed rate per 100,000 people of 2,112.4 vs projected of 2,040.8, 95%: 1,942.9–2,143.8), except for females and those in the age group 65 years and older, for whom rates remained lower than projected (Table 2, Supplementary Table 7). Similarly, observed rates remained lower than projected during Wave I and Summer Lull for CT and returned to projected during Wave II: observed rate of 4,096.4 vs. projected of 4,130.1, 95%: 3,878.4–4,398.2 (Table 2). This pattern was similar by age and sex subgroups (Supplementary Table 8).
ED Visits and Hospitalizations
During the first year of the pandemic, all-cause ED visits rates remained significantly lower than projected: during Wave II, the observed rate was 8,665.1 vs. projected of 10,421.4 (10,119.8–10,732.0) (Table 2, Fig. 1). During the first year of the pandemic, all-cause hospitalization rates remained significantly lower than projected during Wave I and returned to projected during Summer Lull and Wave II (Table 2, Fig. 1). Sex and age did not influence this pattern (Supplementary Tables 9–10).
All-Cause Mortality
Compared to projected, observed all-cause mortality rates significantly increased during Wave I (observed rate of 355.8 vs projected of 308.8, 95% CI: 276.3–345.1) and returned to the projected during Summer Lull and Wave II (Table 2, Supplementary Figure 3). During Wave I, all-cause mortality was increased only among individuals 65 years old and older: observed rates of 950.5 vs. projected 809.4, 95% CI: 700.5–935.2. Sex did not influence this pattern (Supplementary Table 11).
Health System Costs
The observed total health system cost was significantly reduced only during Wave I and then returned to the projected (Table 3). A similar pattern was noted for physician-, medication-, and laboratory-related costs. While the observed cost of hospitalizations reduced during Wave I, it increased above projected since June 2020 and remained elevated above projected during Wave II: 66.73 million vs 61.14, 95%: 56.47–66.20 (Figure 1).
Changes in Non-Urgent Healthcare Services Since the Pandemic and Adverse Health Outcomes
The primary care visits and COVID period interaction terms were significantly related to the rates of all-cause ED visits and hospitalizations (interaction p-values<0.008) (Table 4). The interaction p-values indicate one or more significant differences between these RRs, suggesting that the decrease in the rate of ED visits and hospitalizations with the pandemic, compared to pre-pandemic, was greater during those months with a lower frequency of primary care visits than those with a higher frequency. The increase in the rate of all-cause mortality during the pandemic, compared to pre-pandemic, was greater during those months with a higher frequency of primary care visits than those with a lower frequency (interaction p-value < 0.0001).
The EEG tests and COVID period interaction terms were not significantly related to the rates of all-cause ED visits and hospitalizations (interaction p-values > 0.6) (Table 4). The increase in the rate of all-cause mortality during the pandemic, compared to pre-pandemic, was greater during those months with the lower frequency of EEG rates than those with higher frequency (interaction p-value < .0001). The decrease in the rate of ED visits and hospitalizations with the pandemic, compared to pre-pandemic, was greater during those months with a lower frequency of sleep study tests than those with a higher frequency (interaction p-values < .004) (Table 4). The effect on all-cause mortality was not significant (interaction p-value = 0.54). The decrease in the rate of ED visits and hospitalizations with the pandemic, compared to pre-pandemic, was greater during those months with a lower frequency of MRI tests than those with a higher frequency (interaction p-values < 0.03) (Table 4). The increase in the rate of all-cause mortality during the pandemic, compared to pre-pandemic, was greater during those months with the lower frequency of MRI rates than months with higher frequency (interaction p-value < 0.001). Similarly, the decrease in the rate of ED visits and hospitalizations with the pandemic, compared to pre-pandemic, was greater during those months with a lower frequency of CT scans than those with a higher frequency (p values for interactions < .0001) (Table 4). The increase in the rate of all-cause mortality during the pandemic, compared to pre-pandemic, was greater during those months with the lowest frequency of CT scan rates than months with higher frequency (interaction p-value = 0.04).
Restricted to the pandemic period and compared to months with the lowest proportion of virtual care visits (reference = Quantile I), more virtual care visits were generally associated with increased ED visit rates, but not hospitalization (other than Quantile III) or all-cause mortality rates (Table 5).
Discussion
Our population-based, retrospective study is one of the first to describe the impact of the COVID-19 pandemic on healthcare utilization and mortality rates in adults with epilepsy during the first year of the pandemic. During the first quarter of the pandemic, in adults with epilepsy, we demonstrated an overall reduction in outpatient visits, relevant diagnostic testing, ED visits, and hospitalizations, as well as an important shift to virtual care and a temporary increase in mortality. Both primary care and specialist visits significantly increased by the end of the first year of the pandemic compared to pre-pandemic years. Most of the diagnostic test rates returned to projected by the end of the first year of the pandemic. Although inpatient visit rates returned to projected by the end of the first year of the pandemic, the observed cost of hospitalizations increased above projected since June 2020 and remained elevated by the end of the first year of the pandemic, suggesting a more complex patient population. The increase in the rate of all-cause mortality during the pandemic, as compared to pre-pandemic, was greater during those months with the lower frequency of EEG, MRI, and CT scan rates as compared to months with higher frequency, suggesting that access to those diagnostic tests is likely important for individuals with epilepsy while planning restrictions on non-urgent health services. More virtual care visits were generally associated with increased ED visit rates, but not hospitalization or all-cause mortality rates, suggesting better discretion in referring people to the ED and/or the need for further enhancement of the quality of virtual care delivery. Reference Hardcastle and Ogbogu26
These results largely support those of existing literature on the topic. Previous studies have shown that during the early phase of the pandemic, there was a temporary reduction in non-emergency healthcare services and a rapid increase in telemedicine. Reference Mehrotra, Chernew, Linetsky, Hatch, Cutler and Schneider27 In addition, our findings are consistent with many survey-based studies that reported that individuals with epilepsy and their caregivers perceived that the pandemic posed challenges to access healthcare professionals during the beginning of the pandemic. Reference Casassa, Moss and Goldenholz2,Reference Subotic, Pricop and Josephson3,Reference Reilly, Muggeridge and Cross7,Reference Beniczky, Husain and Ikeda9,Reference Berg and Jobst28,Reference Ahrens, Ostendorf and Lado29 Our results also support those of recent literature that describes a decrease in ambulatory testing specific for the diagnosis of epilepsy, like EEG, and discontinuation or limited availability of epilepsy surgeries. Reference Lignou, Greenwood, Sheehan and Wolfe4 The diagnosis of epilepsy, in certain cases, may rely on detecting epileptiform abnormalities on EEG or a localizing structural epileptogenic lesion on neuroimaging. Such findings on ancillary testing increase the risk of seizure recurrence and justify the initiation of ASM. Reference Smith18,Reference Kanner and Bicchi30 A delay in diagnosis leads to a delay in treatment with ASMs, which leaves individuals with undiagnosed epilepsy exposed to the risk of future seizures and the life-threatening complications that can result from seizure recurrence (including status epilepticus, brain damage, musculoskeletal injuries, aspiration pneumonia, and rhabdomyolysis). Reference Huff and Murr31–Reference Taquet, Devinsky, Cross, Harrison and Sen33 There have also been reports of individuals with COVID-19 who presented with seizures, although recent data has shown that the incidence of new epilepsy following COVID-19 infection is low (0.30%). Reference Taquet, Devinsky, Cross, Harrison and Sen33 On the other hand, an increased risk of severe complications with COVID-19 has been shown in individuals with epilepsy, Reference Yoo, Kim, Jeon, Kim and Song34 which may contribute to increased all-cause mortality. Further, COVID-19 may lower the seizure threshold, leading to provoked seizures in the epilepsy population, similar to other systemic infections. A winter seasonality (a respiratory virus season) of increased mortality rates shown in our study even before the pandemic supports this hypothesis. Finally, drug interactions of ASMs (especially hepatic inducers, such as phenytoin and carbamazepine) with antiviral medications may reduce the efficacy of antiviral medications. Antiviral medications may also lower the seizure threshold. Reference Parihar, Tripathi and Dhamija35,36 All of these factors combined, as well as social and behavioral factors (for example, avoiding visiting the emergency room, despite a medical emergency, due to perceived risk of COVID-19 exposure), Reference Czeisler, Marynak and Clarke37 could have produced a temporary increase in mortality during Wave I, as seen in other publications. Reference Kendzerska, Zhu and Gershon5 The correlation of increased primary care visits with increased mortality in the epilepsy population may be a reflection of more complex/severe patients requiring closer follow-up (supported by increased healthcare costs); the same population is also at risk of seizure breakthrough via lowering of the seizure threshold in the setting of infection, Reference Bohmwald, Galvez, Rios and Kalergis38 which has the potential to lead to serious complications and death. Reference Parihar, Tripathi and Dhamija35
Our study has several strengths, such as the ability to analyze data from a sizable population during the entire first year of the pandemic and the use of the ARIMA analytic approach that provided us with projected rates that allowed us to take into account baseline trends prior to the pandemic for more accurate analysis and its monthly analysis design. While an open-cohort sampling strategy does not allow to follow the same group of individuals over the entire time period and estimate cumulative incidences (risks), this approach represents the reality more accurately as patients enter and leave the Ontario health system through immigration/emigration.
Our study, however, has several limitations. This study was not designed to infer causation and was limited to adults only. We lack data on the cause of death; therefore, we cannot completely rule out that a temporary increase in all-cause mortality during the early phase of the pandemic was not directly related to COVID-19 complications as the primary factor. Our study is limited to a part of North America and may not necessarily reflect the impact of the pandemic in other countries with different healthcare systems. While EEG, MRI, and CT are often done as part of initial diagnostic work in individuals with epilepsy, repeat relevant diagnostic testing can still be considered for different populations and clinical scenarios. Reference Hasan and Tatum39 Thus, access to relevant diagnostic tests should be applicable to individuals with known epilepsy as well. We have not considered in our analyses the duration or severity of epilepsy (for example, we did not distinguish between well-controlled versus refractory epilepsy) and prior comorbidities other than mental health, which should be addressed in future studies. Although our study focused only on the first year since the pandemic, this year was critical for individuals with chronic conditions, given the significant restrictions in health care services in this population and the rapid shift from in-person to virtual care. It is unclear whether longer follow-up would be helpful, given that most services returned to projected at the end of the first year of the pandemic.
Conclusion
In this population-based, retrospective cohort study, in adults with epilepsy, during the first quarter of the pandemic, we demonstrated an overall reduction in all-cause outpatient visits, epilepsy-related diagnostic testing, inpatient visits, and a temporary increase in mortality, as well as a significant shift to virtual care. All-cause primary care and specialist visits significantly increased by the end of the first year of the pandemic compared to pre-pandemic years. Most of the diagnostic tests returned to projected by the end of the first year of the pandemic. Although inpatient visits returned to projected by the end of the first year of the pandemic, the observed hospitalization cost remained above projected by the end of the first year of the pandemic, suggesting a more complex patient population. We demonstrated that access to epilepsy-relevant diagnostic testing (such as EEG, MRI, and CT) is likely important for patients with epilepsy while planning restrictions on non-urgent health services. Virtual care visits associated with increased ED visit rates suggest a better discretion in referring people to the ED and/or the need for further enhancement of the quality of virtual care delivery.
Supplementary material
The supplementary material for this article can be found at https://doi.org/10.1017/cjn.2023.316.
Data availability & sharing statement
In Ontario, the dataset from this study is held securely in coded form at ICES. While data-sharing agreements prohibit ICES from making the dataset publicly available, access may be granted to those who meet pre-specified criteria for confidential access, available at www.ices.on.ca/DAS. The full dataset creation plan and underlying analytic code are available from the authors upon request, understanding that the computer programs may rely upon coding templates or macros that are unique to ICES and are, therefore, either inaccessible or may require modification.
Author contribution
All coauthors were involved in the following: study conception and design, interpretation of the data, critically revising the manuscript for accuracy and important intellectual content, and final approval of the version to be published.
Tetyana Kendzerska and Andrea Gershon were also involved in obtaining administrative data. Espinoza Vargas Maria and Tetyana Kendzerska were also involved in drafting the manuscript.
Michael Pugliese was additionally involved in data analyses, visual data presentation, and drafting of the manuscript.
Funding
This study was supported by the Ottawa Hospital Academic Medical Organization, the Ontario Health Data Platform (OHDP), a Province of Ontario initiative to support Ontario’s ongoing response to COVID-19 and its related impacts, and by ICES (formerly known as the Institute for Clinical Evaluative Sciences), which is funded by an annual grant from the Ontario Ministry of Health (MOH) and the Ministry of Long-Term Care (MLTC). Parts of this material are based on data and information compiled and provided by the Canadian Institute for Health Information (CIHI). The analyses, conclusions, opinions, and statements expressed herein are solely those of the authors and do not reflect those of the funding or data sources; no endorsement is intended or should be inferred. The analyses, conclusions, opinions, and statements expressed herein are those of the author and not necessarily those of CIHI. No endorsement by the OHDP, its partners, the Province of Ontario, and ICES, CIHI, or the Ontario MOH and/or MLTC is intended or should be inferred.
Competing interests
All authors declare they have no potential conflict of interest. Tetyana Kendzerska and Andrea Gershon are supported by the PSI (Physicians' Services Incorporated) foundation. Teresa To is supported by the Canadian Institutes of Health Research, Tier 1 Canada Research Chair in Asthma. Claire Kendall is supported by a Faculty of Medicine Clinical Chair Award. The funding sponsors had no role in the study design, data collection and analysis, or preparation of the manuscript. No other relationships or activities could appear to have influenced the submitted work.
Guarantor statement
Together, Tetyana Kendzerska and Michael Pugliese had full access to all the data in the study and took responsibility for the integrity of the data and the accuracy of the data analysis. They affirm that the manuscript is an honest, accurate, and transparent account of the study being reported; no important aspects of the study have been omitted; any discrepancies from the study as planned have been explained. All authors had full access to statistical reports and tables.
Ethical statement
We confirm that we have read the Journal’s position on issues involved in ethical publication and affirm that this report is consistent with those guidelines.
ICES is a prescribed entity under Ontario’s Personal Health Information Protection Act (PHIPA). Section 45 of PHIPA authorizes ICES to collect personal health information, without consent, for the purpose of analysis or compiling statistical information with respect to the management of, evaluation, or monitoring of the allocation of resources to or planning for all or part of the health system. Projects that use data collected by ICES under section 45 of PHIPA, and use no other data, are exempt from REB review. The use of the data in this project is authorized under section 45 and approved by ICES' Privacy and Legal Office.
All methods were carried out in accordance with relevant guidelines and regulations. The study datasets were linked using unique encoded identifiers and analyzed in the secure environment at ICES following Ontario privacy standards.