Cost-effectiveness of a physician-nurse supplementary triage assessment team at an academic tertiary care emergency department

Abstract

Objective

The purpose of this study was to evaluate the cost-effectiveness of physician-nurse supplementary triage assistance team (MDRNSTAT) from a hospital and patient perspective.

Methods

This was a cost-effectiveness evaluation of a cluster randomized control trial comparing the MDRNSTAT with nurse-only triage in the emergency department (ED) between the hours of 0800 and 1500. Cost was MDRNSTAT salary. Revenue was from Ontario’s Pay-for-Results and patient volume-case mix payment programs. The incremental cost-effectiveness ratio was based on MDRNSTAT cost and three consequence assessments: 1) per additional patient-seen; 2) per physician initial assessment (PIA) hour saved; and 3) per ED length of stay (EDLOS) hour saved. Patient opportunity cost was determined. Patient satisfaction was quantified by a cost-benefit ratio. A sensitivity analysis extrapolating MDRNSTAT to different working hours, salary, and willingness-to-pay data was performed.

Results

The added cost of the MDRNSTAT was $3,597.27 [$1,729.47 to ∞] per additional patient-seen, $75.37 [$67.99 to $105.30] per PIA hour saved, and $112.99 [$74.68 to $251.43] per EDLOS hour saved. From the hospital perspective, the cost-benefit ratio was 38.6 [19.0 to ∞] and net present value of –$447,996 [–$435,646 to –$459,900]. For patients, the cost-benefit ratio for satisfaction was 2.8 [2.3 to 4.6]. If MDRNSTAT performance were consistently implemented from noon to midnight, it would be more cost-effective.

Conclusions

The MDRNSTAT is not a cost-effective daytime strategy but appears to be more feasible during time periods with higher patient volume, such as late morning to evening.

Résumé

Objectif

L’étude avait pour but d’évaluer le rapport coût-efficacité d’une équipe supplémentaire d’aide au triage, formée d’infirmières et d’un médecin (acronyme anglais: MDRNSTAT), du point de vue de l’hôpital et de celui des patients.

Méthode

Il s’agit d’un essai comparatif, avec répartition aléatoire et échantillonnage en grappes, visant à comparer le rapport coût-efficacité de l’équipe supplémentaire avec celui d’équipes de triage formées uniquement de personnel infirmier, au service des urgences (SU), entre 8 h et 15 h. Les coûts ne comprenaient que le salaire de l’équipe supplémentaire. Les revenus provenaient du programme de financement axé sur les résultats ainsi que du programme de paiement en fonction du nombre de patients et de la composition de la clientèle de l’Ontario. Le rapport coût-efficacité différentiel reposait sur le coût de l’équipe supplémentaire et sur trois paramètres, soit le coût 1) par patient supplémentaire examiné; 2) par heure gagnée relativement à l’évaluation initiale par le médecin et 3) par heure gagnée par rapport à la durée du séjour au SU. A aussi été déterminé le coût de substitution pour les patients. Quant à la satisfaction des patients, elle a été quantifiée sous forme de ratio coûts-avantages. Enfin, les auteurs ont réalisé une analyse de sensibilité en appliquant les coûts de l’équipe supplémentaire à différentes heures de travail, à différents salaires et à la disposition à payer.

Résultats

Le coût additionnel de l’équipe supplémentaire s’élevait à 3597,27 $ (1729,47 $ – ∞) par patient supplémentaire examiné; à 75,37 $ (67,99 $ – 105,30 $) par heure gagnée relativement à l’évaluation initiale par le médecin et à 112,99 $ (74,68 $ – 251,43 $) par heure gagnée par rapport à la durée du séjour au SU. Du point de vue de l’hôpital, le ratio coûts-avantages était de 38,6 (19,0 – ∞) et la valeur présente nette, de −447 996 $ (−435 646 $ à −459 900 $). Quant aux patients, le ratio coûts-avantages au regard de la satisfaction était de 2,8 (2,3 – 4,6). Enfin, si le rendement de l’équipe supplémentaire était toujours appliqué de 12 h à 24 h, la mesure serait plus rentable.

Conclusions

L’ajout d’une équipe d’aide au triage, formée d’infirmières et d’un médecin n’est pas une mesure rentable le jour, mais celle-ci semble plus facilement applicable durant les périodes de forte fréquentation, par exemple depuis la fin de la matinée jusqu’en soirée.

INTRODUCTION

It is well established that prolonged emergency department length of stay (EDLOS) is associated with increased morbidity, mortality, ^{1 , 2} decreased patient satisfaction, ^{3 , 4} and increased left-without-being-seen (LWBS) rates. ⁵ Additionally, prolonged EDLOS is expensive. In Canada, it was estimated that $51 million dollars were spent on patients in 2005–2006 admitted through emergency departments (EDs) and waiting for a hospital bed. ⁶ A study published in 2010 concluded that ED admission delays greater than 12 hours increased inpatient LOS at an annual additional cost of 2.1 million dollars. ⁷ Owing to limited resources and increasing patient demand, the largest contributing factor to ED crowding is access block ¹ —the “diminished access to health care.” ⁸ This multifactorial issue has no single solution, and its resolution will require a systems-approach rather than through the ED. Various solutions have been proposed to decrease EDLOS ^{9 - 26} ; however, it remains unclear as to which solution is the most cost-effective.

In the province of Ontario, the problem of prolonged EDLOS came to the attention of the local government in 2006. The Ministry of Health and Long-Term Care, in concert with provincial representatives for the hospitals and physicians, convened an expert panel and provided 17 recommendations. ²⁷ In 2008, the Pay-for-Results program was implemented, whereby hospitals were provided financial incentives to improve their EDLOS by 10% from the previous year until ≥90% of all ED patients reached target thresholds. ²⁸ For the institution studied, the 2009–2010 Pay-for-Results target was to have >=38% of admitted and >=71% of discharged high-acuity patients (Canadian Triage Acuity Scale [CTAS] 1-3) with EDLOS <=8 hours. For discharged low-acuity patients (CTAS 4-5), the target was to have >=75% of patients with an EDLOS of <=4 hours. The 90th percentile target for physician-initial-assessment (PIA) time was set at 5 hours and 24 minutes, with an ideal target of 3 hours and 48 minutes. ^{28 , 29} The duration between triage evaluation and assessment by the doctor was the PIA time. ⁸

One approach proposed to decrease ED wait-times is the team approach to care ^{29 - 32} or a front-line primary care team. A joint report by the major colleges in the United Kingdom recommended senior clinicians be present at the ED front door, ^{33 , 34} and some hospitals in Australia ³⁵ and the United States have placed a physician at triage. ^{36 , 37} But such an approach is perceived to be expensive ³⁸ given that ED costs are labor-driven and variable, and, consequently, marginal costs do not decrease as ED volumes increase. ³⁹ As a result, justification is required to increase manpower in the department. ⁴⁰ Some clinical studies have concluded that primary care teams improve outcomes at reasonable incremental costs ^{41 - 43} ; however, no economic evaluations on team-based solutions to decrease EDLOS have yet been reported. Given our era of limited health resources, ⁴⁴ a rigorous determination of the cost-effectiveness of ED team-based solutions for LOS would help hospital administrators and decision makers decide whether implementation of a team-based approach to ED management is worth the expense.

The physician-nurse supplementary triage assessment team (MDRNSTAT) trial was a prospective, pragmatic, cluster randomized control trial over 26 weeks that compared a MDRNSTAT (intervention) to nurse-only triage (control) from 0800 to 1500 on weekdays and was published in 2013. ²⁹ This trial took place at Sunnybrook Hospital, a tertiary care academic centre located in Toronto, ON. It is a trauma, regional stroke, interventional cardiology, neurosurgical, and oncology centre with 348 acute care beds. In 2009, the number of patient visits to the ED was 45,405 per year with an admission rate of 22% with 80% CTAS 1-3 patients (5% CTAS 1). Access block was a significant issue with hospital occupancy typically exceeding 90% ^{45 - 47} and a median EDLOS for admitted patients of approximately 12 hours. By 2013, the number of visits increased to 58,518 with an admission rate of 22% and 88% of CTAS 1-3 patients (4% CTAS 1), and the number of acute beds decreased to 341. Hospital occupancy remained unchanged.

The MDRNSTAT intervention was found to significantly decrease median PIA time and median EDLOS for high (CTAS ⁴⁸ 2-3) and low (CTAS 4-5) acuity, discharged patients not requiring a consultation. Consequently, morbidity, mortality, patient satisfaction, and expense-associated with prolonged EDLOS could be partially mitigated by such a program; however, its implementation consumes health care resources that could potentially be used elsewhere. The purpose of this study was to determine whether the implementation of MDRNSTAT was economically efficient from the perspective of a publicly funded hospital and the perspective of the patient.

METHODS

Reference study

The outcomes, EDLOS, PIA time, and LWBS rates were derived from the aforementioned cluster randomized-control trial comparing MDRNSTAT days (65 days, 3137 patients) with nurse-only triage days (66 days, 3163 patients). ²⁹ EDLOS was defined as the duration between triage arrival and departure from the ED. ⁸ LWBS patients were those who left the ED before a medical exam was initiated. ⁴⁹

Control patients were triaged by the nurses, assigned a CTAS score, and directed into a patient care space or the waiting room if care spaces were not available. Triage-nurse orders were limited to basic lab investigations and electrocardiogram acquisition.

Intervention patients were similarly nurse-triaged. Those who had an immediate patient care space available were brought into the ED to wait for the emergency physician. When no patient care space was available, the patient was similarly placed in the waiting room. The MDRNSTAT would then select waiting room patients to assess in a triage assessment area, where a brief history and physical was performed. Selection of patients was at the team’s discretion, but factors in the decision included wait-time, acuity, and necessity for physician time-sensitive decisions. The team initiated orders for diagnostic imaging (including CT or ultrasound), advanced lab work (e.g., D-dimer), treatment, consultation, and possible disposition. MDRNSTAT nurses initiated lab orders and carried out IV starts and treatment. If an assessment space became available in the ED, the patient’s care was transferred to the regular emergency physician. Otherwise, the patient would be placed back in the waiting room. Patients were not blinded to the intervention but were unaware of which days the MDRNSTAT was working.

Costs and revenue

The analysis was conducted from the hospital and patient perspective. Because of the short time horizon with concrete costs, revenue, and outcome measures, we used a decision analysis and extrapolation model. The province of Ontario has a universal, publicly funded, government-run insurance system. For the hospital perspective, resources were based on personnel and diagnostic costs. Personnel costs were based on our hospital’s physician and nurse hourly rates and Ministry of Health and Long-Term Care diagnostic imaging fees. Because capital costs, such as the physical plant, health professionals salaries and benefits, food, medication, and cost transfers were unchanged between the control and intervention groups, they were not included in the analysis. Costs and revenues were calculated in 2009 Canadian dollars ($1.00 CAD=$0.87 USD, 2009 ⁵⁰ ).

In terms of ED resources, the Alternate Funding Agreement, Global Funding Program, and Pay-for-Results programs collectively determine hospital revenue. The Alternate Funding Agreement prospectively funds the province’s EDs based on the prior years’ patient-volume seen and the case-mix of patients. In this program, a lump sum value is allocated to the hospital’s ED for emergency physician salaries. Reconciliation payments for the current year are paid to an ED if actual patient volume exceeded what is allocated. Therefore, by decreasing the LWBS rate, Alternate Funding Agreement revenue is increased. The Global Funding Program is a fee-for-service model based on the Ontario Schedule of Benefits. ⁵¹ In this program, for every service a physician provides for the patient, 38% of the cost of the service code value is flowed back to the physician. Therefore, by seeing more patients, revenue to the ED increases for both physicians and the institution. The Pay-for-Results program provides financial incentives to hospitals for achieving specific time threshold indicators. In 2009, reaching the 90th percentile PIA time target would reward the hospital $100,000. Reaching acuity-based EDLOS targets for discharged and admitted patients would additionally reward the hospital $748,000. Because the effectiveness outcomes were in the range of hours, discounting was not required.

Effectiveness outcomes

This is a cost-effective analysis. ^{52 - 54} Effectiveness outcomes were based on three intermediate outcomes: 1) the additional number of patients seen, 2) total hours saved for PIA time, and 3) EDLOS.

The trial’s results were extrapolated to a MDRNSTAT staffed from 0800 to 1500 for the institution’s ED patient volume of 45,405 patients during the 2009 calendar year. For this daytime period, 19,120 patients (42.1% of annual volume) with 2.0% LWBS rate were seen. We projected the reference study’s non-consulted, discharged CTAS 2-3 and CTAS 4-5 proportions to the corresponding 7 hours. We also analysed by hour of arrival with associated patient arrivals, LWBS rate, PIA-time, and EDLOS.

Extrapolating the LWBS-rate difference between intervention and control to the corresponding patient volume determined additional patients seen. Two-sample, two-sided tests of proportions were carried out, and 95% confidence intervals were calculated around estimates.

For total EDLOS- or PIA-time saved, only statistically significant differences between intervention and control were used. Keeping the intervention LWBS rate of 1.5% and multiplying the corresponding patient volumes by their respective time differences determined total EDLOS time or PIA time saved between the control and intervention groups. Due to the non-parametric distribution of these measures, median differences and their associated confidence intervals were determined by the Hodges-Lehmann estimation method. This approach involves an analysis all pairwise differences between the two groups and to derive a median and associated 95% confidence interval around the differences.

Cost-effectiveness and cost-benefit analysis—hospital perspective

We conducted two comparative economic evaluations from the hospital perspective: 1) incremental cost-effectiveness analysis and 2) incremental cost-benefit analysis. Direct cost and revenue generation by the MDRNSTAT was determined for 1 year. Revenue from the Alternate Funding Agreement, Global Funding Program, and reaching Pay-for-Results thresholds was determined by using study data extrapolated to the 2009 calendar year. Net values were calculated from the difference between cost and revenue. Incremental cost-effectiveness ratios were calculated by dividing net value over three different outcome measures: additional patients seen, PIA minutes saved, and EDLOS minutes saved. An incremental cost-benefit ratio (CBR) was determined by dividing the cost of the intervention by the revenue generated. Net present value was the cost subtracted from the revenue.

Satisfaction analysis—patient perspective

The literature suggests that a positive correlation exists between ED patient dissatisfaction, LWBS rates, and increased PIA times. ^{5 , 55} Patient satisfaction was estimated by calculating the PIA time saved and additional patients seen between the intervention and control groups. For the cost-benefit analyses, willingness-to-pay values ⁵⁶ to decrease ED wait-times are preferred; however, Canadian data have not been determined. An alternative uses the human capital approach, ⁵⁶ where wait-times are an opportunity cost of lost wages, irrespective of employment status. We used the 2009 Canadian minimum wage as a financial surrogate for patient valuation of wait-times. Based on a 2012 hourly wage of $24.38 ⁵⁷ with 1.9% annual inflation, it was estimated that the 2009 hourly rate was $23.02. By multiplying PIA time saved with hourly wage and additional patients seen by daily wage, a value for patient satisfaction was determined. Dividing the gross MDRNSTAT cost by patient satisfaction value provided a CBR.

Satisfaction analysis—staff perspective

Three non-MDRNSTAT emergency physicians, three non-MDRNSTAT nurses, a MDRNSTAT physician, and a nurse completed a survey after each shift. The survey queried whether staff felt that the MDRNSTAT provided better patient quality of care, benefited patient flow, contributed to teamwork and collegiality, or improved personal efficiency. This was determined using a 7-point Likert Scale, ranging 1 (strongly disagree) to 7 (strongly agree).

Sensitivity analysis

By changing the MDRNSTAT working time period and salary, we performed a univariate sensitivity analyses to determine the most cost-efficient period for the team. We extrapolated study data to the corresponding patient volumes and LWBS rates between 1600 and 2400 (8 hours), 1200 to 0600 (18 hours), and 1200 to 2400 (12 hours) (Figure 1). MDRNSTAT salary was decreased from $180/hr to $100/hr. In 2009, the LWBS rate was 6.2%.

Figure 1 Plots the number of patient arrivals and left-without-being-seen (LWBS) rate by hour of day starting from 2400 from January 1 to December 31, 2009. The 2009 LWBS rate was 6.2%.

For patients, we used willingness-to-pay values from a Dutch study ⁵⁸ on valuation of wait-times for nonemergent orthopedic assessment or non-palliative radiotherapy. We performed the cost-effective analysis and patient flow graphs with Microsoft Excel (Version 14.4.1, Microsoft Corporation, Redmond, WA). Stata (Version 13.1, StataCorp, College Station, TX) was used to carry out the hourly cost-effective analysis and produce sensitivity graphs.

RESULTS

Primary analysis

In 2009, 75.8% (62.8% non-consulted, discharged) and 19.6% (89.8% non-consulted, discharged) of all patients seen at the study location were CTAS 2-3 and CTAS 4-5, respectively. The MDRNSTAT directly saw 24.7% and 20.2% of the CTAS 2-3 and CTAS 4-5, respectively. Table 1 provides outcomes of the original trial of the MDRNSTAT and illustrates interventions, such as lab orders, diagnostic imaging, consultations, and admissions were similarly distributed between the two groups. Compared to controls, the MDRNSTAT group had a significantly decreased PIA time and EDLOS for non-consulted discharged patients. For patients who were discharged, the MDRNSTAT was associated with decreased lab work, diagnostic imaging, and consult time. For patients who were admitted, lab work and diagnostic imaging request time were significantly decreased in the MDRNSTAT group. Table 2 shows the cost and hospital revenue of the MDRNSTAT compared to the control group. Revenue was achieved by decreasing the number of LWBS patients through government funding programs.

Table 1 Outcomes of the original trial of a physician-nurse supplementary triage assistance team (MDRNSTAT)

CTAS=Canadian Triage Acuity Scale; EDLOS=emergency department length of stay; EP-scheduled emergency physician is initial physician seen; LWBS=left without being seen; MDRNSTAT-team is initial physician seen; P4R=Pay-for-Results.

Table 2 Cost and revenue of the MDRNSTAT and control group: base study and sensitivity analysis

* Base study.

Base study is from 0800 to 1500 with MDRNSTAT salary of $180/hr. Base rate=$180/hr.

Sensitivity analysis by hourly rate and working hours: reduced rate=$100/hr. Working hours: 1600 to 2400, 1200 to 0600, 1200 to 2400.

AFA=Alternate Funding Agreement; EDLOS=emergency department length of stay; GFP=Global Funding Premium; NPV=net present value (NPV=cost - revenue); P4R=Pay-for-Results; PIA=physician-initial-assessment time.

Table 3 provides the intermediate effectiveness outcomes (increased number of patients seen, PIA time, and EDLOS) from the hospital perspective. The intervention cost was $3,597.27 (CI: $1,729.47 to ∞) per additional-patient-seen from 0800 to 1500 (Figure 2). Keeping the LWBS constant at 1.5%, the intervention cost $75.37/PIA hour saved (CI: $67.99 to $105.30) (Figure 3) and $112.99/EDLOS hour saved (CI: $74.68 to $251.43) (Figure 4). The hospital CBR was 38.6 (CI: 19.0 to ∞).

Figure 2 Plots the 95% confidence interval of the cost per additional patient seen by MDRNSTAT operating hours of 0800 to 1500 (base), 1600 to 2400, 1200 to 0600 the following day, and 1200 to 2400 at salary rates of $180/hour and $100/hour.

Figure 3 Plots the 95% confidence interval of the cost per physician initial assessment (PIA) hour saved by MDRNSTAT operating hours of 0800 to 1500 (base), 1600 to 2400, 1200 to 0600 the following day, and 1200 to 2400 at salary rates of $180/hour and $100/hour.

Figure 4 Plots the 95% confidence interval of the cost per emergency department length of stay (EDLOS) hour saved by MDRNSTAT operating hours of 0800 to 1500 (base), 1600 to 2400, 1200 to 0600 the following day, and 1200 to 2400 at salary rates of $180/hour and $100/hour.

Table 3 Hospital perspective on intermediate effectiveness outcomes between intervention and control

Base analysis is 0800 to 1500. Sensitivity analysis uses extrapolated outcomes from 1600 to 2400, 1200 to 0600, 1200 to 2400, and by the hour of arrival.

EDLOS=emergency department length of stay; LWBS=left without being seen; PIA=physician initial assessment.

Table 4 provides the cost-effective analysis by hour of arrival. From 1900 to 2400, the intervention cost less than $510 per additional patient seen. Between 1200 and 0200, the cost per PIA hour saved was less than $100.00. For EDLOS, the cost per hour saved remained less than $120 for 1200 to 1900 and 2300 to 0100.

Table 4 Cost-effective analysis by hour of arrival

CTAS=Canadian Triage Acuity Scale; EDLOS=emergency department length of stay; LWBS=left without being seen; PIA=physician initial assessment; NS=not significant.

Table 5 provides patient satisfaction information. The MDRNSTAT was associated with a decrease in the time to see a physician of 6,102 hours and 996 hours of saved opportunity cost for 124 LWBS patients. Applying the LWBS rate of 1.5% with a Canadian minimum wage of $23.02 as a surrogate for patient satisfaction, the CBR was 2.8 (2.3 to 4.6) (Figure 5).

Figure 5 Plots the 95% confidence interval of the cost-benefit ratio for patient satisfaction by MDRNSTAT operating hours of 0800 to 1500 (base), 1600 to 2400, 1200 to 0600 the following day, and 1200 to 2400 at salary rates of $180/hour. Can-Canadian minimum wage ($23.02), Dutch-Dutch valuation of waiting time for treatment ($45.83).

Table 5 Patient satisfaction

Satisfaction analysis values time saved by seeing physician faster and decreasing left-without-being-seen rate. Base analysis is from 0800 to 1500.

LWBS=left without being seen; MDRNSTAT=physician-nurse supplementary triage assistance team; PIA=physician initial assessment.

The MDRNSTAT and non-MDRNSTAT emergency physicians and nurses completed 162 and 551 surveys, respectively. Compliance was 99.7%. Staff generally indicated that the MDRNSTAT provided better patient quality of care, benefited patient flow, and improved personal efficiency. Staff also strongly indicated that the MDRNSTAT contributed to teamwork and collegiality.

Sensitivity analysis

We extrapolated our study results to three different time periods: 1600 to 2400, 1200 to 0600, and 1200 to 2400. Each period had different LWBS rates and PIA times. During the 1600 to 2400 shifts, the LWBS rate was 6.4%. Keeping the intervention LWBS rate at 1.5%, the cost per additional patient seen was $526.20 ($475.61 to $586.63), $94.59/PIA hour saved ($85.34 to $132.16), $141.81/EDLOS hour saved ($93.74 to $315.57), and the CBR was 6.5 (6.0 to 7.1). The patient satisfaction CBR was 1.8 (1.7 to 2.2).

From 1200 to 0600 the following day (18 hours), our ED exceeded the ideal Pay-for-Performance PIA target of 3 hours and 48 minutes. LWBS rates progressively exceeded 2.4% by 1200 and peaked at 13% by 2400, and dropped to 3.6% by 0500 (see Figure 1). Annual LWBS rate was 6.2%. Assuming that MDRNSTAT working from 1200 to 0600 would achieve the Pay-for-Performance PIA target and decrease the annual LWBS rate to 1.5%, the intervention would cost $414.50 per additional patient seen ($371.47 to 466.22), $101.18/PIA hour saved ($91.28 to $141.36), and $165.69/EDLOS hour saved ($109.52 to $368.70). Hospital CBR was 3.9 (3.7 to 4.1). Patient satisfaction CBR was 1.9 (1.7 to 2.2).

We hypothesized that the MDRNSTAT working from 1200 to 2400 could achieve the same outcomes as working from 1200 to 0600. If so, the intervention would cost $228.58 per additional patient seen ($201.21 to $261.46), $74.55/PIA hour saved ($67.25 to $103.81), and $129.39/EDLOS hour saved ($84.60 to $284.82). Hospital CBR was 2.6 (2.4 to 2.8). Patient satisfaction CBR was 1.3 (1.2 to 1.6).

From the hospital perspective, our analyses were replicated based on a salary of $100/hr. The sensitivity analysis for cost per additional patient seen, PIA hour saved, EDLOS hour saved, and CBR is summarized in Figures 2, 3, and 4. For patient satisfaction, the Dutch value treatment waiting time at €30.10 per hour ($45.83 CAD) ⁵⁸ resulting with a CBR<1 from 1200 to 2400. Results of this sensitivity analysis are provided in Table 5 and Figure 5.

DISCUSSION

We found that the MDRNSTAT program was associated with a significant decrease in ED wait times for non-consulted, discharged patients and a decrease in the number of LWBS patients in an academic tertiary level hospital. The cost and revenue drivers for this team were salary, hours worked, and pay-for performance schemes. In the absence of access block or financial wait-time incentives, low LWBS rates, or high manpower costs, the MDRNSTAT would not be cost-effective. Because access block, patient arrivals, LWBS rates, and PIA times increase from 1200 onward, it appears that implementing such a program from 1200 to 2400 would be more cost-effective than 0800 to 1500. Lowering salaries or having only physician-triage ³⁵ would reduce manpower costs. Physician and nurse salaries vary internationally, ⁵⁹ so MDRNSTAT would be more cost-effective in countries with lower hourly rates. In countries such as Australia, physicians are capable of performing all of the MDRNSTAT duties. By eliminating the nurse, the physician-triage role would be more cost-efficient. Reduction of manpower costs could be achieved by using delegated orders; however, it is uncertain whether quality of care or patient satisfaction outcomes in such an approach would be equivalent. Regarding patient satisfaction, the team appears more cost-effective during prolonged PIA times and LWBS rates. Consequently, working at 1200 to 2400 would be more cost-effective than working at 0800 to 1500.

There were limitations in our study. This was a cost-effectiveness study using intermediate outcomes rather than metrics such as quality-adjusted-life years (QALY) or mortality end points. A cost-utility analysis, with a formalized measurement of QALYs, patient satisfaction, or willingness-to-pay would be superior.

In the sensitivity analysis, the assumption we made that the MDRNSTAT working from 1200 to 2400 would achieve an annual 1.5% LWBS rate could be questioned. However, from 0600 to 1200, LWBS rates and PIA times were less than 2% and below the PIA target of 3 hours and 48 minutes, so a MDRNSTAT would not be required. From 1200 to 2400, 60% of the daily volume arrived. From 2400 to 0600, 10% of the patient volume arrived. High LWBS rates from 2400 to 0600 likely arise from long wait-times secondary to the 1200 to 2400 patient volume backlog being cleared after 2400. If the MDRNSTAT efficiently managed patient flow from 1200 to 2400, this backlog would likely be eliminated, and working from 2400 to 0600 would not be required. A future study of MDRNSTAT working 1200 to 2400 would be beneficial.

The generalizability of our study is limited by the fact that our results arise from a single-centre tertiary academic centre with a complex patient population. ²⁹ Most public academic hospitals are supported by public insurance plans with unique funding models; therefore, our results may not be generalizable to other health systems and jurisdictions. However, hospitals using a case-mix, volume-based, fee-for-service, or pay-for-performance funding schemes should find this analysis useful. A future multicentre study, with different funding models and a MDRNSTAT working during the hours of high patient flow, would be ideal. Additionally, a larger study population would allow the determination of whether significant mortality differences exist. To assess morbidity, longer term and regional follow-up is required. We used a positivist approach investigating a single intervention for tackling the problem of wait-times. Given the complexity of factors and multiple numbers of stakeholders involved in prolonged ED wait-times, a relativist, systems-thinking approach may be preferable. ^{60 , 61}

Prolonged PIA times and LWBS rates are associated with decreased patient satisfaction. However, for patients who are not employed, hourly wages may not accurately represent a patient’s willingness to pay to decrease wait-times. The Dutch study surveyed patients who were not working and were waiting for nonemergent orthopedic, non-palliative radiation treatment or rehabilitation. ⁵⁸ We applied the value arising from this research (€30.10=$45.83 CAD) in our sensitivity analysis. However, it is arguable that this value underestimates ED waiting time. Many patients seek care for perceived emergent problems, such as pain. As a result, their expectations of quick resolution of the presenting complaint may be higher. At our institution, 40% of patients arrive with a complaint of pain. Additionally, we may have underestimated the gains in PIA time in our sensitivity analysis by extrapolating study data to the other time intervals. The median control PIA time for the study was 1 hour and 21 minutes, but from 1200 to 0600, the median PIA was 1 hour and 54 minutes. For the study period, the maximum PIA time was 9 hours and 15 minutes.

Our results indicate that MDRNSTAT decreases waiting in the front lines of the ED and is unable to mitigate access block to hospital admission. It could be argued that the cost of such a team would be better spent on access block solutions. Future cost-effectiveness analyses comparing the MDRNSTAT with access block interventions may be warranted. Although concerns could be raised that the MDRNSTAT provides suboptimal care because patients are not seen in traditional care spaces; however, our original study did not identify any harm from this program.

This is the first study to investigate the cost-effectiveness of the MDRNSTAT strategy. A number of studies have investigated only costs and found that personnel and construction of patient-care areas are expensive. ^{32 , 38} Revenue gained by seeing more patients is dependent upon the patient remuneration system. In systems that provide even more robust remuneration than the Alternate Funding Agreement, Global Funding Program, and Pay-for-Results systems, the costs of such a team could be offset.

CONCLUSION

The MDRNSTAT is not a cost-effective daytime strategy but appears to be more feasible during time periods with higher patient volume, such as late morning to evening. ED administrators need to be thoughtful on whether a MDRNSTAT could be effectively used in their department. Factors to consider include patient arrival rates, LWBS reduction, physician satisfaction, and impact on patient wait-times. The need for cost-effectiveness research on patient-flow strategies and quality interventions has never been greater. With information arising from such research, administrators could make more evidence-informed ED operational decisions.