Acute otitis media (AOM) is the most common reason antibiotics are prescribed to children in the United States; it affects >60% of children by 3 years of age. Reference Fleming-Dutra, Hersh and Shapiro1–Reference Kaur, Morris and Pichichero3 Up to 85% of infections will self-resolve, Reference Glasziou, Del Mar, Sanders and Hayem4,Reference Venekamp, Sanders, Glasziou, Del Mar and Rovers5 but most children with AOM (>95%) Reference Froom, Culpepper and Green6 are prescribed an antibiotic, resulting in substantial unnecessary antibiotic use. The overuse of antibiotics promotes the development of antibiotic-resistant organisms, which is increasingly common among otopathogens. Reference Kaur, Fuji and Pichichero7,8 Additionally, >25% of children who are prescribed an antibiotic report an antibiotic-associated adverse drug event (ADE), Reference Gerber, Ross and Bryan9 and antibiotic use increases the risk for Clostridioides difficile infection and may be associated with chronic diseases later in life. Reference Miranda-Katz, Parmar, Dang, Alabaster and Greenhow10–Reference Kronman, Zaoutis, Haynes, Feng and Coffin12 Although AOM is typically described as a single entity, it is caused by several different pathogens including respiratory viruses, Streptococcus pneumoniae, Haemophiles influenzae, and Moraxella catarrhalis. Reference Kaur, Fuji and Pichichero7,Reference Van Dyke, Pirçon and Cohen13,Reference Martin, Hoberman and Shaikh14 The associated otopathogen has important implications for management because each one has a different severity of infection and likelihood of resolving without an antibiotic (Table 1). Reference Kaur, Fuji and Pichichero7,Reference Van Dyke, Pirçon and Cohen13,Reference Broides, Dagan, Greenberg, Givon-Lavi and Leibovitz15–Reference Polachek, Greenberg and Lavi-Givon20 Additionally, the optimal antibiotic agent differs between otopathogens based on β-lactamase production. Reference Kaur, Fuji and Pichichero7 Unfortunately, no clinical features can reliably distinguish between causative organisms, and otopathogens are not routinely tested for in clinical practice. Thus, national recommendations take a one-size-fits-most approach for AOM management. Reference Lieberthal, Carroll and Chonmaitree21
Note. AOM, acute otitis media; ADE, adverse drug effect; CMS, Centers for Medicare and Medicaid Services; BLS, Bureau of Labor Statistics; PCR, polymerase chain reaction assay.
a Includes pathogens listed below. Polymicrobial infection rates calculated from referenced studies.
b The composite cost of broad-spectrum antibiotics was calculated from Redbook values for amoxicillin-clavulanate, cefdinir, and azithromycin based on US prescribing distribution of each drug.
c Assumed that for each episode of AOM, one 8-hour work-day productivity was lost.
d Disutility calculated as a total of disutility of another episode of AOM with ADE for broad-spectrum antibiotic use (does not include mastoiditis complication).
Ideally, clinicians would diagnose AOM using stringent criteria Reference Lieberthal, Carroll and Chonmaitree21,Reference Shaikh, Hoberman, Rockette and Kurs-Lasky22 ; they would prescribe antibiotics only for children who are likely to benefit, and they would use the narrowest-spectrum antibiotic needed to treat the infection. However, national treatment guidelines and antimicrobial stewardship programs have not resulted in a substantial reduction in antibiotic prescribing for AOM on a national scale. Reference King, Tsay, Hicks, Bizune, Hersh and Fleming-Dutra23 For other infections, such as pharyngitis, the use of rapid diagnostic tests (RDTs) has significantly reduced unnecessary antibiotic use as has individualized care based on the organism(s) detected. Reference Luo, Sickler, Vahidnia, Lee, Frogner and Thompson24,Reference Maltezou, Tsagris and Antoniadou25 An RDT for AOM could prevent unnecessary antibiotic use for children while assuring that children likely to benefit from an antibiotic receive one. Additionally, it could ensure that the optimal antibiotic agent is prescribed. Although tympanocentesis is not routinely performed on children with AOM in clinical practice, organisms detected in the nasopharynx have a high negative predictive value (>92%) for organisms in the middle ear. Therefore, nasopharynx testing could effectively exclude the presence of organisms during AOM episodes. Reference Kaur, Czup, Casey and Pichichero26,Reference Yatsyshina, Mayanskiy and Shipulina27
We propose 2 diagnostic algorithms for the management of AOM in children using rapid nasopharyngeal polymerase chain reaction (PCR). We evaluated the cost-effectiveness and potential annual reduction in antibiotic use for each algorithm compared to usual care.
Methods
Design of the study
We used a decision analytic model to estimate the costs and utilities of 2 nasopharyngeal RDT-based management strategies for uncomplicated AOM in children compared to usual care (Fig. 1). We also estimated the reduction in annual antibiotic use with each strategy. In accordance with the recommendations for the conduct of cost-effectiveness analyses, we evaluated outcomes from a societal perspective, which included costs associated with loss of work by parents and antimicrobial resistance. Reference Sanders, Neumann and Basu28
Comparator strategies
We used 2 nasopharyngeal PCR-based RDT algorithms to guide the AOM antibiotic prescribing strategy: (1) observation without an antibiotic, delayed prescription to fill and take if symptoms worsen or do not improve in 72 hours, or (2) an immediate amoxicillin or amoxicillin-clavulanate prescription to fill and take immediately (Fig. 1). Reference Kronman, Zaoutis, Haynes, Feng and Coffin12 We assumed that the RDT would include testing for S. pneumoniae, H. influenzae, and M. catarrhalis, the 3 most common otopathogens, as well as sequences associated with β-lactamase production by H. influenzae. Reference Kaur, Fuji and Pichichero7,Reference Van Dyke, Pirçon and Cohen13
The prescribing strategy was determined based on known severity and self-resolution rates of otopathogens, whereas the antibiotic agent was determined based on the likelihood of β-lactamase production by organism(s) detected (Supplementary Table 1 online). Because up to 40% of infections are polymicrobial, Reference Kaur, Czup, Casey and Pichichero26 we used a tier system to determine the optimal prescribing strategy and agent in these polymicrobial cases (Table 1). Proportions of AOM associated with each otopathogen were obtained from the literature. Reference Kaur, Fuji and Pichichero7,Reference Kaur, Czup, Casey and Pichichero26,Reference Yatsyshina, Mayanskiy and Shipulina27,Reference Wald and DeMuri29 The model was designed to be iterative so it could be updated as the proportion of infections caused by each otopathogen and resistance patterns change over time.
Decision model
We compared 3 treatment strategies in a hypothetical cohort of children aged 6 months–12 years with uncomplicated AOM. We defined uncomplicated AOM as AOM not associated with severe systemic symptoms, with recurrent disease requiring multiple antibiotic treatments, or with tympanic membrane perforation. We did not assess the cost-effectiveness for children with tympanostomy tubes, recurrent AOM, or other underlying medical conditions (eg, immunocompromised). In the primary analysis, we compared 3 strategies: (1) usual care; (2) the use of an RDT with immediate prescribing, delayed prescribing, or observation based on otopathogen(s) (RDT-DP); and (3) use of an RDT with immediate prescribing or observation (no delayed prescribing) based on otopathogen(s) (RDT-OBS). In the Supplementary Material, we also provide a comparative analysis of 2 additional AOM management strategies: (1) initial observation for all children, which is common in many European countries and (2) adherence to the 2013 American Academy of Pediatrics (AAP) guidelines (Supplementary Table 2). Reference Lieberthal, Carroll and Chonmaitree21
Exploratory analyses were conducted to estimate costs associated with in-person versus phone or electronic follow-up for children managed by observation whose treatment failed. Given the high costs associated with in-person follow-up, we assumed in the final model that patients managed by observation whose treatment failed would primarily be prescribed an antibiotic via phone or electronic follow-up rather than an in-person office visit. We used a 30-day time horizon because most outcomes secondary to AOM occur during this time and because there are no significant differences in longer-term outcomes between placebo and antibiotic treatment. Reference Mygind, Meistrup-Larsen, Thomsen, Thomsen, Josefsson and Sørensen30,Reference Le Saux, Gaboury and Baird31 Given the short time horizon, we did not discount costs or utilities. The outcomes considered within the model included cure (resolution of symptoms), clinical treatment failure (persistent symptoms after 3 days or worsening symptoms), and mastoiditis. We estimated clinical treatment failure rates for children managed with observation or a delayed prescription from prior clinical trials, Reference Chao, Kunkov, Reyes, Lichten and Crain32–Reference Stuart, Hounkpatin and Becque38 and we estimated the proportion of children that would qualify for initial watchful waiting with AAP guidelines using observation data and clinical trials. Reference Hoberman, Paradise and Rockette39,Reference McGrath, Frost and Newland40
The model and analyses were completed using Amua version 0.3.0 software.
Costs
We included direct and indirect costs including the costs of medications, follow-up office visits, diagnostic testing, ADE-associated costs (diapers, diphenhydramine, etc), mastoiditis, and lost productivity (Table 1). The cost of antimicrobial resistance was valued at $13 for every AOM episode that required antibiotics. Reference Michaelidis, Fine and Lin41 This cost included societal costs associated with growing antimicrobial resistance including increased hospitalizations from antimicrobial-resistant infections and the need for broader, non–first-line antibiotics in inpatient and outpatient settings. Because all strategies would have the same initial office visit cost these costs were not included in the model except in the cases of treatment failure. Reference Lieberthal, Carroll and Chonmaitree21 Additional productivity losses were added for treatment failures. We did not include costs of antipyretics or analgesics because all children are expected to receive pain control, and clinical trials did not show a difference in analgesic use between children who received antibiotics or placebo. Reference Hoberman, Paradise and Rockette39,Reference Shaikh, Dando and Dunleavy42 We assumed that the test could be run on existing PCR platforms such as those used for rapid influenza and severe acute respiratory coronavirus virus 2 (SARS-CoV-2) testing, which are commonly used in emergency departments and outpatient clinics. Thus, we did include costs for additional capital investment. Finally, we assumed 100% uptake by health systems and providers. Because the model is iterative, capital costs and lower uptake could be incorporated into future analyses.
Quality of life
Quality of life was determined using quality-adjusted life days (QALD), with 0 representing death and 1 representing ideal health. Because the time horizon was 30 days, the maximum QALD for each child was 30. We estimated that each clinical treatment failure resulted in an additional 0.21 disutility. Reference Shaikh, Dando and Dunleavy42,Reference Oh, Maerov, Pritchard, Knowles, Einarson and Shear43 We calculated a summary disutility value for each antibiotic agent based on associated ADE (Table 1). Finally, we estimated that mastoiditis resulted in an additional 0.56 disutility. Reference Shaikh, Dando and Dunleavy42,Reference Coco44
Statistical and sensitivity analysis
The primary outcome measured was the incremental cost-effectiveness ratio (ICER) expressed as cost per QALD. Secondary outcomes included (1) the cost at which an RDT would result in the ICER being below the willingness-to-pay threshold and (2) the estimated reduction in annual antibiotics used. We set the willingness-to-pay threshold at $274 per QALD. Reference Laupacis, Feeny, Detsky and Tugwell45,Reference Sanders, Neumann and Basu46
We used deterministic and probabilistic sensitivity analyses to evaluate the model’s results. Reference Briggs47 For the 1-way deterministic sensitivity analyses, we evaluated the results by changing the variables over the range of estimated values (Table 1). For the probabilistic sensitivity analyses, the variables were entered as probability distributions based on their values and were varied simultaneously across 10,000 iterations. We used β distributions for probability and utilities, and we used normal distributions for cost variables. We used a 1-way sensitivity analysis to determine the cost at which a diagnostic test would result in an ICER below the willingness-to-pay threshold and at which point it would equal the cost of usual care.
The study was reviewed and approved by the Colorado Multiple Institutional Review Board.
Results
The results of the cost-effectiveness analysis are shown in Table 2. The costs of each strategy listed in order of least costly to most costly, were as follows: usual care ($334.88), RDT-DP ($418.34) and RDT-OBS ($439.27). The primary driver of cost in the RDT strategies was the cost of testing, whereas the primary driver of cost for usual care was ADEs. RDT-DP incurred lower costs than RDT-OBS because RDT-DP avoided an extra day of disutility and productivity loss because these patients could simply fill the delayed prescription rather than needing to recontact the provider for a prescription. Disutility was similar between strategies: 0.12 for usual care, 0.06 for RDT-DP, and 0.09 for RDT-OBS. RDT-DP had an ICER of $1,336.15 per QALD compared with usual care and strongly dominated RDT-OBS.
Using one-way sensitivity analyses, we sought to determine whether changes to the cost of the RDT affected the preferred strategy. At an RDT cost of $278.56, the ICER for RDT-DP exceeded the willingness-to-pay threshold. However, if the cost of the RDT was <$212.10, the ICER was below the willingness-to-pay threshold, and if the cost of the RDT was <$195.00, the RDT-DP was cost saving compared to usual care (Fig. 2). At a test cost of $195, RDT-DP was likely to be more cost-effective than usual care (Fig. 3).
Note. RDT-DP, rapid diagnostic test with immediate prescribing, delayed prescribing or observation based on otopathogen(s) (Fig. 1); RDT-OBS, rapid diagnostic test with immediate prescribing or observation, no delayed prescribing, based on otopathogen(s) (Fig. 1); QALD, quality-adjusted life days; ICER, incremental cost effectiveness ratio.
a RDT-DP had an ICER of $1,336.15 per QALD compared with usual care and strongly dominated RDT-OBS.
Both RDT algorithms reduced predicted annual antibiotic use, including broad-spectrum antibiotic use, compared to usual care (Table 3). RDT-OBS resulted in the fewest antibiotic prescriptions taken (4.67 million, a 55.7% reduction) followed by RDT-DP (5.38 million, a 48.9% reduction) in comparison to usual care (10.5 million Reference Hersh, Shapiro, Pavia and Shah2 ).
Note. RDT-DP, rapid diagnostic test with immediate prescribing, delayed prescribing or observation based on otopathogen(s) (Fig. 1); RDT-OBS, rapid diagnostic test with immediate prescribing or observation (no delayed prescribing) based on otopathogen(s) (Fig. 1).
a Based on US prescribing rates.
b Amoxicillin.
c Non-amoxicillin antibiotic.
d Patients with clinical failure may have had >1 prescription for an antibiotic.
The use of initial observation for all children or complete adherence to the AAP guidelines would be cost saving compared to usual care or the use of RDT. Compared to initial observation for all children the ICER for RDT-DP ($44,789.7) exceeded the willingness-to-pay threshold (Supplementary Table 2).
Discussion
In this study, we have demonstrated that a nasopharyngeal RDT to guide management of AOM could be cost-effective compared to usual care if the cost of the RDT is <$212. RDT could also substantially reduce overall antibiotic use (57%) and broad-spectrum antibiotic use (68%). This approach has the potential to individualize care for AOM and to reduce antibiotic-associated morbidity and the development of antibiotic resistance among otopathogens, while assuring that children most likely to benefit from an antibiotic receive the appropriate agent.
Historically, a single first-line agent (amoxicillin) has been recommended for treatment of most children with AOM. Reference Lieberthal, Carroll and Chonmaitree21 The increase in β-lactamase–producing organisms associated with AOM has prompted some to call for a change in the firstline agent to a broader-spectrum antibiotic (ie, amoxicillin-clavulanate) for most children. Reference Wald and DeMuri48 Most children are currently prescribed an immediate antibiotic and 40% are prescribed a broad-spectrum antibiotic. Reference McGrath, Frost and Newland40 A change in guidelines that recommends first-line use of a broad-spectrum antibiotic would likely result in increased resistance, ADEs, and cost. 8,Reference Gerber, Ross and Bryan9,Reference Butler, Brown and Durkin49 Fortunately, scientific advancement has rendered it feasible to identify the presence of organisms and resistance-associated genes quickly and reliably. A shift to an evidence-based RDT-guided therapy could reduce ambiguity around which bacterial pathogens are present, if treatment with immediate antibiotics is necessary, and reduce unnecessary costs and ADEs.
Previous studies have demonstrated that individualization of care based on otopathogens improved outcomes in pediatric AOM. Reference Pichichero, Casey and Almudevar50 Unfortunately, these studies have relied on tympanocentesis, which has limited their generalizability and scalability because most clinicians are no longer trained in tympanocentesis and time constraints reduce its utility in routine practice. Although tympanocentesis more reliably detects otopathogens than nasopharyngeal testing, nasopharyngeal testing is likely to be more feasible in most care settings. In particular, nasopharyngeal testing can effectively exclude the presence of otopathogens in the middle-ear fluid >92% of the time. Reference Kaur, Czup, Casey and Pichichero26 In the minority of cases in which nasopharyngeal testing may not accurately detect pathogens that are present in the middle-ear fluid, the risk of complications from delayed antibiotic treatment is exceedingly low. Reference Shaikh, Dando and Dunleavy42 Approaches have been further limited using culture rather than PCR, which is expensive, time-consuming, and may yield less accurate results than PCR, particularly for fastidious organisms such as S. pneumoniae.
We previously demonstrated that the sensitivity of nasopharyngeal PCR for otopathogens compared to culture is >99%. Reference Frost, Sebastian and Keith51 In addition, serum biomarkers have been suggested as a potential option for pathogen-directed therapy for AOM. Reference Pichichero, Morris and Almudevar52 However, this would likely require capital investments from health systems, and it is not clear how antimicrobial resistance would be determined, though it is necessary to choose the appropriate agent, particularly for H. influenzae.
Finally, management of AOM should logically progress over time as AOM pathogens and resistance evolve. The use of an algorithm associated with an RDT would automatically help tailor management to local pathogen epidemiology and resistance patterns.
Although initial observation and complete adherence to the AAP guidelines are the most cost-effective approaches, they do not manifest in routine practice. Management guided by RDTs has improved care for other infections. For example, the use of RDTs, including molecular-based RDTs, to direct treatment of group A β-hemolytic streptococci (GAS) pharyngitis improved care by reducing unnecessary antibiotic use while assuring that patients likely to benefit were prescribed an antibiotic. Reference Luo, Sickler, Vahidnia, Lee, Frogner and Thompson24,Reference Maltezou, Tsagris and Antoniadou25 Similar to AOM, signs and symptoms of pharyngitis can be nonspecific, and accurately establishing the causative organism to appropriately direct antibiotic therapy using clinical criteria alone is difficult. Reference Shaikh, Swaminathan and Hooper53 The use of an RDT could similarly guide management of AOM, albeit more complex than pharyngitis because multiple organisms are associated with AOM and antibiotic resistance is more prevalent among otopathogens than GAS.
Additional parallels exist between AOM and pharyngitis. Both conditions exhibit high carriage rates (eg, high carriage of M. catarrhalis in the nasopharynx). Reference Kaur, Czup, Casey and Pichichero26,Reference Shaikh, Leonard and Martin54 In both scenarios, diagnostic testing is most effective at excluding the presence of organisms rather than predicting that organisms are causing disease. Thus, like pharyngitis, testing would still result in some overtreatment. Additionally, clinicians would similarly need to be able to select appropriate children for testing; thus, AOM diagnostic accuracy would remain important. Despite these challenges, the use of RDTs for GAS profoundly reduced unnecessary antibiotic use for pharyngitis. An AOM RDT has the potential to be a valuable stewardship tool that could be coupled with other stewardship interventions to reduce overall and/or broad-spectrum antibiotic use.
Several important practical aspects of a AOM RDT need to be addressed prior to implementation. First, at an estimated cost of $274, which aligns with commercially available respiratory viral molecular based tests, RDT is unlikely to be cost-effective using the current willingness-to-pay threshold. However, a modest reduction in price (23%, $212) meets the currently established threshold. Notably, this price is comparable to currently used molecular-based tests for GAS. The test would also need to have a quick turnaround time (optimally <30 minutes) to be useful in most outpatient settings. This turnaround time may be a challenge for smaller practices that typically send out samples for PCR testing. Given the complexity of AOM pathogenesis, clinicians would need to have an easy-to-use support tool to interpret RDT results to guide management. Finally, the test would ideally be used on currently available RDT platforms, such as those already used for SARS-CoV-2, influenza, or GAS testing to reduce the need for capital investment.
The strengths of this study include the creation of an iterative model for AOM that can easily be modified as epidemiology and resistance patterns change. We were able to address the polymicrobial nature of AOM by using an algorithm. We also included costs associated with antimicrobial resistance. In addition to evaluating the cost-effectiveness of RDT guided care, we determined the potential reduction in antibiotic use, which is important from antimicrobial stewardship and public health perspectives. We focused on a highly pragmatic aspect of care that included an estimated cost needed for an RDT to be cost-effective. To our knowledge, no prior research has evaluated the potential cost-effectiveness or reduction in antibiotic use with an RDT for AOM. We hope that this analysis will stimulate future studies and discussion on how we can potentially use an RDT to better guide appropriate management of AOM.
Our study also had several limitations. As with all cost-effectiveness evaluations, the results are subject to underlying assumptions. We assumed complete uptake of the algorithm and that all clinicians followed the algorithm. A formative study evaluating parent and clinician acceptability of potential RDT use for AOM would help to inform expected test uptake and antibiotic use with an RDT. We presumed no need for additional capital investment for testing given the widespread implementation of PCR-based platforms. Clinical settings without ready access to PCR-based RDTs, such as rural clinics or private practices, may not be able to adopt this strategy to guide management. We based antibiotic use with each prescribing strategy (ie, immediate antibiotic, delayed antibiotic, and observation) on pragmatic studies of fill rates with these strategies rather than calculating the likelihood of success of treatment by organism. Thus, we may have overestimated actual antibiotic use and costs. A call-in rather than in-person care strategy was assumed for all patients managed with observation whose treatment failed, which might not be appropriate for some patients. Additionally, we estimated a full day of lost productivity for patients whose clinical treatment with observation failed, which may have been an overestimate. Some variables were from single studies, and other variables had a wide range of values. Given the variation in variables, we completed sensitivity analyses to vary values throughout the range of estimates. Given the paucity of evidence on the risks of chronic medical conditions (eg, inflammatory bowel disease) associated with a single antibiotic course, we did not include costs and disutilities associated with chronic medical conditions. Finally, this study was designed to be exploratory to begin the discussion on how we move the field of AOM management forward. It was not designed to be a definitive study on best strategies for AOM management.
In conclusion, RDT could be a feasible mechanism to individualize care for AOM. In the era of increasing antimicrobial resistance, RDT should be explored as a potential patient-centered mechanism to improve care and reduce unnecessary antibiotic use.
Supplementary material
To view supplementary material for this article, please visit https://doi.org/10.1017/ash.2023.127
Acknowledgments
The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Gerber Foundation or the National Institutes of Health.
Financial support
In part, this research was supported by The Gerber Foundation. H.F. received salary support from the Eunice Kennedy Shriver National Institute of Child Health & Human Development of the National Institutes of Health (grant no. K23HD099925).
Conflicts of Interest
Drs. Frost and Sebastian are inventors on US provision patent 63/335,801 “Methods for Diagnosing and/or Treatment Otitis Media.” All other authors have no conflicts relevant to this article.