Abstract
PURPOSE This study evaluated the costs and utility of observation and routine antibiotic treatment options for children with acute otitis media.
METHODS The cost-effectiveness analysis was performed among children aged 6 months to 12 years seen in primary care offices. The interventions studied were watchful waiting as practiced in the Netherlands, delayed prescription, 5 days of amoxicillin, and 7 to 10 days of amoxicillin. The main outcome measure was cost per quality-adjusted life-year (QALY).
RESULTS In the base case analysis, delayed prescription was the least costly option and 7 to 10 days of amoxicillin was the most effective. The incremental cost utility ratio (ICUR) of 7 to 10 days of amoxicillin compared with delayed prescription was $56,000 per QALY gained. Watchful waiting and 5 days of amoxicillin were inferior options. The results were sensitive to the rate of nonattendance in the delayed prescription strategy: when the rate was less than 23%, watchful waiting was the least costly option and delayed prescription was an inferior option. Probabilistic sensitivity analysis, in which all model variables were simultaneously varied, showed with 95% certainty that compared with delayed prescription, 7 to 10 days of amoxicillin had a 61% probability of having an ICUR of greater than $50,000 per QALY gained, and watchful waiting had a 23% probability of having an ICUR of less than $50,000 per QALY gained.
CONCLUSIONS Economically, an approach to the treatment of acute otitis media with either an initial period of observation or routine treatment with amoxicillin is reasonable.
- Acute otitis media
- cost-effectiveness analysis
- decision analysis
- health care use
- disease management
- children
- antibiotics
- watchful waiting
INTRODUCTION
Acute otitis media (AOM), or inflammation of the middle ear, is responsible for 13.6 million pediatric office visits annually in the United States1 at an estimated annual cost of $2.98 billion in 1995.2 In the United States, AOM is routinely treated with antibiotics and, because of the large number of visits, accounts for a considerable percentage of all outpatient antimicrobial prescriptions.3,4 The benefit of antibiotic treatment of AOM is controversial, however, for children older than 6 months.5–8 Meta-analyses and systematic reviews of the literature have found a spontaneous resolution rate of 81% compared with a 93% resolution rate with antibiotic therapy, for an overall benefit of shortening the course of AOM by 1 day in 1 of 8 children treated.9–12 Suppurative complications, such as acute mastoiditis, are rare,13 and the extensive use of antibiotics contributes to bacterial resistance.14–20
Several recent reports document the efficacy and safety of 2 alternative, observational approaches to routine use of antibiotics: delayed prescription and watchful waiting.21–24 These approaches involve waiting for 72 hours to see if symptoms improve before instituting antibiotic therapy. Routine antibiotic treatment is the usual option for treating AOM in the United States, but recent guidelines have allowed for observation of children in whom the infection is less severe.25 The extent to which clinicians will adopt this approach remains to be seen. Because of the controversy, an economic analysis would be useful in clarifying these issues. The purpose of this study was to examine the economic implications of observational and routine antibiotic treatment approaches to AOM through a cost-effectiveness analysis.
METHODS
Decision Model
The study was an incremental cost utility analysis of 4 strategies for treating AOM using a decision analytic model. The analysis adopted a societal perspective that includes non–health care costs of parental work loss and transportation. The analysis was performed in patients aged 6 months to 12 years seen in primary care offices with uncomplicated, sporadic AOM who had not received antibiotics in the previous month or who had documentation that a previous episode of AOM treated with antibiotics within the last month had resolved. The model compared the cost and utility of 4 management strategies: (1) watchful waiting (72 hours of observation to see if symptoms improve before starting amoxicillin) as currently practiced in the Netherlands,26 (2) delayed prescription, in which patients return to the office for a prescription of amoxicillin if symptoms persist for 48 to 72 hours,21 (3) routine treatment with 5 days of amoxicillin, and (4) routine treatment with 7 to 10 days of amoxicillin. (These treatment lengths represent the usual duration of therapy in Europe and the United States; efficacy but not cost is similar. The cost of 8.5 days of amoxicillin, an average of the latter 2 lengths, was used in the model.10)
The time frame for the study was 30 days. The scope of the model was limited to short-term outcomes of AOM because of a lack of differences between antibiotic and placebo groups in the longer-term outcomes of recurrent AOM, tympanic membrane rupture, and middle ear effusion, as shown in prior studies.2,9–11 The included short-term outcomes were resolution (absence of AOM symptoms such as fever and ear pain) and clinical failure (continuation of AOM symptoms for 3 days while being observed or while receiving amoxicillin).
The study used costs rather than charges and included societal costs of parental work time lost and non–health care expenses, such as those for transportation and over-the-counter medical supplies. Benefits of the interventions, aside from resolution of AOM symptoms, included a reduced rate of mastoiditis with routine use of antibiotics and a decreased likelihood of reconsultation for future episodes of AOM under the observational strategies. Harms from the interventions included gastrointestinal and dermatologic adverse effects of antibiotics. Excluded from the model were the benefits of decreased antibiotic resistance with observational strategies, decreased reconsultation rates with other self-limiting upper respiratory tract infections, and parental satisfaction gained from knowledge of contributing to reduced antibiotic resistance through observational strategies. None of the children in the model developed meningitis.13
Model Pathways and Estimates of Clinical Factors
The model was programmed using statistical software (TreeAge Pro 2005, healthcare version; TreeAge Software Inc, Williamstown, Mass). The decision tree is shown in Figure 1⇓. Values and assumptions used for the various management strategies and possible outcomes were as follows.
-
Watchful waiting: In the Netherlands, 20.3% of parents do not seek consultation for AOM.27 It was assumed that children of these parents had mild disease, experiencing a clinical failure rate of 7.7%.28 The other 79.7% of children had an office visit and were observed with a follow-up plan to contact the physician if symptoms worsened or did not improve in 72 hours.26,27 Observed children experienced a clinical failure rate of 17.5%27 within 3 days that necessitated a second office visit and treatment with 7 to 10 days of amoxicillin, leading to resolution.
-
Delayed prescription: As for watchful waiting, a proportion of children with AOM were not brought in for a visit. The nonattendance rate was 37% for the delayed prescription strategy.21 Again, children not seen were assumed to have mild disease, and the majority experienced spontaneous resolution. The clinical failure rate was 7.7%, and these children required a consultation and 7 to 10 days of amoxicillin, leading to resolution.28 The remaining 63% of children were seen for a consultation, and their parents were informed that a prescription for 7 to 10 days of amoxicillin was available at the office for collection should symptoms persist for 3 days. Clinical failure occurred in 24%, and the prescription was used with subsequent resolution.21 In the remaining children under observation, symptoms resolved spontaneously.
-
Routine antibiotic strategies: In North America, where antibiotics are routinely prescribed, the nonattendance rate for AOM is 6%.27 In this analysis, the children not seen were assumed to have mild disease and also had a clinical failure rate of 7.7%.28 Those who experienced a failure were brought in for a consultation, treated with 7 to 10 days of amoxicillin, and experienced resolution. The remaining 94% of children were seen and treated with either 5 days or 7 to 10 days of amoxicillin. The option of 7 to 10 days was assumed to have the same efficacy as 10 days of amoxicillin based on a meta-analysis that used random-effects estimates of pooled absolute rate differences of outcomes for antibiotic effectiveness in which both lengths of treatment were combined.10 Children who received 7 to 10 days of treatment experienced resolution of symptoms or clinical failure at a rate of 6.1%28 requiring a second office consultation, treatment with 10 days of amoxicillin-clavulanate, and subsequent resolution. The resolution rate with the 5-day regimen was slightly lower based on a meta-analysis that showed an odds ratio of 1.52 for clinical failure at 8 to 19 days when compared with a regimen of 7 to 10 days.29 Children in all pathways treated with antibiotics had a 9.9% probability of experiencing gastrointestinal adverse effects (based on the difference between antibiotic and control groups in the 3 recent trials that reported on this outcome21,30,31) and a 2% risk of dermatologic adverse effects.32
-
Mastoiditis: Children in all treatment groups could develop acute mastoiditis, although a study has shown that rates are almost double in the Netherlands compared with Great Britain and the United States.33 One half of the national rates from that study (Table 1⇓) were used in the model, as only 50% of children with mastoiditis have preceding AOM.41–44 The Netherlands’ rate was applied in the watchful waiting and delayed prescription interventions, and the US rate in the amoxicillin interventions.
Model Estimates: Costs
Various costs in the analysis were estimated as follows.
-
Antibiotic cost: These costs were calculated using published average wholesale drug costs and handling costs.35 Amoxicillin doses were calculated for a child weighing 12.25 kg (the mean weight of a 24-month-old) at 45 mg/kg per day for 8.5 days in the 7- to 10-day treatment arm and for 5 days in the 5-day treatment arm.34 The cost of amoxicillin-clavulanate was based on the same child weight at a dose of 90 mg/kg per day using the ES suspension containing 600 mg of amoxicillin/5 mL for 10 days. The cost of ceftriaxone (used only in the acute mastoiditis pathway) included the cost of 2 additional nurse visits to administer the injection. The cost of a nurse visit was estimated at $13.80 based on the national average Medicare reimbursement45 using code 99211.40 of the International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM).
-
Mastoiditis cost: The cost of hospitalization for acute mastoiditis was calculated from the Healthcare Cost and Utilization Project (HCUP) 2000 database.46 A cost-to-charge ratio of 0.55 was used to convert charges to costs based on recommendations of the Association of Healthcare Research and Quality. The average length of stay was 3.7 days. It was assumed that mastoiditis required 7 days of intravenous antibiotics and then 7 days of an oral second-line antibiotic.47 Outpatient costs were estimated as 3.3 days of home intravenous ceftriaxone35 to complete the total of 7 days (home nurse visit costs were estimated using the Medicaid rate for Lancaster, Pa), then 7 days of a second-line antibiotic. The baseline costs for parental work loss and for non–health care expenses, as discussed subsequently, were tripled. It was assumed that children had 2 outpatient consultations after discharge.
-
Nonmedical cost: Work loss and non–health care costs were obtained from a report based on a random sample of 300 interviews with parents of children receiving a diagnosis of AOM in the Kaiser Permanente system in California from 1997.48 In this report, the average family lost 5.6 hours of work and spent $13 on nonmedical costs including babysitting, day care, travel, parking, and other expenses from an episode of simple AOM. The cost of work loss was estimated based on the US mean hourly wage from a national compensation survey for 2001 ($16.23),49 multiplied by the 5.6 hours. It was assumed that 80% of the non–health care costs were for transportation and that a physician consultation and trip to the pharmacy, if needed, required 2 hours of work time. A trip to the office and pharmacy to collect and fill a prescription required 1 hour of work time. In the clinical failure pathways, work loss and non–health care costs were doubled, commensurate with a doubling of utility loss.
-
Outpatient consultation cost: The cost of an initial outpatient consultation was estimated to be $34.23, a value obtained from the average rate of reimbursement for 67,367 Medicaid claims for the diagnosis of AOM in the state of Pennsylvania for 2001.36 Follow-up consultations were assumed to be (ICD-9-CM) code 99212 and to cost 0.76 of the initial consultation based on data from the US Centers for Medicare & Medicaid Services.45
All costs were adjusted to US dollars for the year 2001 based on the US medical consumer price index.50 Costs and utilities were not discounted because the time frame of the study was only 30 days.
Model Estimates: Effectiveness
Utility estimates were obtained from a cost utility analysis of second-line antibiotics used in AOM treatment.40 In that analysis, a postal survey describing a standardized scenario of a 2-year-old child with AOM was administered to a panel of pediatricians. Responses were used to generate utility scores defined as a preference for each health state rated on a scale of severity from 0 (death) to 1 (perfect health). Health states were rated on a 10-cm visual analogue scale. The following health states were included: AOM, treatment success, treatment failure, and gastrointestinal or dermatologic adverse events secondary to antibiotic therapy. Utility values for these outcomes are given in Table 1⇑.
In the present analysis, children experienced 1 of 5 possible outcomes: (1) resolution with observation, (2) clinical failure with observation, but subsequent resolution with 7 to 10 days of amoxicillin, (3) resolution with 5 days or 7 to 10 days of amoxicillin, (4) clinical failure with amoxicillin, but subsequent resolution with 10 days of amoxicillin-clavulanate, or (5) development of acute mastoiditis. Calculations for the utility tolls, in quality-adjusted life-days, for the first 4 pathways are given in Table 2⇓. It was assumed that an episode of acute mastoiditis had twice the impact on quality of life as did clinical failure with routine treatment with amoxicillin.
Sensitivity Analyses
The sensitivity analyses evaluated how the model’s results changed as the key assumptions were varied over the ranges delimited by the Low Sensitivity and High Sensitivity values in Table 1⇑. Ninety-five percent confidence intervals were used when reported or calculable from reported data. Costs were varied from 50% to 200% of the baseline value. One-way sensitivity analyses were performed for all the variables in the model. Additionally, probabilistic sensitivity analysis, in which the values for all the variables were simultaneously varied, was performed.37 Each variable was entered as a probability distribution based on the range indicated in Table 1⇑. The normal distribution was used for cost variables, and the beta distribution was used for the probability and utility variables.37 New values from within each of the probability distributions were randomly selected during each of 100,000 iterations, and 95% likelihood comparisons of the strategies were calculated.
RESULTS
Baseline Analysis
The results of the baseline analysis are shown in Table 3⇓. Seven to 10 days of amoxicillin resulted in the highest utility score and had an incremental cost utility ratio (ICUR) of nearly $55,900 per quality-adjusted life-year (QALY) gained compared with the least costly option, delayed prescription. Watchful waiting and the 5-day amoxicillin option were inferior. The routine amoxicillin strategies incurred higher overall costs, primarily because of higher costs for antibiotics and office consultations, compared with the 2 observational strategies. The delayed prescription strategy incurred the lowest costs by avoiding a second office consultation for clinical failure. The percentage of children treated with antibiotics was 15.5% with the watchful waiting approach, 17.9% with the delayed prescription approach, and 94.5% with the 2 routine antibiotic approaches.
One-Way Sensitivity Analyses
One-way sensitivity analysis was performed for all variables using the ranges indicated in Table 1⇑. Because the ICUR of 7 to 10 days of amoxicillin compared with delayed prescription was close to the customary, acceptable, US standard of $50,000 per QALY gained, altering the values of several of the cost, clinical, and utility variables affected the base case results. The variables with the greatest impact on the base case results are listed in Table 4⇓. Changing the rates of nonattendance and prescription redemption in delayed prescription had the greatest impact on the ICUR of 7 to 10 days of amoxicillin compared with delayed prescription. The viability of the watchful waiting option was also affected by the nonattendance rate in delayed prescription. Specifically, delayed prescription was dominated by watchful waiting when the nonattendance rate in delayed prescription was less than 23% and had a lower ICUR than 7 to 10 days of amoxicillin compared with delayed prescription when the delayed prescription nonattendance rate was between 23% and 28% (data not shown). When the delayed prescription nonattendance rate was greater than 28%, watchful waiting was dominated by a blend of the delayed prescription and 7 to 10 days of amoxicillin strategies.
Probabilistic Sensitivity Analysis
The results of the probabilistic sensitivity analysis demonstrated that 7 to 10 days of amoxicillin had a 39% chance of having an ICUR of less than $50,000 per QALY gained and a 61% chance of having an ICUR of greater than $50,000 per QALY gained compared with delayed prescription. Watchful waiting had a 23% chance of having an ICUR of less than $50,000 per QALY gained, a 59% chance of having an ICUR of greater than $50,000 per QALY gained, and a 17% of being inferior when compared with delayed prescription. Five days of amoxicillin had a 17% chance of having an ICUR of less than $50,000 per QALY gained and an 80% chance of having an ICUR of greater than $50,000 per QALY gained compared with delayed prescription.
DISCUSSION
Major Findings
This analysis found that treatment of AOM is a tradeoff between 7 to 10 days of amoxicillin, the most effective strategy, and delayed prescription, the least costly strategy. Children with AOM routinely given amoxicillin for 7 to 10 days gained about 3.5 hours of quality-adjusted life at an additional cost of $22.90 compared with children managed with delayed prescription, for an incremental cost of about $56,000 per QALY gained. The reduced cost of delayed prescription was achieved through fewer office consultations and less use of antibiotics. In delayed prescription, 37% of children were not brought in for consultation because parents had learned from prior experience that medical treatment was often not necessary for AOM. Also, children with clinical failure in the delayed prescription strategy were able to collect their prescription without a second consultation. The increased effectiveness of 7 to 10 days of amoxicillin was achieved by a reduction in the rate of clinical failure. One of the factors that lend credibility to the analysis is the rate of antibiotic administration in the delayed prescription option. The overall rate of 17.9% is consistent with the 19% rate of clinical failure found in the placebo groups of meta-analyses,10 suggesting that the model appropriately accounted for about the right proportion of children with continued symptoms.
Rather than enabling an absolute statement about which strategy is best for treating AOM, this study’s value may be in highlighting the quantifiable costs and benefits that must be accounted for when deciding about treatment of AOM. The effectiveness of antibiotics in reducing the symptoms of AOM by several hours comes at considerable financial cost. Spending an additional $22.90 for each of the 13.6 million annual cases of AOM in the United States1 treated with 7 to 10 days of amoxicillin instead of delayed prescription would result in an increase of $311 million in annual health care expenditures. Because it is not possible to quantify other important benefits of reduced antibiotic use, the results of this analysis surely underestimate the overall economic impact that adoption of delayed prescription could achieve. For instance, the analysis did not include the cost implications of antibiotic resistance or the impact of decreased medicalization of other acute, self-limiting infections, such as lower respiratory tract infections and sore throat.51,52
Comparisons With Other Studies
A review of the literature since 1965 shows there have been 14 economic evaluations of the management of otitis media.2,38–40,53–61 Four studies were not specifically restricted to acute disease or were done in settings that could not be compared.38,39,53,54 Six studies did not actually perform a cost-effectiveness analysis, but compiled the direct and indirect costs or national estimates of the cost and disease burden of AOM.2,48,55–58 Thus, only 4 cost-effectiveness evaluations of AOM have been done in the United States.40,59–61 These 4 studies varied widely in approach. In general, none of them were performed based on the recommendations of the US Public Health Service panel on Cost-effectiveness Analysis.62 More importantly, none included the management options of watchful waiting or delayed prescription.
Limitations
The analysis has several limitations worthy of discussion. The assumption with the largest impact on the results is the rate of nonattendance in the delayed prescription strategy. The baseline rate of 37% was chosen from the only trial that evaluated delayed prescription using the approach of having the patient return to collect the prescription rather than of distributing it at the time of consultation.21 The rate was obtained from a posttrial survey in which only 63% of parents in the delayed prescription treatment arm stated that they were very likely to consult a physician in the future for an episode of AOM. And other studies, although not inquiring directly about the likelihood of future consultation, have demonstrated very high levels of parental satisfaction with a similar approach, suggesting that the rate of nonattendance could exceed 37% as parents become accustomed to the safety of waiting for a few days to see if symptoms improve.22
Another area of concern is the assignment of utility values to young children, as they cannot be directly queried regarding their preference for various health states through a standard gamble assessment. The utility values used in this analysis were derived from a postal survey of an expert panel.40 Although the actual values cannot be verified, the utility scores allow for a comparison of effectiveness between treatment approaches. All the children in the observational and routine amoxicillin approaches with spontaneous resolution or clinical failure were assigned the same utility scores with an allowance for antibiotic adverse effects when antibiotics were prescribed.
As mentioned previously, the costs and benefits of increasing antibiotic use cannot be quantified; however, the impact is real. For instance, in Iceland, when a national campaign to decrease antibiotic treatment for otitis media was instituted, the rate of carriage of penicillin-resistant pneumococci decreased within 3 years.18 It has furthermore been demonstrated that among children with AOM, Streptococcus pneumoniae isolates obtained 10 days after presentation are less likely to be resistant in children managed with observation than in children routinely treated with antibiotics.23 Greater use of delayed prescription, through decreased antibiotic use, would likely have an impact on antibiotic resistance because of the large number of children with AOM.
Based on the assumptions in this analysis, children with AOM would receive the most benefit, although at considerable cost, through a strategy of routine amoxicillin treatment for 7 to 10 days. Delayed prescription, the least costly option, would not only save the health service industry considerable expense but would also promote demedicalization of a common, primarily self-limiting acute upper respiratory infection and lessen antibiotic resistance. Lastly, the results of this analysis support the recent guideline of the American Academy of Pediatrics and the American Academy of Family Physicians that includes an observational option for lower-risk children with AOM.25
Footnotes
-
Conflicts of interest: none reported
-
Funding support: The Lancaster General Hospital and the American Academy of Family Practice Grant generating project provided support in completing this research.
- Received for publication January 30, 2006.
- Revision received May 3, 2006.
- Accepted for publication May 22, 2006.
- © 2007 Annals of Family Medicine, Inc.