Abstract
PURPOSE Although lower respiratory tract infections are a leading cause of death in frail elderly patients, few studies have compared treatments and outcomes. We assessed the effects of different antibiotic treatment strategies on survival of elderly nursing home residents with lower respiratory tract infections in the United States and the Netherlands, where treatment approaches are quite different.
METHODS We combined data from 2 prospective cohort studies of lower respiratory tract infections conducted in 36 nursing homes in the United States and 61 in the Netherlands. We included residents whose infections were treated with antibiotics: 806 in the United States and 415 in the Netherlands. Outcome measures were 1-month and 3-month mortality. We used logistic regression to adjust for differing illness severity.
RESULTS Dutch residents had higher mortality than US residents (28.1% vs 15.1% at 1 month, respectively; P <.001). After adjusting for illness severity with logistic regression, the differences between the Dutch and US populations were not significant (odds ratio 1.34; 95% confidence interval, 0.94–1.90). Predicted mortality was overestimated for more severely ill US residents at 1 month but not at 3 months. No antibiotic regimen was consistently associated with increased or decreased mortality.
CONCLUSION Despite differences in illness severity and treatment, adjusted mortality did not differ between the 2 countries. Although we cannot exclude a short-term survival benefit from more aggressive treatment in the United States, differences in baseline health appear prognostically more important than the type of antibiotic treatment.
- Nursing homes
- aged
- respiratory tract infections
- pneumonia
- anti-bacterial agents
- delivery of health care
- health services research
INTRODUCTION
Nursing home residents frequently develop lower respiratory tract infections, mostly pneumonia and bronchitis,1–5 with estimated 30-day mortality from pneumonia or lower respiratory tract infection varying between 10% and 30%.3,6–9 Because meaningful cultures from specimens are rarely obtained in practice,10,11 antibiotic treatment is usually empiric.10–12 Despite guidelines from authoritative groups,13–15 however, little evidence supports any specific regimen. Naughton and colleagues16 found no difference in mortality between residents treated initially with either oral or intramuscular antibiotics. In a second study, adherence to an antibiotic guideline did not affect mortality.17 In a few small trials from the late 1980s or early 1990s, researchers found effectiveness of ceftriaxone or ciprofloxacin to be equal when compared with similar antibiotics.18–21
The ideal study design to test different regimens would be a randomized controlled trial; practical and ethical difficulties make such a study unlikely. Consequently, we must rely on data from observational studies, attempting to control for differences between treatment groups. Two large, concurrent studies of lower respiratory tract infections acquired by residents in nursing homes in the United States and the Netherlands provided the opportunity to examine how antibiotic treatment affected outcomes.22,23 In the US study, 30-day mortality was associated with 8 variables in a multivariable logistic model: blood urea nitrogen, white cell count, low absolute lymphocyte count (<0.8 × 109/L), lower body mass index, pulse rate, activities of daily living status, male sex, and deterioration in mood.22 One-week mortality in Dutch residents who were treated with antibiotics was related to 7 variables in multivariable logistic regression: respiratory rate, pulse rate, dependency in eating, recent increase in discomfort, decreased alertness, inadequate fluid intake, and recent occurrence of decubitus ulcers.23
Compared with treatment in the United States, hospitalization, use of intravenous antibiotics and multiple antibiotic regimens, intravenous fluids, and feeding tubes are relatively rare in the Netherlands.3,7,8,22,24–26 Such wide differences in care provide a natural experiment of the relationship of treatment and outcomes. We hypothesized that although there would be little overall difference in 1- and 3-month mortality among regimens, we would identify a group of residents for whom more aggressive therapy is more effective.
METHODS
Patient Recruitment and Data Collection
The Missouri LRI (lower respiratory tract infection) Study prospectively enrolled residents of 36 nursing homes in central Missouri and the St. Louis area between August 1995 and September 1998. Trained project nurses evaluated residents who had symptoms compatible with a lower respiratory tract infection. Diagnosis of lower respiratory tract infection was determined according to a standardized definition that required either (1) 3 of 6 signs or symptoms of lower respiratory tract infection (eg, cough, purulent sputum production) or general illness (eg, fever or worsening mental or functional status); or (2) 2 signs and symptoms with a chest radiograph interpreted as showing probable pneumonia. To avoid including an exacerbation of congestive heart failure or chronic obstructive pulmonary disease, we also required either probable pneumonia or a temperature of at least 38°C in association with those chronic conditions. Details of identification and evaluation are described elsewhere.22,27 About two thirds of residents had possible or probable pneumonia determined by chest radiographs. Those found to have a lower respiratory tract infection (1,409 episodes in 1,044 residents) were observed for a minimum of 3 months after evaluation. Data were collected from several sources, including nurse evaluations and medical record information. Institutional review boards at the University of Missouri-Columbia School of Medicine and Washington University School of Medicine approved the protocol.
The nationwide Dutch Pneumonia Study was conducted in psychogeriatric units in 61 nursing homes between October 1996 and July 1998.23 Enrollment criteria included psychogeriatric disease (97% had dementia), facility residence for at least 4 weeks, and pneumonia diagnosed by the attending physician. The investigators prospectively identified 706 consecutive residents with a diagnosis of pneumonia. Consistent with Dutch practice, attending physicians belonged to the permanent staff of the nursing home and cared for patients daily.28 They rarely ordered chest radiographs or blood tests. In contrast with the US study, Dutch residents were enrolled only once. The physicians caring for patients recorded their data on standardized forms at several points during 3 months of follow-up. The Medical Ethics Committee of the VU University Medical Center, Amsterdam, approved the study protocol.
Selection of Residents
For this analysis, we included US and Dutch residents aged 70 years or older whose condition explicitly met the US study definition of a lower respiratory tract infection and who received antibiotic therapy. Antibiotic therapy was defined as any antibiotic started from 2 days before diagnosis until 5 days after diagnosis. We excluded residents who did not receive antibiotics because they were dissimilar in the 2 countries. Dutch residents who did not receive antibiotics were quite ill and almost always receiving palliative care; in contrast, many US residents who did not receive antibiotics were not very ill.29,30 Among residents with dementia who did not receive antibiotics, 1-month mortality was strikingly different for Dutch and US residents, 90.2% and 17.5%, respectively.30
Only the first episode of illness was included for US residents with multiple enrollments. We excluded 193 of 1,044 US residents who did not receive antibiotics within the specified time frame and 45 who were younger than 70 years, leaving 806 for this analysis. Of the original 706 Dutch residents, we excluded 127 who did not meet the US study definition, 5 whose diagnosis was revised (to non–lower respiratory tract infection) after enrollment, 141 who did not receive antibiotics or whose antibiotic status was unknown, 16 who were younger than 70 years, and 2 with unknown age. We included the remaining 415 Dutch residents in the analysis.
Variables
We measured variables relative to the time of the treatment decision (in the Dutch study) or the time of the resident’s evaluation (in the US study). Hereafter, we refer to this as “the time of diagnosis” for both studies. Mortality was noted for at least 3 months after diagnosis. Selection of variables and definitions have been described in detail elsewhere.26 We defined dehydration as either poor skin turgor or dry mucous membranes noted at the time of diagnosis. Activities of daily living (ADL) performance was measured using the 5-level self-performance items from the Minimum Data Set (MDS)31 in the US study and the 4-level Bedford Alzheimer Nursing Severity-Scale (BANS-S)32 items in the Dutch study. To create common ADL measures for self-performance of eating, walking, and dressing, we collapsed the middle categories to create 3-level items scored as 0 (independent), 1 (requires assistance), or 2 (fully dependent). The sum of these 3 scores was used to rate overall ADL performance. Our definition of severe dementia included both cognitive and ADL impairment.26 We defined study residents as having severe dementia if they had at least 4 of 6 possible points on the overall ADL scale and were severely cognitively impaired (a score greater than 15 on the BANS-S for Dutch residents or a score of 5 or 6 on the CPS for US residents).
Analysis
We performed all statistical analyses with SAS for Windows.33 To determine a relationship between antibiotic choice and mortality, we first created a statistical model to control for illness severity. After combining the data sets, we began with bivariate analyses to determine which variables were related to mortality and nationality. For the rare missing values (mostly less than 4%), we imputed the mean for continuous variables and the mode for categorical data. To avoid disproportionate influence of extreme outliers, we set pulse rates below 60 beats per minute at 60 beats per minute and pulse rates above 140 beats per minute at 140 beats per minute. Similarly, we truncated respiratory rates above 50 breaths per minute at 50 breaths per minute.
Beginning with residents’ characteristics, we developed logistic regression models for 1- and 3-month mortality. Because the purpose of the models was to control for confounding, we did not limit the number of variables in the models and retained variables of marginal statistical significance (.05 < P< .10) that we believed were clinically important. We also included variables that were not statistically significant if they were important confounders and tested several quadratic terms. After developing these initial models, we tested facility size and the physician’s age and years of experience in the models. Finally, we included a dichotomous nationality variable (Dutch = 1, US = 0). We explored whether variables performed consistently across the 2 studies by interacting variables by nationality and testing the interaction terms in the final models. Stratifying by deciles of predicted mortality, we examined actual mortality for US and Dutch residents to determine whether model performance was consistent in both populations.
We then examined initial antibiotic therapy relative to mortality. Antibiotics were divided into several classes based on the clinical relevance and prevalence of individual agents. For Dutch residents, we further consolidated the classes because some antibiotics were rarely prescribed in the Netherlands.
We found that antibiotic use differed between the 2 countries, not only in the agents used but in how their use related to illness severity (Figure 1⇓). The data are therefore incompatible with the simple approach of adding a design variable representing classes of antibiotics to the basic logistic models that control for resident and facility characteristics. Instead, to test whether mortality differed by antibiotic choice, we stratified residents by ranges of illness severity calculated from our logistic models. Because mortality risk was unevenly distributed in the 2 populations, we used clinically meaningful cutoff values that would place a reasonable number of residents in each group. Because of the disparity in antibiotic treatment, we examined Dutch and US residents separately. After controlling for mortality risk, we used the Cochran-Mantel-Haenszel statistic of general association34 to test for a consistent relationship between mortality and antibiotic treatment over all strata. Fisher’s exact test was used to determine whether antibiotic treatment had different associations with mortality within different risk strata.
RESULTS
Description of Residents and Treatments
Compared with US residents, Dutch residents were more severely ill overall, more severely ADL dependent, and more often had severe dementia; however, they had fewer comorbidities (Table 1⇓). Unadjusted mortality was substantially higher for Dutch residents than US residents at both 1 month (28.1% vs 15.1%, respectively; P <.001) and 3 months (36.5% vs 24.8%, respectively; P <.001).
Most Dutch residents (71.8%) were treated with oral amoxicillin or amoxicillin/clavulanate; only 15.3% of US residents received these regimens (Table 1⇑). US residents most frequently received cephalosporins (37.6%). Thirty-nine different antibiotic agents were used in the United States compared with 15 in the Netherlands. Forty-six (11.1%) Dutch residents received intramuscular ampicillin or amoxicillin, followed by oral amoxicillin; this combination was not used in the United States. Other than that combination, only 1 Dutch resident received 2 antibiotics (cefuroxime and gentamicin) compared with 14.5% of US residents (for example, 9.2% received a third-generation or parenteral second-generation cephalosporin with another agent). US residents received parenteral antibiotics more often than Dutch residents (32.1% vs 12.8%, respectively, P <.001).
Patterns of antibiotic treatment differed between nations across mortality risk derived from our logistic model described below (Figure 1⇑). As mortality risk increased, treatment of US residents with doxycycline, tetracycline, macrolides, or trimethoprim-sulfamethoxazole declined while treatment with third-generation or parenteral second-generation cephalosporins increased. In contrast to the United States, amoxicillin was commonly used across all levels of risk in the Dutch population. The combination of intramuscular ampicillin or amoxicillin followed by oral amoxicillin was given to Dutch residents with higher mortality risk.
Only 1 Dutch resident (0.2%) but almost one third (30.4%) of US residents were hospitalized. For US residents, hospitalization increased with mortality risk, from 15.6% of residents with less than 5% mortality risk, to 56.4% of residents with a mortality risk of 40% or more. More than two thirds (68.2%) of hospitalized residents received parenteral antibiotics compared with 16.4% of residents who were not hospitalized. Rehydration therapy was 10 times more common in the United States (34.5%) than in the Netherlands (3.0%) in the month following diagnosis (P <.001).
Mortality Models
Table 2⇓ shows logistic models for 1- and 3-month mortality. For 1-month mortality, several indicators of acute illness were associated with increased risk of mortality, as were impaired self-performance of eating and walking, male sex, increased age, and Parkinson’s disease. Age was of borderline significance (P = .064), but we retained it in the model to help control for confounding. Model discrimination was good (c statistic = 0.765), with good calibration over the range of mortality risk (Hosmer-Lemeshow goodness-of-fit, P = .895).
The 3-month model also included 2 variables reflecting an increasing number of chronic health problems (bladder continence and congestive heart failure) and respiratory rate, another acute illness indicator, which was of borderline significance (P = .096); respiratory rate was not significantly associated with 1-month mortality (P = .302). Discrimination (c statistic = 0.737) and calibration (Hosmer-Lemeshow goodness-of-fit, P = .635) were good.
Despite the increased illness severity of the Dutch residents compared with US residents, Dutch nationality was not independently significant when added to either the 1- or 3-month models (odds ratio [OR] 1.34, 95% confidence interval [CI] .94–1.90; and OR 1.20, 95% CI, 0.87–1.66, respectively). There were no significant interactions between nationality and other variables. For low to moderately high risk of 1-month mortality (0% to 25%), predicted and actual mortality were quite similar between the 2 populations (Figure 2⇓). At higher levels of predicted mortality, however, the model overpredicted mortality for US residents and underpredicted mortality for Dutch residents. This disparity was not evident at 3 months.
Treatment Effects
After stratifying by mortality risk, the overall association between antibiotic agent and mortality for Dutch residents was not statistically significant at 1 month (P = .143), but it was statistically significant at 3 months (P = .020), indicating that mortality is not distributed evenly between antibiotics after adjusting for mortality risk. Looking within individual risk strata (available in Supplemental Table 1 online at: http://www.annfammed.org/cgi/content/full/3/5/422/DC1), however, there was no statistically significant association between a particular antibiotic and mortality at any level of risk for Dutch residents at either 1 or 3 months. The overall association between antibiotic agent and mortality for US residents was not statistically significant at either 1 or 3 months (P = .208 and .174, respectively) after adjusting for stratum of mortality risk.
DISCUSSION
We examined the different approaches to care of nursing home residents with lower respiratory tract infection in the United States and the Netherlands and found little evidence that specific choice of antibiotic therapy affects mortality. Despite our hypothesis, we also could not identify specific risk strata in which more aggressive antibiotic therapy appeared to result in better mortality outcomes. Based on their characteristics, the Dutch residents appeared to be much sicker and had higher unadjusted mortality. Nonetheless, the variable representing Dutch nationality was not significant in either mortality model. This finding indicates that mortality differences were mostly explained by case-mix and allowed us to substantially control for the differences between these 2 populations. We found no clear advantage for treatment with any particular antibiotic regimen after stratification by illness severity. At high-mortality risk, however, 1-month mortality for US residents was overestimated by the logistic model, and conversely, underestimated for Dutch residents (Figure 2⇑). This difference was not evident at 3 months. These findings are consistent with some short-term increased survival associated with the more aggressive therapy observed in the United States that included more frequent use of parenteral antibiotics, multiple antibiotic regimens, and hospitalization. Even so, we cannot exclude some other difference between the populations as the explanation.
Whether short-term increased survival is of potential benefit is open to question. For residents with advanced dementia, who are facing a high 6-month mortality and the frequent necessity of restraints to prevent removal of intravenous lines, the benefit of such aggressive care has been increasingly questioned.3,26,35–39 Our findings lend further support to this position because aggressive care appeared to offer little survival benefit in the 3 months after lower respiratory tract illness. Previous analysis of Missouri LRI Study data found no difference in 1-month mortality between residents first treated in the nursing home or the hospital, after adjusting for illness severity and probability of hospitalization.40
The study’s main limitation is the universal problem with observational studies—we were unable to assure adequate control for confounding. Across levels of illness severity and between the 2 countries, residents received very different therapies, making it difficult to compare outcomes. Furthermore, the great number of regimens made comparisons difficult. Despite the absence of patterns suggesting agents with clear benefit or harm, a much larger study would be needed to provide adequate numbers in all categories of antibiotics and mortality risk.
Different study procedures and differences in the practice of medicine between the two nations could have affected results. Variables could not be used if they were not present in both studies, which forced us to omit some potent risk factors from the original studies, such as body mass index22 and resident discomfort.23 In the Missouri LRI Study, project nurses actively attempted to identify potential cases, while in the Dutch Pneumonia Study, nursing home physicians included residents when they diagnosed pneumonia. The physicians may have preferentially included the more definitive cases. To make study subjects comparable, we used a common case definition to select residents, and our logistic models performed well in adjusting for differences in mortality risk.
Ultimately, studies involving direct experimental comparisons between antibiotic agents are needed to determine the best treatments for lower respiratory tract infection acquired by nursing home residents. This article may help to provide a basis on which such a study could be ethically justified, because differences in illness severity are likely much more strongly related to mortality than differences in antibiotic treatments. Nonetheless, in the interim, the lack of benefit in 3-month survival found for more aggressive treatment lends support for treating nursing home residents in the nursing home with simpler regimens that involve less discomfort.
Footnotes
-
Conflicts of interest: none reported
-
Funding support: This study was supported by a grant from the National Institute on Aging, grant number AG18335. The original data collection in Missouri was supported by the Agency for Healthcare Research and Quality, grant number HS08551, and a Generalist Physician Faculty Scholars Award to Dr. Mehr from the Robert Wood Johnson Foundation. The original data collection in the Netherlands was supported by grants from Dutch Ministry of Health, Welfare and Sport (VWS, grant numbers 37851, 37852, 37853, and 37832) and the Society ‘Het Zonnehuis.’
- Received for publication December 16, 2004.
- Revision received March 4, 2005.
- Accepted for publication April 4, 2005.
- © 2005 Annals of Family Medicine, Inc.