|
|
||||||||
1 Department of Family Medicine, Roy J. and Lucille A. Carver College of Medicine, University of Iowa, Iowa City, Iowa
2 Department of Health Management and Policy, College of Public Health, University of Iowa, Iowa City, Iowa
CORRESPONDING AUTHOR: Paul A. James, MD, IAFP Endowed Chair in Rural Medicine, Department of Family Medicine, Roy J. and Lucille A. Carver, College of Medicine, University of Iowa, Iowa City, IA 52242, paul-james{at}uiowa.edu
| ABSTRACT |
|---|
|
|
|---|
METHODS We used the 2002 and 2003 Iowa State Inpatient Datasets, including 12,191 Iowa residents aged 18 years or older hospitalized with a principal diagnosis of acute myocardial infarction (International Classification of Diseases, Ninth Revision, Clinical Modification [ICD-9-CM] codes 410.01 410.91) in 116 Iowa hospitals classified as rural or urban. In-hospital mortality was the primary outcome measure. Age, sex, race, admission type, payer, and 2 comorbidity indices (Charlson Comorbidity Index and All Patient Refined Diagnosis-Related Groups) were determined to calculate risk-adjusted mortality. The distance from each patients home to the nearest urban Iowa hospital was used as an instrumental variable to compare risk-adjusted mortality controlled for unmeasured confounders.
RESULTS Unadjusted and risk-adjusted mortality rates using logistic regression models indicated significantly lower in-hospital mortality for patients with myocardial infarction admitted to urban hospitals than for their counterparts admitted to rural hospitals (unadjusted values, 6.4% vs 14%). The urban and rural groups differed significantly on characteristics studied, however. Analyses indicated that the traditional logistic regression models were possibly confounded by unmeasured patient factors, and when the same data were analyzed with the instrumental variable technique, mortality differences disappeared.
CONCLUSIONS In Iowa, mortality from myocardial infarction in rural hospitals is not higher than that in urban ones after controlling for unmeasured confounders. Current risk-adjustment models may not be sufficient when assessing hospitals that perform different functions within the health care system. Unmeasured confounding is a major concern when comparing heterogeneous and undifferentiated populations.
Key Words: Myocardial infarction mortality rural hospitals instrumental variable cardiovascular diseases health care delivery quality of care health services research quantitative methods confounders
| INTRODUCTION |
|---|
|
|
|---|
The validity of these observational studies is increasingly questioned, however.11 Unmeasured confounding may somewhat account for the observed differences in patient outcomes.12,13 For example, usual practice in rural hospitals dictates transferring patients needing higher levels of care to regional referral hospitals or to urban hospitals where advanced technologies and services are available.14 Yet data show that patients admitted to rural hospitals tend to be older, poorer, and sicker, and have more comorbiditiesall factors that contribute to increased mortality.2,12,13 This pattern of selective admissions to rural hospitals appears counterintuitive as it suggests that rural practitioners send the youngest, healthiest patients with less severe myocardial infarction to urban hospitals and admit the oldest, sickest patients with myocardial infarction to rural hospitals.15 We suspect that previously unmeasured confounders may explain this unexpected pattern. We therefore compared mortality outcomes between patients with myocardial infarction admitted to rural vs urban hospitals, using observed in-hospital mortality, risk-adjusted mortality, and mortality outcomes controlled for unmeasured confounders by the technique of instrumental variables.
| METHODS |
|---|
|
|
|---|
Dependent and Independent Variables
Iowa has 116 nonfederal hospitals that are classified as Urban Hospitals, Rural Referral Hospitals, Rural Prospective Payment System (PPS) Hospitals, or Critical Access Hospitals (CAHs). The 20 Urban Hospitals are located in a Metropolitan Statistical Area (MSA). The 7 Rural Referral Hospitals are located in non-MSA areas but have operating characteristics similar to those of urban hospitals.16 The 80 CAHs became part of the Medicare Rural Hospital Flexibility Program, which permits them to bill for services to Medicare beneficiaries in rural areas on a cost basis. The remaining 9 rural hospitals that have not converted to CAH status are now referred to as Rural PPS Hospitals because they continue to bill Medicare using Diagnosis-Related Groups (DRGs). A primary comparison in our analyses is between rural and urban hospitals. We combined CAHs and Rural PPS Hospitals to create the rural category, and we combined Rural Referral Hospitals and Urban Hospitals to create the urban category.
We specified binary variables for payer (Medicare, Medicaid, private insurance, self-pay, no charge, other), admission type (emergency, urgent, other), and race (black or not). We used 2 comorbidity indices: the Charlson Comorbidity Index17 and the All Patient Refined DRG (APR-DRG) risk index. The Charlson Comorbidity Index was created based on all secondary diagnoses.17,18 The APR-DRG classifies patients into 382 clinically meaningful groups. Within each group, patients were divided into 4 severity-of-illness and 4 risk-of-mortality subclasses.19 The APR-DRG risk index was created by using the entire 20022003 Iowa State Inpatient Dataset as a standard to estimate the probability of death for patients with each combination of APR-DRG values.20
The distances between each patients home and all urban hospitals in Iowa were obtained by calculating the distances between the centroids of each patients residential ZIP code and all urban hospitals ZIP codes. The shortest distance was the patients distance to the nearest urban hospital. Our outcome measure was inhospital mortality.
Traditional Analytic Approach
For the univariate analyses of group comparisons,
2 tests were used for dichotomous data and analyses of variance were used for continuous data. To compare adjusted mortality outcomes between patients admitted to rural hospitals vs urban hospitals, we used logistic regression analyses and controlled for patient characteristics. We first adjusted for demographic characteristics (age, sex, race, admission type, and payer). Next, we included each comorbidity index (Charlson Comorbidity Index and APR-DRG risk index). We then estimated the in-hospital mortality of 2 subgroups of patients (admitted to rural hospitals or to urban hospitals) using the best logistic regression model and compared the goodness of fit of the models for the 2 populations using c statistics and the Hosmer-Lemeshow
2 test.21
Instrumental Variable Approach
The traditional risk-adjustment approach can only adjust for measured patient characteristics. If important characteristics associated with in-hospital mortality are not available in the data set and the omitted relevant characteristics are related to patient or physician selection of the hospital, the traditional approaches (eg, logistic regression analysis) may yield biased estimates of the impact of hospital type (urban vs rural) on in-hospital mortality. For example, the difference in mortality rate could be due to unmeasured patient risk factors instead of quality of care. In such cases, an instrumental variable technique has been recommended for its ability to adjust for potential unmeasured confounding effects.13,2225
The instrumental variable method is an econometric technique that enables an unbiased estimation of treatment effects in observational studies. A detailed description of this technique is given in an article by Newhouse and McClellan.22 For elderly patients with myocardial infarction, several unmeasured confounders, such as severe comorbid conditions that limit life expectancy or patient preferences to remain in the rural hospital, may reduce transfers to larger urban hospitals and thereby increase mortality. As discussed above, the biases of traditional approaches are due to the correlation between the variable of interest (rurality in this case) and unmeasured confounders. The instrumental variable technique can extract variation in the variable of interest that is unrelated to unmeasured confounders, and use this variation to estimate the causal effect on an outcome.2225
The instrumental variables should satisfy 2 assumptions: (1) they should correlate with treatment choice and (2) their effect on outcome should only be through treatment choice (ie, they should have no relationship with unmeasured confounders).2225 Instrumental variables are used to achieve a "pseudorandomization."21 The outcome of a coin toss in a randomized controlled trial would be a perfect instrumental variable,21 if we could use a coin toss to assign patients to rural or urban hospitals. In this case, a patients choice of hospital would depend only on the outcome of the coin toss and would not be associated with any unmeasured confounders, such as the severity of myocardial infarction. We could therefore attribute the observed effects to the treatment and derive an unbiased estimate. In observational studies, distance is often used to create the instrumental variables for studying outcomes of myocardial infarction.13,22 Similar to the approach of Brooks et al,23 instrumental variables in our study were binary variables that grouped patients based on their distance to the nearest urban hospital.
We hypothesized that the distance of a patients home to the nearest urban hospital would independently predict the likelihood of selection of either a rural or an urban hospital but would not be related to the patients comorbidities or other unmeasured confounders. For estimation, the SYSLIN 2-stage least-squares (2SLS) procedure in SAS version 9.1 (SAS Institute, Cary, NC) was used. We used F statistics in the first-stage regression to test the first assumption of the instrumental variables.24,25 We examined the second assumption of the instrumental variables in several ways. As indicated by Newhouse and McClellan,22 if the instrumental variables are independent of the unmeasured confounders, it should also be independent of observed risk factors (eg, age and comorbidity index). Using approaches similar to those of Newhouse and McClellan,22 Frances et al,13 and Brooks et al,23 we tested the independence of the instrumental variables with observed risk factors. Following Brooks et al,23 instrumental variables were constructed as categorical variables by separating patients into 2, 4, 8, and 12 groups based on the distance of a patients home to the nearest urban hospital. In addition, overidentifying restrictions tests* were used to examine the second assumption of instrumental variables.24,25
| RESULTS |
|---|
|
|
|---|
|
|
|
2 with 8 degrees of freedom was 11.56 for the urban hospital model and was not significant at the 5% level. It was 22.22 for the rural hospital model, which was significant at the 1% level. The logistic regression model for patients admitted to rural hospitals had a much worse goodness-of-fit statistic than the model for patients admitted to urban hospitals. This finding indicates that a substantial amount of variation in patients with myocardial infarction in rural hospitals cannot be captured in these multivariate models.
Instrumental Variable Analyses
The unbalanced patient characteristics between rural and urban hospitals, and the poor goodness of fit for the rural hospital model suggested that the traditional analytic approaches for comparing mortality caused by myocardial infarction may be subject to bias because of omitted variables. We tried to address this possible bias using instrumental variable methods. To evaluate the validity of the instrumental variable, we separated the patients with myocardial infarction into 2 groups based on their distance to the nearest urban hospital, using the median distance (14.08 miles) as the cut point. As shown in Table 4
, patients who lived closer to an urban hospital were much more likely to be admitted to an urban hospital than those who lived farther away. Although the groups differed significantly in terms of age, the difference was much smaller than that between patients admitted to urban vs rural hospitals (Table 1
). There were no significant differences between groups in the Charlson Comorbidity Index or the APR-DRG risk index. This comparison validated our assumption that the distance to the nearest urban hospital significantly influences the selection of either an urban or a rural hospital, and is not associated with patients severity of diseases.
|
The results were consistent with our results in Table 5
Finally, we tested our data using the bivariate probit model for instrumental variable estimation, and the results we obtained were consistent with 2SLS estimations.
|
| DISCUSSION |
|---|
|
|
|---|
The benefit of the instrumental variable approach is that one obtains unbiased and reasonably good estimates of the effect of the treatment on the outcome variable, if the instrumental variables chosen meet the 2 assumptions.21 We attempted to remove residual selection bias by choosing the distance to the nearest urban hospital from a patients residence as an instrumental variable.13,22,23,28 We rigorously tested the instrumental variables and found them to be valid, and demonstrated that the instrumental variable estimates should be unbiased. We believe that this approach offers advantages because it yields unbiased estimation. It does so by comparing the mortality of patients with myocardial infarction between rural and urban hospitals among those comparable patients22,23 who selected the hospital for myocardial infarction care based on the fact that it was the geographically closest hospital. In other words, patients chose rural or urban hospitals because they lived near the hospitals. They would not have chosen these hospitals had they lived farther away. We believe that most patients with myocardial infarction select the hospital that is geographically nearby. Our findings from the instrumental variable estimation differ from the findings obtained with the logistic regression models and show that patients with myocardial infarction admitted to urban hospitals no longer have reduced in-hospital mortality compared with their counterparts admitted to rural hospitals.
Our results have potential limitations. First, the instrumental variable estimation can be generalized only to patients with myocardial infarction whose selection of admitting hospital was influenced by their geographic location.21,22 For example, the conclusion cannot be applied to patients with myocardial infarction in rural areas who bypass rural hospitals and seek care in urban hospitals. A second possible limitation is that the findings for hospitals in 1 state do not generalize to other states. Likewise, analyses of in-hospital mortality rates may not be generalizable to mortality rates after discharge. We recommend replication of this work with larger, national data sets.
Our results conflict with findings from previous observational studies. Health care professionals experienced in rural health care delivery know that the previous studies are inconsistent with established practice. Rural physicians in small hospitals with minimal supporting infrastructure do not admit, but rather transfer quickly patients with myocardial infarction who require intensive medical management. Yet the traditional analytic approaches suggest that the patients sent to urban hospitals tend to be younger and less severely ill than those who remain in the rural hospitals. This pattern of patient selection for urban hospitals suggests that the clinical judgment about transfer of rural elderly patients with myocardial infarction may rely on different criteria, and this influence likely contributes to the unmeasured confounding.
We believe that those different criteria are not reflected in the data sets we used for study and may not be uniformly reflected in patients charts. The preferences of patients likely play a substantial role in hospital selection, especially among elderly patients experiencing myocardial infarction. Patient preferences may reflect personal choices or the existence of serious comorbid conditions. Patients who have complex medical and personal histories may choose to remain near home and ultimately to die near home. The transfer patterns may therefore reflect rural physicians respecting patients decisions that are complex and not related to disease.
Rural hospitals, because of their size and limited personnel, often function as triage hospitals. Our study provides evidence to support the continued importance of rural hospitals and their role in caring for patients with myocardial infarction.
This study adds to the questions previously raised about the use of in-hospital mortality rates as a quality indicator for hospitals,29 even when risk adjustment is used. Current methods to monitor quality may be flawed if they do not adequately control for selection bias caused by unmeasured confounders. By showing an important influence of such confounders, we believe that this study strongly challenges the contention that care for myocardial infarction is inferior in rural hospitals.
| ACKNOWLEDGMENTS |
|---|
| FOOTNOTES |
|---|
Funding support: Support for this work was provided by the Agency for Healthcare Research and Quality through grant HS015009.
* The null hypothesis for overidentifying restrictions tests is that instruments are uncorrelated with unmeasured confounders.25 ![]()
* These tests can only be done if there is more than 1 instrumental variable.24,25 ![]()
* Given the word limit, the results are not reported. They are available on request from the authors. ![]()
We did not run the APR-DRG risk adjusted models for 3-year data given that APR-DRG variables were not available in 2001 data set. ![]()
These tests can only be done if there is more than 1 instrumental variable.24,25 ![]()
Received for publication March 23, 2006. Revision received June 13, 2006. Accepted for publication July 24, 2006.
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
G. Tatu-Chitoiu, M. Cinteza, M. Dorobantu, M. Udeanu, O. Manfrini, C. Pizzi, M. Vintila, D. D. Ionescu, E. Craiu, D. Burghina, et al. In-hospital case fatality rates for acute myocardial infarction in Romania Can. Med. Assoc. J., June 9, 2009; 180(12): 1207 - 1213. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. S. Ross, S.-L. T. Normand, Y. Wang, B. K. Nallamothu, J. H. Lichtman, and H. M. Krumholz Hospital Remoteness And Thirty-Day Mortality From Three Serious Conditions Health Aff., November 1, 2008; 27(6): 1707 - 1717. [Abstract] [Full Text] [PDF] |
||||
![]() |
T.-H. Lu, K.-P. Shaw, P.-Y. Hsu, L.-H. Chen, and S.-M. Huang Non-referral of unnatural deaths to coroners and non-reporting of unnatural deaths on death certificates in Taiwan: implications of using mortality data to monitor quality and safety in healthcare Int. J. Qual. Health Care, June 1, 2008; 20(3): 200 - 205. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. C. Stange On TRACK: Primary Care Opportunities for Filling Unmet Need Ann. Fam. Med, May 1, 2007; 5(3): 270 - 272. [Full Text] [PDF] |
||||
![]() |
K. C. Stange and W. R. Phillips In This Issue: Real Change Is Real Hard in the Real World Ann. Fam. Med, March 1, 2007; 5(2): 98 - 100. [Full Text] [PDF] |
||||
Read all TRACK Comments
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |