|
|
||||||||
1 Department of Family and Community Medicine, Medical College of Wisconsin, Milwaukee, Wisc
2 Injury Research Center, Medical College of Wisconsin, Milwaukee, Wisc
3 Department of Surgery, Medical College of Wisconsin, Milwaukee, Wisc
CORRESPONDING AUTHOR: Linda N. Meurer, MD, MPH, Department of Family & Community Medicine, Medical College of Wisconsin, 8701 Watertown Plank Road, Milwaukee, Wisconsin 53226, lmeurer{at}mcw.edu
| ABSTRACT |
|---|
|
|
|---|
METHODS The Wisconsin Medical Injuries Prevention Program (WMIPP) screening criteria were used to identify medical injuries, defined as "any untoward harm associated with a therapeutic or diagnostic healthcare intervention," among discharge diagnoses for all 562,317 patients discharged from 134 acute care hospitals in Wisconsin in 2002. We then derived estimates for crude and adjusted relative risk of in-hospital mortality associated with the presence of a medical injury diagnosis. Logistic regression adjusted for baseline risk of mortality using a comorbidity index, age, sex, Diagnosis Related Groups, hospital characteristics, and clustering within hospital.
RESULTS There were 77,666 discharges that met WMIPP criteria for at least 1 medical injury (13.8%). Crude risk ratios for death ranged from 1.27 to 2.4 for those with medical injuries within 1 of 4 categories: drugs/biologics; devices, implants, and grafts; procedures; and radiation. After adjustment, estimates of excess mortality decreased, and significance persisted only for injuries related to procedures (39%; 95% confidence interval [CI], 28%52%) and devices, implants, and grafts (16%; 95% CI, 3%30%).
CONCLUSIONS Estimates of excess mortality that do not account for baseline mortality risk may be exaggerated. Findings have implications for the care family physicians provide in the hospital and for the advice they give their patients who are concerned about the risks of hospitalization.
Key Words: Hospital mortality safety, medical device medication errors postoperative complications adverse effects iatrogenic disease comorbidity medical errors quality of health care research methods
| INTRODUCTION |
|---|
|
|
|---|
The 1999 Institute of Medicine report To Err is Human4 estimated that between 44,000 and 98,000 people die annually as a result of medical errors, placing health care injury among the top 10 causes of death, more than motor vehicle crashes, breast cancer, and acquired immunodeficiency syndrome.5 These frighteningly high numbers raised concern and awareness about patient safety and have led to advances in the measurement and prevention of adverse events in the clinic and the hospital.6,7 These estimates, obtained by extrapolating data from 2 large studies based on chart reviews of thousands of hospital records,810 led to some controversy.11,12 One criticism of the IOM estimates is that the original studies lacked control for baseline mortality risk or illness severity and that many patients would have died in the absence of an adverse event.11
Zhan and Miller13 advanced estimation of patient mortality related to safety using administrative hospital discharge data to study the frequency and outcomes of the Agency for Healthcare Research and Quality (AHRQ) Patient Safety Indicators (PSIs).14,15 PSIs are a specific set of 20 indicators designed to identify events reflecting a high probability of poor-quality inpatient care during a specific hospitalization. Using a comorbidity index to account for baseline differences in mortality risk, Zhan and Miller found that PSIs involving infections and postoperative complications were associated with significant increases in mortality risk.
These approaches and others use voluntary incident reporting to identify errors and near misses and focus on identifying sources of error or poor-quality care to improve safety. Many medical injuries occur, however, in the course of appropriate care.8,16 An injury control model that focuses on patient outcomes provides a complementary framework for studying patient safety problems.16
Wisconsin Medical Injury Prevention Program Approach
The Wisconsin Medical Injury Prevention Program (WMIPP) screening criteria identify medical injuries, defined as "any untoward harm associated with a therapeutic or diagnostic healthcare intervention,"17 in routinely collected hospital discharge data. The criteria are based on 688 specific ICD-9 CM (International Classification of Disease, 9th revision Clinical Modification)18 diagnostic N codes and, where relevant, E codes, which attribute an external cause to injuries, poisonings, and adverse events. Medical injuries are classified into 4 broad categories: drugs and biologics; procedures; devices, implants, and grafts; and radiation. Using a medical record review as a reference standard, and after adjusting for oversampling of records with medical injury diagnoses, WMIPP determined the screening criteria had a sensitivity of 60% and a specificity of 97%.17
We used the WMIPP screening criteria to identify medical injuries among patients discharged from Wisconsin hospitals and to estimate associated excess mortality, crudely and after adjustment for baseline mortality risk. We hypothesized that some of the excess mortality associated with medical injury would be accounted for by confounding differences between patients with and without a medical injury.
| METHODS |
|---|
|
|
|---|
To identify and categorize occurrences of medical injury codes, we applied WMIPP screening criteria to discharge diagnoses for all patient discharges from the 134 general, acute care hospitals in Wisconsin in 2002, excluding the delivery discharge records for normal newborns. Our study methods were reviewed and approved by the Medical College of Wisconsins Institutional Review Board.
Statistical analysis was performed using Stata software.19 Rates of medical injuries were calculated as the number of discharge records with the particular identified medical injury code divided by the total number of discharges. The crude mortality rate ratio (RR) and 95% confidence interval (CI) were calculated using standard methods for categorical data for patients whose discharge records had at least 1 medical injury code compared with those whose records had no medical injury code.
We used logistic regression to estimate odds ratios for mortality associated with medical injury after adjusting for baseline risk of death with Zhan and Millers comorbidity index. This comorbidity index is based upon Elixhausers 30 comorbidity measures, which account for underlying, preexisting conditions not related to the main reason for hospitalization, but which increase the likelihood of a poor outcome.13,20 The comorbidity index was derived by first estimating the regression coefficients of each of the comorbidities on in-hospital mortality and then summarizing those comorbidities that were significantly and positively associated with excess mortality into an index with a possible range of scores from 0 to 33.81.13 We also adjusted for age, sex, Diagnostic Related Group (as a fixed effect), hospital characteristics (ownership, trauma center level, transplant services offered, teaching/nonteaching, percentage of board-certified staff, and specificity of ICD-9 coding), and clustering within hospital (as patients within specific hospitals may share characteristics). The intraclass correlation for clustering within hospitals was 0.0043 with death as the outcome variable.
| RESULTS |
|---|
|
|
|---|
|
|
|
Closer examination of the WMIPP codes in these data showed that the most cases involved drug side effects, or "adverse effects of drugs, properly administered." Although common, medication side effects are often not life-threatening (eg, rash, nausea). Given the limited number of fields on the uniform billing report form, we hypothesized that patients who are more seriously ill would have multiple comorbidities and other diagnoses, and they would therefore be less likely than an otherwise healthy patient to have a minor drug side-effect listed as one of their diagnoses codes. We therefore examined the relationship among total number of diagnosis codes, mortality, and the coding of a medical injury. Indeed, whereas mortality increased with number of coded diagnoses, rates of recorded medication-related injury diagnoses decreased as the total number of recorded diagnoses rose above 8 (Figure 2
). This trend was not apparent for the other categories (data shown for drug- and procedure-related injuries).
|
| DISCUSSION |
|---|
|
|
|---|
|
Both medical injury and in-hospital mortality risks were higher among older patients who had multiple comorbidities at admission. After controlling for the baseline mortality risk using Zhan and Millers comorbidity index, our estimated excess risk of mortality associated with medical injury dropped to less than one half the unadjusted estimates. The excess mortality was primarily accounted for by procedure-related complications or injuries related to devices, implants, and grafts, a finding consistent with earlier work.13 Extrapolating these data nationally corresponds to roughly 1.95 million procedure-related injuries and 1 million device-related injuries, and assuming no overlap, an adjusted best estimate of 19,400 excess deaths.
WMIPP criteria are designed to identify medical injuries, or harm that occurs as a result of diagnostic or therapeutic health care interventions. Unlike chart reviews and adverse event reporting, these criteria do not identify cases of delayed diagnosis and therefore the delay or absence of intervention. WMIPP also uses a broad definition of injury to include all reported harms, not only those that result in permanent or severe disability. By using an injury control model, WMIPP criteria capture a different but overlapping subgroup of patients affected by patient safety problems, which complements other surveillance methods but makes direct comparison to earlier estimates based on chart review unwarranted. The substantial impact on estimates of excess mortality obtained by adjusting for baseline mortality risk suggests, however, that the number of deaths directly attributable to medical injury may not be as high as previous unadjusted estimates, and that future research in this area should include further development of methods for such adjustments.
With better understanding of the scope and consequences of medical injury, family physicians can take a proactive role in patient safety through facilitating hospitalization decisions, coordinating care and managing chronic illness, and responding promptly to injuries that appear or are carried into the posthospitalization period. Physicians must advise patients (especially those with multiple comorbidities) of the potential incidence and impact of medical injury, particularly if there are interventional and noninterventional approaches for treating a certain condition. More detailed examination of the characteristics of patients who suffer medical injury from specific procedures may help to assess risk for individual patients and guide treatment recommendations for patients at higher risk. In addition, by taking lessons from studies using hospital-based administrative data, we may be better equipped to design systems to monitor and detect medical injuries in the outpatient setting, thus adding to our armamentarium of patient safety tools.
Administrative data are dependent on the quality and completeness of coding and reporting practices, and lack clinical detail. Even so, the breadth and wide availability of hospital discharge data provide an efficient means to identify trends, suggest associations, and generate hypotheses for further study of patient safety. Using a broad definition of harm, such as that used by WMIPP criteria, enables surveillance of the wide spectrum of medical injuries treated in hospitals, whether originating in the community or occurring during specific hospitalization. Such a system could complement error reporting and chart reviews in the ambulatory setting as well, but would require uniform coding practices and systems designed to recognize and document harm caused by medical interventions. Recent enhancements of the hospital discharge data to include admission diagnoses will enable researchers to better delineate the source of injuries in the future, and facilitate prospective studies and the study of injuries related to outpatient care.
This study is limited by accuracy of administrative coding practices and the completeness of ascertainment of medical injuries using ICD E code and N codes. In Wisconsin, external cause of injury (E) coding is required for relevant N codes (N 800996); relevant records that do not contain an E code are returned to the submitting hospital for completion. For motor vehicle crashes, external cause of injury (E) coding is very complete as a result,25 but E coding rates for medical inujuries have not been studied. WMIPP criteria rely on information obtained or coded in the chart and therefore are likely represent an undercounting of harmful events, particularly among patients with multiple comorbidities. For drug-related injuries, patients with multiple diagnoses were less likely to have an injury code recorded, which may explain the finding that drug-related medical injuries were actually associated with a decreased adjusted risk of mortality. Relatively minor "adverse effects to drugs properly administered," such as nausea or dermatitis, may be coded more often for patients with otherwise uncomplicated hospital stays. The same may also be true to a lesser extent for other categories, leading to a possible underestimate of the risk of death attributable to an injury category. The complexities related to coding given the large numbers of diagnoses warrants further examination.
Even so, death is not the only result of medical injury worthy of attention. Regardless of how adverse events in health care are defined or identified, their numbers remain consistently high. In 2002, nearly 78,000 patients in Wisconsin alone experienced a medical injury, defined as harm, regardless of whether that harm resulted in death, major disability, increased costs or length of stay, or more immeasurable but real costs to the individual, such as pain, discomfort, or fear. Whereas attention to deaths and disabling injuries is critically important, limiting the focus to only the most severe outcomes may skew both the health care communitys and the publics perception of the extent and impact of injuries related to health care.
| ACKNOWLEDGMENTS |
|---|
| FOOTNOTES |
|---|
Funding support: This project was supported in part by the Agency for Health Research and Quality (U18 HS11893) and by the Centers for Disease Control and Prevention (R49/CCR519614).
Received for publication August 23, 2005. Revision received January 16, 2006. Accepted for publication January 30, 2006.
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
K. C. Stange On TRACK: Challenges and Insights Ann. Fam. Med, November 1, 2006; 4(6): 561 - 563. [Full Text] [PDF] |
||||
![]() |
K. C. Stange In This Issue: Capacity for Caring and Generating New Knowledge Ann. Fam. Med, September 1, 2006; 4(5): 386 - 388. [Full Text] [PDF] |
||||
Read all TRACK Comments
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |