|
|
||||||||
1 Department of Family Medicine, University of Colorado Health Sciences Center, Aurora, Col
2 The CNA Corporation, Alexandria, Va
CORRESPONDING AUTHOR: Douglas H. Fernald, MA, Department of Family Medicine, UCHSC at Fitzsimons, Mail Stop F496, PO Box 6508, Aurora, CO 80045-0508, doug.fernald{at}uchsc.edu
| ABSTRACT |
|---|
|
|
|---|
METHODS Applied Strategies for Improving Patient Safety (ASIPS) is a demonstration project designed to collect and analyze medical error reports from clinicians and staff in 2 practice-based research networks: the Colorado Research Network (CaReNet) and the High Plains Research Network (HPRN). A major component of ASIPS is a voluntary patient safety reporting system that accepts reports of errors anonymously or confidentially. Reports are coded using a multiaxial taxonomy.
RESULTS Two years into this project, 33 practices with a total of 475 clinicians and staff have participated in ASIPS. Participants submitted 708 reports during this time (66% using the confidential reporting form). We successfully followed up on 84% of the confidential reports of interest within the allotted 10-day time frame. We ended up with 608 relevant, codable reports. Communication problems (70.8%), diagnostic tests (47%), medication problems (35.4%), and both diagnostic tests and medications (13.6%) were the most frequently reported errors. Confidential reports were significantly more likely than anonymous reports to contain codable data.
CONCLUSION A safe and secure reporting system that relies on voluntary reporting from clinicians and staff can be successfully implemented in primary care settings. Information from confidential reports appears to be superior to that from anonymous reports and may be more useful in understanding errors and designing interventions to improve patient safety.
Key Words: Practice-based research network medical errors primary health care incident reporting risk management
| INTRODUCTION |
|---|
|
|
|---|
After the landmark study by Brennan et al11 and the Institute of Medicines first report on medical errors,12 the US Congress authorized new funding for research in this area. Applied Strategies for Improving Patient Safety (ASIPS) is 1 of 24, 3-year demonstration projects funded by the Agency for Healthcare Research and Quality and 1 of 4 specifically focused on primary care. These projects are designed to collect and analyze medical error reports.13
Knowing the limitations in incident reporting systems, such as failure to recognize an event, failure to report because of time constraints, and concern with the safety of reporting,3,14 we were interested in learning about (1) the types of events submitted to ASIPS using confidential or anonymous reports, (2) any differences in the ability of the 2 types of reports to capture information, and (3) differences among reporters using confidential or anonymous reports.
| METHODS |
|---|
|
|
|---|
The Patient Safety Reporting System
The ASIPS patient safety reporting system is a Web-based data collection and data management system, described in detail elsewhere.15 It is modeled on the Federal Aviation Administration (FAA) Aviation Safety Reporting System, which is widely recognized as a major success.12,16,17 Similar to the FAA reporting system, the ASIPS research team represents an outside third party: the project is not directly attached to any institutional quality improvement group, nor does any team member supervise those making reports.
We aimed to elicit wide participation from all clinical and nonclinical personnel in practices, assuming that anyone working in a practice might observe patient safety events. This approach represents a departure from most previous studies, which have examined patient safety in primary care from the physicians perspective.1,18
Reporting Events We asked participants to report "any event you dont wish to have happen again, that might represent a threat to patient safety." Such a broad definition was used to allow participants freedom to use their interpretation of a safety event and is similar to the reporting criterion used in another primary care patient safety study.1 We emphasized that this definition includes near misses where no patient harm actually occurs.
ASIPS accepts confidential or anonymous reports by telephone hotline, secure Web site, or paper. All 3 modes use the same instruments. Anonymous reports consist of 11 multiple-choice items and 6 fill-in-the-blank questions (Table 1
). Confidential reports require minimal initial informationreporters name, telephone number, and a brief description of the event. By offering the 2 report types, we attempted to balance reporters desire for anonymity with our desire to collect complete event data for better understanding. Confidential reports also allowed us to track event types (not specific events) by practice for direct feedback for practice improvement.
|
Taxonomy We used a multiaxial taxonomy of medical errors19 to code events. The portion of this taxonomy used by ASIPS contains 10 axes within 4 domains. A code must be applied from each axis for every report (taxonomy axes and domains are available in Appendix 1, which can be found online as supplemental data at http://www.annfammed.org/cgi/content/full/2/4/327/DC1). Multiple codes may be used within any single domain. The axes allowed us to classify the setting of each event, the clinical domain (eg, procedures, medications), patient outcome, course and cause(s), discoverer, and roles and contribution of participants involved. An event participant was someone who was involved in the event at the time the event occurred. Because many events occurred over an extended time, a single report could include multiple participants. Patients were included as participants only when their conscious action or inaction contributed to the event.
The taxonomy includes a code category of "unknown" (unknown codes) in all 10 axes to indicate insufficient information is available to code the event in greater detail. Analysis was performed using SAS version 8.2.
Analysis 1. Differences in the Nature of Reports Submitted
Figure 1
shows the number of safety events that were received and how they were grouped for analysis. We used all 608 coded events for analysis. Anonymous reports were compared with confidential reports for differences in who made the report and the nature of the error reported.
|
Analysis 3. Ability to Capture Harm Information We classified event reports into 5 mutually exclusive categories of harm: clinical harm, future risk of clinical harm, nonclinical harm, unstable (too early to ascertain harm), and no known harm (a combination of no reported harm and unknown). (Appendix 2, which can be found online at http://www.annfammed.org/cgi/content/full/2/4/327/DC1, provides supplemental detail concerning the harm categories.) Each event report was coded into 1 and only 1 harm category. We also formed combined categories within the 5-category harm hierarchy: any clinical harm combined the first 2 categories (clinical harm and future risk of clinical harm), and any harm combined any clinical harm and nonclinical harm.
| RESULTS |
|---|
|
|
|---|
Description of Type of Report by Reporter Type
Reporters used the confidential report form 66% of the time. We attempted to follow up on 91% of the confidential reports, with a success rate of 84% (76% of total). Table 2
shows the role of the reporter and the percentage of confidential reports submitted by that reporter group. Office staff were more likely than clinicians to use the confidential reporting method.
|
Anonymous vs Confidential Reports
Results from Analysis 1: Differences in the Nature of Reports Submitted
Table 3
displays data on the nature of reported events stratified by reporting method. No particular type of event was reported more or less commonly by confidential reports. Overall, our data show the preponderance of errors associated with diagnostic tests, 47% of events reported. Medication errors appeared in 35.4% of reports, and both a diagnostic testing and a medication error appeared in 13.6% of reports. Communication errors were identified in 70.8% of reports
|
|
|
| DISCUSSION |
|---|
|
|
|---|
Similar to those of previous studies, our findings highlight the value of a multifactorial approach to coding errors, because many events involve more than 1 person or error.20,21 Likewise, while communication errors appear as a component of many errors, they are infrequently viewed as the focus of an event; thus, the extent of the contribution of communication breakdowns to errors might not be reflected in coding systems that apply a single label.1,14
Confidential reports require time for the research staff to collect a complete set of data. While a complete data set allows for clarification and detailed information, it is also costly. It is possible that combined systems (such as the FAA system and the Australian Patient Safety Foundation system)16,22 requiring a great amount of structured data entry, even when submitting confidential reports, could maintain the effectiveness of confidential systems while decreasing their cost. Greater structured data entry may also improve anonymous reports. Early in the learning process, structured data collection often slows the data-entry process.23 It will be important to be careful when designing system interfaces for long-term use, because our participants indicated that lack of time to create a report is a major barrrier to system use.
| CONCLUSION |
|---|
|
|
|---|
| ACKNOWLEDGMENTS |
|---|
| FOOTNOTES |
|---|
Funding support: Support was provided by the Agency for Healthcare Research and Quality, grant #U18-HS011878, Wilson D. Pace, MD, principal investigator.
Received for publication October 17, 2003. Revision received February 27, 2004. Accepted for publication March 11, 2004.
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
L. P. Casalino, D. Dunham, M. H. Chin, R. Bielang, E. O. Kistner, T. G. Karrison, M. K. Ong, U. Sarkar, M. A. McLaughlin, and D. O. Meltzer Frequency of Failure to Inform Patients of Clinically Significant Outpatient Test Results Arch Intern Med, June 22, 2009; 169(12): 1123 - 1129. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. C. Antonacci, S. Lam, V. Lavarias, P. Homel, and R. D. Eavey Benchmarking Surgical Incident Reports Using a Database and a Triage System to Reduce Adverse Outcomes Arch Surg, December 1, 2008; 143(12): 1192 - 1197. [Abstract] [Full Text] [PDF] |
||||
![]() |
G M Kuo, R L Phillips, D Graham, and J M Hickner Medication errors reported by US family physicians and their office staff Qual. Saf. Health Care, August 1, 2008; 17(4): 286 - 290. [Abstract] [Full Text] [PDF] |
||||
![]() |
B Hoffmann, M Beyer, J Rohe, J Gensichen, and F M Gerlach "Every error counts": a web-based incident reporting and learning system for general practice Qual. Saf. Health Care, August 1, 2008; 17(4): 307 - 312. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. G. Kennedy, B. Littenberg, and J. W. Senders Using nurses and office staff to report prescribing errors in primary care Int. J. Qual. Health Care, August 1, 2008; 20(4): 238 - 245. [Abstract] [Full Text] [PDF] |
||||
![]() |
J Hickner, D G Graham, N C Elder, E Brandt, C B Emsermann, S Dovey, and R Phillips Testing process errors and their harms and consequences reported from family medicine practices: a study of the American Academy of Family Physicians National Research Network Qual. Saf. Health Care, June 1, 2008; 17(3): 194 - 200. [Abstract] [Full Text] [PDF] |
||||
![]() |
D G Graham, D M Harris, N C Elder, C B Emsermann, E Brandt, E W Staton, and J Hickner Mitigation of patient harm from testing errors in family medicine offices: a report from the American Academy of Family Physicians National Research Network Qual. Saf. Health Care, June 1, 2008; 17(3): 201 - 208. [Abstract] [Full Text] [PDF] |
||||
![]() |
M A B Makeham, S Stromer, C Bridges-Webb, M Mira, D C Saltman, C Cooper, and M R Kidd Patient safety events reported in general practice: a taxonomy Qual. Saf. Health Care, February 1, 2008; 17(1): 53 - 57. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. Berlin Communicating Results of All Radiologic Examinations Directly to Patients: Has the Time Come? Am. J. Roentgenol., December 1, 2007; 189(6): 1275 - 1282. [Full Text] [PDF] |
||||
![]() |
S. M Evans, B. J Smith, A. Esterman, W. B Runciman, G. Maddern, K. Stead, P. Selim, J. O'Shaughnessy, S. Muecke, and S. Jones Evaluation of an intervention aimed at improving voluntary incident reporting in hospitals Qual. Saf. Health Care, June 1, 2007; 16(3): 169 - 175. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. M Woods, E. J Thomas, J. L Holl, K. B Weiss, and T. A Brennan Ambulatory care adverse events and preventable adverse events leading to a hospital admission Qual. Saf. Health Care, April 1, 2007; 16(2): 127 - 131. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. J. Holden and B.-T. Karsh A Review of Medical Error Reporting System Design Considerations and a Proposed Cross-Level Systems Research Framework Human Factors: The Journal of the Human Factors and Ergonomics Society, April 1, 2007; 49(2): 257 - 276. [Abstract] [PDF] |
||||
![]() |
R. F. Van Vorst, R. Araya-Guerra, M. Felzien, D. Fernald, N. Elder, C. Duclos, and J. M. Westfall Rural Community Members' Perceptions of Harm from Medical Mistakes: A High Plains Research Network (HPRN) Study J Am Board Fam Med, March 1, 2007; 20(2): 135 - 143. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. Parnes, D. Fernald, J. Quintela, R. Araya-Guerra, J. Westfall, D. Harris, and W. Pace Stopping the error cascade: a report on ameliorators from the ASIPS collaborative Qual. Saf. Health Care, February 1, 2007; 16(1): 12 - 16. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. A. Ruiz and G. M. Glazer The State of Radiology in 2006: Very High Spatial Resolution but No Visibility Radiology, October 1, 2006; 241(1): 11 - 16. [Full Text] [PDF] |
||||
![]() |
D. E. Hildebrandt, J. M. Westfall, D. H. Fernald, and W. D. Pace Harm Resulting from Inappropriate Telephone Triage in Primary Care J Am Board Fam Med, September 1, 2006; 19(5): 437 - 442. [Abstract] [Full Text] [PDF] |
||||
![]() |
D M Woods, J Johnson, J L Holl, M Mehra, E J Thomas, E S Ogata, and C Lannon Anatomy of a patient safety event: a pediatric patient safety taxonomy Qual. Saf. Health Care, December 1, 2005; 14(6): 422 - 427. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. Berlin Using an Automated Coding and Review Process to Communicate Critical Radiologic Findings: One Way to Skin a Cat Am. J. Roentgenol., October 1, 2005; 185(4): 840 - 843. [Full Text] [PDF] |
||||
![]() |
J. W. Mold and K. A. Peterson Primary Care Practice-Based Research Networks: Working at the Interface Between Research and Quality Improvement Ann. Fam. Med, May 1, 2005; 3(suppl_1): S12 - S20. [Abstract] [Full Text] [PDF] |
||||
![]() |
W. D. Pace and E. W. Staton Electronic Data Collection Options for Practice-Based Research Networks Ann. Fam. Med, May 1, 2005; 3(suppl_1): S21 - S29. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. C. Smith, R. Araya-Guerra, C. Bublitz, B. Parnes, L. M. Dickinson, R. Van Vorst, J. M. Westfall, and W. D. Pace Missing Clinical Information During Primary Care Visits JAMA, February 2, 2005; 293(5): 565 - 571. [Abstract] [Full Text] [PDF] |
||||
![]() |
N. C. Elder and J. Hickner Missing Clinical Information: The System Is Down JAMA, February 2, 2005; 293(5): 617 - 619. [Full Text] [PDF] |
||||
![]() |
K. C. Stange In This Issue: Practice Change and Patient Safety Ann. Fam. Med, July 1, 2004; 2(4): 290 - 291. [Full Text] [PDF] |
||||
![]() |
J. H. Wasson Why Isn't It Better? Ann. Fam. Med, July 1, 2004; 2(4): 292 - 293. [Full Text] [PDF] |
||||
Read all TRACK Comments
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |