Abstract
PURPOSE Many intervention studies have found that flow sheet use improves patient care by drawing attention to a particular medical condition or needed preventive service and encouraging an immediate response from the health care professional; however, there are no studies examining how often flow sheets are used for diabetes in primary care practice. We assessed the relationship between diabetes flow sheet use and diabetes patient care outcomes in the everyday practice of primary care.
METHODS We abstracted the medical records of 1,016 patients with diabetes seen at 54 New Jersey and eastern Pennsylvania family practices participating in a quality improvement trial. The use of diabetes flow sheets was noted for each medical record. Scores for adherence to evidence-based diabetes guidelines in terms of assessment, treatment, and target attainment were determined on 100-point scales, with higher scores indicating better adherence. Generalized linear models were used to determine associations between use of diabetes flow sheets and adherence to guidelines.
RESULTS Diabetes flow sheets were used in 23% of the medical records of patients with diabetes. Use of flow sheets was associated with better mean guideline adherence scores for the assessment of diabetes (55.38 vs 50.13, P = .02) and the treatment of diabetes (79.59 vs 74.71, P = .004), but not for the attainment of intermediate diabetes outcome targets (hemoglobin A1c level, low-density lipoprotein cholesterol level, and blood pressure).
CONCLUSIONS Diabetes flow sheets can be used to promote better adherence to guidelines when it comes to assessing and treating diabetes. Additional research is needed to explore patient and physician variables that mediate the relationship between use of diabetes flow sheets and intermediate outcome targets for diabetes.
- Flow sheets
- diabetes mellitus
- family practice
- guidelines
- assessment
- treatment
- outcomes
- primary care
- quality of health care
- process assessment (health care)
- medical record review
INTRODUCTION
Several studies have shown the efficacy of disease-specific flow sheet use for improving patient care1–7; however, there are no studies in primary care settings examining how often flow sheets are used to guide diabetes care or the effectiveness of diabetes flow sheet use for improving patient outcomes. We undertook a study to describe the relationship between diabetes flow sheet use and patient care outcomes in the everyday practice of primary care.
METHODS
We used baseline data collected by retrospectively abstracting medical records in 54 New Jersey and eastern Pennsylvania family medicine practices participating in the ULTRA (Using Learning Teams for Reflective Adaptation) quality improvement intervention trial, which was designed to evaluate the effectiveness of a facilitated team-building intervention in improving adherence to guidelines for multiple chronic diseases.8 Practices owned and primarily staffed by family physicians were sampled from the New Jersey Family Medicine Research Network (NJFMRN) and the Eastern Pennsylvania Inquiry Collaborative Network (EPICnet); practices recommended by others knowledgeable about local practices were sampled as well. To be eligible to participate in the project, practices had to be in existence for at least 1 year and be willing to comply with the study protocol for 5 years. Approximately 48% of practices provided with detailed information about the study agreed to participate. The University of Medicine and Dentistry of New Jersey – Robert Wood Johnson Medical School Institutional Review Board approved this study.
Each participating practice generated a list of patients coded for insurance purposes for diabetes during the previous 12 months. Patients were excluded if they were deceased, were younger than age 18, were no longer a patient of the practice, or did not have at least 1 visit for diabetes in the previous 12 months. Within each practice, approximately 20 patients were randomly selected from the list, for a total of 1,016 patients.
Research nurses were trained by a physician to collect information from progress notes, laboratory results, and flow sheets of medical records on a structured survey instrument. Nurses recorded process and outcome data for diabetes care and information on the organization of the medical record, including the use of diabetes flow sheets. Flow sheets were considered “used” if they were present in the paper or electronic medical record and had at least 1 piece of information recorded on them. For practices with electronic medical records, we accepted data that were either manually or automatically entered into flow sheets.
Our main outcome of interest was adherence to diabetes guidelines recommended by the National Diabetes Education Program (NDEP).9 A multidisciplinary research team developed adherence scores for diabetes assessment, treatment, and target attainment based on these guidelines. The scoring and weights for guideline adherence were subsequently reviewed by independent consultants. Similar scoring algorithms have been used in previous analyses for diabetes as well as for hyperlipidemia.10–13
Diabetes assessment scores were based on documentation in the medical record of 5 assessments: hemoglobin A1c level tested in the past 6 months, urine microalbumin level tested in the past year, low-density lipoprotein (LDL)-cholesterol level tested in the past year, smoking status, and blood pressure. Each item was given 20 points if documented and 0 if not documented, for a total possible assessment score of 100.
Diabetes treatment scores consisted of documentation in the medical record of 4 measures: LDL-cholesterol level below 100 mg/dL or use of a lipid-lowering agent, hemoglobin A1c level at or below 8% or use of a hypoglycemic agent, blood pressure at or below 130/85 mm Hg or use of an antihypertensive agent, and urine microalbumin level below 30 mg/g creatinine or use of an angiotensin-converting enzyme (ACE) inhibitor or angiotensin II receptor blocker (ARB). Each item was given 25 points if documented and 0 if not documented, for a total possible treatment score of 100.
Diabetes target attainment scores consisted of documentation in the medical record of attainment of 3 targets: hemoglobin A1c level less than 8%, LDL-cholesterol level less than or equal to 100 mg/dL, and blood pressure less than or equal to 130/85 mm Hg. Each item was given 33.3 points if documented and 0 if not documented, for a total possible target attainment score of 100.
The main independent variable of interest was use of flow sheets for diabetes care.
We conducted data analysis using SAS version 9.1 (SAS Institute Inc, Cary, North Carolina).14 The guideline algorithm detailed above was used to calculate guideline adherence scores for each patient. Generalized linear models with random effects to account for clustering of patients within practice were used to determine associations between flow sheet use and guideline adherence scores. At the practice level, we controlled for the use of electronic medical records, owner of the practice (physician, hospital, university, or other), and number of clinicians. Effect sizes were calculated using a pooled standard deviation with the Cohen d statistic.15
RESULTS
Study patients made an average of 8.1 visits (SD, 5.3) to the practice in the preceding 2 years. On average, patients were aged 59.5 years (SD, 14.5) and weighed 206 lb (SD, 51.6), with 30.2% of patients noted as overweight or obese by their physician. Slightly more than one-half (50.9%) of the patients were female.
The median number of clinicians per practice was 4 (range, 1–34). Approximately 30% (16) of the practices had electronic medical records. Sixty-seven percent of practices were physician owned, 23% were hospital owned, 7% were university owned, and 4% had other owners.
Diabetes flow sheets were used in 23% of medical records overall. About 39% (21) of the practices used diabetes flow sheets for at least some patients. On average diabetes flow sheets were used for 21.4% of diabetes patients in a particular practice (range 0%–100%).
Use of a diabetes flow sheet was associated with better scores for guideline adherence in terms of diabetes assessment (P = .02) and diabetes treatment (P=.004), but not in terms of target attainment (Table 1⇓). Although the associations between flow sheet use and assessment and treatment were significant, differences between the flow sheet and no–flow sheet groups were small.
Scores for Adherence to Components of Diabetes Guidelines According to Use of Diabetes Flow Sheets (N = 1,016 Patients)
DISCUSSION
This is the first study to assess the association between the use of disease-specific flow sheets and adherence to care guidelines for diabetes in the everyday practice of primary care.
Our study demonstrates that use of diabetes flow sheets may improve adherence to guidelines when it comes to assessing and treating diabetes, but not when it comes to attaining targets. Because flow sheets are tools for managing and measuring processes of care, using them increases the chance of adhering to assessment guidelines. Target scores, however, while dependent on processes of care, are influenced by other factors such as disease severity, length of time on treatment, type of treatment, ability of physicians to identify and target patients not meeting outcome targets, physician-patient relationship, frequency of visits for diabetes, patients’ prescription plans, and patients’ compliance. Other studies have noted that because of these patient and physician variables, improving processes of diabetes care does not necessarily translate to improved patient outcomes.16,17 Our method of creating guideline adherence scores is an innovative way of generating scores that reflect processes of care as well as clinical outcomes. Researchers who use only target outcome measures would find no detectable difference with the use of flow sheets, thus concluding they were not useful.
There are several limitations to this study. Because this is a cross-sectional study, we are unable to assess causality. It is also possible that there are additional confounders we have not controlled for. We did not collect data on specific flow sheet entries; therefore, we can only determine whether at least 1 piece of information was present on the flow sheet, but not how often they were used or when they were last used. Additionally, we do not know which practice members, if any, were trained to use flow sheets. Despite these limitations, this study is unique in examining diabetes flow sheet use in community practices.
In conclusion, our study shows that use of diabetes flow sheets is associated with increased adherence to guidelines for diabetes care and may be a valuable tool in improving patient care.
Acknowledgments
This study was conducted within the New Jersey Family Medicine Research Network (NJFMRN) and the Eastern Pennsylvania Inquiry Collaborative Network (EPICnet). The authors wish to acknowledge Pamela Ohman Strickland, PhD, for statistical guidance.
Footnotes
-
Conflicts of interest: none reported
-
Funding support: Funding support for this work was provided by the National Heart, Lung, and Blood Institute (R01HL70800), an American Academy of Family Physicians Center Grant, the Primary Care Developing Shared Resource of the Cancer Institute of New Jersey, and the Lehigh Valley Hospital and Health Network.
- Received for publication June 5, 2007.
- Revision received September 18, 2007.
- Accepted for publication September 28, 2007.
- © 2008 Annals of Family Medicine, Inc.