Article Figures & Data
Tables
Baseline 12-Month Follow-up Patient Characteristics Control No. (%) Intervention No. (%) Control No. (%) Intervention No. (%) Age, y 50–59 133 (42) 148 (42) 128 (44) 124 (36) 60–69 98 (31) 104 (29) 109 (37) 115 (33) ≥70 89 (28) 101 (29) 57 (19) 109 (31) Sex Male 118 (37) 136 (39) 112 (38) 152 (44) Female 202 (63) 217 (61) 182 (62) 196 (56) Race White 189 (59) 269 (76) 187 (64) 280 (80) Black 96 (30) 27 (8) 75 (26) 32 (9) Hispanic 20 (6) 41 (12) 17 (6) 22 (6) Other 15 (5) 16 (5) 15 (5) 14 (4) Insurance Commercial 135 (42) 172 (49) 154 (52) 169 (49) Medicare 123 (38) 129 (37) 92 (31) 135 (39) Other 62 (19) 52 (15) 48 (16) 44 (13) Education level Less than high school 50 (16) 34 (10) 35 (12) 27 (8) High school diploma or some college 147 (46) 171 (49) 135 (46) 189 (55) College or graduate school degree 123 (38) 143 (41) 123 (42) 129 (37) Self-rated health Excellent-good 184 (58) 227 (65) 181 (63) 221 (64) Fair-poor 134 (42) 123 (35) 106 (37) 122 (36) Smoking status Current 45 (14) 27 (8) 33 (11) 37 (11) Never 185 (58) 216 (61) 175 (60) 200 (58) Former 88 (28) 109 (31) 84 (29) 109 (32) Body mass index Underweight 2 (0.7) 2 (0.6) 5 (2) 2 (0.6) Normal 75 (25) 87 (26) 67 (24) 71 (21) Overweight 94 (31) 120 (36) 98 (35) 129 (38) Obese 135 (44) 126 (38) 112 (40) 134 (40) Years enrolled in practice ≤1 84 (26) 79 (22) 53 (18) 58 (17) 2–4.9 90 (28) 88 (25) 99 (34) 102 (29) 5–9.9 109 (34) 122 (35) 104 (35) 117 (34) ≥10 37 (12) 64 (18) 38 (13) 71 (20) Visits in last 24 months <5 121 (38) 96 (27) 108 (37) 96 (28) 5–8 103 (32) 109 (31) 94 (32) 130 (37) 9–12 61 (19) 84 (24) 47 (16) 67 (19) ≥13 35 (11) 64 (18) 45 (15) 55 (16) Measure Control Practices (n=11) Intervention Practices (n=12) Odds of improvement OR (95% CI)a 0.80 (0.58–1.12) 1.17 (0.86–1.59) OR=1, P valueb .18 .32 Breslow-Day, P value <.001 .001 Ratio of ORsc – 1.45 Equal ORs, P value – .10 Change in performance Average difference of proportions (95% CI)d −0.05 (−0.20 to 0.09) 0.04 (−0.09 to 0.17) Change within group, P value .44 .56 Intervention effect, P value – .33 -
OR = odds ratio, interpreted as the odds of screening at follow-up relative to the odds of screening at baseline.
-
↵a P value testing the null hypothesis of no improvement within group.
-
↵b P value testing whether the odds of improvement are homogeneous across practices within a group.
-
↵c Calculated as the odds of improvement under the intervention relative to the odds of improvement for the control group.
-
↵d For each practice, change was measured as the proportion screened at follow-up minus the proportion screened at baseline.
-
Measure Control Practices (n=11) Intervention Practices (n=12) Odds of improvement OR (95% CI)a 0.82 (0.59 to 1.15) 1.21 (0.87 to 1.68) OR=1, P valueb .24 .25 Breslow-Day, P value <.001 .008 Ratio of ORsc – 1.47 Equal ORs, P value – .11 Change in performance Average difference of proportions (95% CI)d −0.05 (−0.23 to 0.13) 0.04 (−0.08 to 0.15) Change within group, P value .59 .48 Intervention effect, P value – .40 -
CI=confidence interval. OR = odds ratio, interpreted as the odds of screening at follow-up relative to the odds of screening at baseline.
-
↵a P value testing the null hypothesis of no improvement within group.
-
↵b P value testing whether the odds of improvement are homogeneous across practices within a group.
-
↵c Calculated as the odds of improvement under the intervention relative to the odds of improvement for the control group.
-
↵d For each practice, change was measured as the proportion screened at follow-up minus the proportion screened at baseline.
-
Baseline Follow-up Screening Control No. (%)a Intervention No. (%)b Control No. (%)c Intervention No. (%)d Total screened 136 (43) 174 (49) 111 (38) 183 (53) Colonoscopy only 114 (84) 139 (80) 95 (86) 164 (80) FOBT only 5 (4) 22 (13) 6 (5) 6 (3) Colonoscopy + FOBT 11 (8) 11 (6) 10 (9) 13 (7) Sigmoidoscopy only 6 (4) 2 (1) 0 (0) 0 (0) Screened or recommended 197 (62) 236 (67) 170 (58) 246 (71) - Table 5
Qualitative Assessment of Quality Improvement Implementation (Intervention Practices)
Practice Team Structure Leadership Engagement Psychological Safety Intra-communication Inter-communication CRC Screening Rates Baseline (%) 12-Month Follow-up (%) P2a Strong Moderate Strong Strong Strong Moderate 14 30 P7 Strong Weak Moderate Weak Moderate Weak 53 73 P8a Strong Moderate Strong Moderate Moderate Weak 37 52 P10a Strong Moderate Moderate Moderate Strong Strong 71 33 P11 Weak Weak Moderate Weak Moderate NA 54 66 P15 Moderate Weak Moderate Weak Moderate Weak 50 67 P16a Strong Strong Strong Strong Strong Weak 43 48 P17 – – – – – – 41 10 P19a Strong Strong Strong Strong Strong NA 52 44 P21 – – – – – – 38 56 P22a Strong Weak Moderate Moderate Moderate Weak 47 71 P23a Strong Moderate Strong Strong Strong Weak 93 86 -
CRC=colorectal cancer; NA=not applicable.
-
↵a High-performing practice.
-
Additional Files
Supplemental Appendixes 1-3, Figures 1-2, Table
Supplemental Appendix 1. Practice 2: Strong QI Implementation With Improved CRC Screening Rates; Supplemental Appendix 2. P10: Moderate to Strong Implementation With Dramatic Drop in CRC Screening Rates; Supplemental Appendix 3. P15: Weak Implementation but Achieved Positive CRC Improvements; Supplemental Figure 1. Practice randomization; Supplemental Figure 2. Patient recruitment; Supplemental Table. Details of RAP Teams and Learning Collaboratives (Intervention Practices)
Files in this Data Supplement:
- Supplemental data: Appendix 1 - PDF file, 1 page, 176 KB
- Supplemental data: Appendix 2 - PDF file, 2 pages, 164 KB
- Supplemental data: Appendix 3 - PDF file, 1 page, 168 KB
- Supplemental data: Figure 1 - PDF file, 1 page, 164 KB
- Supplemental Figure 2 - PDF file, 2 pages, 168 KB
- Supplemental data: Table - PDF file, 1 page, 164 KB
The Article in Brief
Eric K. Shaw , and colleagues
Background This study evaluates a practice-based quality improvement intervention. Practices were given a specific goal (to improve colorectal cancer screening rates) and a change process (a series of facilitated team meetings and learning collaboratives), and were allowed to generate their own quality improvement objectives and strategies in hopes of enhancing their capacity for change.
What This Study Found Among 23 primary care practices, there was no significant improvement in screening rates in intervention practices compared with control practices. Successful implementation of the quality improvement program did not always translate into improved screening rates. There were associations between how well practice leaders fostered team development and the extent to which team members felt safe to engage in the change process. High-performing practices appeared to improve their capacity for change more than low-performing practices through the use of a reflective adaptive process.
Implications
- Practice transformation cannot be realized through only a series of incremental quality improvement projects. Developing greater organizational learning and change capacities is required.
- The quality improvement approach used in this study (Multimethod Assessment Process, Reflective Adaptive Process, facilitated team meetings, and learning collaboratives) may not be an optimal strategy for single-target interventions, particularly if gains in short-term guidelines are the goal.
- The researchers call for future research to address not only whether quality improvement interventions work but also why they work.