Abstract
PURPOSE Practice facilitation is an evidence-informed implementation strategy to support quality improvement (QI) and aid practices in aligning with best evidence. Few studies, particularly of this size and scope, identify strategies that contribute to facilitator effectiveness.
METHODS We conducted a sequential mixed methods study, analyzing data from EvidenceNOW, a large-scale QI initiative. Seven regional cooperatives employed 162 facilitators to work with 1,630 small or medium-sized primary care practices. Main analyses were based on facilitators who worked with at least 4 practices. Facilitators were defined as more effective if at least 75% of their practices improved on at least 1 outcome measure—aspirin use, blood pressure control, smoking cessation counseling (ABS), or practice change capacity, measured using Change Process Capability Questionnaire—from baseline to follow-up. Facilitators were defined as less effective if less than 50% of their practices improved on these outcomes. Using an immersion crystallization and comparative approach, we analyzed observational and interview data to identify strategies associated with more effective facilitators.
RESULTS Practices working with more effective facilitators had a 3.6% greater change in the mean percentage of patients meeting the composite ABS measure compared with practices working with less effective facilitators (P <.001). More effective facilitators cultivated motivation by tailoring QI work and addressing resistance, guided practices to think critically, and provided accountability to support change, using these strategies in combination. They were able to describe their work in detail. In contrast, less effective facilitators seldom used these strategies and described their work in general terms. Facilitator background, experience, and work on documentation did not differentiate between more and less effective facilitators.
CONCLUSIONS Facilitation strategies that differentiate more and less effective facilitators have implications for enhancing facilitator development and training, and can assist all facilitators to more effectively support practice changes.
- practice facilitation
- quality improvement
- large-scale initiative
- capacity building
- implementation facilitation
- organizational change
- organizational innovation
INTRODUCTION
Practice facilitators are trained individuals who build medical practices’ capacity to make meaningful operational changes aligned with current evidence.1,2 Facilitators provide education, motivation, accountability, and guidance on organizational processes.3 Facilitators increase practices’ awareness about needs for change, prioritize Plan-Do-Study-Act (PDSA) cycles and quality improvement (QI) activities, promote relationship building and communication, train staff to use data for monitoring and evaluation,1,3,4 and/or provide technical advice.5
Facilitators have been particularly used in primary care settings4–7 to help practices improve process and outcome measures6 and adopt evidence-based guidelines.7 Research suggests that facilitation can be effective8–10 and that use of facilitators is growing,5 as policies and guidelines affecting primary care rapidly change.11
Studies suggest that facilitators use varied interpersonal communication and health information technology skills to help practices make incremental process improvements,9,12–15 and facilitators benefit from training and other supportive structures, including peer support.16 Research examining the strategies facilitators use that contribute to organizational change and clinical outcome improvement,17–19 which would benefit the change management field more broadly, is limited.20,21 This study begins to fill this important research gap5,20 by addressing a key research question: what characteristics and strategies distinguish between more and less effective facilitators?
METHODS
Setting
Advancing Heart Health, funded by the Agency for Healthcare Research and Quality (AHRQ), was a large-scale practice change initiative launched in mid-2015 that focused on improving practice capacity and cardiovascular preventive care clinical outcomes. Seven regional grantees, called cooperatives, participated; the cooperatives spanned 12 states and brought together a range of partners to implement this initiative, launching work with practices in 2016.22 Facilitation was a core implementation strategy delivered to all practices, across all cooperatives, in conjunction with other implementation support (ie, expert consultation, learning collaboratives, data feedback, and benchmarking)23 that varied by cooperative.24–26 Cooperative intervention details are described elsewhere.24–27
Cooperatives worked with a range of facilitator organizations, including Area Health Education Centers, Regional Extension Centers, and practice-based research networks, to develop a workforce to engage more than 200 practices in each region and 1,630 practices overall. To assess the initiative’s impact, we conducted the EvidenceNOW national evaluation called Evaluating System Change to Advance Learning and Take Evidence to Scale (ESCALATES).28 The Oregon Health & Science University Institutional Review Board approved this study.
Sample
The sample for this study included cooperative leaders, facilitators, and practices. All cooperatives and their practices that submitted quantitative data both before and after the initiative were included. A subset of facilitators participated in this study. To be included, facilitators had to have participated in qualitative data collection (observation and/or interview); had to have worked with at least 4 practices, resulting in a stable caseload that allowed assessment of effectiveness; had to be external facilitators, meaning they were part of the cooperative workforce and not employees of the primary care organization; and had to be either more or less effective as facilitators, according to criteria described in detail below. Figure 1 and Table 1 show the numbers of practices and facilitators included in this sample.
Study Design
This study used a sequential mixed methods design (Table 2). Qualitative data collection and analysis preceded quantitative analyses that identified more and less effective facilitators. Once both data sources were independently assessed, the team integrated these data and analyzed the complete data set further.
Data Collection
Clinical Quality Measures
We collected 3 outcomes defined by the Centers for Medicare and Medicaid Services as measures of the quality of clinical care: aspirin use in high-risk individuals, blood pressure control, and smoking cessation counseling (ABS). Possible values ranged from 0% (no eligible patients met the measure) to 100% (all eligible patients met the measure). These measures, detailed elsewhere, were collected quarterly from all practices (Supplemental Table 1) from baseline until the end of intervention.28 ABS outcomes, abstracted from electronic health records, were collected by cooperatives at the practice level and shared with the ESCALATES team.
Practice Capacity for Change
Practice capacity for change was measured at baseline and at the end of the intervention by the Change Process Capability Questionnaire (CPCQ), which assessed the extent to which practices engaged in specific QI strategies during the previous year.29 Possible scores range from −28 (lowest capacity) to 28 (highest capacity).30
Observation and Interviews
A multidisciplinary team having expertise in qualitative methods, primary care, and practice improvement conducted the observations and interviews. During the active intervention, we observed facilitators, selected by cooperative leadership, working with their practices for at least 7 QI meetings, paying particular attention to the strategies facilitators used. Researchers (S.M.S., A.B., J.D.H., D.J.C.) took notes during these meetings, and later developed these into detailed field notes that described the observed activities. After observation, facilitators were interviewed using a semistructured guide (Supplemental Appendix 1) to explore professional background, training, education, skills, and facilitation approach.
After the intervention, we conducted semistructured interviews by telephone with facilitators who worked with at least 1 practice that made a positive change in ABS outcome measures. Facilitators worked with practices that varied on size, ownership, and geography. These interviews were similar to those conducted during the active intervention, but focused on the specific changes practices made to improve metrics and the facilitator’s role in fostering improvements (Supplemental Appendix 2). We also conducted interviews with 39 individuals responsible for hiring and supporting facilitators to learn about facilitator training and monitoring.
Defining Facilitator Effectiveness
Using quantitative data, we purposively selected a group of more effective and a group of less effective facilitators. Facilitators were defined as more effective if at least 75% of their practices improved on an ABS and/or CPCQ outcome. Facilitators were defined as less effective if less than 50% of their practices improved on these measures. Data from facilitators who achieved improvements in 50% or more but less than 75% of their practices were not considered further (Figure 1).
A practice was defined as improved if (1) it had a below-median baseline change capacity (assessed from CPCQ score) and, with the intervention, achieved an increase of at least 6 points in CPCQ score or an increase of at least 5 percentage points in 1 or more ABS measures, or (2) it had an above-median baseline change capacity and, with the intervention, achieved an improvement of at least 5 percentage points in 1 or more ABS measures. We selected this definition for several reasons. First, previous research has shown that a 6-point positive change in CPCQ score represents a moderate-level improvement, as determined by the Cohen d effect size.31 Second, an improvement of at least 5 percentage points in an ABS measure was clinically meaningful and achievable. In addition, our prior work showed that EvidenceNOW interventions were associated with average ABS improvements ranging from +3.39 percentage points (aspirin use) to +7.73 percentage points (smoking cessation counseling).32 Third, in practices with below-median baseline CPCQ scores, facilitators might prioritize foundational QI work (which this questionnaire assessed) over ABS change, whereas practices already having higher CPCQ scores may be deemed better positioned to immediately begin work implementing QI strategies to improve ABS outcomes.
Data Management
Interviews, which generally lasted an hour, were audio recorded, professionally transcribed, and reviewed for accuracy. The quantitative analyst provided the qualitative team with identification numbers for more and less effective facilitators, without identifying the group to which facilitators belonged. All qualitative data were deidentified and organized into Atlas.ti 7 (Scientific Software Development GmbH) for management and analysis.
Analysis
Qualitative data analysis preceded our selection of more and less effective facilitators. During this early analysis stage, 2 to 3 cooperative facilitators joined group analysis sessions. Together, we read field notes and interview transcripts to develop an understanding of facilitators’ work using an immersion crystallization approach.33 We developed an initial codebook that identified a range of strategies facilitators used. In teams of 2, we used this codebook to analyze incoming data, comparing each team’s findings, discussing differences, and refining the codebook, as needed.
The quantitative analyst (D.E-H.) identified 33 more effective and 30 less effective facilitators (28% and 26% of the sample, respectively). We had qualitative data for 23 more effective and 13 less effective facilitators.
Analysts (J.D.H., A.B., D.J.C.), who were blinded to the facilitators’ group assignment, reanalyzed the field notes and interviews from these 36 facilitators. For each facilitator, we identified the strategies we observed them using, as well as their professional characteristics. We unblinded the facilitator’s effectiveness group, clustered findings of more and less effective facilitators, and conducted within- and across-group comparisons. We performed confirming-disconfirming analyses34 to further refine our results, considering features of their cooperative infrastructure that might have shaped facilitators’ work.
We thought it was possible that facilitators working with practices with lower baseline ABS measures and CPCQ scores may have been placed in the more effective group because their practices had more room to improve and might do so faster. As a result, we created a composite ABS score, calculated as the mean ABS change from baseline to follow-up, and created plots showing the distribution of mean ABS change between more and less effective facilitators stratified by baseline CPCQ score and baseline ABS measure. We then conducted a simple linear regression analysis modeling the outcome change as a function of facilitator effectiveness (more vs less), baseline change capacity (CPCQ score above vs below median), and composite baseline performance (ABS measure above vs below median). Quantitative analyses were performed using R version 4.1.1 (the R Foundation).
RESULTS
Sample Characteristics
Table 2 enumerates the practice and facilitator cohorts for this study by cooperative. Cooperatives operated in different contexts, had varied geographies and prior experience with large-scale change initiatives and facilitation, and offered different levels of support to facilitators with some cooperatives standardizing facilitator skillsets. There was good cooperative representation in both facilitator groups, however, with all but 1 cooperative contributing at least 1 facilitator to each group.
Facilitator Effectiveness and Practice Improvement
Practices working with more effective facilitators had higher changes in the composite ABS performance outcome (Figure 2 and Table 3), regardless of whether their baseline change capacity was low or high (based on a CPCQ score of less than the median of 11 points vs 11 points or greater) and regardless of whether their baseline performance was low vs high (based on an ABS composite measure of less the median of 65% of patients meeting any of the 3 measures vs 65% or greater). In our regression model, when adjusting for baseline ABS measure and CPCQ score, practices working with a more effective facilitator had a 3.6% greater change in mean composite ABS performance (P <.001).
Facilitator Differentiators
Professional Background
Facilitator professional background and experience did not distinguish between more and less effective facilitators. Both groups had facilitators with prior relevant work experience, including clinical backgrounds or familiarity working in clinical settings, technical expertise, and previous facilitation experience.
Strategies Used
In contrast, several strategies for supporting practice change differentiated between more and less effective facilitators across the cooperatives. More effective facilitators helped cultivate motivation by tailoring QI work, addressing practice resistance, and guiding practices through the change process, regardless of practice focus (Table 4). These strategies were not mutually exclusive; in fact, more effective facilitators used these strategies in combination. Less effective facilitators rarely used these strategies or, if they did, used a single strategy exclusively.
More effective facilitators tailored QI work to practices’ experience, needs, and preferences, and directly addressed resistance when encountered. To learn about motivators, they asked open-ended questions about practice goals and challenges, or used motivational interviewing to identify and stimulate enthusiasm for practice change.
Facilitators who were more effective also approached practices individually based on their experience and interests, and fostered change by being flexible about what the practice worked on. We observed and heard more effective facilitators describe how EvidenceNOW aligned with other payer initiatives or unique practice goals:
Keeping an open mind is important. And not going in with your own agenda, but going in and helping them find what works for them… because you have to understand people dynamics while you’re doing this, and you’re helping them find what’s meaningful to them. – Facilitator Interview, Cooperative 6
Less effective facilitators described rigidity in their approach and were less adept at surfacing and leveraging motivation to customize possible practice changes.
Despite tailoring QI efforts, some practices remained resistant to change. When this situation arose, more effective facilitators addressed resistance directly. This trait was a notable differentiator, widely displayed among more effective facilitators and absent among less effective facilitators. The former identified specific barriers to the change (ie, limited staff capacity, the need for better data) and focused on minimizing them. We saw and heard less effective facilitators describe their role in more passive terms such as providing education without guiding practices to make a plan:
From my end, it was a lot of just education on what does the blood pressure metric mean, and then they came up with the plan of remeasuring anyone that was close. – Facilitator Interview, Cooperative 2
Less effective facilitators described not wanting to push the practice too hard or be in the practice’s way, citing resistance as an insurmountable roadblock.
We observed more effective facilitators guide practices through the change process by helping them think critically to identify solutions at pain points, and by providing structure and accountability to implement those solutions. They leveraged ideas from other practices (a process called cross-pollination) to stimulate thinking and provide options. By doing this, practices not only improved a specific clinical quality measure, but also built their capacity to address future changes. This strategy sometimes led to new workflows or expanded practice member roles:
You can’t walk in and take over and do things for practices, because they’ve got to be able to go forward long term. What if I’m not here forever? They’ve got to be able to understand what it is that they need to do, and it’s our role, in my opinion, to help guide them to get them there so that they can function on their own. – Facilitator Interview, Cooperative 1
We noted that less effective facilitators educated without helping practice members apply lessons and did work for the practice.
More effective facilitators also provided project management and organizational support to practices by creating an agenda and providing reminders. These facilitators discussed setting goals and tracking progress. During meetings, we observed them allocating concrete tasks to specified individuals (even for members not present) with target dates for completion, and providing accountability by routinely asking for updates:
They know next time they see me, I’m gonna ask about it. They often would beat me to the question. “This is what we did. What we’ve been working on. You’re gonna be so proud.” – Facilitator Interview, Cooperative 7
We saw less effective facilitators use meetings to present clinical guidelines or check-in. Some less effective facilitators did not hold meetings with individuals or groups, but instead, emphasized being available for assistance, limiting the structure or accountability provided.
A subset of both more and less effective facilitators focused on building electronic health record efficiencies and making documentation changes. This strategy improved specific measures (primarily aspirin use and smoking cessation counseling) by moving data to the appropriate electronic health record location. Although this strategy did not require clinical or process changes, it often led to an immediate improvement in outcome. Cleaning data and documentation changes were not distinguishing features between more and less effective facilitators; however, more effective facilitators who worked on documentation changes did so in conjunction with other strategies such as cultivating motivation and addressing resistance.
Articulation of Strategies
More effective facilitators could specifically describe how they helped their practice make improvements (Table 4). This description included describing their role, how they approached practices (and how they approached practices differently), and specific changes practices made that likely led to observed improvements. Less effective facilitators struggled to provide details about their work and the changes practices made. They spent more time describing materials without discussing how the practice used those resources or translated this information into action, even when probed.
DISCUSSION
Our findings show that practices that worked with a more effective facilitator had significantly larger improvements in cardiovascular disease preventive care than practices that worked with a less effective facilitator. Although backgrounds did not distinguish more and less effective facilitators, their strategies did. These strategies included cultivating motivation by tailoring work, directly addressing resistance, guiding practices through the change process by problem solving, and providing structure and accountability to help practices implement changes. This study’s findings echo some of the existing research describing facilitator work,1,3,5 and connect the strategies that we observed facilitators using to effectiveness.7,20
All but 1 cooperative contributed at least 2 facilitators to the more effective group. This finding suggests that the strategies we identified were generalizable and transcended differences among the EvidenceNOW cooperatives. There are, however, a few cooperative variations worth exploring. For example, Goldberg et al35 reported that an overly ambitious timeline negatively affected cooperative 5. This finding likely explains why this cooperative did not contribute facilitators to the more effective group: they did not have sufficient time to engage practices using the identified strategies. Similarly, our prior work shows facilitators benefit from training and ongoing support.16 Cooperatives that intentionally and consistently assess and address facilitators’ learning needs may produce facilitators who are more able to make practice changes, thereby minimizing the effect of facilitator background and experience.
Our results also have implications for facilitator trainings. The technical skills associated with facilitation (conducting record audits and PDSA cycles)1,5,9 were not sufficient for practice change. Facilitator training would benefit from a greater focus on complex skills, such as fostering motivation, addressing resistance, and creating dynamics in which practices can engage in self-assessment and think critically to address weaknesses. These skills, which are arguably more difficult to teach, may require ongoing support and hands-on training through activities such as shadowing and peer learning.16 One way of knowing whether facilitators are absorbing these skills is their ability to thoroughly describe their work. Although it was a somewhat unexpected finding that more effective facilitators were also better at describing their work, this ability may be important for those recruiting, hiring, and supporting facilitators, as well as for practices deciding whether to work with a particular facilitator.
There are several limitations to this study. First, although the criteria to be considered a more effective facilitator had multiple pathways, it is possible that some facilitators were effective at making changes outside the scope of the ABS and CPCQ measures. Second, individual practice characteristics such as size, ownership, disruptions, and internal motivation for change can influence the strategies a facilitator uses36 and a facilitator’s ability to make practice changes.37–39 Although practice characteristics vary in all studies, some facilitators reported having more challenging (eg, larger or less engaged) practices and believed that despite their best efforts, these issues were insurmountable. This perception may be true, but our study was not designed to examine it. We thus might have excluded some effective facilitators from our sample.
In conclusion, practices that worked with more effective facilitators made significantly larger improvements in cardiovascular disease preventive care than practices that worked with less effective facilitators. Facilitator experience and background and use of documentation changes did not distinguish more and less effective facilitators, but a range of strategies, including cultivating motivation, addressing resistance, helping practices to think critically, and providing accountability, did. Practices considering working with a facilitator and organizations that employ facilitators should seek out these qualities.
Acknowledgments
We are grateful to all of the EvidenceNOW Cooperatives and facilitators who made this work possible. In addition, the entire ESCALATES study team, especially William L. Miller, MD, MA, and Leif I. Solberg, MD, willingly contributed their thoughtful feedback.
Footnotes
Conflicts of interest: authors report none.
Funding support: This work was supported by the Agency for Healthcare Research and Quality (grant No. R01HS023940-01).
Disclaimer: The views expressed are solely those of the authors and do not necessarily represent official views of the authors’ affiliated institutions or funder.
Previous presentation: Facilitation Characteristics That Lead to Improvement in Practice Capacity and Clinical Quality. Presented at the 48th Annual North American Primary Care Research Group meeting; November 2020; virtual.
Trial registration: Registered as Observational Study at www.clinicaltrials.gov (NCT02560428).
- Received for publication June 2, 2021.
- Revision received March 16, 2022.
- Accepted for publication May 4, 2022.
- © 2022 Annals of Family Medicine, Inc.