INTRODUCTION

The context in which primary care is delivered is rarely evaluated as part of quality improvement initiatives or research studies. Often overlooked is the role of work conditions perceived by health care clinicians and the potential impact on clinicians and patients.1 A robust primary care workforce is needed in the wake of health care reform and the predicted marked increase in patients seeking primary care clinicians.2 Unfortunately, little attention has been paid to whether the US will be able to retain and recruit primary care clinicians impacted, in part, by the perception of work conditions expressed by current primary care practitioners.3

In the Physician Worklife Study (PWS) in 1996–2000, we demonstrated a high prevalence of stress and burnout, especially among women physicians and those who practiced primary care. We also showed that adverse work conditions were associated with an intention to leave the practice and perceptions of suboptimal patient care.1,4,5 The MEMO study (Minimizing Error, Maximizing Outcome) in 2001–2005 showed that work conditions in primary care were strongly associated with adverse physician outcomes, such as stress, burnout, dissatisfaction and intent to leave.6 MEMO also demonstrated that some patient outcomes were sensitive to primary care work conditions.6 Recent articles have called attention to the potential impact of physician burnout,710 and of the adverse consequences of electronic health records for busy clinicians.11,12 We devised the current study (Healthy Work Place study, or HWP) to test whether knowledge of clinician perceptions of the workplace would prompt conversations among clinic leaders, staff and clinicians, and lead to interventions to address work conditions and improve clinician outcomes. Future results from HWP will focus on whether patient outcomes were altered by these efforts.

We hypothesized that workplace changes, prompted by feedback on clinician perceptions and outcomes, would lead to a decrease in clinician stress and improved care for patients. This paper specifically addresses the following question: Does receipt of baseline data on work conditions and targeted clinical interventions improve satisfaction, stress, burnout and intent to leave the practice?

METHODS

Sample

We chose three study sites, two in the upper Midwest and one in New York City. The sites were selected to provide a mix of urban/rural/suburban and academic/non-academic locations. With site-specific Institutional Review Board (IRB) approval, we recruited 166 primary care clinicians (including general internists, family physicians, nurse practitioners and physician assistants) at 34 primary care clinics. Sample size calculations prior to initiating recruitment of clinicians determined that 34 clinics would provide sufficient power to address the study questions. Eligible clinicians included those who had been with the practice for at least 1 year at a minimum of 0.5 full time equivalent (FTE) weekly.

Study Design

We based our study upon the conceptual model highlighted in and refined after the MEMO project,6 with work conditions affecting clinician and patient outcomes (Fig. 1). We performed a cluster randomized control trial with the clinic as the unit of randomization, with 34 clinics randomized to an intervention versus a control arm. Randomization took place after clinics consented to participate. To maintain balance per site, a permuted block randomization scheme using 1:1 allocation to treatment/control was used, providing a balance of clinics per site. Site 1 recruited ten clinics, site 2 recruited 14 clinics and site 3 recruited ten clinics. Measures were performed at baseline in both intervention and control clinics (see below for measure description). An office and worklife (OWL) two-page measure of worklife and work conditions6 was created using 1) clinician perceptions of work conditions, 2) clinician outcomes (stress, burnout, and intent to leave the practice), and 3) patient quality of care data. These summaries were presented at intervention clinics to clinicians, staff and clinical leaders.

Figure 1.
figure 1

MEMO model of relationships between work conditions, clinician reactions and patient care. Adapted and used with permission from: Linzer M, Manwell LB, Williams ES, Bobula JA, Brown RL, Varkey AB, et al. Working conditions in primary care: physician reactions and care quality. Ann Intern Med. 2009;151:28–36.

Clinical and research staff met at each intervention site to discuss the data and a list of topics/interventions was generated and used to address adverse clinician work conditions. Research staff facilitated discussion among clinicians and provided guidance on the type or approach of intervention(s) chosen. OWL worklife and work condition data were the basis for the discussions and the selected interventions. While clinical teams worked off a relatively small menu of proven interventions (drawn from the literature, such as 13,14), intervention(s) chosen were customized at the individual clinic level and comprised a broad list of ways to address work conditions (Table 1). Twelve to eighteen months later, clinician and patient measures were repeated at all 34 clinics.

Table 1. List of Representative Interventions in Healthy Work Places Study by Category

Measures

Work conditions and clinician reactions were measured using survey tools adapted from MEMO6 and the PWS.4,5 Managers were questioned about clinic structure (rooms, staffing), policies, finances and procedures. Clinicians were questioned about stress,15 burnout (a five-item scale, focusing primarily on emotional exhaustion, with a score of 3 or higher indicating burnout,16,17 intent to leave in 2 years, and satisfaction.4 They also provided perceptions of work conditions, including time pressure during visits, work control, emphasis on work home balance, chaotic environments, and organizational culture, such as alignment of values with their leaders. Patient data (up to eight patients with diabetes or hypertension per enrolled clinician) were also included on the OWL worklife and work condition summary. Patients were asked about their satisfaction with care18 and chart audits determined care quality. All data were averaged per site, bundled into the two-page summary measures and distributed to intervention site clinicians, staff and leaders.

Interventions

Intervention sites chose a variety of methods to improve worklife and clinician outcomes (see Table 1). Details of selected interventions include 1) scheduling standing monthly provider meetings focused on either a) worklife issues and personal challenges, or b) difficult patient care management issues; 2) off-loading nonessential tasks to non-physician staff including hiring additional staff, having medical assistants (MAs) enter patient data into the EMR, altering workflow between MAs and appointment coordinators, and consistently pairing MAs and clinicians; 3) removing bottlenecks to care in patient rooms regarding medication reconciliation, vaccinations, and data entry; 4) reduced time pressure with plans for a future increase in primary care visit time from 15 to 20 minutes; 5) instituting a new prescription line to free up RN staff; 6) clerks instead of clinicians tracking forms and sending faxes; and 7) presenting OWL data as a platform to discuss issues within the department. After the study was completed, the initiatives were grouped into three categories: 1) improving communication especially among clinicians and staff; 2) changes in workflow; and 3) QI projects addressing clinician concerns. These categories were developed by convening a work group of healthcare professionals (two physicians, one nurse practitioner, one research assistant, and the project manager) who identified the theme of each intervention. These themes were eventually grouped into the three categories. “Improving communication” was a broad category that included provider–provider and provider–patient communication, obtaining better data and external marketing. Many clinics performed more than one type of intervention.

Analyses

Intra-class correlations (ICCs) were assessed for the four primary outcomes to determine dependency (impact of clustering). Two level regression analyses with clinicians nested within clinics assessed a post intervention group effect on group averages of clinician outcomes controlling for clinician age, gender, specialty and baseline clinician scores. A second two-level logistic regression analysis (person centered) then assessed any improvement change from baseline of intervention versus control clinicians, controlling for the covariates of age, gender, specialty, and years in practice. When a treatment effect was seen, an additional hierarchical logistic regression model was used to determine specific types of interventions associated with improvement. This analysis assessed different treatment configurations (e.g., improved communication versus workflow changes versus control), controlling for age, gender, specialty, and years in practice,. This analytic framework has been proposed by others19 to assess the impact of treatments on subjects (in this case, clinicians), rather than the impact of treatments on measures.

RESULTS

Within 34 clinics, 166 clinicians were recruited into the study. One hundred and thirty-five clinicians at 32 clinics completed the project (81.3 % of clinicians and 94.1 % of clinics). Table 2 describes clinicians in intervention versus control clinics by specialty, gender, age, percent physicians (versus nurse practitioners or physician assistants), discipline, and baseline and final outcome data, including stress, burnout, satisfaction and likelihood to leave the practice. A relatively small proportion (13.3 %) of the sample was comprised of non-physicians (nurse practitioners and physician assistants.) Burnout was present at a somewhat higher rate in intervention clinics, 41.4 % versus 30.1 % in controls (p = 0.12). While dependency was found to be minimal due to ICCs < 0.11, with design effects < 2, this was still controlled for within the hierarchical models.

Table 2. Characteristics of HWP Clinicians in Intervention Versus Control Sites

All intervention site leaders reported that presentation and assessment of baseline worklife and work condition data facilitated important conversations about the work environment. Table 2 shows that burnout decreased from 41.4 to 33.8 % (a relative decrease of 17.6 %) in intervention clinicians, while burnout increased from 30.1 to 32.8 % in control clinicians (an increase of 8.9 %). The initial multivariable modeling assessing the impact on clinician outcomes of OWL worklife and work condition data feedback and of the heterogeneous interventions at all intervention clinics combined did not disclose a group treatment effect. However, the person-centered improvement analysis showed significant treatment effects, with burnout decreasing more often in intervention clinicians (21.8 % fewer clinicians burned out vs 7.1 % fewer control clinicians, p = 0.01, see Fig. 2). There were no significant differences in improvements in stress and intention to leave between intervention and control clinics. Satisfaction improved more often after the interventions (23.1 % of clinicians were more satisfied in intervention clinics versus 10.0 % in controls, p = 0.04).

Figure 2.
figure 2

Percent of HWP clinicians showing improvement in burnout, stress, satisfaction and intention to leave in intervention versus control clinics. *p < 0.05.

Clinicians in clinics performing workflow interventions were significantly more likely to have decreased burnout than those in control sites (OR of improvement in burnout in intervention clinics 5.9, p = 0.02, see Tables 3 and 4). Clinicians in clinics performing targeted QI projects were also more likely to show decreases in burnout (OR of improvement 4.8; p = 0.02). Clinician satisfaction improved more often in clinics with interventions in communication or workflow than in controls (OR of improvement in satisfaction 3.1, p = 0.04). Communication or workflow interventions also led to borderline improvements in intention to leave (OR 4.2, p = 0.06): The models showed no appreciable change after incorporating a variable reflecting “professional status” (physician versus nurse practitioner or physician assistant).

Table 3. Multilevel Logistic Regression Analysis of Clinician Improvement by Specific Intervention Type: Control Clinics Versus 1) Communication Improvement and 2) Workflow Change Clinics
Table 4. Separate Multilevel Logistic Regression Analysis of Clinician Improvement by Specific Intervention Type: Control Clinics Versus 1) Targeted QI Clinics and 2) Communication or Workflow Change Clinics

DISCUSSION

In this cluster randomized controlled study of 166 clinicians in 34 clinics, we found that data on clinician work conditions facilitated discussions on the need to improve worklife for the benefit of patients and clinicians. Burnout was prevalent, and reported in approximately 37 % of primary care clinicians. A significant effect on clinician outcomes was seen when assessing specific intervention types on individual clinicians. In particular, all three of the following types of interventions led to improvements in some clinician outcomes: 1) workflow redesign, 2) improved communication, especially among clinicians and staff, and 3) QI projects directed at clinician concerns. These data suggest that targeting a range of interventions to clinician perceptions can lead to improvements in meaningful clinician outcomes including burnout, dissatisfaction, and perhaps, retention.

There is little debate that the future of affordable and high quality care in America depends upon a large and dedicated primary care workforce. Current studies show that primary care clinicians are dissatisfied, not recommending the field to students, and in danger of leaving the field themselves.3 The current study addresses mechanisms for improving primary care work conditions, and may be the first to date that does so in a multi-center, randomized study design. Many issues have previously been identified that affect primary care clinicians, among them the electronic health record,11,12 inefficiencies in office practice, lack of teamwork, time pressure during office visits,6 a lack of control in the workplace,6 and a lack of career fit for time to do what one is most passionate about.20 Clinics serving minority patients have especially challenging work conditions,21 and primary care may be hardest to support where it is needed most.

The current study adds to this discussion, and begins to fill in knowledge gaps. Despite many warnings about burnout in primary care, our data show that burnout prevalence is high, and indeed is higher than in our prior studies, where it averaged 25–30 %.6 Pressures for increasing patient volumes remain, and few administrators appear to have incorporated clinician wellness into institutional quality measures.22 If clinicians leave their practices, replacement costs may exceed $250,000.23 These are among the many reasons for focusing on stress and burnout in primary care.

We propose that stress and burnout be measured and addressed as organizational quality metrics22; annual brief surveys may suffice, with more frequent measures in challenged clinics or departments. The current study provides data that demonstrate the potential power of new types of interventions in the workplace. There is emerging literature about interventions that individuals can undertake to better combat the tendency to burn out.24,25 Our study complements this work by showing that organizational change may also lead to reduced stress and improved clinician outcomes. Our most powerful intervention was workflow modification, such as reassigning clinic staff work and changing call schedules. Our next strongest intervention, championed by Dunn et al.,13 was communication improvement, especially among staff and clinicians. (This involves, for example, conducting meetings focused on topics with meaning for clinicians, such as clinical cases and issues of clinic worklife.) Finally, we have demonstrated that there is potential value in targeting an organization’s QI projects to clinician concerns. A wide range of QI programs was used, including automated prescription phone lines and establishing mechanisms to improve quality metrics for routine screening.

The interventions in the HWP project moved the clinics in both important and replicable directions. Communication projects resulting in improved communication among clinicians and staff instilled a culture of enhanced communication in the primary care setting. Workflow changes promoted the primary care team as a critical unit in improving clinician work. Finally, QI projects addressed achieving quality metrics, medication reconciliation and improved screening processes, areas that tend to be taxing for primary care clinicians.

There are limitations to our study, including the absence of an overall group treatment effect with receipt of OWL worklife and work condition data followed by an undifferentiated series of QI projects. However, a significant effect was seen with the individually focused analysis, especially within each of the three types of interventions. We suspect that the absence of an effect in the initial analysis may be due, in part, to the multiplicity or diversity of interventions. Future studies on the impact of the three intervention types are thus encouraged to confirm our results. Other limitations include the uncertainty as to how well or reproducibly the interventions might have been instituted, and whether a longer duration of follow-up might have provided a better sense of the impact of these workplace changes. There are numerous strengths to our study, including the rigorous study design, the geographic and clinical diversity of the three sites, and the use of previously validated, robust measures of clinician outcomes.

In summary, our data suggest that high burnout among primary care clinicians may be addressed by programs that measure clinician and patient outcomes, provide meaningful feedback to clinics, and modify workplaces via improvements in workflow and communication, or by using QI projects targeted to clinician concerns.