INTRODUCTION

Burnout is a prevalent occupational condition characterized by employee feelings of emotional exhaustion, lack of personal connection to colleagues and patients, and doubting their professional abilities or impact.1 Over half of US physicians2 and nearly half of nurses working in primary care3 , 4 screen positive for burnout on surveys. National surveys of US physicians and Veterans Health Administration (VA) primary care employees report that burnout has increased significantly in recent years.2 , 5

Clinician burnout has many negative consequences. Patients cared for by providers suffering from burnout report lower satisfaction6 , 7 and receive lower-quality care.8 10 Providers with burnout report higher levels of absenteeism and more frequent intention to leave their jobs.11 13 Ultimately, they are more likely to reduce work hours14 and leave medical practice entirely.12 , 15 , 16 This has led some to call for the Triple Aim advanced by the Institute for Healthcare Improvement to be amended to include a fourth aim of improving clinician work life in addition to the original three goals of improving patient experience, expanding population health, and reducing costs.17

A number of workplace conditions appear to contribute to burnout. Workload issues such as working overtime18 , 19 and excess patient volume20 22 are associated with burnout in primary care, as are turnover among primary care support staff20 and insufficient staff to manage patient volume.23 26

The patient-centered medical home (PCMH) has been suggested as a model to simultaneously improve quality of care and reduce burnout among primary care employees in part through team-based approaches to patient care.27 Modern primary care is complex, involving the provision and coordination of care for patients who often have several chronic medical and psychiatric conditions and who require a variety of services from multiple providers. Team-based care should distribute clinical duties among team members in a way that optimally matches team members’ responsibilities and competencies.

In 2010, the US Department of Veterans Affairs undertook the largest implementation of the PCMH to date, involving over 900 primary care clinics.28 A key feature of the VA’s implementation of this model was the creation of Patient Aligned Care Teams (PACT) consisting of one primary care provider, one nurse (RN) care manager, one clinical associate (LPN), and one clerical assistant. Given the scale of program, however, it proved difficult to achieve full staffing at all sites. Moreover, demand for care varied among sites resulting in variable workload.

In prior evaluations of the PACT initiative, no associations were found between burnout among primary care personnel and clinical workload in terms of primary care team panel size or the complexity of patients on the panel.29 , 30 However, these evaluations adjusted for panel size and complexity only at the clinic level, a method that may mask important variation in workload experienced at the team level. While the perception of inadequate staffing was associated with burnout,29 , 31 the importance of team-specific employee turnover was not evaluated. Finally, while prior research has demonstrated that workload and staffing are associated with burnout in primary care, little is known about the individual or combined effects of excess workload and inadequate staffing. We sought to assess the association between burnout among primary care employees and team-specific staffing and workload, as well as staffing and workload among each of the four occupations that constitute the core VA medical home team.

METHODS

Setting and Design

We conducted an individual-level cross-sectional analysis of national VA primary care personnel survey data collected from members of patient aligned care teams, and administrative data on primary care team workload. The survey was fielded online in August and September 2014. The survey link was disseminated via an email from VA central office leadership to network and facility leaders, with instructions to distribute to primary care personnel.

Measures and Sample

We included respondents from four occupations that make up the core VA primary care team: primary care providers (PCPs, which included physicians, nurse practitioners, and physician assistants), nurse care managers, clinical associates (mainly licensed practical nurses), and administrative clerks.

Workplace burnout was measured with a validated single-item measure used in the Physician Worklife Study that asks respondents to rate their level of burnout using a five-point ordinal scale (Table 1). We dichotomized burnout as ≥3 (burnout) versus <3 (not burned out) according to previously established cutoffs.32

Table 1 Descriptive Statistics

We analyzed nine independent variables: three related to team staffing and six related to clinical workload. We anticipated that belonging to a single, stable, fully staffed team would, on average, improve the working environment, and reduce burnout. Team staffing variables included three survey items: Are you currently on more than one team?; Is your team currently staffed at the recommended 3:1 ratio? (3 full-time staff for 1 full-time PCP); and Has your team had any changes in, or loss of, staff in the past 12 months?

We anticipated that high workload, represented by panel overcapacity, patient appointments outside regular hours, and a panel of patients with high comorbidities, would contribute to a more stressful work environment and higher burnout. Workload variables included four survey items and two variables from administrative data. The three survey items were questions asked only of respondents who replied yes to the question Does your PACT team have provider appointments available outside the traditional business hours of M–F, 0800–1700 (8 am–5 pm)? We refer to this as extended hours. This subgroup was asked: How often does your team work extended hours during the week? (4 categories dichotomized to Yes/No); How often does your team work extended hours on the weekends? (4 categories dichotomized to Yes/No); and Does your team work extended hours together as a team (at least 80% of the time)? (Yes/No).

The administrative variables were two team-level clinic workload measures that we linked to individual respondents. The first was the size of the patient panel for the respondent’s team, dichotomized as within or over capacity. We defined panel capacity based on a national VA recommendation of 1200 patients per panel, adjusted for the number of half-days per week providers spend providing primary care and for provider type, with nurse practitioners and physician assistants having lower panel targets of 900 patients.28 Second, we calculated panel comorbidity, using the average Gagne comorbidity score, a validated, single-number comorbidity score that combines the conditions in the Charlson and Elixhauser measures to predict short- and long-term mortality.33

We excluded respondents who did not know whether their team was currently staffed at the recommended 3:1 ratio (n = 385), or who could not be linked to a team in the administrative files and therefore for whom no data on panel size or patient comorbidity were available (n = 239).

Other covariates included duration of VHA tenure (8 categories), total years/time working in the PACT model (4 categories), and clinic location (community-based outpatient clinic [CBOC] or VA medical center [VAMC]).

Analyses

Odds ratios (ORs) were estimated using mixed-effects logistic regression models on respondents having observed data for all covariates of interest. All models were adjusted for the following: team staffing (team staffed to the 3:1 ratio, working on multiple tams, turnover on the team) and clinic workload variables (panel overcapacity, average panel comorbidity, working extended hours), respondent occupation, duration of VA tenure, VA medical center (vs. CBOC) indicator, and two random intercepts for team and clinic, since respondents were nested within teams, which were further nested within clinics. Models that further estimated ORs by occupation (and other variables) included additional two- and three-way interaction terms between occupation and each of the variables of interest. As a sensitivity analysis, we re-estimated ORs using weighted propensity score methods to adjust for the potential selection bias often associated with low survey response. The propensity to respond was estimated for each responder and non-responder using available administrative data (occupation, VA tenure, and clinic location); these propensities were used to form adjustment cells, and respondents were weighted by the inverse of the observed response rate in that cell, referred to as “response propensity stratification”34 (see Appendix A, available online).

RESULTS

A total of 4610 respondents were included in the sample (20.9% response rate). Of the 8114 teams in the administrative files at the time, 3020 (37.2%) had at least one survey respondent and 1113 (13.7%) had multiple respondents, and 702 of the 935 primary care clinics (75.1%) had at least one respondent and 576 (61.6%) had multiple respondents.

Overall, 40.8% of respondents screened positive for burnout, ranging from 32.0% of clinical associates to 49.2% of PCPs (Table 1). For staffing, 64.8% of respondents reported working on a team staffed to the recommended ratio, and 61.2% reported a change in one or more team members in the past 12 months. For workload, 31.6% of panels exceeded capacity when adjusted for panel size and part time versus full time; 37.3% worked extended hours during the week or weekend. Of those working extended hours, 57.4% reported working at least 80% of extended hours with members of their own team versus other teams.

In unadjusted analyses, the largest burnout differences were between respondents on fully staffed versus not fully staffed teams (35.2% vs. 52.3%, respectively), respondents with turnover versus no turnover on the teamlet (45.7% vs. 33.2%, respectively), and respondents with panel overcapacity versus no overcapacity (43.9% vs. 39.9%) (Table 2). Although overall burnout prevalence differed by occupation and was highest among PCPs, differences in burnout by team staffing, turnover, and panel overcapacity status were similar for all four occupations (Table 2).

Table 2 Burnout Percentage by Provider Occupation, Team Staffing, and Clinic Workload

Respondents who reported working on teams that had appointments outside traditional business hours (i.e. “extended hours”) had burnout prevalence of 44.0%, versus 38.9% for respondents not working extended hours. Among team members working extended hours, those working extended hours during the week had burnout prevalence of 43.2%, versus 50.8% for those who did not. Conversely, burnout prevalence was 45.6% for those working extended hours during the weekend, versus 37.5% for those not working extended hours during the weekend. Team members who worked extended hours with their teamlets had burnout prevalence of 40.6%, versus 48.5% for those who did not work extended hours with their teamlet (Table 2).

In adjusted models, working on a fully staffed team (OR = 0.55, 95% CI 0.47–0.65), turnover on the team (OR = 1.67, 95% CI 1.43–1.94), and having panel overcapacity (OR = 1.19, 95% CI 1.01–1.40) were all significantly associated with odds of burnout (Table 3). Working on multiple teams, average panel comorbidity, and working extended hours were not associated with burnout. When testing the interactions between these variables and occupation, we found that these associations did not differ by occupation (results not displayed).

Table 3 Adjusted Odds of Burnout (n = 3986)

The associations between burnout, team staffing, team turnover, and panel capacity appear to be additive (Fig. 1). For example, observed burnout for respondents on a team that had no turnover, was fully staffed, and had a panel within capacity was 28.5%, whereas that for respondents on a team not fully staffed, that had experienced turnover in the prior year, and that had panel overcapacity was 58.6%.

Figure 1
figure 1

Observed burnout percentages by combinations of team staffing, team turnover, and panel overcapacity.

Propensity score methods, described in Appendix A (available online), produced ORs for fully staffed, turnover, and overcapacity that remained significant and in the same direction as our original analysis. The propensity-weighted ORs for turnover and overcapacity were larger, and the OR for fully staffed smaller, than our original non-weighted results. The OR for being a member of multiple teams was statistically significant in the predicted direction in the propensity-weighted model only.

DISCUSSION

In this study of VA primary care employees working in PCMH teams, burnout was associated with several workload and staffing characteristics. Inadequate staffing, team member turnover, and patient panel overcapacity were all associated with burnout among all occupations within the team. The associations with burnout were statistically significant, large, and additive. Observed burnout for employees on a fully staffed team with no turnover and a panel within capacity was an absolute 30.1% lower than that for employees on understaffed teams, with turnover, and with patient panel overcapacity.

An important finding from this paper is that, while the overall prevalence of burnout was lower for nurse care managers, clinical associates, and administrative clerks relative to PCPs, the associations with workload and staffing variables did not differ significantly by occupation. Prior literature has rarely included team members such as clinical associates or clerks.

Among those with patient appointments outside traditional business hours, working extended hours on the weekend, but not during the week, was associated with higher burnout, something for clinics to consider when assessing options to provide more convenient hours of operation for patients. Working extended hours with one’s team was associated with lower odds of burnout, which is consistent with the supposition that team-based primary care is a more supportive work environment and may reduce burnout. Alternatively, clinics able to schedule teams to work extended hours together may be different in other ways not captured in the model, such as how well the clinic is managed and overall staffing availability (as opposed to team-specific staffing). Those factors may be associated with lower burnout and may be unobserved confounders. In addition, there are ways that PCPs and staff work outside regular business hours, such as charting and responding to patient messages, that we do not capture with this item. These may be important correlates of burnout as well.

We found no association between burnout and working on multiple teams, working extended hours during the week, clinic location (hospital- vs. community-based), or patient panel complexity.

These findings make several contributions to the current literature on burnout and team-based primary care. We linked individual survey data on burnout to team-level administrative data on panel size and average patient complexity, whereas previous studies in primary care settings have relied on self-reported workload,20 , 22 , 35 which introduces the risk of method bias.36 Examining clinic-level rather than team-level patient complexity and panel size may mask important variations among teams, and may explain why a previous analysis observed no association between clinics with average panel size overcapacity and burnout among their employees.29

Our findings highlight the potential importance of stable team membership and adequate staffing. A recent study of 29 high-performing primary care practices using team-based care models identified stable team structure and adequate staffing ratios as among the nine key success factors.37 Finally, while most of the literature on burnout in primary care has focused on physicians and RNs,18 22 , 35 our findings also include other members of the primary care team including LPNs, medical technicians, and administrative clerks, and we found similar patterns of associations among these members of the primary care team.

Limitations

The most important limitation of this study is potential response bias, with an estimated response rate of 21% for primary care personnel. When we compared respondents to non-respondents using administrative data, we found that non-response was associated with occupation, VA tenure, and clinic location, with lower response rates for administrative clerks, those with longer VA tenure, and those at VA medical center-based clinics (as opposed to community-based clinics). Consequently, we adjusted for these three variables in all complete-case regression models, since regression coefficients are not subject to response bias if the probability of non-response depends only on observed variables accounted for in the regression.38 As an additional sensitivity analysis, we used propensity score models to examine the effect of non-response on our initial findings, and found that model coefficients remained significant and in the same direction, but with more extreme ORs. While we cannot rule out the possibility that unobserved differences between respondents and non-respondents affected the results, the propensity score results suggest that our initial findings may be conservative.

These findings do not demonstrate causality. These were cross-sectional analyses, focused on a relatively small set of workplace variables and testing a relatively limited set of associations. Burnout is highly complex and is likely a function of interactions among a range of variables, including relationships with patients, clinician social support, and innate resilience. These findings are influenced both by unobserved confounders, such as the quality of the clinic leadership, and imperfect measurement, such as an inability to distinguish between turnover when a poor performer leaves and that from failure to retain a needed team member.

VA primary care settings differ from other primary care settings in ways that may limit the generalizability of the findings, such as lower average panel sizes, higher patient comorbidities, longer visit times, and a salaried structure with a quality metric-based performance system.39

Finally, there are concerns about endogeneity. Burnout is a known precursor to turnover, and the conditions that lead to burnout likely affect the primary care team broadly. Therefore, turnover on the teamlet might be as much a consequence of burnout as a cause.

CONCLUSIONS

We found large differences in burnout associated with team staffing, team member turnover, and patient panel capacity. Previous studies have found higher burnout associated with working overtime18 , 19 and having insufficient clinical staff to manage workloads,23 26 and lower burnout associated with working in a team structure with a strong team culture40 and the quality of physician–nurse relationships.24 Our findings make an important contribution by testing these associations at the team level and for all team members. Whereas most prior research is based on self-reported workload, we linked burnout to independent measures of team-level workload from administrative data. We also assessed burnout among all members of the medical home team, including clinical associates, and administrative clerks, whereas with few exceptions,40 prior research has focused exclusively on physicians and RNs. Overall, our findings confirm the importance of team stability and the completeness of team staffing as critical factors in predicting burnout levels among primary care physicians, nurses, and administrative staff. Future research is needed to determine whether burnout declines as staffing and workload improve.