Abstract
PURPOSE We wanted to describe small, independent primary care practices’ performance in meeting the Million Hearts ABCSs (aspirin use, blood pressure control, cholesterol management, and smoking screening and counseling), as well as on a composite measure that captured the extent to which multiple clinical targets are achieved for patients with a history of arteriosclerotic cardiovascular disease (ASCVD). We also explored relationships between practice characteristics and ABCS measures.
METHODS We conducted a cross-sectional, bivariate analysis using baseline data from 134 practices in New York City. ABCS data were extracted from practices’ electronic health records and aggregated to the site level. Practice characteristics were obtained from surveys of clinicians and staff at each practice.
RESULTS The proportion of at-risk patients meeting clinical goals for each of the ABCS measures was 73.0% for aspirin use, 69.6% for blood pressure, 66.7% for cholesterol management, and 74.2% screened for smoking and counseled. For patients with a history of ASCVD, only 49% were meeting all ABC (aspirin use, blood pressure control, cholesterol management) targets (ie, composite measure). Solo practices were more likely to meet clinical guidelines for aspirin (risk ratio [RR] =1.17, P =.007) and composite (RR=1.29, P = .011) than practices with multiple clinicians.
CONCLUSION Achieving targets for ABCS measures varied considerably across practices; however, small practices were meeting or exceeding Million Hearts goals (ie, 70% or greater). Practices were less likely to meet consistently clinical targets that apply to patients with a history of ASCVD risk factors. Greater emphasis is needed on providing support for small practices to address the complexity of managing patients with multiple risk factors for primary and secondary ASCVD.
INTRODUCTION
Cardiovascular disease remains the number 1 cause of death in the United States.1 One-half of the US adult population has 1 or more preventable risk factors for arteriosclerotic cardiovascular disease (ASCVD), but less than one-half are meeting all of their clinical goals.2 Increasing the adoption of effective clinical preventive services that reduce ASCVD mortality, including treating hypertension and hyperlipidemia, would result in large improvements in population health.3
HealthyHearts New York City, 1 of 7 research cooperatives funded through the EvidenceNOW initiative, is studying the effectiveness of external practice facilitation to increase capacity among small, independent primary care practices to implement innovations in health care aimed at increasing adoption of the Million Hearts ABCS (aspirin use, blood pressure control, cholesterol management, and smoking cessation) guidelines.1,4 These guidelines include aspirin when indicated, blood pressure control, cholesterol management through guideline-recommended use of lipid-lowering medications, and both screening for tobacco use and offering smokers cessation interventions or counseling.1
There is a strong rationale for evaluating the impact of external support for practice transformation in small practices. Despite declines in the number of small practices in the United States, and market forces driving consolidation, small practices continue to provide care for a major proportion of the population.5,6 A recent survey of more than 10,000 family physicians found more than one-half worked in solo or very small practices (fewer than 5 clinicians).7
Although an important source of primary care, these practice settings are underrepresented in the quality improvement and practice transformation literature. Moreover, most practice improvement studies focus on a single risk factor, yet about 25% of adults in the United States have 2 or more concurrent chronic conditions.8 Based on strong evidence, guidelines for secondary prevention of ASCVD recommend comprehensive risk factor management that includes medication for lowering lipid levels and antihypertensive and antiplatelet agents.9,10 We are not aware, however, of any studies examining how well small practices that serve diverse populations are achieving goals across multiple risk factors in patients with a history of ASCVD.
HealthyHearts New York City provides an opportunity to fill gaps in knowledge about the performance of small practices on key quality indicators and factors that may influence patient care and clinical outcomes. We describe the baseline performance of small practices in meeting ABCS targets and a composite measure which captured the extent to which clinical targets are achieved across the measures of ABC (aspirin use, blood pressure control, cholesterol management) for patients with a history of ASCVD. We also explore associations between practice characteristics and ABCS measures.
METHODS
Site Eligibility
Study sites were primary care practices with <10 FTE clinicians in New York City that were members of the New York City Department of Health and Mental Hygiene’s Primary Care Information Project (PCIP) practice network. PCIP is a bureau in the Division of Prevention and Primary Care and serves as New York City’s Regional Extension Center.11,12 Site eligibility is described in more detail in a previous publication.13
Study Design and Setting
HealthyHearts New York City is using a stepped-wedge, cluster randomized controlled trial design in which sites were randomized into 1 of 4 intervention waves to evaluate the effect of practice facilitation on ABCS measures in small independent practices in New York City. Details about the study design are also described in the previously published protocol article.13
Of the 437 practices screened for eligibility, 291 were recruited through the PCIP network and randomized into 1 of the 4 waves. Thirty-four withdrew after randomization, leaving a total of 257 active practices. Participation in the study was voluntary. For this study, we included the 134 practices that submitted baseline survey responses on or before the cutoff date (February 15, 2017).
Of note, we have ABCS baseline data on all 257 practices. To explore the potential for selection bias, we conducted t tests to compare the difference in the ABCS data among the 134 practices that completed a baseline questionnaire and the 123 practices without baseline survey data and found no significant differences.
Study Instruments
Baseline survey instruments included a practice questionnaire and a practice member questionnaire that were developed in collaboration with all 7 cooperatives and the external evaluation team.14 The practice questionnaire elicited information on practice characteristics (eg, size, ownership, staffing) and included the Change Process Capability Questionnaire (CPCQ).15–17 Either the lead clinician or office manager completed the practice questionnaire. The practice member questionnaire assessed organizational culture and additional measures of practice capacity (eg, adaptive reserve, burnout) and was completed at baseline by all clinicians and staff in all enrolled practices.18,19 Depending on their preferences, respondents completed mailed paper questionnaires or used REDCap, a Web-based format.
Measures and Data Sources
We analyzed baseline performance on the 4 individual ABCS measures and the composite measure. Data on practice and patient characteristics were obtained from the practice and practice member questionnaires, the PCIP practice database, and the Health Resources and Services Administration website. The survey items are in Supplemental Appendix 1, available at http://www.annfammed.org/content/16/Suppl_1/S21/suppl/DC1/.
Dependent Variable
ABCS measures were based on Million Hearts clinical quality measures and definitions that are approved by the National Quality Forum and were finalized through a collaborative process across the 7 cooperatives (Supplemental Appendix 2, available at http://www.annfammed.org/content/16/Suppl_1/S21/suppl/DC1/).20,21 The individual measures were defined as the proportion of at-risk patients who reached clinical goals for each of the 4 guidelines: aspirin use when indicated (A), blood pressure control (B), cholesterol management (C), and screened for tobacco use and offered cessation intervention if identified as a tobacco user (S). For example, the aspirin measure was defined as the proportion of patients aged 18 years and older with ASCVD who had documented use of aspirin or other antithrombotic. Baseline data included all patients that met criteria for at least 1 of the ABCS measures and had a visit during the 1-year period before the start of the intervention (January 1, 2015–December 31, 2015). A composite measure assessed the proportion of patients with a history of ASCVD who met treatment targets for 3 of the 4 Million Hearts outcomes (ABC). We were unable to include the smoking measure because of limitations associated with our measure reporting system.
The ABCS data were extracted through electronic queries executed directly against the practice electronic health records. A trend analysis during the 12-month baseline period indicated no significant changes in ABCS measures with time.
Independent Variables
For practice characteristics, survey data assessed number of clinicians (solo vs 2 or more), practice ownership (independent vs other), accountable care organization (ACO) status (part of ACO vs other), and full-time-equivalent of supporting staff (ie, medical assistant, registered nurse, office manager, etc). We used the PCIP practice database to obtain data on patient-centered medical home (PCMH) status and patient panel size, and the Health Resources and Services Administration website to obtain the practices’ medically underserved area designation.21
For patient characteristics, insurance status was obtained from the practice survey questionnaire and defined as the percentage of patients in a site that were covered by a Medicaid payer (including Medicaid-only payers and dual Medicaid and Medicare payers). We obtained data on patient race and ethnicity using the PCIP practice database.
Organizational capacity measures included adaptive reserve,18 a measure of practices’ ability to make and sustain change; the CPCQ,15 a measure of practices’ strategies for quality improvement; and burnout.19 All measures were assessed by the lead clinician. Both the CPCQ and adaptive reserve included 14 items. Questions were answered on a 5-point Likert scale ranging from “strongly disagree” to “strongly agree.” Consistent with the literature, we converted the score for each item to a 0–1 scale and then calculated the mean by summing all values for nonmissing items and dividing by the number of nonmissing items.18 A larger value indicated a higher level of adaptive reserve, and for the CPCQ, greater adoption of the range of quality improvement strategies assessed.
To assess burnout, clinicians checked 1 of 5 statements that best described their feelings about the situation at work (Supplemental Appendix 1). A dichotomous variable for the analysis compared not burned out (for those who chose “I enjoy my work,” or “I have no symptoms of burnout”), and burned out for those who checked 1 of the last 3 options (eg, “I am definitely burning out and have one or more symptoms of burnout, such as physical and emotional exhaustion”).
Statistical Analysis
All analysis was performed using the R program.22 Descriptive statistics summarized baseline practice characteristics, patient characteristics, and organizational capacity. β Regression23 with pairwise deletion of missing data was used to estimate bivariate associations between independent variables and ABCS measures. To address the number of bivariate analyses conducted and control the type I error rate, we adjusted P values using the Holm method.24 Values of ABCS that were exactly 0 or 1 were recoded using the formula suggested by Smithson and Verkuilen.25 In the precision portion of the β regression model, the log transformed number of patients considered for the ABCS measure was included as the sole explanatory variable. All significance tests were 2-tailed.
RESULTS
ABCS Individual and ABC Composite Measures
Figure 1 shows the ABCS and ABC composite measures across the 134 practices. On average, 73.0% (SD = 17.3%) of eligible patients were receiving aspirin, 69.6% (SD = 12.9%) achieved recommended blood pressure control, 66.7% (SD = 13.8%) met the target for cholesterol medication management, and 74.2% (SD = 18.8%) of patients with a visit during the baseline period were screened for tobacco use and, if identified as a smoker, offered a cessation intervention or counseling. Among those patients with a history of ASCVD, however, only 49% (SD = 17.8%) met all the ABC recommended treatment targets (ie, the composite measure).
Practice Characteristics
Table 1 shows the characteristics of the 134 practices. Most (73.2%) practices were solo-clinician practices, 91.7% were independently owned by clinicians, and 11.4% of lead clinicians reported experiencing symptoms of burnout. On average, practices reported that less than 20% of patients were non-Hispanic white, and 43.3% were covered by Medicaid.
Association Between Characteristics of Small Practices and ABCS Measures
Table 2 shows the bivariate analyses of the associations between the independent variables and the ABCS measures. Solo-clinician practices were more likely than practices with more than 1 clinician to meet the clinical guidelines for aspirin treatment (risk ratio [RR] = 1.17, 95% CI, 1.08–1.25, P = .007) and the ABC composite measure (RR = 1.29, 95% CI, 1.12–1.47, P= .011). Because few bivariate associations were significant, we did not undertake multivariate analyses.
DISCUSSION
Small practices in New York City, on average, were meeting or were very close to meeting Million Hearts individual clinical goals for the ABCSs (ie, 70% or greater) before initiation of the practice facilitation intervention. Comparison with 2014 national and New York State data further suggest that these small practices are comparable in performance to the full spectrum of primary care practices.20
Despite this overall good news, it is noteworthy that considerable variability exists among practices in the ABCS measures, meaning that many small practices fall below target levels on each of the measures. For example, only 41% of practices met the 70% target for the cholesterol measure. Further, the average rate of compliance with the composite measure was only 49%, indicating there is ample room for improvement in managing multiple risk factors for patients with a history of ASCVD. Other studies have found comparably low rates of simultaneous control among patients with concurrent risk factors for cardiovascular disease.26 Managing multiple risk factors is a complex process, and literature on effective interventions to address this quality gap is scarce. Because research indicates that reductions in both primary and secondary ASCVD-related deaths are highly correlated with the number of risk factors controlled, developing strategies to support small practices to improve multiple risk factors simultaneously should be a high priority.10,27 HealthyHearts New York City’s focus on improving outcomes across all of the ABCS measures offers an opportunity to explore the impact of external facilitation on helping small practices achieve clinical targets for these high-risk patients.13
We found no consistent pattern of relationships among most of the practice, patient, and organizational characteristics and the ABCS measures, despite substantial variability in these measures. The only practice characteristic associated with ABCS measures was number of clinicians; solo practitioners outperformed practices with multiple clinicians. Recent studies and commentaries suggest that small practices struggle more than larger practices to provide optimal care.28–30 The results from this baseline assessment, however, belie that perception and suggest that with the type of ongoing support provided by PCIP and participation in similar programs that offer shared resources, such as ACOs and independent practice associations, very small and solo practices can meet targets for quality metrics.31–33
The lack of association between PCMH recognition and ABCS measures may reflect the use of a crude measure of PCMH status that does not capture the extent to which the multiple components of PCMH are implemented.34 Similarly, measures of organizational capacity (ie, adaptive reserve and the CPCQ) were not associated with baseline ABCS measures. There is some evidence that adopting a larger number of PCMH components is associated with improvement in quality of care scores for chronic disease management.35,36 We are not aware of any literature to date, however, that has reported an association between change capacity and ABCS outcomes. Further study is needed to identify practice characteristics that are associated with improvements in care processes and patient outcomes. Additional research is also needed to better elucidate the value of offering practice facilitation and other types of support build small practice capacity to implement evidence-based changes in health care delivery.37
The overall lack of consistent associations between baseline characteristics of the study sites and ABCS measures may suggest that very small practices require the application of different organizational frameworks or lenses to identify and understand what factors are associated with practice improvement. We might need to look to the broader literature on small businesses and the differences between small and large businesses in terms of decision-making power, communication, and the use of more informal approaches to practice change.38,39 In solo clinician sites, ABCS performance essentially reflects the performance of the individual clinician and may be better studied by measuring individual-level constructs that were not included in our questionnaires, such as clinician motivation, beliefs, skills, and social support and influences commonly found to be associated with clinician behavior.40 Small practices continue to provide health care for a large proportion of Americans. This important role warrants further investments in research to identify care structures and processes in these settings that are associated with better care and better clinical outcomes.
Limitations
Our main limitation for this study is that the practices included in this study were not randomly selected; however, the large sample includes practices from all 5 city boroughs (aka counties) with similarly diverse patient populations. Additional imitations include the need to exclude 123 practices from the analysis because we did not receive their baseline survey data by the cutoff date for the study. As noted, further analysis found no significant difference in baseline ABCS measures between the 134 included practices and the 123 excluded practices. Finally, the β regression model tested 60 hypotheses, and we found 2 significant results (Table 2).
Conventional wisdom gleaned from the study of large practices, which constitutes the vast bulk of the literature on primary care practice, may provide only limited value in developing, implementing, and evaluating interventions that will meaningfully improve the care provided in small practices. HealthyHearts New York City will provide much needed insight into the types of support small, independent practices need to achieve optimal patient health outcomes.
Footnotes
Conflicts of interest: authors report none.
Funding support: This project was supported by the Agency for Healthcare Research and Quality (AHRQ) through contract No. HHSA29020120009I, and grant No. R18 HS023922.
Disclaimer: This work represents the opinions of the authors and should not be interpreted as official positions of the Agency for Healthcare Research and Quality or the US Department of Health and Human Services.
Previous presentation: This study was presented in part at the New York State Population Health Summit; December 12, 2016; New York, New York.
Supplementary materials: Available at http://www.AnnFamMed.org/content/16/Suppl_1/S21/suppl/DC1/.
- Received for publication June 13, 2017.
- Revision received October 6, 2017.
- Accepted for publication October 11, 2017.
- © 2018 Annals of Family Medicine, Inc.