Abstract
PURPOSE The aim of this study was to assess whether the quality of diabetes care differs among practices employing nurse-practitioners (NPs), physician’s assistants (PAs), or neither, and which practice attributes contribute to any differences in care.
METHODS This cross-sectional study of 46 family medicine practices from New Jersey and Pennsylvania measured adherence to American Diabetes Association diabetes guidelines via chart audits of 846 patients with diabetes. Practice characteristics were identified by staff surveys. Hierarchical models determined differences between practices with and without NPs or PAs.
RESULTS Compared with practices employing PAs, practices employing NPs were more likely to measure hemoglobin A1c levels (66% vs 33%), lipid levels (80% vs 58%), and urinary microalbumin levels (32% vs 6%); to have treated for high lipid levels (77% vs 56%); and to have patients attain lipid targets (54% vs 37%) (P ≤ .005 for each). Practices with NPs were more likely than physician-only practices to assess hemoglobin A1c levels (66% vs 49%) and lipid levels (80% vs 68%) (P≤.007 for each). These effects could not be attributed to use of diabetes registries, health risk assessments, nurses for counseling, or patient reminder systems. Practices with either PAs or NPs were perceived as busier (P=.03) and had larger total staff (P <.001) than physician-only practices.
CONCLUSIONS Family practices employing NPs performed better than those with physicians only and those employing PAs, especially with regard to diabetes process measures. The reasons for these differences are not clear.
- Family medicine
- nurse practitioners
- physician assistants
- diabetes mellitus
- quality of health care
- practices
- professional practice
- office visits
- long-term care
- disease management
- patient care management
INTRODUCTION
Increasingly, nurse-practitioners (NPs) and physician’s assistants (PAs) serve as a primary point of contact for patients within primary care practices.1,2 Bolstering this trend is the development of new models of primary care practice advocating collaborative teams of diverse clinicians.3–5 Yet, among family physicians, some uncertainty and unease persists about the use of these clinicians,6–8 particularly with regard to quality of care,9,10 patient satisfaction,11,12 and financial efficiency.13,14
Most randomized clinical trials and observational studies have focused on comparing the quality of care between physicians and NPs, with relatively little published research comparing PAs with either physicians or NPs.9,15–18 For example, in a study comparing NP and physician performance in the care and attainment of outcomes for patients with diabetes, Lenz et al19 found significant differences in documentation but not in patient outcomes. Some have argued that NPs may enhance primary care because they are trained specifically for health promotion and education.2,20,21 In fact, Hopkins et al22 found that compared with physicians, NPs performed better at secondary prevention, assessment, and counseling. In addition, Kinnersely et al15 and Sakr et al16 found that patients cared for by NPs received more information about their care and were less likely to return for follow-up advice. Regarding self-reported patient satisfaction, studies have found no significant differences whether care was provided by NPs (or PAs) or physicians.11,12 The literature thus suggests some benefits of care provided by NPs, potentially making these clinicians more than just adequate substitutes during physician shortages. Since NP and PA salaries are generally less than those of physicians, this literature suggests that practices using NPs or PAs could potentially provide quality care at lower cost to the practice13,23; however, differences in productivity and patient mix and needs for supervision and backup may negate this benefit. A recent Cochrane review reported that most studies have not found significant cost differences.24
These studies have compared care provided by individual clinicians (physician, PA, or NP) by directly linking individual patients with the type of clinician15–17,23 or by comparing care provided by practices solely staffed by either physicians or NPs.9 Evidence suggests, however, that care quality needs to be viewed from a systems perspective and according to the interrelationships among individuals, not simply from the perspective of specific individuals.25–27 Whereas evidence thus exists that NPs and PAs are capable of providing quality care, this capability does not necessarily imply they are used effectively when added to the typical primary care practice. Rather than focusing on individual skill sets, this study therefore examined the effectiveness of practices employing different midlevel clinicians to better understand at a practice level the effect of NPs and PAs on quality of care; furthermore, because of the complexity of managing patients with diabetes in primary care practices,28–30 this study focused on care for these patients. Specifically, the study’s objectives were to evaluate (1) whether the quality of care provided to patients with diabetes differs between practices with and without PAs or NPs and (2) whether the organizational characteristics of practices with PAs or NPs differ from those without such clinicians.
METHODS
Study Design
This study was a secondary, cross-sectional analysis of the baseline data from a quality improvement trial in family medicine practices. After the study was approved by the institutional review board of the University of Medicine and Dentistry of New Jersey, baseline data were collected from 46 New Jersey and Pennsylvania nonresidency family medicine practices participating in ULTRA (Using Learning Teams for Reflective Adaptation), a group randomized intervention study31 aimed at testing a method for improving practice adherence to guidelines for multiple conditions. These independent, small group or solo, single-specialty family medicine practices included 28 practices with neither a PA nor an NP on staff (physician-only practices), 9 practices with 1 or more PAs, and 9 practices with 1 or 2 NPs. Two practices with both PAs and NPs were excluded.
Nurse chart auditors retrospectively assessed each practice’s adherence to diabetes guidelines in 20 patients randomly selected from all adults treated for type 1 or type 2 diabetes in the past year, based on International Classification of Diseases, Ninth Revision (ICD-9) codes 250.xx. In 6 practices with fewer than 20 patients coded for diabetes, all of these charts were audited. In total, 846 patients’ charts were audited.
Basic information concerning each practice was collected from the practice manager or lead physician using a standardized Practice Information Form (PIF), described below. In addition, all practice staff were given a questionnaire that included the Survey of Organizational Attributes for Primary Care (SOAPC)32 and the Competing Values Framework (CVF),33,34 also described below. Questionnaires were collected by the practice manager and returned to a member of the research team.
Measures
We used the audits of medical records to assess adherence to guidelines for diabetes care, adapted from the clinical practice guidelines of the American Diabetes Association (ADA),35 in the areas of assessment, treatment, and achievement of clinical targets. These measures, which are mostly process measures, are presented in Table 1⇓. Practice adherence to the assessment component of the guidelines was studied in all patients, whereas practice adherence to the treatment and target components of the guidelines was studied using 2 populations: (1) all patients with diabetes and (2) only patients with diabetes who were appropriately assessed. In both populations, credit for adhering to treatment guidelines was given if the patient was appropriately treated or if evidence of achieving targets existed (as determined by assessments within the recommended time frame). In the latter case, we assumed there may have been alternative treatment strategies that aided the patient in achieving targets. In both populations, credit for adhering to target guidelines was given only if evidence existed that the patient had achieved the targets. Analyses of practice adherence included several patient-level and practice-level covariates, described below.
The practice manager or lead physician from each practice completed a PIF, which provided the following information: a list of staff members and their roles; whether the practice was a solo or group practice; whether the practice had a diabetes registry; whether the practice used patient reminder systems; and whether nurses or health educators were used for counseling for diabetes, physical activity, nutrition, or tobacco.
Staff members completed a 20-minute, self-administered questionnaire that included the SOAPC32 and the CVF.33,34 Of 732 staff members, 452 (62%) returned the questionnaire, with 95% of those completing the SOAPC and 98% completing the CVF. The SOAPC assessed levels of busyness, practicewide participation in decision making, nurses’ participation in decision making, communication, and history of change. Each item (Table 2⇓) was rated on a scale of 1 (strongly disagree) to 5 (strongly agree). To obtain staff scores, we averaged the responses for each domain, reverse-scoring items that were negatively worded. To obtain scores for the practice overall, we averaged the staff scores. The CVF allowed for description of each practice as more or less group oriented, developmental, hierarchical, or market driven, allowing us to study whether practices with NPs or PAs were more or less market driven than other practices. We used the 6 CVF items that pertain to market orientation (Table 2⇓). We applied the scoring method outlined by Quinn33 to obtain staff and practice-averaged ratings of a practice’s market orientation and then dichotomized the practice score (market driven vs not market driven) relative to the sample median.
Statistical Analyses
We used univariate analyses, including exact χ2 tests for categorical descriptors and analysis of variance for continuous descriptors, to compare the characteristics of the 3 types of practices.
We used hierarchical logistic regression analysis to model associations between the presence of PAs or NPs in practices and patient-level measures of diabetes assessment, treatment, and target attainment, accounting for clustering of patients within practice while controlling for both practice-level covariates (solo practice or not, diabetes registry, nurse or health educator for diabetes counseling, reminder system, total staff size) and patient-level covariates (age, sex, comorbid conditions, number of visits in last 2 years). Specifically, generalized estimating equations using a working correlation matrix with exchangeable structure modeled the log-odds of adherence as a function of practice- and patient-level covariates, using the GENMOD procedure within the SAS/STAT software (SAS system for Windows, version 9.1.3; SAS Institute Inc, Cary, North Carolina).36 We used contrasts to examine differences between practice types and to calculate adjusted rates of adherence. The false-discovery rate was controlled at .05 via the Hochberg procedure for multiple testing37 within each domain (assessment, treatment, and targets).
Additional analyses compared organizational attributes (as measured by the SOAPC) of practices with and without PAs or NPs at both the practice level and staff level. For the former, analysis of covariance compared the average practice scores. For the latter, hierarchical models, with staff member as the unit of observation, were used to test differences in how staff members perceived the practice in which they worked as a function of practice type (physician-only, PA, NP), controlling for practice size and staff member covariates including role (office manager, physician, PA, NP, clinical staff, or office staff) and sex. We used similar analyses, applying a logit link for binary responses, to evaluate whether practice type could predict whether the practice was more or less market driven (as determined from the CVF). Imputation methods were used to adjust for survey nonresponse. Specifically, we used sequential multivariate regression models (logistic, Poisson, or categorical, depending on the dependent variable type) to multiply impute the missing data38 using IVEware (University of Michigan Survey Research Center, Ann Arbor, Michigan), an SAS callable software application.39 Standard errors for means or comparisons of means were corrected using standard multiple imputation adjustments.
RESULTS
Practice Characteristics
Thirteen of 17 PAs and all of the 9 NPs were women. PAs had worked at their current practice for shorter times relative to NPs, although this difference was not statistically significant (P = .11 based on analysis of variance using listwise deletion).
Table 3⇓ summarizes practice characteristics for the 3 practice types. Practices with PAs were more likely to have a larger total staff (P <.001). Eight practices had only 1 NP and 1 had 2 NPs; however, 4 practices had 1 PA whereas 5 had between 2 and 4. The number of NPs or PAs per physician did not differ significantly among practices. On the basis of the information available from the staff questionnaires (from 20 physician-only practices, 6 practices with PAs, and 6 practices with NPs), physicians at the 3 types of practices were statistically indistinguishable with respect to sex, age, race, years at the practice, and average mean hours worked per week.
Across the 3 practice types, patients with diabetes did not differ significantly in terms of sex, age, and comorbidities (Table 4⇓). Overall, one-half of patients were male, and the average age was 60 years. Two-thirds had coronary artery disease, hypertension, or both.
Quality of Diabetes Care Among Practices
We compared the quality of diabetes care (1) between practices with NPs and those with PAs, (2) between practices with NPs and physician-only practices, and (3) between practices with PAs and physician-only practices (Table 5⇓).
Practices With NPs vs Practices With PAs
Compared with practices with PAs, practices with NPs were almost twice as likely to assess hemoglobin A1c (HbA1c) levels (P = .005), were 37% more likely to assess lipid levels (P = .004), and were more than 5 times as likely to assess microalbumin levels (P <.001) (Table 5⇑). Practices with NPs were also 37% more likely to meet treatment guidelines for lipids (credit given if assessed appropriately and within target or if treated according to guidelines) (P = .004) and were 45% more likely to have patients attain lipid targets (if not assessed, it is assumed a patient was not at target) (P = .001). These results for lipids retained marginal significance even when patients who were not assessed were eliminated from the analyses. Although not significant, the rate ratio comparing treatment for the microalbumin measure between NP and PA practices was similar to that for lipids.
Practices With NPs vs Practices With Physicians Only
Compared with physician-only practices, practices with NPs were 34% more likely to assess HbA1c levels (P <.001) and 17% more likely to assess lipid levels (P = .007) (Table 5⇑). The assessment rate for microalbumin was higher among practices with NPs as well, although not significantly so.
Practices With PAs vs Practices With Physicians Only
Compared with physician-only practices, practices with PAs were 67% less likely to assess microalbumin levels (P = .02) (Table 5⇑). Although the difference was not significant, they were also 32% and 15% less likely to assess HbA1c and lipid levels, respectively. Additionally, practices with PAs were 32% less likely than physician-only practices to have patients attain lipid targets (P <.001), a relationship that held even when nonassessed patients were eliminated from analyses.
Organizational Attributes and Market Orientation of Practices
We found little difference in the organizational attributes and market orientation of practices with or without PAs or NPs (Table 6⇓). Physician-only practices were somewhat less busy than practices with either PAs or NPs (P =.03). These results remained similar after adjusting for potential confounders and when considering just clinician responses.
DISCUSSION
Family medicine practices employing NPs significantly outperformed practices employing PAs in key ADA-recommended assessments for HbA1c, lipids, and microalbumin for patients with diabetes. As high lipids are a major contributor to excess mortality among individuals with diabetes,40 it is important that we found that patients in practices with NPs were more likely to be treated for high lipid levels and to attain lipid targets than their counterparts in practices with PAs. Better monitoring of HbA1c and microalbumin levels did not appear to carry over to better treatment or control of these intermediate outcomes, however. Compared with physician-only practices, practices employing NPs were more likely to appropriately monitor HbA1c and lipids, although again this did not translate into significantly better treatment or control. If verified in other studies, these results highlight the need for greater understanding of the many possible reasons for these differences as well as the reasons for the lack of a causal relationship between process and outcome measures.
This study had a number of limitations. First, this secondary analysis of baseline data from an intervention trial had relatively small numbers of practices with either NPs or PAs. The small sample size may have affected our ability to find significant differences in patient care or measured organizational characteristics. This small sample size combined with missing information on physician, practice, or patient characteristics may also have led to a failure to detect differences between the practices that may have served as confounders for the effect of practice type. Measuring additional variables may have provided more hints as to the reason for the differences found. For example, there may be additional confounders that we did not capture, including patient demographics such as socioeconomic status, additional physician demographics or patient care philosophies, or other measures of practice culture. In addition, we may not have measured components of care that are potentially most affected by collaboration with a diverse clinician base, such as behavioral counseling. Finally, this study may not be generalizable to all small family medicine practices for 2 reasons. First, this analysis focused on average trends and did not highlight individual practices, for example, those practices with PAs that did demonstrate good diabetes care. Second, the study included only a small number of practices in New Jersey and Pennsylvania that agreed to participate in a fairly intensive intervention trial.
Because this study was observational, we cannot conclude causation from any associations; furthermore, the study design precludes connection of patients with particular clinicians. Previous studies, including randomized trials, that have matched patients to specific midlevel and physician clinicians have found similar results for NPs, however.19,22 A strength of this study is that it examines the overall effect of teams of clinicians in family medicine practices on treating patients with diabetes. This approach is consistent with several major recommendations arguing that primary care practices should use teams of clinicians working together to treat populations of patients.3–5
Explanations for the results of this study may rest either with the NPs and PAs or with the practices that hire them, although we were unable to uncover literature that would support any particular explanation. On one hand, differences in training between NPs21,22 and PAs41 or the original selection of careers by individuals with different values may affect the care given and how these clinicians interact with other members of the practice. For example, PAs are trained to work in environments where they are supervised by physicians, whereas NPs may treat patients independently. In addition, NPs may add new perspectives within a team of clinicians because of their background in nursing as well as their emphasis on the well-being of the whole patient, prevention of illness, and patient education.21,22 Alternatively, the rationale that practices have for hiring and integrating a particular type of midlevel clinician may result in different models of care. For example, practices wishing to improve quality of care or adhere to a more holistic approach to medicine may tend to hire NPs, whereas those that want to increase patient volume may tend to hire PAs, although our analysis of our market orientation measures of the practices did not confirm this explanation. To conclusively exclude the latter explanation, one would need to conduct a randomized clinical trial in which NPs, PAs, or neither were randomly assigned to physician-only practices and follow-up data were used to study changes in care patterns.
We had hoped to identify explanations for these results by analyzing qualitative field notes from facilitators’ observations and from key informant and in-depth interviews of clinicians and staff collected in each practice at baseline for the ULTRA study. We hypothesized a priori that a confounding factor for the relationship between presence of NPs and improved guideline adherence was the level of practice cohesion, in the form of good communication, cross-training, shared decision making, and mutual respect of diverse roles. We selected 1 practice that performed well and 1 that performed poorly with respect to the diabetes care indicators from each of the 3 groups (physician-only, practices employing NPs, and practices employing PAs) and blinded the analysts to the performance level of the practice. A careful analysis of these qualitative data, through the process of immersion and crystallization,42 was unable to confirm this hypothesis or identify other organizational features or patterns that differed among the types of practices.
Additional studies are needed with the primary intent of uncovering differences between practices, reasons why practices hire NPs and PAs, and processes by which those clinicians are integrated into practices. These studies should attempt to identify the best roles for different clinicians working in teams to maximize their impact on patient care. Further investigation into the distribution of patients and types of patient visits to clinician type may uncover reasons for differences among practices in the quality of adherence to diabetes assessment guidelines and attainment of lipid targets. For instance, when a practice uses either PAs or NPs, the practice’s overall performance may reflect the distribution of patients to clinicians. Complex patient cases may be assigned to physicians, more routine or acute cases may be assigned to PAs, and cases requiring a more preventive approach may be assigned to NPs. Theoretically, this could lead to more efficient and individualized patient care.
In conclusion, family medicine practices with NPs performed better at providing some types of diabetes care (primarily monitoring tests) than physician-only practices and especially better than practices using PAs. With the burgeoning use of PAs and NPs in attempts to cut costs and try different models of clinical care,3–5 these results point to a need for additional research to confirm these associations and to explore their causes. Given the lack of literature examining the roles and contributions of both NPs and PAs within the context of family medicine practices, even additional descriptive studies would be helpful. Such studies should be part of the process of discovering how teams of clinicians that include midlevel practitioners can be used most effectively and efficiently in primary care practice.
Acknowledgments
We gratefully acknowledge the practices from the New Jersey Family Medicine Research Network and Eastern Pennsylvania Inquiry Collaborative Network, whose participation made this study possible.
Footnotes
-
Conflicts of interest: none reported
-
Funding support: Data collection and analysis were supported by a grant from the National Heart, Lung, and Blood Institute (R01 HL70800) and an AAFP Research Center Grant. This research was also supported by the Cancer Institute of New Jersey’s Primary Care Research shared resource.
An early version of this work was presented as a poster at the 2006 NAPCRG annual meeting, October 15-18, Tucson, Arizona.
- Received for publication March 13, 2007.
- Revision received July 25, 2007.
- Accepted for publication August 10, 2007.
- © 2008 Annals of Family Medicine, Inc.