Abstract
PURPOSE The purpose of this study was to determine the relationship between the number of patients under a primary care physician’s care (panel size) and primary care quality indicators.
METHODS We conducted a cross-sectional, population-based study of fee-for-service and capitated interprofessional and non-interprofessional primary health care practices in Ontario, Canada between April 2008 and March 2010, encompassing 4,195 physicians with panel sizes ≥1,200 serving 8.3 million patients. Data was extracted from multiple linked, health-related administrative databases and covered 16 quality indicators spanning 5 dimensions of care: access, continuity, comprehensiveness, and evidence-based indicators of cancer screening and chronic disease management.
RESULTS The likelihood of being up-to-date on cervical, colorectal, and breast cancer screening showed relative decreases of 7.9% (P <.001), 5.9% (P = .01), and 4.6% (P <.001), respectively, with increasing panel size (from 1,200 to 3,900). Eight chronic care indicators (4 medication-based and 4 screening-based) showed no significant association with panel size. The likelihood of individuals with a new diagnosis of congestive heart failure having an echocardiogram, however, increased by a relative 8.1% (P <.001) with higher panel size. Increasing panel size was also associated with a 10.8% relative increase in hospitalization rates for ambulatory-care–sensitive conditions (P = .04) and a 10.8% decrease in non-urgent emergency department visits (P = .004). Continuity was highest with medium panel sizes (P <.001), and comprehensiveness had a small decrease (P = .03) with increasing panel size.
CONCLUSIONS Increasing panel size was associated with small decreases in cancer screening, continuity, and comprehensiveness, but showed no consistent relationships with chronic disease management or access indicators. We found no panel size threshold above which quality of care suffered.
INTRODUCTION
Given the central role that primary health care plays in creating a sustainable health care system, improving access to high quality primary health care is an international priority.1 Where physician resources are scarce, one way to achieve better population coverage and ensure that all individuals have a primary care physician is to promote larger panel sizes, defined as the number of patients under the care of a primary care provider. There is, however, a concern that quality may decline at larger panel sizes.2 Establishing the “ideal” panel size for a primary care physician by striking a balance between population access and quality of care is a key objective for decision-makers and clinicians. Setting a maximum size or range, however, is challenging because quality of care can be influenced by a large number of patient, provider, and contextual factors.
Studies have reported significant correlations between larger panel sizes and shorter consultations,3 fewer home visits,4,5 and higher rates of referral to specialists.6 Previous research conducted by members of our team has also found an association between higher self-reported panel sizes and lower likelihood of providing high quality primary and secondary preventive care.7–9 These findings help to identify potential problems with excessive panel sizes but are insufficient to define optimal panel size ranges.
Our objective was to investigate the relationship between panel size and a comprehensive set of primary care quality indicators using linked, population-based health administrative databases. Our approach was to allow the existing pattern of relationship to emerge, with no a priori assumptions about the shape of that relationship or whether there was a cut-off point across which performance would be compared. Our hypothesis was that the quality of patient care would drop as panel size increased.
METHODS
We conducted a cross-sectional, population-based study of primary care services from April 1, 2008, to March 31, 2010 in the province of Ontario, Canada. The data-sets used were linked using unique, encoded identifiers and analyzed at the Institute for Clinical Evaluative Sciences (ICES), a not-for-profit research institute. The databases used for this purpose are described in Supplemental Appendix 1, available at http://www.annfammed.org/content/14/1/26/suppl/DC1. This study was approved by the Bruyère Research Institute Ethics Board and by the Research Ethics Board at Sunnybrook Health Sciences Centre, Toronto, Canada.
Setting
Canada has a publicly funded universal health care system. In Ontario, all medically necessary physician, laboratory, and hospital fees are covered by the Ontario Health Insurance Plan (OHIP) for all 13 million permanent residents, and prescription medications are covered for those on social assistance and those who are aged 65 years or older. More than 80% of Ontarians receive care in 1 of 3 models: reformed fee-for-service, capitation/non-interprofessional team, and capitation/interprofessional team. In the fee-for-service model, patient enrollment is strongly encouraged, and physicians accrue a fee for each service they perform. In the capitation model, patient enrollment is an integral component of the compensation in that physicians receive a monthly allotment based on an age-sex adjusted formula for each patient enrolled in their practice. Approximately one-half of these capitated practices were funded by the Ontario Health Ministry to build interprofessional teams. Team composition varies across practices, but teams include non-clinical and clinical staff such as nurses, pharmacists, and social workers who work alongside physicians in the practice. All 3 models offer physicians financial inducements for achieving quality goals. These include payments for achieving various thresholds of cancer screening and immunizations, incentives for completing flow sheets for diabetes and congestive heart failure, and bonus payments for after-hours care.
Participants
Physicians
We used the Corporate Provider Database to identify primary care physicians and attribute them to the model in which they were working on March 31, 2010. We limited the evaluation to generalists working in 1 of the 3 primary care models that serve the majority of Ontarians. Physicians were excluded if they were identified as specialists in the Ontario Physician Human Resource Database or were deemed to have a focused practice because they billed OHIP fewer than 8 of the 18 standard primary care fee schedule codes during the study period. Physicians with a prolonged absence from active practice (no billings for at least 8 consecutive weeks during the study period) were also excluded.
We obtained the age, sex, place of residency, training (Canadian and international), number of years since medical school graduation, practice size, number of years of experience working in their current payment model, and practice rurality for each physician from the Corporate Provider Database. Rurality was determined using the Rurality Index of Ontario (RIO),10 which derives its measure from population density and availability of additional health services within the area. RIO ranges from 0 to 100, with higher numbers indicating greater rurality, and is commonly grouped into 3 categories: major urban (less than 10), urban (10 to 45), and rural (greater than 45).
Panel Size
We defined panel size for each physician as the number of patients receiving their care from that physician. All patients formally enrolled under the care of a physician (86% of patients) as of March 31, 2010, as identified by the Client Agency Program Enrollment Tables were attributed to that physician’s panel. The remaining patients, those not formally enrolled, were virtually rostered to the physician from whom they received the majority of their primary care services during the two-year study period, as determined by their costs.
Because the amount of time a physician worked in his or her clinic would considerably influence the number of patients for whom the physician would have the capacity to care for, and since we did not have a measure of work hours or full-time equivalent available in the health administrative data, we used small panel size as a proxy. We hypothesized that part-time clinicians would be more likely to have smaller panels, and that by excluding physicians with the smaller panel sizes, we would have a more homogeneous population. Because approximately 25% of primary care physicians in Ontario report working part time, we excluded physicians with panel sizes less than 1,200 patients, which eliminated the lower tertile.
Patients
We included patients with valid health care coverage (OHIP). Patient age and sex were obtained from the Registered Persons Database. We linked the postal codes to census data using the Postal Code Conversion File to determine residential patient income quintiles.11,12 Immigration status was inferred based on when patients were issued their OHIP cards: if prior to 1998, they were considered long-term residents of the province, and if after 1998, they were considered recent registrants. Approximately 80% of recent registrants are immigrants from other countries, while the remainder are interprovincial migrants.13 To measure patient complexity or burden of disease we used Resource Utilization Bands with a range from 0 to 5, derived from physician claims and hospital admissions using the Johns Hopkins Adjusted Clinical Groups (ACG) System.14 We used the Ontario Diabetes Database,15 Congestive Heart Failure registry,16 and Ontario Asthma Surveillance Information System17 to identify patients with these conditions. These databases are based on validated algorithms with high specificity for the target condition.
Quality of Care Indicators
We relied on 16 indicators of primary care delivery covering 5 dimensions of care: cancer screening, chronic disease management, access, continuity, and comprehensiveness. Supplemental Appendix 2, available at http://www.annfammed.org/content/14/1/26/suppl/DC1, provides the operational definition of the indicators and indicates whether financial incentives were available for each measure during the study period. Medication indicators were evaluated only in individuals aged 65 years and older because data were not available for other age groups.
We evaluated access and continuity indicators for all patients. Comprehensiveness was measured at the physician level. Cancer screening and chronic care indicators were evaluated in the subset of patients eligible for that care. For instance, colorectal cancer screening was assessed only in patients aged 50 to 74 years, while eye screening and hemoglobin A1c tests were assessed only in individuals with diabetes and aged 40 years and older.
Analyses
Statistical Methods
We conducted multilevel regressions to assess the relationship between panel size and each quality of care indicator, using generalized estimating equations to account for the clustering effect of patients within physicians. Panel size was the main independent variable, with each indicator in turn the dependent variable. We used negative binomial regressions for all indicators with count outcomes (access measures), logistic regressions for indicators of cancer screening and chronic disease management, and linear regressions for continuity and comprehensiveness. Because of the known strong influence of rurality on the use of hospital services, access regression analyses were carried out only for major urban regions (RIO <10). For all other models, the inclusion of the RIO index in the model was felt to be sufficient to account for any potential influence rurality might have on these indicators. Regressions were adjusted for all factors listed in Table 1 and the primary care model. Statistical significance was set at 0.05, and 95% confidence intervals were reported.
We used restricted cubic splines to optimize modeling of the relationship between panel size and each outcome variable. The curving functions of the cubic splines allow the existing pattern of the relationship between panel size and the outcome to emerge.18 We chose to use 3 knots for our analyses after comparing the QICu (a goodness of fit measure) of 3-, 4-, 5-, and 7-knot splines as applied to our data because the higher knot numbers were unnecessary and overfitted the data. Statistical analyses were performed using SAS version 9.2 statistical software (SAS Institute). Restricted cubic spline regressions were implemented for each outcome with the “%daspline” SAS macro.19 We used the regression coefficients to derive the estimated level of the quality indicator across panel sizes 1,200 to 3,900, setting the coefficients at their mean or mode, as appropriate.
RESULTS
Population
In total, 6,801 physicians operated in the 3 primary care models during the study period. From this group, 38 were removed due to prolonged absences and 373 because they were deemed to be specialists or primary care physicians with focused practices, leaving 6,390 physicians. Removing physicians with panel sizes less than 1,200 left 4,195 physicians serving a total patient population of 8.3 million people. The practices excluded due to low panel size did not differ markedly from the sample as a whole, with the exception that excluded practices were more likely to care for women (56% vs 52%) and be rural (9.1% vs 3.3%). We also ensured that quality of care did not peak at panel sizes less than 1,200 by visualizing the relationship in the lower panel sizes (results not shown). Table 1 shows the patient profile across panel sizes. Physicians with larger panel sizes were more likely to be male, foreign trained, and work in urban practices. Immigrant patients and those from lower income quintiles were more likely to receive care from physicians with larger panel sizes.
Adjusted Analyses
The relationship between panel size (at intervals of 300) and each indicator is shown in Table 2. Plots of the mean estimates of each indicator across panel size and the omnibus P value are displayed in Supplemental Appendix 3, available at http://www.annfammed.org/content/14/1/26/suppl/DC1. The omnibus P value represents the overall effect of the 2 panel-size cubic spline variables produced by the equation.
The likelihood of being up-to-date according to guideline requirements for cervical cancer screening decreased with increasing panel size by 5.0%, (from 63.7% to 58.7%), or a 7.9% relative difference (P <.001). Breast and colorectal cancer screening showed a similar but less-pronounced association, with absolute and relative differences from peak to nadir of 3.0% and 4.6%, respectively for breast (P <.001), and 2.7% and 5.9%, respectively, for colorectal cancer (P = .01).
Only 1 of the 9 chronic disease indicators reflecting the guidelines for the management of the condition showed an association with panel size. The likelihood of individuals aged 40 years and over with congestive heart failure having an echocardiogram within 1 year of diagnosis increased by 6.1% (8.1% relative difference) across the range studied (P <.001). Four medication and 4 screening test indicators showed no significant association.
The rate of non-urgent emergency department visits decreased from 19.5 to 17.4 visits per 100 patients per 2 years, a 10.8% relative difference (impact of small differences in the decimals not shown), across increasing panel size ranges (P = .004), while the rate of hospitalization for ambulatory-care–sensitive conditions increased by 1.25 admissions per 10,000 (relative difference 9.4%) over the range studied (P = .04).
Continuity, which reflects the proportion of primary care visits made to the practice to which the patient is attached, showed a modest inverted U-shaped relationship with panel size. Patients were less likely to receive primary care services from the practice to which their physician belonged if their physician had smaller or larger panel sizes (P <.001). The difference between the highest and lowest estimated continuity scores was 2.6% (relative difference 3.3%). We found a modest decrease in comprehensiveness, the proportion of 20 standard primary care services rendered, (1.6% absolute, and 2.4% relative difference) with increasing panel size (P = .03).
DISCUSSION
Main Findings
Within the panel size range studied, increasing panel size was associated with modest decreases in cancer screening, but we found no decrease in chronic disease management indicators. There was a small but notable inverted U relationship with relational continuity, and a negligible drop in comprehensiveness of care across the panel size range. The likelihood of having a hospitalization related to an ambulatory-care–sensitive condition increased with larger panel sizes, whereas the likelihood of making use of the emergency department for non-urgent issues dropped.
Comparison With Other Studies
Findings of this study are in keeping with others reporting negative associations between panel size and cancer screening,8,20 as well as with studies finding no associations with recommended chronic disease processes of care20 and clinical outcome measures.21 A possible explanation is that cancer-screening interventions are more time consuming because they necessitate a discussion of risks and benefits of screening and often the completion of a maneuver by the physician. Other time-consuming activities such as healthy lifestyle counseling and immunizations8,20 have also been found to be negatively associated with higher panel sizes.
The literature shows that primary care physicians carrying larger panel sizes may be more likely to refer complex patients to specialists, who would then be more likely to adhere to guidelines.22 Surprisingly, we found the likelihood of undergoing an echocardiogram within 1 year of a congestive heart failure diagnosis showed a positive association with panel size. From our data, we are unable to determine whether higher rates of referral to specialists, greater experience and expertise, or both could have contributed to this pattern.
Hospital admissions for ambulatory-care–sensitive conditions, ostensibly an indirect measure of primary care systems’ capacity to manage chronic conditions such as diabetes, congestive heart failure, and asthma,23 increased across the panel size range studied. Estimates for these hospitalizations, however, had wide confidence intervals, and the findings should thus be interpreted with some caution. In contrast, the rate of emergency department visits for non-urgent conditions, often used as an indicator of poor access to primary care services,24,25 was negatively associated with increasing panel sizes; patients of physicians with larger panels had fewer emergency department encounters. The majority of studies assessing access have relied on measures of direct contact with the physicians, such as the number of yearly visits,26 home visits,27 and consultation times,3,26,28,29 and showed consistently lower access associated with panel size. Another study evaluating emergency department visits as we did reported no association with panel size.30
We found a negligible decrease in the comprehensiveness of care and small changes in continuity of care across the panel size range we studied.31 Continuity appeared optimized in the mid-range, showing a maximum gain of 2.6% in that range relative to the lowest measure. Since an ongoing and consistent relationship with the same primary care provider or practice over time is associated with better patient outcomes, especially for patients with chronic conditions, this difference may be of clinical relevance.32,33
Strengths and Limitations
Our study estimated the association between panel sizes ranging from 1,200 to 3,900 and a broad spectrum of primary care quality indicators in more than 4,000 primary care physicians using a cross sectional, population-based design relying on health administrative data. The study’s multiple outcomes, though allowing us a comprehensive assessment of the potential role of panel size, were vulnerable to type I errors. For that reason, statistical significance, especially when weak, should be interpreted with caution. In addition, the precision of some estimates was lower, as reflected by the broader confidence intervals. As a result, it is possible that potentially meaningful differences across panel sizes could not be detected for some measures.
The analyses accounted for several factors potentially confounding the relationship of interest. We controlled for rurality because the limited availability of other health care services in rural areas can lead primary care physicians to take on a broader role in patients’ care provision, consuming more of their time.34 We accounted for the model in which care was provided because the remuneration structure is known to affect physician behavior35 and because team composition can affect the practice’s capacity to care for patients. We recognize, however, that many practices that did not receive funding to establish interprofessional teams would likely have included nurses, and that, in exceptional cases, some might have independently hired a complement of other health professionals. These practices would have remained attributed to the non-interprofessional group in the analyses. We accounted for the sex36–38 and age39 of the physician because these were found to be associated with quality of care in some studies. We used multiple factors to control for patient medical or social complexity, as complex patients require more time per visit and more visits per year.40,41 Socioeconomic status and immigration, however, were determined by proxy measures. We also cannot exclude the possibility that some unmeasured and unaccounted-for factor may be contributing to the observed associations.
Importantly, we did not have access to some parameters that could have helped us explain our findings. For example, we didn’t know whether physicians with larger panel sizes worked longer hours to accommodate the increased demands of a larger practice.26 We also had no data on physicians’ attitudes and behaviors, and have limited information on practice organizational structure and context.
CONCLUSION
Because the observed differences in quality of care associated with panel size were modest, and especially because all showed apparent gradual changes over the panel size range studied, with no evidence of a threshold or shoulder beyond which quality dropped, our findings do not support policy measures such as thresholds or caps that reduce payments to physicians with large panel sizes.
We postulate that physicians who take on larger patient panels may be able to do so without compromising care quality because some personal or practice characteristics allow them to provide effective and efficient care. Characteristics such as physician communication style,42,43 better organizational climate,44,45 and systematic improvements in practice access46 are reported to promote efficiency and/or quality. We need to better understand what makes some practices high performing and what factors support greater efficiency. Building on this work, our team is undertaking a survey of Ontario primary care practices to understand their organizational structure and study the relationship of organizational factors with quality measures. Subsequent research should also include practice-based observations and qualitative studies that allow a more in-depth understanding about efficient high-performing practices.
Acknowledgments:
The authors would like to extend thanks to Monica Hernandez for excellent study coordination, and Alex Kopp and Steven Hawken, senior analysts, for their guidance in the analyses.
Footnotes
Conflicts of interest: authors report none.
Funding support: All authors had financial support from the Canadian Institutes of Health Research (FRN 102660). This study was supported by the Institute for Clinical Evaluative Sciences (ICES), which is funded by an annual grant from the Ontario Ministry of Health and Long-Term Care (MOHLTC).
Disclaimer: The opinions, results, and conclusions reported in this paper are those of the authors and are independent from the funding sources. The funders had no role in the design or implementation of the study. No endorsement by ICES or the Ontario MOHLTC is intended or should be inferred.
Previous presentations: North American Primary Care Research Group Annual Meeting. December 1–5, 2012, New Orleans, Louisiana; Canadian Association for Health Services and Policy Research (CAHSPR), May 29 – 31, 2012, Montreal, Québec; Trillium Primary Health Care Research Day, June 6, 2012, Toronto, Ontario; Kingston, Ontario, and Institute of Clinical and Evaluative Sciences Program Meeting, February 20, 2013;,Toronto, Ontario.
Supplementary materials: Available at http://www.AnnFamMed.org/content/14/1/26/suppl/DC1.
- Received for publication March 9, 2015.
- Revision received August 13, 2015.
- Accepted for publication August 19, 2015.
- © 2016 Annals of Family Medicine, Inc.