Abstract
PURPOSE On the eve of major primary health care reforms, we conducted a multilevel survey of primary health care clinics to identify attributes of clinic organization and physician practice that predict accessibility, continuity, and coordination of care as experienced by patients.
METHODS Primary health care clinics were selected by stratified random sampling in urban, suburban, rural, and remote locations in Quebec, Canada. Up to 4 family or general physicians were selected in each clinic, and 20 patients seeing each physician used the Primary Care Assessment Tool to report on first-contact accessibility (being able to obtain care promptly for sudden illness), relational continuity (having an ongoing relationship with a physician who knew their particulars), and coordination continuity (having coordination between their physician and specialists). Physicians reported on aspects of their practice, and secretaries and directors reported on organizational features of the clinic. We used hierarchical regression modeling on the subsample of regular patients at the clinic.
RESULTS One hundred clinics participated (61% response rate), for a total of 221 physicians and 2,725 regular patients (87% response and completion rate). First-contact accessibility was most problematic. Such accessibility was better in clinics with 10 or fewer physicians, a nurse, telephone access 24 hours a day and 7 days a week, operational agreements to facilitate care with other health care establishments, and evening walk-in services. Operational agreements and evening care also positively affected relational continuity. Physicians who valued continuity and felt attached to the community fostered better relational continuity, whereas an accessibility-oriented style (as indicated by a high proportion of walk-in care and high patient volume) hindered it. Coordination continuity was also associated with more operational agreements and continuous telephone access, and was better when physicians practiced part time in hospitals and performed a larger range of medical procedures in their office.
CONCLUSIONS The way a clinic is organized allows physicians to achieve both accessibility and continuity rather than one or the other. Features that achieve both are offering care in the evenings and access to telephone advice, and having operational agreements with other health care establishments.
- Organization & administration
- physician’s practice patterns
- accessibility of health services
- continuity of patient care
- coordination of patient care
- primary health care
- practice-based research
INTRODUCTION
In Quebec—as in the rest of Canada—primary care is delivered principally by independent, physician-run practices, supported as private practices through reimbursement for medically necessary services on a fee-for-service basis. Approximately 15% of primary health care in Quebec is delivered in territorially based community health centers (CLSCs) that receive block funding and have salaried personnel who deliver health and social services. These 2 subsystems have operated in parallel, and their independent functioning is considered to be an important cause of the problems in accessibility and continuity of care that have been highlighted in a recent health care commission.1
In 2002, Family Medicine Groups (FMGs) were proposed as a new organizational model to enhance integration between private practices and community health centers. The FMG is a volunteer administrative arrangement for existing practices or networks of 8 to 10 physicians who are accredited by the regional health authority to provide a basket of planned services, have extended service hours (including evenings, Saturdays, and Sundays), and have formal agreements with other establishments to offer the full range of services to a population of registered patients. In turn, the FMG receives 1 or more nurses paid from the budget of the local community health center. These organizational features are similar to those of primary health care models that are being introduced throughout Canada in an effort to strengthen primary health care.
In 2002, we conducted a survey to measure first-contact accessibility and continuity as perceived by primary care patients and to identify characteristics of clinic organization and physician practice that explain the observed variance in these attributes. Continuity refers to both relational continuity between the patient and physician and to care continuity between the family physician and specialist, which we refer to as coordination continuity. The goal was not only to inform policy content for FMGs but also to guide decisions within the independent, physician-led practices that continue to be the predominant primary care model.
METHODS
Study Population
We conducted a cross-sectional, multilevel survey of 100 primary care clinics selected by stratified random sampling to have 75% private group practices, 10% solo practices, and 15% community health centers within urban, suburban, rural, and remote strata in Quebec, Canada. Eligible sites offered general medical services to an undifferentiated clientele, had not had major organizational changes in the last year, and had more than two-thirds of patients who could respond in English or French.
In clinics with 2 or fewer physicians, we selected all physicians, and in clinics with 3 or more physicians we selected 2 to 4 family or general physicians, depending on the clinic size. This approach maximized our statistical efficiency to detect effects at the clinic and physician levels.2 Physician selection varied by site, from those who volunteered to those who were available on data collection days. Eligible physicians practiced general medicine on site at least 1 day per week and had worked at the clinic for at least 1 year. We recruited from the waiting room 20 consecutive patients consulting the selected physician. Data collection sometimes spanned multiple days, but was stopped if 20 patients were not recruited after 5 recruitment efforts on different days.
Information Collected
We collected information on accessibility, relational continuity, and coordination continuity from patients; on practice profiles from physicians; and on clinic organizational features from administrators and directors. The information was collected with self-administered questionnaires that had closed-ended questions and were validated in French and English. Research technicians administered the study on site, made observations, and obtained information from secretarial staff.
Dependent Variables: Patient Assessment of Accessibility and Continuity
We assessed patients’ experience of first-contact accessibility and continuity principally by using the adult and child versions of the Primary Care Assessment Tool (PCAT).3,4 We selected this instrument because it has both patient and clinician versions. Parents reported on care received by children. All questions relate to the patient’s regular care clinician or—for those without one—to the physician or clinic consulted that day. The conceptual and operational definitions of first-contact accessibility, relational continuity, and coordination continuity are provided in Table 1⇓. The scales represent the patient’s confidence in being seen within a day for a sudden sickness (first-contact accessibility), in the clinician’s knowledge of the patient’s medical history and personal situation and in ongoing care (relational continuity), and in the coordination of care with the last specialist seen (coordination continuity). Each item asks the patient to estimate the likelihood of a positive aspect of care, with a response scale of 1 indicating definitely not; 2, probably not; 3, probably; and 4, definitely. We averaged the item scores for each validated scale (range, 1–4). We established a mean score of 3 (probably) as the minimum expected level for each dimension of care. The extent to which a clinic was above or below the expected minimum was based on the mean of patient responses for that clinic.
Independent Variables: Physician and Clinic Characteristics
For each participating patient, the study physicians completed an encounter form indicating whether they were the principal responsible physician for that patient (affiliation), and if not, whether and how information would be communicated to the responsible physician (informational continuity). Physicians also completed the clinician version of the PCAT6,7 and reported on their practice profile (years in practice, practice sites, average hours per week at the clinic, weekly patient volume, acceptance of new patients, number and type of medical procedures performed),8 degree of integration in the practice organization, and practice culture. The secretary provided their third next available appointment, most recent hourly patient volume, and preferred modalities for handling urgent care needs.
Practice administrators or medical directors reported on organizational attributes of the clinic: physical and human resources, governance and management structures, the number of health care establishments with which they had operational agreements, and practice culture. The measure of practice culture, inspired from various sources,9–11 was the mean of respondents’ assessments of importance (on a 5-point scale) given to rapid access, psychosocial care management, customer service orientation, and business viability of the practice.
Analysis
Only patients whose regular clinician was a participating physician were included in this analysis. We built separate linear regression models for each outcome of interest in which the score for first-contact accessibility, relational continuity, or coordination continuity was the dependent variable and the variables related to clinic organization and physician practice were the independent variables. Considering the nested nature of the data structure, we used the HLM multilevel software12 to build 3-level, random-intercept hierarchical regression models, with clinics at level 3, physicians at level 2, and patients at level 1, and allowing the intercept for each clinic to vary rather than be fixed as in ordinary least squares regression. We partitioned the total variance for each outcome into proportions attributed to clinic and physician levels of the data structure in an empty model, and then estimated how much of the clinic- and physician-level variance was explained by the respective variables included in the final model. Continuous variables were centered at the mean so that the intercept reflected the mean for all clinics and unit changes were meaningful below and above the mean. All models controlled for patient age, education, and use of primary care services in the past year.
We characterized the independent variables into 4 blocks relating to vision (practice culture), resource structure (number and type of physical and health human resources, hours during which the clinic was open, services offered), governance mechanisms (management structures and processes), and physician practice (availability at the clinic, information continuity, patient volume).13,14 We used stepwise regression analysis to identify the strongest variables in each conceptual block of variables, then added blocks in the order presented above. Building a stable regression model is challenging because, by definition, organizational dimensions are highly correlated in functional models. When attributes from different dimensions were too highly correlated to contribute independently, we selected the variable with the strongest association that was also modifiable.
RESULTS
Among 201 clinics randomly selected, 171 were eligible. Of clinics invited to participate, 64% (110) accepted, but after data collection started, 3 withdrew and 7 were judged to be ineligible because more than one-third of their clientele could not complete the questionnaire in English or French. The final clinic participation rate was 61% (100 of 164 eligible). The characteristics of the 100 clinics are presented in Table 2⇓. The 221 physicians contributed an average of 18 patients (median, 20) in private practices and 12 patients (median, 12) in community health centers (CLSCs). Of the 4,764 contacted patients, 93% were eligible and 89% participated, but only 87% provided complete information. Of these, 2,725 were included in this analysis because their regular physician was a participating physician.
Table 3⇓ shows average PCAT scores for all clinics as well as performance relative to the minimum expected for each measure. Results for each patient-reported measure of care are detailed below.
First-Contact Accessibility
The most problematic aspect of care from patients’ perspective was first-contact accessibility. The mean score of 2.3 was 35% below the minimal expected standard of 3, and the vast majority of clinics were below the minimal level: the lower limit of the 75th percentile was 2.41 or 29% below minimal (Table 3⇑). Only 10% of patients were confident that someone from their clinic would see or advise them within 1 day for a sudden illness. Indeed, the average waiting time for an appointment was 24 days (median, 19).
The single most important predictor of first-contact accessibility was offering telephone access to patients 24 hours a day, 7 days a week; such access was offered by 10% of urban private practices and all community health centers in remote areas. The final multilevel regression model for first-contact accessibility is presented in Table 4⇓, with characteristics grouped according to clinic or physician level. Each coefficient is expressed as the mean difference in PCAT score associated with a unit change in the characteristic. The model effects are additive, so that the average clinic (score, 2.3) could meet expected accessibility levels by having a nurse on site (0.12), offering continuous telephone service (0.30), offering evening walk-in care (0.07), and adjusting appointment scheduling so that appropriate cases could be seen within 1 week (0.09): 2.3 + 0.12 + 0.30 + 0.07 + 0.09 = 2.88. Increasing open hours would also increase access, but we found that the effect of each additional hour the clinic was open (0.008) was significant only after a threshold of 55 hours. Enhancing links with other health care establishments also positively influenced accessibility (0.03 for each establishment).
Patients in practices with more than 10 family physicians experienced a 0.21-point lower first-contact accessibility than their counterparts in clinics with 10 or fewer. Offering weekend walk-in services had no effect, whereas offering evening walk-in services increased accessibility, as noted above. This increase did not reach significance in the final model, but was significant before adding physician-level variables and was retained because it has implications for organizing practice.
Patients of the 20% of physicians who were available for appointments within a week experienced higher first-contact accessibility (0.09), as did patients of physicians who had a high hourly volume of patients, with a 0.02-point increase in accessibility for every patient above the mean of 3.4 patients per hour. Physicians who responded to urgent needs by meeting patients in the emergency department had a 0.17-point lower accessibility. On closer examination, this effect was principally attributable to physicians who spent less than one-half of their practice time at the clinic, a pattern occurring mainly in rural areas.
The partitioning of variance showed that more of the total observed variance in first-contact accessibility was attributed to between-clinic differences than to between-physician differences (20% vs 3%). The block of physician practice variables reduced between-clinic variance rather than between-physician variance, suggesting that—despite their name—these variables reflect organizational rather than individual practice styles; nonetheless, most of the variance in reported accessibility was due to random error and between-patient variance.
Relational Continuity
In contrast to the case for first-contact accessibility, the vast majority of clinics had higher-than-minimal relational continuity (Table 3⇑). Despite apparent problems of accessibility, 77% of patients were consulting their regular physician, an independent corroboration of the importance of relational continuity to patients. Our relational continuity model is presented in Table 5⇓. The number of other establishments with which the clinic had operational and formal care agreements improved relational continuity (0.03 points each), as did offering scheduled visits in evenings (0.05); the effect for weekends was not significant. The total variance in relational continuity attributed to between-clinic variance and between-physician variance was almost equivalent: 8.8% and 6.7%, respectively.
We found that physician attachment to the practice community increased continuity (0.05), as did plans for informational continuity (0.09). A walk-in care and high-volume practice style was associated with lower relational continuity. When more than 70% of a physician’s practice consisted of walk-in care, relational continuity decreased by 0.14 points. Although higher patient volume increased accessibility, each additional patient over the mean of 3.4 per hour reduced relational continuity by 0.03 points.
Coordination Continuity
Patient-reported coordination continuity was above the defined minimum expectation (Table 3⇑), but between-clinic variance was high.
Table 6⇓ presents the impact of clinic organization and physician practice on perceived coordination continuity. Again, offering continuous telephone access (0.16) and having agreements with other health care establishments (0.04 points each) increased perceived coordination.
The physician’s practice profile seemed to be the principal determinant of coordination continuity. Coordination increased with every medical procedure the physician performed on site above the mean of 3.8 (0.02) among the 14 procedures elicited. If physicians spent 50% to 70% of their time at the clinic and worked the rest of the time in a hospital, emergency department, or long-term care facilities, coordination continuity was 0.09 points higher than if physicians worked almost exclusively within or outside of the clinic. Again, the former is a typical profile of rural primary care physicians, 77% of whom worked in hospitals or long-term care settings, compared with 35% of their urban and suburban counterparts.
Whereas relational continuity was only weakly correlated with first-contact accessibility (r = 0.10, P <.001), it was a key factor in coordination continuity (r = 0.41, P <.001). Alone, it accounted for 12.6% of the total variance in coordination, whereas our final model accounted for only 7.8% of the total expressed variance. More of the variance in coordination was due to between-physician variance (6.3%) than to between-clinic variance (2.4%).
DISCUSSION
We found that in Quebec in 2002, patients had little confidence in being able to promptly access their primary care provider for a sudden illness, but were generally confident in an ongoing relationship with their general physician, who knew their particulars, and in coordination of care between their general physician and specialists. Most importantly, we found that characteristics that are features of the proposed FMG models can be expected to improve these attributes of care: a group size of 8 to 10 physicians, the presence of a nurse, offering service in the evenings, having an information link to the nurse help line, and establishing formal arrangements for shared care with other establishments. Some of these features have been highlighted by other studies.15,16 Between 2002 and mid-2007, 127 FMGs were accredited by the Ministry of Health and Social Services to serve more than 1 million registered patients, and more are planned. Although only a small proportion of the population is covered formally by FMGs, they constitute a major sea change in the way that primary health care is delivered, and their use is expected to influence this delivery generally. A strength of this study is that it demonstrates how accessibility and continuity can be improved in clinics that are not FMGs.
The organizational feature common to higher accessibility, relational continuity, and coordination continuity is the number of other health care institutions with which the primary health care clinic has operational and formal agreements. Our initial questionnaire did not specify the nature of these agreements, so we asked clinics to describe them in more detail (73 clinics responded). These agreements were mostly shared-care protocols or mechanisms for facilitated referrals and information sharing. In community health centers, these tend to be formal agreements, but in physician-run practices, the agreements were based on social relationships. The degree of integration of primary care models has been identified as a crucial element of model effectiveness.14 The improvement in coordination of care that we observed when physicians worked in more than 1 setting may be due to a strengthening of the personal links with specialists.
Although other studies have found that patient assessments of access are lower than those for continuity,15 accessibility in our study was particularly problematic. The long wait for appointments was an independent validation of patient perceptions. The accessibility problem may not be unique to Quebec. In the national survey Access to Health Care Services, 18.8% of Canadians reported having difficulties in getting care for immediate health problems in 2001,17,18 and this increased to 24.2% in 2003.17 A recent study showed Canadians waited longer for primary care appointments than patients in New Zealand, Australia, and the United Kingdom.19 Although changes in physician supply and practice style may explain part of the problem, our results provide direction for organizational changes to increase access for patients. Improving telephone access seems particularly critical; our study showed least satisfaction with the ability to get through to the clinic and to obtain needed advice.20 For clinics that cannot extend service hours over the minimal threshold of 55 hours per week, a redistribution of open hours to offer care in the evenings would enhance both accessibility and relational continuity. Integrating a nurse into the practice was associated with higher accessibility; our data did not allow us to specify what roles of the nurse enhance accessibility, but nurses’ recognized strength in patient education may provide patients with confidence that they can obtain advice and orientation for new health problems.
Achieving balance between accessibility and continuity is a challenge for physicians,7,21,22 and it appears that most family physicians have organized their practice to maximize continuity at the expense of accessibility. Yet good accessibility is required to maintain continuity. Balance might be achieved by leaving space for urgent care between scheduled patients, varying according to time of year, and reserving advance appointments for nonurgent care.23
We expected that relational continuity would suffer in large physician groups, but surprisingly, accessibility did. Higher scores for accessibility in smaller practices have also been reported in studies in England.15,24 In large practices, patients may be less likely to see their own physician and consequently may perceive lower accessibility; their perceptions of health care may be more positive when they perceive their clinician’s affiliation to be personal rather than institutional.14
Our study has some limitations. This is an exploratory study. Of the many variables significantly related to dimensions of care, we retained in the final model those we judged to be relevant to practice policies, but often this approach entailed choosing 1 among correlated variables so that the variable was a proxy for a cluster of features. For instance, physicians who spent more than 50% of their time in walk-in care also had a high hourly patient volume, performed a larger range of medical procedures, and tended not to be integrated in the management of the clinic. Some of these features were retained in the accessibility model, and some were retained in the continuity models, but the cluster of features would be related to both outcomes.
Although we successfully explain a large proportion of between-clinic and between-physician difference, the overall variance explained by the models (R2) is small, indicating the presence of random error, measurement error, or both in patients’ assessments of the attributes. Patients’ assessments of one attribute seem to be influenced by other attributes. We found that satisfaction with waiting time for an appointment (data not shown) was more strongly correlated with relational continuity than with the reported time to the third next available appointment. Patients’ assessments of clinic features such as access appear to be greatly influenced by interpersonal dimensions of care.
In conclusion, despite limitations, our study suggests concrete ways to organize and deliver primary health care for better accessibility and continuity, especially in the Canadian context. Many features of FMGs in Quebec should improve first-contact accessibility and both relational and coordination continuity of care. In particular, telephone access is a critical feature to improve, one that has been overlooked in many renewal initiatives to improve primary care.
Footnotes
-
Funding support: This study was funded by the Canadian Health Services Research Foundation; the Quebec Health Research Foundation (FRSQ); the regional health authority (Régie régionale de la Santé et des Services sociaux) of Montréal-Centre; and the Dr Sadok Besrour Research Chair in Family Medicine. Direct in-kind support was provided by Quebec National Institute of Public Health (INSPQ), Collège des médecins du Québec (Quebec College of Physicians), The Quebec Federation of General Practitioners (FMOQ), the regional health authorities of Bas-Saint-Laurent and Côte-Nord, and the Quebec Ministry of Health and Social Services (MSSS). During the period of this study, Jeannie Haggerty was appointed in the Department of Family Medicine at the Université de Montréal and was supported as a research scholar (Junior 1) by the Quebec Health Research Foundation (FRSQ). Marie-Dominique Beaulieu held the endowed chair of the Dr Sadok Besrour Research in Family Medicine.
- Received for publication May 30, 2007.
- Revision received August 21, 2007.
- Accepted for publication October 8, 2007.
- © 2008 Annals of Family Medicine, Inc.