Abstract
PURPOSE Health care leaders encourage clinicians to offer portals that enable patients to access personal health records, but implementation has been a challenge. Although large integrated health systems have promoted use through costly advertising campaigns, other implementation methods are needed for small to medium-sized practices where most patients receive their care.
METHODS We conducted a mixed methods assessment of a proactive implementation strategy for a patient portal (an interactive preventive health record [IPHR]) offered by 8 primary care practices. The practices implemented a series of learning collaboratives with practice champions and redesigned workflow to integrate portal use into care. Practice implementation strategies, portal use, and factors influencing use were assessed prospectively.
RESULTS A proactive and customized implementation strategy designed by practices resulted in 25.6% of patients using the IPHR, with the rate increasing 1.0% per month over 31 months. Fully 23.5% of IPHR users signed up within 1 day of their office visit. Older patients and patients with comorbidities were more likely to use the IPHR, but blacks and Hispanics were less likely. Older age diminished as a factor after adjusting for comorbidities. Implementation by practice varied considerably (from 22.1% to 27.9%, P <.001) based on clinician characteristics and workflow innovations adopted by practices to enhance uptake.
CONCLUSIONS By directly engaging patients to use a portal and supporting practices to integrate use into care, primary care practices can match or potentially surpass the usage rates achieved by large health systems.
INTRODUCTION
Electronic personal health records hold great promise for improving health. High-quality personal health records can facilitate connectivity between patients and clinicians, allow patients to view their medical record, support online clinical and administrative transactions, deliver essential resources to promote informed decision making, and more actively engage patients in care.1
In the United States, regulations developed by the Office of the National Coordinator and the Centers for Medicare and Medicaid Services to strengthen the functionality of electronic health record systems (meaningful use regulations) encourage practices to engage patients in care through information technology, such as personal health records.2,3 Although patients appear interested,4,5 practices cannot meet this need without infrastructure, workflow, and cultural changes. Most published experiences with engaging patients online have occurred in integrated health systems that have resources and business models to support adoption, implementation, and maintenance of the personal health record.6–9 For example, between 2002 and 2009, Kaiser Permanente and Group Health Cooperative of Puget Sound made major investments to promote online services, resulting in uptake by 27% and 58% of patients, respectively, over 6 to 9 years.6,7
Little is known about whether small to medium-sized practices (eg, 15 or fewer clinicians)—where most primary care services are provided—can replicate these successes or how their experiences will differ. Even less is known about which patients will use and derive benefits from a personal health record. Some skeptics worry that focusing on information technology could exacerbate health disparities related to race-ethnicity, age, or socioeconomic status.10
Patients can be meaningfully engaged in their care through personal health records that are patient-centered, interactive, relevant, and integrated into care.11,12 In our prior work, we described a model to make personal health records more patient centered,11 created a patient-centered personal health record for prevention (termed an interactive preventive health record, IPHR),13 and demonstrated in a randomized controlled trial that offering the IPHR to patients increased delivery of evidence-based preventive services.14,15 Uptake of the IPHR, however, relied on mailing patients an invitation to use the portal, and only 16.8% of invited patients responded.
To improve uptake, we hypothesized that practices could more effectively promote IPHR use by making it part of patient care and using approaches and workflows customized by practices. This manner of promotion would be more applicable to primary care than methods used by large integrated health systems. We extended our original study14 at 8 practices to test this hypothesis in a large sample of patients exposed to the IPHR.
METHODS
Between December 2010 and June 2013, we applied a mixed methods design to prospectively evaluate the feasibility of whether small to medium-sized primary care practices could engage patients to use the IPHR. We observed whether patients and clinicians used the IPHR and factors associated with use. The Virginia Commonwealth University Institutional Review Board approved this study (#HM12746).
Setting
The study was conducted at 8 practices in the Virginia Ambulatory Care Outcomes Research Network (ACORN) that participated in the previously reported IPHR efficacy trial. The practices are located within a 35-mile radius, spanning 5 northern Virginia counties. They operate independently for clinical, staffing, and business activities, but use a common electronic health record (EHR) (AllscriptsTouchworks EHR, Allscripts) and a commercial portal that only provides secure patient messaging.
Intervention
In 2009, the 8 practices agreed to offer the IPHR to all patients aged 18 to 75 years. Although we attempted to integrate the IPHR into the practices’ secure messaging portal, the vendor was not able to support integration. Accordingly, practices had to field 2 portals concurrently.
The IPHR provides personally tailored recommendations and resources for 18 preventive services recommended by the US Preventive Services Task Force (USPSTF) and associated chronic conditions.16 The IPHR design is published elsewhere.13,15,17 In brief, patients who visit the IPHR create an account that links the system to their clinician’s EHR. The IPHR extracts hundreds of EHR data elements, and patients complete a health risk assessment of patient-reported information (eg, health behaviors) and information poorly recorded in EHRs (eg, family history, surgical history).
Based on the USPSTF and 6 other guidelines,16,19–25 the IPHR applies programmed logic to generate a personally tailored list of preventive and chronic care recommendations with 392 variations of patient educational material. The site provides detailed personal messages that explain each service and its rationale, references relevant elements of the patient’s history, includes links to evidence-based educational materials and decision aids, and summarizes next steps. After patient use, the IPHR forwards a summary to the EHR inbox of the patient’s clinician. Initially, the IPHR provided only laboratory results for selected screening tests. In month 10, IPHR functionality was upgraded to enable patients to view all laboratory results, with an explanatory message from their clinician.
Study practices received no financial incentives, although the IPHR was provided at no cost. Using organizational change theory as a guide,26–32 we provided practices basic implementation assistance. Two champions from each practice participated in 7 learning collaboratives to share implementation experiences, train practice clinicians and staff to use the IPHR, and direct local implementation strategies. Other research team support included conducting learning collaboratives (led by A.H.K. and P.K.) and providing weekly IPHR use feedback. Remaining implementation efforts were practice-driven.
Data Collection
We used 5 quantitative and qualitative sources for outcomes: EHR data, IPHR data, learning collaborative transcripts, a clinician survey, and exit interviews. From the EHR, we identified all patients seen for an office visit, their demographic characteristics, and their comorbidities. We used the IPHR to identify patients who created an account. Learning collaboratives, which generated qualitative data on how practices implemented the IPHR, were recorded, transcribed, and coded. Practice champions were interviewed after study completion to critique our interpretation of findings.
The clinician survey included questions from the Agency for Healthcare Research and Quality Health IT Survey Compendium.33 Questions based on the Technology Acceptance Model34 and diffusion of innovation theory35 asked clinicians to rank agreement/disagreement on a 5-point scale with the following statements: “my office is innovative,” “I am comfortable using my EHR,” “…I am usually one of the first to find out about a new test or treatment (early adopter),” “promoting prevention is important to our office,” “our office has a good system to promote prevention,” “training I received about [the IPHR] was adequate,” and “I am confident in my ability to use [the IPHR].”36,37 Clinicians were e-mailed an invitation to take the survey online 1 year after IPHR implementation. Nonresponders received 3 reminders.
Statistical Analysis
IPHR use was computed as the percentage of patients aged 18 to 75 years with an office visit during a given month who created an account within 30 days. We calculated overall use and use by practice and clinician for the complete study period and each individual month. Simple linear regression was used to estimate monthly change in use. To compare IPHR use between practices, we used a univariate logistic regression model. Whether patients created an IPHR account was modeled against the practice, which we treated as a categorical explanatory variable.
Using demographic information recorded in the EHR, we compared characteristics of patients who used and did not use the IPHR. For continuous characteristics (eg, age), mean values for users and nonusers were compared using independent 2-sample t tests. For categorical characteristics (eg, ethnicity and race), percentages of users and nonusers were compared using a univariate logistic regression model.
We conducted a bivariate and multivariate analysis. The bivariate analysis compared whether practices or clinicians had a greater effect on IPHR use. We used a generalized linear mixed model, which had no fixed effects and included the practice and clinician as random effects with a variance components correlation structure. P values were obtained using the COVTEST option of the GLIMMIX procedure, SAS 9.3 (SAS Institute). We conducted a multivariate analysis by applying a generalized linear mixed model to all available clinician covariates (all responses to the clinician survey) and all patient covariates available in the EHR (age, sex, race-ethnicity, and comorbidities) that had a plausible likelihood of affecting IPHR use. We treated the patient and clinician factors as fixed effects and the practice as the sole random effect.
Qualitative Analysis of Learning Collaborative Transcripts
Using an open-template approach,38 4 reviewers (D.R.L., P.K., A.H.K., S.F.R.) used directed coding to capture practice-identified IPHR implementation facilitators, barriers, and workflow impacts.
Two reviewers coded each transcript independently. Merged data were reviewed for discrepancies and discussed by the group to identify themes until reaching consensus. The strength of a given theme was demonstrated by majority participant agreement, consistency of expression, and frequency of associated coding instances.
RESULTS
IPHR Use
During the study period, 112,893 patients aged 18 to 75 years had an office visit, and 28,910 (25.6%) created an IPHR account. Monthly IPHR use across all 8 practices is shown in Figure 1. The monthly increase in IPHR users was nearly linear, with an estimated monthly increase of 1.0% (SE = 0.03%, P <.001). Of patients who visited practices in the final month, 32.5% had a new or preexisting IPHR account. This percentage was a significantly greater uptake (P <.001) than the 16.8% uptake we observed in our prior efficacy trial, in which the IPHR was promoted only through mailings (Table 1).
Although patients created an IPHR account in an average of 59.5 days after their office visit, 23.5% of patients did so within 1 day, and thus the median was only 6.0 days. Fully 64.0% of patients created an IPHR account after 2 office visits, and another 21.8% did after 4 (median = 2.6) visits. Patients logged into the IPHR an average of 3.7 times after creating an account (range of 1 to 261 times) and spent 7 minutes per session. Among users, 26.7% visited the site only once.
Factors Influencing Use
Across the 8 practices there was an initial upsurge in new account creation, a plateau during the middle of the study, and then a decline as more patients seen had an existing account (Figure 2). A group of “high achiever” practices had early increases in new accounts (practices 1 and 8), another group had a more modest delayed surge in uptake (practices 5 and 7), and a third group maintained stable but lower usage rates (practices 2, 4, and 6).
Uptake by practice ranged from 22.1% to 27.9% (Table 1), and use by clinician ranged from 0.0% to 51.3%. In the bivariate analysis, variance between practices lost significance (variance = 0.00; P = .368), whereas the variation between clinicians remained significant (variance = 0.28; P <.001).
Operational changes at certain practices may explain individual variation in usage rates across practices. Although the learning collaboratives discussed a range of passive (eg, websites, telephone hold messages, kiosks) and active (eg, distributing cards, brochures) implementation strategies (Supplemental Appendix), certain innovations adopted by practices may account for the marked increases observed in Figure 2.
For example, the first inflection point in month 2 occurred when 2 practices adopted a team approach to engage staff in notifying patients about the IPHR rather than relying solely on clinicians. Practice 8 created this new workflow: front desk staff stapled information cards to registration sheets and explained the IPHR, nurses discussed the IPHR and reviewed sign-up instructions when rooming patients, and clinicians reinforced the IPHR’s value. Practice 1 immediately copied the workflow, and the 2 practices competed to enroll more patients.
The second change occurred in month 10, when the ability to view all laboratory results became available. Practices 1, 3, and 8 initially utilized this feature, followed by practices 5 and 7, whereas other practices (2, 4, and 6) made less use of this feature. In month 21, many practices experienced decreases in new registrants when they refocused implementation efforts on adopting a new practice management billing system. Finally, in month 23, practices began generating aftercare summaries for patients to comply with meaningful use requirements.39 Practices 1 and 3 adopted an automated program to include information about the IPHR in the aftercare summary, although this routine dissipated after a few months.
In general, IPHR uptake was lower among smaller practices and practices that relied primarily on clinicians to notify patients about the IPHR, that sent IPHR clinical summaries to the clinician rather than medical records or nursing staff, and that did not use the IPHR to inform patients of laboratory results. Qualitative analysis of learning collaboratives identified dominant analytic findings with respect to facilitators (having a culture amenable to change and getting buy-in from all clinicians and staff), barriers (prior negative experiences with other informatics tools and competing demands on staff), and workflow (engaging staff at higher functional levels and engaging patients outside the practice). Further details are provided online in the Supplemental Appendix.
IPHR users and nonusers are compared in Table 2. Older patients were more likely to create an IPHR account—32.9% of 60- to 69-year-olds enrolled—as were patients with chronic conditions (32.5% vs 21.2%, P <.001). Although black and Hispanic patients were less likely to use the IPHR, on multivariate analysis race-ethnicity was a weaker predictor of use than age or having a chronic condition (Table 3). The multivariate analysis also revealed that IPHR use was less likely when clinicians were older than 55 years, younger than 35 years, or male. Interestingly, residency training status did not influence use. IPHR use was strongly associated with clinicians who identified themselves as early adopters and those who expressed comfort with IPHR use training or confidence in using the IPHR.
DISCUSSION
Small to medium-sized primary care practices can effectively engage patients to use patient portals such as the IPHR by integrating promotion into routine care. This approach appears to be more effective than mailing invitations and to match the results of more elaborate promotion efforts by large integrated health systems.
Among patients, a key factor influencing IPHR use was having a comorbid condition. Patients with chronic conditions have more office visits, laboratory and procedural tests, and self-management needs.40,41 Although critics express concerns that online technologies might discriminate against older patients,42,43 1 out of 3 patients aged 60 to 69 years enrolled, the highest use rate by any age-group.
Black and Hispanic patients were less likely to use the IPHR. Even though prior studies document a digital divide in use of personal health records among at-risk populations,44 the growing ubiquity of mobile devices is closing the digital divide,45 and greater use of these very technologies is being discussed to narrow health inequities.46–48
Statistically, the substantial variation in IPHR use across practices was explained largely by variation among clinicians. Patients were less likely to use the IPHR if their clinician was older, perhaps because older clinicians are less accustomed to using electronic resources in patient care. We also found lower usage rates among younger clinicians, but not among residents in particular. Why younger clinicians, most familiar with electronics, would be less inclined to promote usage is unclear.
Decisions made at the practice level appear to explain inflection points in uptake, underscoring the importance of system and workflow redesign. In particular, we found that uptake was influenced by the adoption of a team-based approach and the addition of a new IPHR feature to report laboratory test results. The overall uptake of the IPHR for the 8 practices masked important variances in patterns, underscoring the value to researchers of “unpacking” patterns by practice. Doing so exposed a subgroup of 2 high-achieving practices that functioned as early innovators, 3 practices that followed with a delayed uptake, and 3 practices that maintained stable but lower uptake throughout the project. Proactive reinforcement strategies throughout the study seemed critical for overall uptake.
This study has several limitations to note. First, the study lacked an internal control group. Second, the setting was restricted to a single geographic region; replication in other settings would broaden generalizability. Third, the study design permits inferences about potential disparities in care only. Future studies will need to track the influence of portal use on patient outcomes as a function of ethnicity, race, income, education, location, and patient engagement in care. Finally, we lacked data to adjust for characteristics of clinicians’ patient panels, which may influence IPHR uptake independently of patient characteristics.
Despite these limitations, our data demonstrate that a substantial proportion of primary care patients will utilize online personal health records that interact with the EHR. The characteristics of these users may represent an important contextual factor for further research, especially if this class of patients is, by nature, more likely to care for themselves or access other health care services. Efforts by our study practices to promote the IPHR present another important contextual factor; uptake may be lower for online personal health records offered by Internet companies or health plans, where the imprimatur of one’s personal clinician is lacking. Learning collaboratives underscored the need for practices to customize their implementation plan, which cultivates innovation. Even with such efforts, however, not all patients used the IPHR. Remaining patients may require alternative engagement strategies. Nonetheless, the steady growth in uptake of this resource argues for further investigation of its capacity to promote preventive care and engage patients in self-care outside the practice.
Acknowledgments
The authors thank the participating study practices: Fairfax Family Practice, Gainesville Family Medicine, Herndon Family Medicine, Lorton Station Family Medicine, Prince William Family Medicine, South Riding Family Medicine, Town Center Family Medicine, and Vienna Family Medicine. We thank Kristin Schmidt for project assistance and Steven Mitchell for database support.
Footnotes
-
Conflicts of interest: Virginia Commonwealth University holds the intellectual property rights to the interactive preventive health record evaluated in this study. Although the university and developers are entitled to the system’s revenue, the tested interactive preventive health record (MyPreventiveCare) is a noncommercial product, and no revenues have been generated other than grant funding.
-
Funding support: This work was supported by the Agency for Healthcare Research and Quality (R21 HS018811) and the National Center for Advancing Translation Sciences (ULTR00058).
-
Trial Registration Clinicaltrials.gov identifier: NCT00589173
-
Supplementary materials: Available at http://www.AnnFamMed.org/content/12/5/418/suppl/DC1/
- Received for publication March 2, 2014.
- Revision received June 27, 2014.
- Accepted for publication July 8, 2014.
- © 2014 Annals of Family Medicine, Inc.