Abstract
PURPOSE The Ask Me 3 (AM3) health communication program encourages patients to ask specific questions during office visits with the intention of improving understanding of their health conditions and adherence to treatment recommendations. This study evaluated whether implementing AM3 improves patients’ question-asking behavior and increases adherence to prescription medications and lifestyle recommendations.
METHODS This randomized trial involved 20 practices from the American Academy of Family Physicians National Research Network that were assigned to an AM3 intervention group or a control group. Forty-one physicians in the practices were each asked to enroll at least 20 patients. The patients’ visits were audio recorded, and recordings were reviewed to determine whether patients asked questions and which questions they asked. Patients were interviewed 1 to 3 weeks after the visit to assess their recall of physicians’ recommendations, rates of prescription filling and taking, and attempts at complying with lifestyle recommendations.
RESULTS The study enrolled 834 eligible patients in 20 practices. There were no significant difference between the AM3 and control patients in the rate of asking questions, but this rate was high (92%) in both groups. There also were no differences in rates of either filling or taking prescriptions, although rates of these outcomes were fairly high, too. Control patients were more likely to recall that their physician recommended a lifestyle change, however (68% vs 59%, P=.04).
CONCLUSIONS In a patient population in which asking questions already occurs at a high rate and levels of adherence are fairly high, we found no evidence that the AM3 intervention results in patients asking specific questions or more questions in general, or in better adherence to prescription medications or lifestyle recommendations.
- Health literacy
- practice-based research
- patient-clinician communications
- patient education
- multi-methods research
- primary care
INTRODUCTION
Numerous studies document the need to improve physician-patient communication.1–4 Patients report that physicians are not sufficiently attentive to their concerns, and patients often do not understand what they are told.5 When interviewed immediately after office visits, patients recall only one-half or less of important information given to them.2
Limited health literacy can further complicate communication between physicians and patients.4 Patients with limited capacity to “obtain, process, and understand basic health information and services needed to make appropriate health decisions”6 have trouble understanding common medical terms and written health-related materials.7–12
Research suggests that better physician-patient communication improves patient outcomes.13–18 Yet, some physicians view better communication as time-consuming and impractical during office visits averaging only 17 minutes.19
Ask Me 3 (AM3) is a simple approach designed to facilitate communication between health care professionals and patients. AM3 was developed by the Partnership for Clear Health Communication (http://www.npsf.org/askme3/). The AM3 approach encourages patients to ask 3 questions at every visit with a clinician: (1) What is my main problem? (2) What do I need to do (about the problem)? and (3) Why is it important for me to do this? The AM3 program is based on the theoretical argument that patients’ increased communication (via patient question-asking) and subsequent understanding (or increased health literacy) will lead to better adherence to treatment recommendations (eg, recommended medication and lifestyle changes).
This study compared patient-physician communication between primary care practices that implemented the AM3 program and control primary care practices that did not. We conducted a practical clinical trial, a design that examines interventions as they would occur in routine clinical practice, and that provides useful information regarding clinical effectiveness.20 Our research questions were as follows: (1) Does the AM3 intervention affect patients’ question-asking behavior? (2) Does the AM3 intervention affect adherence to selected physicians’ treatment recommendations? and (3) Is there a relationship between patient question-asking, in general, and these same adherence outcomes? Our prestudy hypotheses were that (1) patients in practices implementing AM3 would average more questions than patients in control practices; (2) patients in AM3 practices would show greater adherence to physicians’ treatment recommendations; and (3) as patients ask more questions, they would show greater adherence to physicians’ treatment recommendations.
METHODS
Overview
This practical clinical trial, known as the Improving Communication During Office Visits trial, involved 20 primary care practices from the American Academy of Family Physicians National Research Network (AAFP NRN). Practices were randomly assigned to an AM3 intervention group or to a control group in which AM3 was not introduced. The study was approved by the University of Missouri–Kansas City Social Science Institutional Review Board (IRB) and local IRBs of participating practices. Patient enrollment and data collection occurred between November 2004 and May 2005.
Practices
We randomly assigned 10 practices to the intervention group and 10 to the control group. The study sites were located in 18 states distributed across the United States. The practices included 41 physicians: 23 in AM3 practices and 18 in control practices. Practices in both study groups ranged in size from 1 physician to 3 or more. Five practices (3 AM3) were urban, 6 practices (2 AM3) were suburban, and 9 practices (5 AM3) were rural. Most practices were physician owned; 8 (4 AM3) were residency programs.
Patients
Each practice recruited 20 to 25 patients per study physician based on sample size calculations described below. Each practice selected, a priori, a sampling strategy for patient enrollment: every second, third, fourth, or fifth patient who visited the office on a given day to see the study physician for any reason. Office study coordinators obtained informed consent from patients.
Eligible patients were aged 18 years or older and capable of giving informed written consent in either English or Spanish. Patients were excluded if pregnant, too ill to participate, or not capable of being contacted by telephone for a follow-up interview.
AM3 Intervention Group
We used several strategies simultaneously to introduce AM3 into the intervention practices. First, AM3 brochures were made available in waiting rooms, and AM3 posters were placed in waiting rooms and examination rooms. Second, front office staff members were trained to give AM3 pamphlets to patients at check-in. Third, when nurses and medical assistants escorted patients to examination rooms, they reminded patients to ask the physician the 3 questions. Patients also could write their questions in the provided pamphlets to address with their physician later.
Intervention practices were instructed to implement the intervention as described here in their practices for at least 1 week before enrolling patients. Physicians and staff from these practices attended a 1-day face-to-face training session (in Kansas City, Missouri) that covered both the AM3 program and the study protocol.
Control Group
Physicians and staff from the control group practices attended a separate training session in which data collection protocols were reviewed. They were not told about AM3 or specific details about health literacy. They were instead informed that we were conducting a study about physician-patient communication, and they were asked not to change their current communication behaviors with patients during the study. Control practices received the AM3 information after the study ended.
Data Collection
Data were collected from patients and physicians, and from their interaction during the visit using 2 questionnaires, audio recordings, and a follow-up telephone interview (Table 1⇓).
Patient Postvisit Questionnaire
Immediately after their office visit, patients in both groups completed a questionnaire. The questionnaire asked about demographics and health literacy. The literacy items were drawn from previously validated instruments21 and modified to decrease the reading demand and to place questions in a primary care rather than hospital-based context.
Physician Postvisit Questionnaire
Physicians in both groups completed a questionnaire immediately after the patient visit. The questionnaire asked (1) about the physician’s perceptions of her/his communication with the patient, (2) about the nature of the patient’s problems, (3) whether medications were prescribed, and (4) whether lifestyle changes were recommended.
Recordings of Physician-Patient Visits
In both sets of practices, staff placed an audio recorder in the examination room, and the entire office visit of consenting patients was recorded. The recordings were mailed to the AAFP NRN for review and coding. Information abstracted for coding included (1) number of times each AM3 question was asked, (2) total number of AM3 questions asked, (3) total number of questions of any type asked, (4) whether a medication was prescribed, and (5) whether a lifestyle recommendation was made. Coders worked together during the first few days of coding and subsequently once per week using the same audio recordings to check each others’ coding, interpretations, and assumptions. Where differences occurred, consensus was reached on interpretation and coding decisions.
We assessed reliability of these measures by having the 2 (of the project’s 5) research associates who had coded the majority of recordings randomly select 75 (10%) of the recordings and independently code the same information, and then evaluating the concordance between the 2 coders. The coders’ agreement was 97% (“Was Ask Me 3 question 1 asked?”), 68% (“Was Ask Me 3 question 2 asked?”), and 93% (“Was Ask Me 3 question 3 asked?”), with a mean agreement across the 3 items of 86%. These items’ κ values were 0.653, 0.138, and 0.269, respectively.
Patient Postvisit Telephone Interview
Patients were telephoned for follow-up interviews if their physician indicated that a new or refill medication had been prescribed at the visit. The mean number of days between the index visit and follow-up was 14.2 (SD = 10.1) and 14.1 (SD = 12.3) for the intervention and control patients, respectively. Across all eligible patients, 84% were interviewed within 3 weeks. The interviewers asked about patients’ adherence to recommendations made during the visit (Table 2⇓).
Data Analysis
Statistical analyses were conducted using SPSS, version 11.5.1 (SPSS for Windows, SPSS Inc, Chicago, Illinois) and SAS 9.1 (SAS Institute Inc, Cary, North Carolina). We computed frequency distributions and descriptive statistics for survey questions and abstracted items from the audio recordings. We used χ2 tests and t tests for categorical and continuous dependent variables, respectively, when assessing the bivariate relationships.
Multivariate analyses were used to address the primary research questions using general linear mixed models (SAS Proc Mixed) for continuous (or semicontinuous) outcomes or generalized linear mixed models with logit link (SAS Proc Glimmix) for dichotomous outcomes, adjusting for patients clustered within physicians.22,23 Although physicians were clustered within practices, in most cases, there were too few physicians per practice to model both physician- and practice-level random effects. Patient sex, age category, race/ethnicity, marital status, education, health literacy, and number of years with study physician were included as covariates in every model with group (intervention vs control) included as a fixed effect.
We calculated that a minimum sample size of 400 patients in each group would provide 80% power to detect a difference (α = .05) of 25% between the intervention and control patients in asking 1 or more AM3 questions. We assumed an intraclass correlation coefficient (patients within physicians) of 0.10 and estimated that about 50% of the intervention patients would ask some variant of these questions, compared with 25% of the control patients.
RESULTS
Participation Rates and Usable Data
Overall, 1,088 patients were invited and 834 (77%) consented to participate in the study—445 (76%) in intervention practices and 389 (78%) in control practices (Figure 1⇓). Data from 5 patients were unusable (because the patients were underage or their signed informed consent form was missing), leaving 829 patients. The intervention physicians enrolled an average of 19.3 patients (SD = 7.4, median = 23), compared with 21.6 patients (SD = 3.7, median = 21) for the control physicians. In all, 763 (92%) of the audio recordings were usable. Reasons for unusable audio recordings included the recorder was not turned on, the recording was not audible, and the recorder stopped before the visit ended.
Participating vs Nonparticipating Patients
In total, 193 (76%) of the 254 patients who declined participation provided their demographic information. Younger patients were more likely to have participated than older patients (mean age, 51.6 vs 57.6 years; P <.001). Men and women did not differ significantly in their participation, and racial identification did not differ between the participants and nonparticipants (data not shown).
Patients’ Demographics and Health Literacy
Intervention and control patients did not differ (P >.05) with respect to sex, age, racial identification, employment, retirement status, source of insurance, or years as a patient of the study physician (Table 3⇓). The 2 groups did differ in terms of ethnic identification, marital status, and educational attainment. Specifically, intervention patients were more likely to be Hispanic (P = .002) and married (P = .048), and less likely to report both lack of high school graduation (11% vs 16%) and lack of postcollege study (8% vs 13%), but also more likely to report high school graduation, some college education, and college graduation (combined 82% vs 71%, P = .02).
The patients’ responses to the 3 questions about health literacy revealed differences between the groups for the question, “How easy or hard is it to fill out medical forms by yourself?” (Table 4⇓). Intervention patients were more likely to respond either “extremely easy” or “very easy” compared with control patients (70% vs 62%, P = .001).
Rates of Question-Asking
Hypothesis 1 stated that intervention patients would ask more questions on average than control patients. There was no statistically significant difference between the groups in asking questions (Table 5⇓) as measured by (1) the percentage of patients asking 1 or more AM3 questions (26% vs 30%, P = .16); (2) the percentage of patients asking at least 1 question of any type (92% vs 92%, P = .87); (3) the mean number of AM3 questions asked (0.47 vs 0.52, P = .56); and (4) the mean number of any questions asked, including AM3 questions (6.94 vs 6.37, P = .23) and excluding AM3 questions (6.46 vs 5.86, P = .18). When study patients who ranked the lowest on the second health literacy question (ease of filling out medical forms) were compared with patients with higher rankings, their respective means were 5.4 vs 6.7 for all questions asked (P = .22) and 5.1 vs 6.2 for all non-AM3 questions asked (P = .24).
Multivariate analyses yielded similar results. Intervention patients were no more likely than control patients to ask any of the 3 AM3 questions (F1,39 = 1.18, P = .34), even after adjusting for patient age, sex, race/ethnicity, marital status, education, health literacy, and number of years with the primary care physician. Multivariate analyses also yielded similar results for number of AM3 questions asked (F1,39 = 0.11, P = . 83), and number of all questions asked including AM3 (F1,39 = 0.001, P = .82) and excluding AM3 (F1,39 = 0.01, P = .80).
Question-Asking and Adherence
Hypothesis 2 stated that intervention patients would show greater adherence to physicians’ treatment recommendations. The adherence outcomes in the intervention group were no better than those in the control group (Table 6⇓). The only comparison showing a significant difference indicated that control patients were more likely than intervention patients to accurately recall their physician’s recommending lifestyle change(s) during the visit (68% vs 59%, P = .04). These 2 patient groups did not differ with respect to attempting recommended lifestyle changes, however (92% vs 93%, P = .90).
Hypothesis 3 stated that as patient question-asking behavior increases, patients would show greater adherence to physicians’ treatment recommendations. There were no significant differences in these outcomes based on whether patients asked the AM3 questions or any questions in general (data not shown). Adjusting for potential confounders in the multivariate analyses did not change these results (all P >.05).
DISCUSSION
With data gathered from a national practice-based research network, we found no evidence that the AM3 intervention results in patients asking their physicians a greater number of questions or more specific questions. The intervention did not improve adherence to treatment as we defined it, a finding consistent with previous studies that used similar, simple communication interventions.24–26
In contrast, studies that use interventions that are more personalized (eg, requesting patients to list the questions they have before seeing the clinician) or intensive (eg, a 15-minute previsit training session with a communications specialist) tend to find significant effects on both question frequency and patients’ adherence to treatment recommendations.24,27–30
One explanation for our findings, however, is not that the AM3 intervention lacks effect but rather that a ceiling effect prevented detection of differences between the 2 groups. With more than 9 of 10 patients in the control group already asking questions even without prompting, and the vast majority filling recommended prescriptions for medications (70% for refills and >80% for new medications), it would be difficult for any intervention to improve question asking or adherence. In addition, our sample may not be the appropriate target for an intervention such as AM3, as the health literacy levels and educational attainment of both patient groups were relatively high. It is possible that AM3 might be more effective among patients who have lower health literacy skills. Our study had relatively few low-literacy individuals, and we could not demonstrate an effect for this subgroup. Although not statistically significant, the data suggested that patients scoring lower on health literacy were more likely to ask fewer questions overall during their office visits.
Another possibility is that physicians in the intervention group may have anticipated the specific AM3 questions. That is, rather than waiting for questions to be asked explicitly by patients, physicians may have “answered” these questions in advance. To examine this possibility we reviewed a random sample of 75 (17%) of the intervention visits recordings and did not find any instances in which physicians preemptively “answered” the AM3 questions.
Regardless of the reason for our findings, they are nonetheless important to consider when selecting patient communication interventions to use in clinical settings. A more specific, personalized intervention, supported by more detailed training and supplemented by coaching, may have been more effective, but also more expensive, complicated, and labor intensive.17,24,27–33 Unfortunately, this type of intervention typically is not sustainable in practice once research funding has ceased.
Alternative methods of communication, other than a question-prompting intervention, are available and may improve patients’ understanding of health information. These methods include technology-based approaches such as interactive video applications, audiotapes, electronic linkages to patient education, computerized reminders to both patients and physicians, and others.33,34 Additional research is warranted to define the effectiveness of such approaches in primary care.
Limitations
There are several limitations of this study, including the possible variation in how AM3 was implemented in practices. Even though the physicians and staff in the intervention practices participated in both centralized and telephone training, actual implementation of AM3 was the responsibility of 1 physician and 1 study coordinator per practice. Variability in how the intervention is delivered is common in effectiveness trials and mimics how AM3 would be used in clinical practice.
Self-report bias is other possible limitation. Data on patient prescription filling and taking were based on self-reports, not pharmacy records. The possibility of this bias is noteworthy because patients did not always recall visit content accurately—substantial proportions did not remember being prescribed a new medication (25%) or refill medication (23%), even when physicians’ postvisit questionnaires indicated that such prescribing had occurred. Similarly, a sizable proportion (37%) did not accurately recall their physician’s recommendations for lifestyle changes.
For both prescription ordering and lifestyle recommendations, however, we based recall accuracy on patient interview data and its agreement with the physician report. In at least some cases, physician reports of prescription ordering and behavioral recommendations—rather than patient reports—conceivably were the ones in error. We conducted follow-up interviews with 75 (25%) of the noneligible patients, that is, patients whose study physicians reported that they had not ordered either a new or refill prescription at the visit. When these patients were queried, 22 (29%) reported having received either a new or refill prescription at that visit. This finding suggests there were recall errors on the part of patients and physicians alike. Even so, there is no indication that such errors were more likely to affect 1 group compared with the other.
Another study limitation is the lack of baseline measurement on question-asking behavior among both control and intervention patients. This study gathered question-asking behavior and adherence information only after AM3 had been implemented in the intervention practices. A longitudinal design allowing for both baseline measurement and statistical controls for possible differences between intervention and control patients at baseline would have provided a more rigorous assessment of the AM3 intervention.
In addition, a Hawthorne effect may have influenced our findings. Patients in both the intervention and control groups were informed that this was a study on communication—a focus that was reinforced by the presence of a tape recorder in examination rooms. Patients may have changed how they typically communicated and asked more questions in this office visit. Blinding patients in the control group to the nature of the study, as was done in the Direct Observation of Primary Care (DOPC) study, may have helped to address this issue.34
We found that the AM3 intervention did not increase the frequency of patient question-asking either for the AM3 questions specifically or for questions generally. The AM3 intervention also did not improve patient adherence to treatment recommendations. Further study is warranted in practices with lower baseline rates of question-asking, prescription filling, and adherence to lifestyle recommendations. A longer intervention in which patients are exposed to the approach over several visits also is needed.
Acknowledgments
This research was funded by an unrestricted grant from Pfizer, Inc to the AAFP NRN via the AAFP Foundation. The funder played no role in the design or conduct of the study, or interpretation or analysis of the data. The study data are owned and controlled by the AAFP NRN. The authors acknowledge the collaboration of the medical practices, study physicians, and practice study coordinators who executed the research protocol at their locations. We thank the following clinicians for their contributions: Alber Abrahim, MD; Olga Arias-Field; Chandra Batra, MD; Allison Braud; John Bucek, MD; Donna Bush; Sharon Buskin, LPN; Cindy Carlson, RN; Penny Carter; Georgina Chan-Perdomo, MD; Elizabeth Corona; Clint Curtis, MD; Nancy Deleon; Dan Doyle, MD; Andrew Eisenberg, MD; Emil Faris, MD; John Farmer, DO; Troy Fiesinger, MD; Patricia Glowa, MD; Tom Golemon, MD; Stephanie Hardy; Michael Hartsell, MD; Tanya Hauf, RN; Meg Hayes, MD; Cindy Hendrickson, RN; Amanda Hillebrand; Jackie Hodgson, RN; Debbie Johnson; Raj Kachoria, MD, PC; Nina Katovic; Lou Kazal, MD; Scott Knutson, MD; Donald Kollisch, MD; Charles Korte, MD; Kim Krohn, MD, MPH; Carol Kuhle, DO; Stacey Langley; Joel Lazar, MD; John MacMaster, DO; Frances Mallet, RN, MSN; Evelyn Mazariegos; Elaine Meier; Connie Mitchell; Samantha Moore, LPN; Marion Mueller, RN; Eden Murad, MD; Denise Nichols, PharmD; Bernard O’Brien, PAC; Shirley Ocloo, MD; Alex Perdomo, MD; Heather Pierce, MD; Robert Pieroni, MD; Dorothy Pieroni; Marina Raikhel, MD; Michael Reis, MD; Eugene Reynolds, MD; Carol Rodgers, RN; Chris Seidler, RN; Yogesh Shah, MD; Amit Shah, MD; Lisa Soldat, MD; Elisabeth Spector, MD, MPH; James Stevermer, MD, MSPH; Linda Stewart, MD; Rick Sone, MD, MPH; Gregg Stoner, MD; Steven Stripe, MD; Feliks Syniak, PhD; Vilmary Vazquez, NCMA; Christy Ward, LPN; Chris White, MD; Marilyn Wissmiller, RN; Sonja Woods, MD; and Frances Wu, MD.
Footnotes
-
Conflicts of interest: none reported
-
Funding support: Funding for this project was made possible by a research grant from Pfizer, Inc to the AAFP Foundation.
- Received for publication September 2, 2008.
- Revision received June 30, 2009.
- Accepted for publication July 27, 2009.
- © 2010 Annals of Family Medicine, Inc.