Abstract
PURPOSE Early detection and management of unhealthy behaviors and mental health issues in primary care has the potential to prevent or ameliorate many chronic diseases and increase patients’ well-being. This study aimed to assess the feasibility and acceptability of the systematic use of a Web-based eCHAT (electronic Case-finding and Help Assessment Tool) screening patients for problematic drinking, smoking, and other drug use, gambling, exposure to abuse, anxiety, depression, anger control, and physical inactivity, and whether they want help with these issues. Patients self-administered eCHAT on an iPad in the waiting room and received summarized results, including relevant scores and interpretations, which could be by a family physician on the website and in the electronic health record (EHR) at the point of care.
METHODS We conducted a mixed method feasibility and acceptability study in 2 general practices in Auckland, New Zealand. Participants were consecutive adult patients attending the practice during a 2-week period, as well as all practice staff. Patients completed eCHAT, doctors accessed the summarized reports. Outcome measures were patients’ responses to eCHAT, and patients’ written and staff recorded interview feedback.
RESULTS Of the 233 invited patients, 196 (84%) completed eCHAT and received feedback. Domains where patients wanted immediate help were anxiety (9%), depression (7%), physical activity (6%), and smoking (5%), which was not overwhelming for physicians to address. Most patients found the iPad easy to use, and the questions easy to understand and appropriate; they did not object to questions. Feedback from 7 doctors, 2 practice managers, 4 nurses, and 5 receptionists was generally positive. Practices continue to use eCHAT regularly since the research was completed.
CONCLUSIONS eCHAT is an acceptable and feasible means of systemic screening patients for unhealthy behaviors and negative mood states and is easily integrated into the primary care electronic health record.
INTRODUCTION
Unhealthy behaviors and mental health issues are major contributors to the burden of chronic disease suffered by many primary care patients. Early detection and helping patients in self-management can assist in primary and secondary prevention.
We developed the paper-based CHAT (Case-finding and Help Assessment Tool) for systematic assessment of lifestyle risk factors (smoking, problematic drinking, other drug use, gambling, exposure to abuse, physical inactivity) and mental health issues (depression, anxiety, anger control), which we evaluated in a number of primary care and community settings,1–4 and validated against a composite reference standard.5 A key component of CHAT is the help question, which asks patients whether they would like help, either during this visit or at a later date. This patient-centered approach facilitates shared decision making and self-management. We have shown that the help question significantly improves the specificity of the test.6–8
We subsequently developed an electronic version (eCHAT) to be used on a touch screen computer kiosk in the waiting room of a family practice. During a feasibility and acceptability study, most patients found the touch screen easy to use and the eCHAT questions clearly phrased and easy to understand, and that there were minimal objections to the questions being asked and minimal concerns about privacy with the process.9 This version was integrated directly into 1 of the 4 main electronic health records (EHRs) used by New Zealand family physicians; however, we decided a Web-based version would be more flexible.
The current eCHAT is self-administered on a tablet computer (eg, an iPad) in the waiting room, and the summarized results, including relevant scores and interpretations, where available, can be accessed by the family physician on the website and then downloaded into the EHR at the point-of-care. The clinicians have the choice or reading the summarized reports off the web-site, cutting and pasting these into the clinical notes, or clicking a button to load results into the EHR, entered in the screening and diagnosis fields. A red alert is provided if the patient’s responses are positive for self-harm.
The digital nature of eCHAT allows for additional tools to be completed where relevant. If patients respond positively to the smoking, drinking, or other drug questions, they are administered the relevant World Health Organization Alcohol, Smoking and Substance Involvement Screening Test (ASSIST),10 and their responses scored and interpreted and provided in the clinician’s summary. Similarly, positive answers to the depression and anxiety questions trigger the Patient Health Questionnaire for Depression (PHQ-9)11 and the Generalized Anxiety Disorder Assessment (GAD-7),12 respectively. The help question is asked after positive responses in any of the 9 domains. The CHAT is available as an online Supplemental Appendix in the Annals of Family Medicine (http://www.annfammed.org/content/suppl/2009/05/07/7.3.239.DC1/Goodyear-Smith_Supp_App.pdf) and the added tools (ASSIST, PHQ-9 and GAD-7) are in the public domain.
There is support in North America for such a tool. A recent US study identified support by stakeholders, including primary health care clinicians and patients of patient-reported data reflecting health behaviors and psychosocial issues being included in the EHR.13 Krist el al identify that information about health behaviors could be one of the most appropriate types of information provided by patients through a patient-centered personal health record portal.14 A study of standardized, brief practical health behavior (diet, physical activity, smoking, alcohol consumption) measures used across 7 practice-based research networks found modest improvements after intervention but concluded variations in implementation and instrumentation performance needed attention, which eCHAT would address.15
Primary care is the arena for improving population health. Barbara Starfield made the case that family physicians must be in the forefront of health care reform.16 She identified that primary health care needs to be accessible, person-focused over time, comprehensive, and coordinated.17 This approach is in line with the development of the patient-centered medical home, defined as “an approach to providing comprehensive primary care...that facilitates partnerships between individual patients and their personal providers and, when appropriate, the patient’s family.”18–20 The 2010 Patient Protection and Affordable Care Act seeks to strengthen the primary care foundation in the United States through the use of innovative delivery models, such as the patient-centered medical home,21 based on the following principles:
-
Patients having an on-going relationship with a personal physician trained to provide first-contact, continuous and comprehensive care
-
A physician-led practice team approach; a whole person orientation with the personal physician responsible for providing for all the patient’s health care needs or arranging appropriate care with other professionals
-
Coordinated and/or integrated care across specialists, hospitals, and community agencies
-
Quality and safety assurance by a care planning process, evidence-based medicine, clinical decision-support tools, performance measurement, active participation of patients in decision making, information technology, quality improvement activities, and other measures
-
Enhanced access to care, such as new options for patient-clinician communication
eCHAT facilitates development of the patient-centered medical home. Because information is collected, analyzed automatically, and transferred seamlessly to EHR in real time to be accessed by the clinician, it is an efficient and cost-effective way of assessing some of patients’ major lifestyle health risks. The time needed to identify problematic lifestyle behaviors and mental health issues is reduced, because eCHAT can be self-administered in the waiting room before the visit. It further minimizes the chance of missing opportunities to provide early health care. eCHAT puts the patient, not the disease, in the center with a whole-person orientation. The questions on the eCHAT application greatly enhance the potential for clinicians to accurately identify patients’ needs around such sensitive mental health issues as depression, domestic violence, and alcohol or illicit drug use.
Our aim for this study was to assess the feasibility of the systematic use of the Web-based eCHAT self-administered by patients in the waiting room, with summarized results accessed by family physicians during the ensuing visit, and to gauge the acceptability of this tool by patients, physicians, and other practice staff.
METHODS
Our study setting was 2 family practices in Auckland, New Zealand, between November 2011 and February 2012. Neither of the 2 practices had previously participated in CHAT or eCHAT research. They were selected because one had a particular interest in mental health issues and a patient profile of a relatively high socioeconomic status, and the other was in a relatively deprived neighborhood with a large number of patients who had substance misuse issues. In both practices over a 2- to 3-week period, the research assistant approached consecutive adult patients (aged 16 years and older) in the waiting room and invited them to participate in the study. Exclusion criteria included inability to communicate in English, impaired mental status (such as dementia) to the extent that they could not meaningfully participate, and previous recruitment in the study. Consenting patients self-administered the eCHAT on an iPad. During their consultation, their family physician had access to their responses and relevant scores, using the eCHAT Web-based report followed by the option to download outcomes into the EHR.
Although the demographic characteristics of individual patients were not collected, the practices differed with respect to socioeconomic status, and enrollment by consecutive patients is likely to have meant that they represented the overall demographic of the practice population.
We used a multistrand mixed method (quantitative and qualitative) study design. We collated anonymized eCHAT responses from recruited patients extracted from the eCHAT database on the website. After the consultation, the patient completed a feedback form with both quantitative (yes /no) and free-text responses (see the Supplemental Appendix at http://annfammed.org/content/11/5/460/suppl/DC1 for questions). At the end of patient data collection from each practice, the research assistant invited all staff to participate in face-to-face, audio-recorded semistructured interviews, which were then transcribed.
We analyzed quantitative data using descriptive statistics. Two researchers read and re-read qualitative data to identify themes, which they then independently coded; the few discrepancies were resolved through adjudication.
Ethical approval was obtained from the Auckland Northern Y Regional Ethics Committee (reference NTY/11/10/102). Subsequent to the study phase both practices continue to implement eCHAT screening with their patients.
RESULTS
In total, 233 patients were invited to participate (practice A = 127; practice B = 106) of whom 211 consented, for a 91% response rate, and 196 patients both completed the eCHAT and provided feedback on the tool (84% of the invited sample) (Table 1). Attrition was due mainly to time constraints, with the research assistant unable to collect the feedback from every patient immediately after their visit with their doctor. Reasons that 22 patients declined to participate are shown in Table 1.
The responses patients gave to eCHAT are recorded in Table 2. The top domains where patients wanted immediate help were anxiety (9%), depression (7%), physical activity (6%). and smoking (5%), which their doctors did not find overwhelming. No patient wanted help during the consultation with more than one issue.
Most patients found eCHAT easy to use and did not object to the questions (Table 3). Themes derived from their qualitative responses are presented in Table 4. Although the majority were very positive about their eCHAT experience, a couple of patients expressed concerns about the security of Web-based data or the implications should their insurance company request this information. There was no significant difference (Fisher’s exact 0.09), however, when comparing the number of positive eCHAT domains in the total participant group and those who did not answer the privacy question with those who had privacy concerns (Table 5).
Practice A staff consisted of 4 family physicians, 2 nurses, 3 receptionists, and 1 practice manager. Practice B had 3 family physicians, 1 practice manager, and 2 nurses who also served as receptionists. Table 6 records the major emerging themes with examples from the 16 audio-recorded and transcribed staff interviews. In general, staff found the tool to be simple, quick, and easy to use; they liked the way their patients were screened; they valued the way it facilitated patient engagement; and they appreciated the way it integrated with the EHR at the point of care. A concern about insurance companies having access to eCHAT reports was raised by 1 doctor who chose not to download the results into the EHR for this reason. Although some staff believed it saved them time, others saw that it could lead to an extended consultation on occasion in the short-term, but in the longer term it was an efficient way of finding out and addressing patient needs. All 7 family physicians agreed that eCHAT could contribute to patient understanding in relation to their risky health behaviors or mental health issues through various interventions and self-management.
DISCUSSION
eCHAT was found to be an acceptable method of implementing systematic lifestyle and mental health screening in patients to general practice. With a more than 90% response rate, eCHAT screening is an effective means of identifying, managing, and documenting these issues. The help question further empowers patients to control the direction of their consultation. Evidence indicates that when a patient identifies an issue as a problem, it is more likely to be solved than when it is identified by their health care clinician.22,23
eCHAT screening offers an opportunity to improve documentation of lifestyle and mental health issues. For instance, it was found previously that New Zealand general practice EHRs had smoking status recorded for less than 50% of adults,24 a rate can be improved through routine use of eCHAT. Interoperability of eCHAT with the EHR also allows for improved clinical coding, whereas without such a system many of the eCHAT areas, even if addressed, would be likely to be recorded only as free-text notes.
The potential for improved coding, however, has not gone unnoticed by patients and staff, both of whom raised concerns with respect to future access to the information, particularly by insurance companies. The concerns parallel issues arising with the increasing documentation of genomic data and how this recording in the clinical notes may affect patients’ future equity of health care access.25,26 Such concerns may be difficult to alleviate: in the United States, where 17 months after introduction of the Genetic Information Nondiscrimination Act of 2008 (GINA) it was found that physicians were only patchily aware of its protections, and awareness did not alleviate physician concerns regarding the risk of genetic discrimination.27 The collection, however, of lifestyle and mental health data that is worrying some patients and staff is already an issue intrinsic in the EHR; the systematic approach using eCHAT only brings this latent issue into sharper focus.
Although patients expressing negative feedback and concerns were in the minority, there were a few criticisms of the scope and form of questions, particularly in how such questions as physical activity offered “no grey areas.”
Since the research phase, both practices have continued to use eCHAT at a relatively constant rate as part of routine practice during the past year. They are provided with regular feedback about their eCHAT usage. A regular e-mailed activity report logs how many they have conducted each week. One practice is using eCHAT on every adult patient and has averaged 13 per week over 40 weeks. The other practice uses eCHAT on selected patients (for example, all new patients, pregnant, not seen for 1 year, history of chronic illness, mental illness, or substance misuse) and has averaged 7 per week over 46 weeks.
Strengths and Limitations
Strengths of this study include the high response rate of patients agreeing to participate and feedback data obtained from 196 patients. A limitation is that, because of time constraints, not all consecutive patients who walked into the waiting room were able to be asked to participate in the study by the research assistant. As a result, our selection process was not a systematic way of recruiting patients, which could mean there is some bias in the data. Further, the eCHAT was piloted in 2 volunteer practices, which might not necessarily represent the range either of staffing arrangements, work flows, cultures, and technical configurations or of enthusiasm for such an innovation.
Comparison With Our Previous Study
We conducted a previous, smaller feasibility and acceptability study of a touch-screen (pre-iPad) computer-based eCHAT.9 In this current study, we had a larger number of participants with completed feedback forms (196 compared with 50). Results from the 2 studies are similar in that most patients found the iPad or touch-screen computer easy to use and the questions clearly phrased, and they had minimal objection to the questions or concerns about privacy. Our touch-screen study had a higher rate of patients declining to participate (26%), whereas in this iPad study only 9% of patients did not want to complete the eCHAT. The ease of use of the iPad, its increased privacy due to its portability, and the novelty factor may be contributing factors to the lower decline rate.
Implications
From this study we have determined that the eCHAT can be easily incorporated into the family practice environment, as most patients, physicians, and other practice staff find it acceptable for use in this setting, and it is easily integrated into the EHR. The eCHAT is therefore an acceptable tool for systemic finding of cases of unhealthy behaviors and negative mood states in primary care.
Future Developments
Electronic links to stepped-care decision support is now being implemented. This provides for each domain a suite of self-management options (information sheets, help lines, URLs including eTherapies), physician-initiated treatments (brief interventions and medications), referral to community-based agencies, and finally to secondary services. Where patients can access their own EHR and complete eCHAT prior to presenting for their appointment, they will be able to access self-help and support options themselves and only consult their physician when they require a step-up in intervention.
The question remains as to whether systematic case-finding using eCHAT will lead to improved health outcomes. We propose conducting a clustered randomized trial to determine the effectiveness and cost-effectiveness of systematically detecting and assisting patients to address the 9 eCHAT domains.
Acknowledgments
We would like to thank the patients and practice staff who contributed to this study.
Footnotes
-
Conflicts of interest: authors report none.
-
Prior presentations: Poster presentation, North American Primary Care Research Group annual meeting, 2012.
-
Funding support: Funding for summer studentship provided by the Royal New Zealand College of General Practitioners and the University of Auckland.
- Received for publication August 27, 2012.
- Revision received November 13, 2012.
- Accepted for publication December 27, 2012.
- © 2013 Annals of Family Medicine, Inc.