|
|
||||||||
1 Department of Family Medicine, College of Human Medicine, Michigan State University, East Lansing, Mich
2 Department of Statistics and Probability, Michigan State University, East Lansing, Mich
3 Center for Health Care Quality and Evaluation Studies, Blue Cross Blue Shield of Michigan, Detroit, Mich
CORRESPONDING AUTHOR: William C. Wadland, MD, MS Department of Family Medicine College of Human Medicine B-106 Clinical Center East Lansing, Michigan 48824-1313 wadland{at}msu.edu
| ABSTRACT |
|---|
|
|
|---|
METHODS We conducted a group-randomized clinical trial comparing the impact of 6 quarterly (18 months) feedback reports (intervention) with that of general reminders (control) on practice-based clinician referrals to a quit-line service. Feedback reports were based on an Achievable Benchmark of Care approach using baseline practice, clinician, and patient survey responses, and referrals per quarter. Comparable quit responses and costs were estimated.
RESULTS Three hundred eight clinicians participated (171 family medicine, 88 internal medicine, 49 obstetrics-gynecology) from 87 primary care practices in Michigan. After 18 months, there were more referrals from the intervention than from the control practices (484 vs 220; P <.001). Practice facsimile (fax) referrals (84%, n = 595) exceeded telephone referrals (16%, n = 109), but telephone referrals resulted in greater likelihood of enrollment (77% telephone vs 44% fax, P <.001). The estimated number of smokers who quit based on the level of services utilized by referred smokers was 66 in the feedback and 36 in the gentle reminder practices.
CONCLUSION Providing comparative feedback on clinician referrals to a quit-line service had a modest impact with limited increased costs.
Key Words: Feedback directive counseling/telephone referral and consultation smoking cessation
| INTRODUCTION |
|---|
|
|
|---|
Feedback on clinical performance has been studied in numerous randomized clinical trials and reported in systematic reviews to have modest effects.13 Comparing personal performance with peer performance should be a powerful motivator to change behavior.1417 Keife et al18 reported improved preventive care for diabetic patients by providing clinicians feedback based on Achievable Benchmarks of Care (ABC). The ABC approach identifies the performance of the top 10% of clinicians as the benchmark.18 Achievable benchmarks that were based on actual performance seemed more realistic to clinicians than preset standards, and they resulted in improved care.18
We found 9 studies that involved feedback on physician performance in smoking cessation.1826 All studies used chart audit to provide feedback, and none reported direct observation of practice. One based feedback on encounter and pharmacy claims.26 The Task Force on Community Preventive Services,27 after reviewing a few studies, reported insufficient evidence to conclude that feedback on smoking cessation increases clinician advice to quit smoking or patient tobacco cessation. No reported studies have based feedback on achievable benchmarks for clinician performance in smoking cessation. Business models of feedback to employees stress that the most effective feedback should be clear, specific to the expected performance, reliable, comparable with peer performance, and repeated over time.28 We developed ABC feedback based on actual clinician performance in making quit-line referrals. We assessed the impact of comparative feedback or general reminders on practice-based referrals to a tobacco cessation quit line and estimated the costs for the projected quit responses.
| METHODS |
|---|
|
|
|---|
The quit-line services for this study were provided by Blue Cross Blue Shield of Michigan (BSBEM), which serves nearly 5 million enrollees in Michigan. The BCBSM Quit the Nic Quit Line is a 24-hour service for smoking cessation counseling and relapse prevention support provided by trained nurses using computer counseling software. Smokers are offered 2 levels of service. Level 1 requires participants to set a quit date in the next 14 days and includes an enrollment intake session (lasting 45 minutes with motivational support to set a quit date and prevent relapse), a mailed quit kit, and 6 proactive telephone sessions at intervals of 1, 3, 7, 14, 30, and 60 days after the quit date, with follow-up at 90, 180, and 360 days after the quit date.7 Level 2 includes a brief intake session (lasting 10 minutes), a mailed quit kit, and several callbacks inviting them into level-1 service. All participants are advised to use pharmacotherapy to assist with withdrawal symptoms if recommended by their physician. The Quit Line service reports long-term success rates of 25% to 30% for level-1 enrollees, a finding consistent with other reports.7,911 The Quit Line service agreed to provide counseling services to all referred smokers from study participants regardless of their health plan.
Interventions
ABC feedback was based on a method developed by Keife and colleagues18 and was determined to be the mean number of referrals per quarter for the top 10% of the clinicians. The benchmark calculation for individual clinician referrals was based on an estimate of smoker visits per quarter calculated to account specifically for each clinicians unique baseline characteristics, including half-days worked per week, adult patients per clinic, and smoking prevalence within the clinic population. A baseline quarter (October 2002 to December 2002) was used to set the benchmark for the first quarter (beginning January 1, 2003) of the comparative feedback intervention. Clinicians received either a mailed comparative feedback report or a general reminder about Quit Line services each quarter for 6 quarters. The benchmark referrals were reset after each quarter based on the clinicians performance during the previous quarter.
The comparative feedback report (Figure 1
) was a 1-page report showing 2 graphs. The first graph displayed the quarter benchmark for referrals, the individual clinician, his or her practice group, and the performance of the study group in numbers of referrals and percentage relative to the benchmark. The second graph showed the actual number of referrals made by the individual clinician per quarter.
|
During the baseline quarter before the feedback intervention, all 308 participating clinicians received a mailed compact disk (developed by W.C.W. and J.S.H.) that included an overview of the clinical practice guidelines on smoking cessation, case examples, and Quit Line referral information. Clinicians who completed a posttest questionnaire (n = 53, 17%) received 2 hours of CME credit, a response rate that was consistent for both intervention and control groups.
Recruitment and Participants
Because the study was a collaboration between Michigan State University and the health plan Quit Line service, all participating clinicians and practices accepted patients covered by the plan. From March to July 2002, we recruited primary care clinicians (in family medicine, internal medicine, and obstetrics-gynecology) from a health plan list of 3,777 primary care practices. Only 858 practices seemed to fit the definition for usual primary care. Of these 858 practices, 102 agreed to participate during telephone recruitment, and completed baseline survey forms were received from 87 (85.3%); 308 of 371 clinicians (83%) within the 87 practices completed baseline survey forms.
Practice directors completed a prestudy survey form assessing practice characteristics (Table 1
). Clinicians completed a prestudy survey form assessing their characteristics (Table 2
), including the number of half-days worked and adult patients seen in each practice.
|
|
Baseline exit surveys of patients were conducted in each practice before the study for 2 half-days in which most clinicians were in the practice. Research assistants approached all patients (aged 18 years and older) as they exited from their visit. A brief (5-minute), 1-page questionnaire assessed clinicians use of the 5 As (ask, advise, assess, assist, arrange) during the visit; age; sex; insurance status; race/ethnicity; smoking status; and, if a current smoker, number of cigarettes smoked per day and readiness to quit. The questionnaire was pilot tested in nonstudy clinics, and questions were adapted from previously developed exit surveys of smoking cessation.29,30
Of the 3,686 eligible patients, 3,239 (87.9%) were approached for inclusion; 1,992 patients completed the questionnaire (54% of all eligible and 61.5% of all approached). Illness and lack of time were main reasons for not completing the questionnaire. Nineteen (19%) of surveyed patients were current smokers (n = 371). The percentages of clinician asking, advising, assessing, assisting, and arranging follow-up were 58%, 42%, 34%, 22%, and 8%, respectively. There were no significant differences in prevalence of smoking or delivering of the 5 As between intervention and control practices at baseline.
All referrals to the Quit Line by study clinicians were identified by the Quit Line staff and categorized based on clinician; practice; level of service utilizedlevel 0 (clinician advice alone, no Quit Line intake), level 1 (enrolled in Quit Line), and level 2 (intake, information only); and type of referralfacsimile (fax) or telephone.
The study design, questionnaires, and survey forms were all approved by the Michigan State University Institutional Review Board and 25 local boards.
We estimated 12-month quit responses based on the number of referrals in each group and the level of service obtained. We estimated the quit responses based on the expected quit responses reported in the literature for the various levels of service and on the previous results reported by the services for level 1 (enrollment and Quit Line use with usual quit rate of 25%), level 2 (brief intake and information only with usual quit rate of 15%), and level 0 (no intake and clinician advice alone with usual quit rate of 10%).7,11,29,3133
Measures and Outcomes
Key measures and outcomes included (1) changes from baseline to postintervention (18 months) in clinician referrals in both intervention and control groups, (2) estimated quit responses of referred smokers, and (3) estimated incremental costs of the feedback intervention.
Analyses
Data were pooled and maintained by the health plan data manager and transferred to Michigan State University for evaluation and statistical analysis. We determined baseline differences between practice, clinician, and patient characteristics using
2 tests and t tests, as appropriate. The Mantel-Haenszel
2 test for repeated measures was used to assess the difference in the primary measure (number of referrals) between the intervention and control groups, over time, which was the main unit of analysis. The study had the power to detect a 25% difference, which required nearly 80 practices and 300 clinicians. Intraclass correlation (ICC) was calculated (see the online-only Supplemental Appendix, which can be found at http://www.annfammed.org/cgi/content/full/5/2/135/DC1). All analyses were conducted using SAS statistical software, version 9.1 (SAS Institute Inc, Cary, NC).
Resource costs were used to calculate the costs of services in both groups. The mean annual salary and benefit cost were used for nurse ($54,600), analyst ($72,602), clerk ($26,000), and statistician ($103,125) staff. These costs were applied to 173 hours of the nurses time for receiving and processing telephone and fax referrals and to 236 hours of administrative staff time to develop and send the feedback reports as well as other program-related tasks. Actual supply costs were also used for printing and mailing feedback reports, letters, quit kits, and smoking cessation program materials. Costs were categorized as fixed or variable, an important difference in that the latter costs are incurred and change with intervention volumes. Because the Quit Line program was already purchased, available, and staffed, its cost represented a fixed cost. Increased use of the program associated with the interventions did not result in an incremental marginal cost increase relative to the control group, although in the long run, more volume can be expected to generate higher mean costs.
| RESULTS |
|---|
|
|
|---|
|
More estimated quits (Table 3
) occurred in the intervention practices than in the control practices (66 vs 36 quits).
|
|
|
| DISCUSSION |
|---|
|
|
|---|
It has been reported that less than 5% of smokers will accept referrals to receive special smoking cessation services such as group counseling.1,34 Although we detected a significant difference in referrals between our intervention and control groups, 704 referrals from more than 300 clinicians during 18 months is a very small response even when a low percentage of smokers generally agree to be referred. Estimating that 10% to 20% of smokers in primary care practice are usually willing to quit, there were potentially 2,200 to 4,500 referrals per quarter. The practices and clinicians were representative of primary care practice across Michigan and had performances on the 5 As guidelines that were consistent with other reports.24
Even though the number of fax referrals was greater than telephone referrals, the probability of enrollment was greater for telephone referrals, which may be explained by the level of self-motivation of smokers who telephone on their own initiative. Some clinicians may have referred smokers by fax to insure their feedback credit.
There are several limitations to this study. A high intraclass correlation and lack of statistical power did not permit analysis of individual clinician or practice differences. The exit surveys assessed only 2 half-days per practice and may not accurately reflect longitudinal changes for individual clinicians, but they are valid for the entire group. We estimated the number of quits based on the reported experience of the Quit Line, which uses self-reports.3537 Smoker visits per quarter were estimated from baseline surveys only.
We interviewed by telephone 28 of the top-referring clinicians (top 10%) in this study. They consistently reported having a method (usually by staff) to identify all smoking patients, offered referrals to all interested smokers, and appreciated having 1 telephone counseling service. Primary care offices should consider having clinical staff identify tobacco use, offer advice to quit, and initiate referrals,37 which is consistent with the new Ask and Act initiative of the AAFP (American Academy of Family Physicians).38 Electronic medical records could also be used to incorporate easy documentation of the 5 As, offer simple cueing supports for clinicians, and tailor pharmacotherapies and referral services based on individual patient health care coverage.39 Clinicians may also be more motivated to refer smokers for services if they receive information on the outcomes of their patients. Quit lines and health plans should provide reports to clinicians on referred smokers. In fact, the staff-model managed care plan within this study has decided to provide ongoing reports on referred smokers based on our findings.
In conclusion, providing simple, clear, and comparable feedback on referrals to a quit-line service had a modest impact on the referral performance of clinicians and may require a major integration of practice and system supports to become truly effective.
| ACKNOWLEDGMENTS |
|---|
| FOOTNOTES |
|---|
Funding support: Addressing Tobacco in Managed Care, Robert Wood Johnson Foundation, grant No. 43968. Department of Family Medicine support for CD-ROM, audiotapes "Enhancing Smoking Cessation in Your Medical Practice," and data analysis.
Received for publication February 2, 2006. Revision received September 11, 2006. Accepted for publication September 27, 2006.
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
K. C. Stange On TRACK: Primary Care Opportunities for Filling Unmet Need Ann. Fam. Med, May 1, 2007; 5(3): 270 - 272. [Full Text] [PDF] |
||||
![]() |
K. C. Stange and W. R. Phillips In This Issue: Real Change Is Real Hard in the Real World Ann. Fam. Med, March 1, 2007; 5(2): 98 - 100. [Full Text] [PDF] |
||||
Read all TRACK Comments
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |