Translation of an Efficacious Cancer-Screening Intervention to Women Enrolled in a Medicaid Managed Care Organization
=====================================================================================================================

* Allen J. Dietrich
* Jonathan N. Tobin
* Andrea Cassells
* Christina M. Robinson
* Meredith Reh
* Karen A. Romero
* Ann Barry Flood
* Michael L. Beach

## Abstract

**PURPOSE** An earlier randomized controlled trial of prevention care management (PCM) found significant improvement in breast, cervical, and colorectal cancer-screening rates among women attending Community Health Centers but required substantial research support. This study evaluated the impact of a streamlined PCM delivered through a Medicaid managed care organization (MMCO), an infrastructure with the potential to sustain this program for the long term.

**METHODS** This randomized trial was conducted within an MMCO serving New York City between May 2005 and December 2005. A total of 1,316 women aged 40 to 69 years and not up to date for at least 1 targeted cancer-screening test were randomized to either PCM or a comparison group. Women in the PCM group received up to 3 scripted telephone calls to identify barriers and provide support to obtain any needed breast, cervical, and colorectal cancer-screening tests. Women in the comparison group received a modified version of the MMCO’s established mammography telephone outreach program, also in up to 3 calls. Women in both groups received a financial incentive on confirmation that they had received a mammogram. Screening status was assessed through MMCO administrative data. Groups were compared using odds ratios.

**RESULTS** In an intent-to-treat comparison adjusted for baseline screening status, PCM women were 1.69 times more likely to be up-to-date for colorectal cancer-screening tests at follow-up than women in the comparison group (95% confidence interval, 1.03–2.77). Follow-up screening rates for cervical and breast cancer did not differ significantly between study groups on an intent-to-treat basis.

**CONCLUSIONS** The abbreviated PCM telephone intervention was feasible to deliver through an MMCO and improved screening for 1 cancer. This approach has the potential to improve cancer-screening rates significantly in settings that can provide telephone support to women known to be overdue.

*   Breast neoplasms/ethnology/prevention & control
*   colorectal neoplasms/ethnology/prevention & control
*   uterine cervical neoplasms/ethnology/prevention & control
*   telephone
*   managed care programs
*   poverty
*   New York City
*   intervention studies
*   Medicaid

## INTRODUCTION

Lower cancer-screening rates among low-income and minority women may contribute to more late-stage diagnoses and higher rates of cancer mortality.1–6 Although socioeconomic variables such as income and education may explain much of the disparity in cancer screening observed between racial and ethnic groups,2,7,8 disparities nonetheless remain. Recent surveys in New York City found that Hispanics and African Americans were less likely to be screened for colorectal cancer than whites,9,10 and cancer mortality rates were 1.3 times higher among residents living in low-income areas than among their counterparts in higher-income areas.11

A previously reported randomized controlled trial of a prevention care management (PCM) intervention found an improvement in cancer-screening status with the intervention among women receiving health care from participating federally funded Community Health Centers.12 PCM is a telephone-based intervention delivered by trained staff to women who were not up-to-date for breast, cervical, or colorectal cancer screening, to help them overcome barriers to receiving needed tests. The intervention significantly increased screening rates for all 3 types of cancer12 among this primarily low-income and minority population.13 The earlier trial, however, required labor-intensive reviews of patient medical records and used research staff to recruit women from Community Health Center waiting rooms and to provide care management support. Through a National Cancer Institute dissemination supplement, we conducted a practical clinical trial14,15 to evaluate the impact of a less resource-intensive modification of PCM implemented through a potentially sustainable resource—the quality improvement infrastructure of a Medicaid managed care organization (MMCO).

MMCOs have several strengths for translational work of this type. Their billing and administrative databases contain cancer-screening information that can efficiently identify patients needing services and evaluate whether services are subsequently obtained. Claims-based screening data can be more accurate than both medical records16,17 and patient self-report.18 In addition, many MMCOs use sophisticated customer relations management software and have experienced staff who can provide telephone outreach to members, an essential component of the PCM intervention.

Interventions have increased cancer-screening rates in Community Health Centers over the short term,19 but these improved rates diminished substantially with time after the end of research support.20 Health care professionals and Community Health Center staff alike face an intimidating array of competing demands in their delivery of patient care,21 demands that can take on more urgency than preventive care. An intervention that could be integrated within an MMCO’s existing outreach activities could lead to sustainable improvements in cancer-screening rates. To that end, we conducted a study of the PCM intervention modified to be compatible with the existing clinical outreach program of one MMCO and used administrative data to evaluate the impact on breast, cervical, and colorectal cancer-screening rates among enrolled women.

## METHODS

### Settings

Dartmouth Medical School, Affinity Health Plan (the MMCO), and Clinical Directors Network22 collaborated on this project. Affinity was founded in 1986 as an independent, not-for-profit managed care company dedicated to serving the needs of low- and moderate-income populations in and around New York City. Clinical Directors Network, a practice-based research network in New York City, served as the intermediary organization during this dissemination project, recruiting Affinity Health Plan and participating Community Health Centers, and training Affinity staff. Six Community Health Centers with a sufficient number of potentially eligible Affinity enrollees and previous research experience were selected to participate.

The project was reviewed by Dartmouth’s Committee for the Protection of Human Subjects, the institutional review boards of both Montefiore Medical Center and Clinical Directors Network, Albert Einstein College of Medicine’s Committee on Clinical Investigations, and Affinity’s Research Board. Because all patient contact took place within the framework of Affinity’s Quality Improvement programs, and Dartmouth and Clinical Directors Network received only deidentified patient data, the respective institutional review boards did not require informed consent.

### Participants

Eligible women, identified through Affinity’s administrative database, were aged 40 to 69 years, received care at 1 of 6 participating Community Health Centers, had been enrolled with Affinity for at least 12 months, and were overdue for at least 1 of the targeted cancer-screening tests.

Definitions of up-to-date status were derived from US Preventive Services Task Force guidelines23–25 and matched Health Plan Employer Data and Information Set (HEDIS) breast and cervical cancer-screening guidelines used to assess the quality of MMCOs.26 Up-to-date screening status for breast cancer required mammography within 2 years; for cervical cancer, a Papanicolaou test within 3 years; and for colorectal cancer (limited to women aged 50 years and older), home fecal occult blood testing within the past year, sigmoidoscopy or double-contrast barium enema within 5 years, or colonoscopy within 10 years. We were not able to distinguish between screening and diagnostic tests in the administrative data.

### Design

Eligible women were stratified by Community Health Center and then by age decade, then randomized to receive the PCM intervention or Affinity’s Mammography Outreach Program (AMOP), both of which are described below. Women could decline to participate in either program without compromising their health care or insurance.

### Interventions

Figure 1⇓ summarizes the similarities and differences between the AMOP and PCM interventions. At the start of this project, Affinity had an ongoing outreach program in place to promote breast cancer screening. In this program, a trained bilingual outreach specialist completed up to 3 telephone calls with women. During the first call, she described the program, encouraged participation, and if the woman agreed, scheduled a mammography appointment. During the second call, the outreach specialist reminded the patient of her upcoming mammography appointment, and during the third call, she verified that the patient had received a mammogram. On confirmation that a mammogram had been received, the patient was given a $25 gift certificate.

![Figure 1.](http://www.annfammed.org/https://www.annfammed.org/content/annalsfm/5/4/320/F1.medium.gif)

[Figure 1.](http://www.annfammed.org/content/5/4/320/F1)

Figure 1.  
**Relationship of the randomized trial study groups to the established program.**

#### AMOP Intervention

During the current study, the comparison group received this established program with 2 modest additions: (1) a mailed brochure providing educational information on breast, cervical, and colorectal cancer screening, and (2) a brief recommendation during the first telephone call to discuss colorectal and cervical cancer screening with their health care professional. We subsequently refer to this comparison group as the AMOP group.

#### PCM Intervention

Women assigned to the PCM intervention received Affinity’s Clinical Outreach Program with important enhancements. First, the content of the calls was expanded to include a detailed assessment of barriers to cancer screening. Here, women who were not up-to-date for any of the 3 screening tests were asked about specific barriers that had prevented them from being screened. These barrier assessments were informed by interviews conducted during the prior PCM trial.27 Second, scripted support was provided to help overcome any barriers. In addition to patient education, this support could include help scheduling primary care and screening appointments for needed tests, and reminders about upcoming appointments. MMCO outreach staff received 6 hours of training in providing PCM. Colorectal cancer-screening support was provided only to women aged 50 years and older. As with the AMOP group, all PCM women who completed a mammogram received a $25 gift certificate, but no separate financial incentive was provided to women who became up-to-date on cervical or colorectal cancer-screening tests.

It should be noted that the PCM intervention as delivered in this study was modified in 3 important ways from that in the original study.12 First, telephone support was provided in no more than 3 calls. In the earlier study, there was no restriction on the number of contacts between care managers and women. Second, calls were provided within a shorter time frame, no more than 8 months, rather than 18 months in the earlier study. Third, initial attempts to contact women were limited to 3 tries, whereas up to 8 tries were made in the earlier project.

#### Both Interventions

In both groups, Spanish-speaking patients received telephone support and educational materials in Spanish. Three outreach staff made calls to women in this study; 2 called both AMOP and PCM patients, and 1 called only AMOP patients.

### Evaluation

We used administrative data to evaluate the impact of the intervention. Up-to-date status of women was assessed twice using Current Procedural Terminology and other administrative codes indicative of the screening service: on May 1, 2005, for baseline measures and on March 31, 2006, for follow-up, allowing 3 months for data to enter the administrative system after the intervention.

### Analysis

The main intent-to-treat analysis included all randomized women regardless of whether a successful contact was made; the subgroup analysis included only randomized women who were contacted at least once, were still insured by Affinity and receiving care at the participating Community Health Center, and were willing to participate. Affinity provided deidentified data to the Dartmouth statistician, who compared up-to-date rates between groups at baseline and follow-up for the 3 cancer-screening tests using odds ratios. We calculated odds ratios and 95% confidence intervals (CIs), using a *P* value of less than or equal to .05 to indicate statistical significance. We used logistic regression models for breast and cervical cancer screening to adjust for age (40 to 49 years, 50 years and older) and baseline screening status. Because colorectal screening analysis was limited to women aged 50 years or older, logistic regression models for this screening were used to adjust only for baseline screening status. STATA (Stata Corp, College Station, Texas)28 was used for data analysis.

## RESULTS

Affinity identified 1,316 eligible women at the 6 Community Health Centers. Their mean age was about 50 years; slightly more than one-half of the women were aged 40 to 49 years (Table 1⇓). Of the approximately 60% of women with a primary language documented in administrative data, about 83% spoke English and 15% spoke Spanish. Eligibility required women to be enrolled with Affinity for at least 1 year; most had been enrolled for 3 years or less, whereas about one-third had been enrolled for 5 years or more.

View this table:
[Table 1.](http://www.annfammed.org/content/5/4/320/T1)

Table 1.  
**Baseline Characteristics of Women by Study Group**

Similar proportions of both study groups were successfully contacted and received the intervention to which they had been assigned (Figure 2⇓). Some 40.4% of PCM women (268 of 663) and 41.5% of AMOP women (271 of 653) received telephone support. Of these women, 197 (73.5%) in the PCM group received only 1 call, whereas 71 (26.5%) received 2 or 3 calls; 246 (90.8%) in the AMOP group received 1 call, and 25 (9.2%) received 2 or 3 calls.

![Figure 2.](http://www.annfammed.org/https://www.annfammed.org/content/annalsfm/5/4/320/F2.medium.gif)

[Figure 2.](http://www.annfammed.org/content/5/4/320/F2)

Figure 2.  
**Flow of participants through randomization and treatment.**

* Dropouts include women who, by the time of their initial call, (1) were no longer insured by Affinity, (2) were no longer receiving care at a participating Community Health Center, or (3) declined telephone support.

Table 2⇓ shows changes in screening up-to-date status for the 3 cancers on an intent-to-treat basis, that is, regardless of whether a woman was successfully reached by telephone. In both unadjusted and adjusted comparisons, PCM women were more likely to be up-to-date for colorectal cancer screening after the intervention than AMOP women, with an odds ratio adjusted for baseline status of 1.69 (95% CI, 1.03–2.77; *P* = .04). Follow-up rates for breast and cervical cancer screenings were not significantly different between the 2 groups in the intent-to-treat analysis. The findings were similar when women who were up-to-date on a given screening at baseline were excluded from analysis (Supplemental Table 1⇑, available online-only at [http://www.annfammed.org/cgi/content/full/5/4/320/DC1](http://www.annfammed.org/cgi/content/full/5/4/320/DC1)). Of note, however, at follow-up in all women aged 50 years or older, women assigned to PCM were almost twice as likely to be up-to-date for all 3 tests (59 of 317, 18.6%) as their counterparts assigned to AMOP (33 of 309, 10.7%), with an odds ratio adjusted for baseline status of 2.00 (95% CI, 1.24–3.22; *P* <.01) (not shown).

View this table:
[Table 2.](http://www.annfammed.org/content/5/4/320/T2)

Table 2.  
**Comparison of Up-to-Date Status Between Study Groups, at Baseline and at Follow-up, According to Intent-to-Treat Analysis Among All Women**

Because many women in both groups could not be reached for the first call within the 3-attempt call limit and thus did not receive the telephone portion of either intervention, we conducted a subgroup analysis of those women who were reached at least once. As displayed in Table 3⇓, up-to-date rates for all 3 cancer screenings increased more in the PCM group than in the comparison group, and the difference was statistically significant for cervical cancer screening adjusted for age and baseline status, with an odds ratio of 1.86 (95% CI, 1.08–3.21). The findings were again similar when women who were up-to-date on a given screening at baseline were excluded from analysis (Supplemental Table 2, available online-only at [http://www.annfammed.org/cgi/content/full/5/4/320/DC1](http://www.annfammed.org/cgi/content/full/5/4/320/DC1)).

View this table:
[Table 3.](http://www.annfammed.org/content/5/4/320/T3)

Table 3.  
**Comparison of Up-to-Date Status Between Study Groups, at Baseline and at Follow-up, According to Subgroup Analysis Among Women Reached by Telephone at Least Once, Still Eligible, and Willing to Participate**

## DISCUSSION

This trial aimed to explore whether PCM could be adapted to fit and have an impact when offered through a managed care organization’s telephone support infrastructure. Our results show that modified PCM could be implemented and did modestly improve cancer-screening rates. The odds ratio of 1.69 for colorectal cancer screening is comparable to results of other mail and telephone outreach interventions to increase cancer screening, most commonly reported for mammography. Luckmann et al29 has reported odds ratios of 1.2 and 1.3 in 2 health maintenance organizations (HMOs) using tailored telephone counseling to increase mammography screening, and Lipkus et al30 found that female HMO patients who received telephone counseling were 1.69 times more likely to be up-to-date for mammography than women receiving usual care. Valanis and colleagues31 achieved better results with an outreach intervention directed at both mammography (odds ratio = 2.94) and Pap testing (odds ratio = 2.92); however, their study population was demographically very different from that reported in our study.

We had a number of reasons to expect that the impact of PCM would be modest at best. Women in the comparison group received Affinity’s usual care, that is, the existing mammography outreach program, with 2 enhancements (mailed information and brief encouragement to discuss other cancer-screening tests with their physician). The study therefore had no true control group. Such a no-contact control group is unlikely to be acceptable to HMOs that may already provide mail or telephone cancer-screening outreach as part of their mission and to improve HEDIS performance.26,32 The enhancements to the AMOP usual-care program were added at the direction of Affinity leaders who insisted on providing all women with this potentially beneficial information, thus attenuating differences between study groups still further.

This administrative request to alter the research design to better fit a patient-centered orientation is part of the landscape when conducting research within an HMO and a quality improvement effort. Such compromises in ability to evaluate interventions rigorously developed with research support are an integral part of practical trials to enhance the buy-in of organizations and facilitate the design of sustainable real-world interventions.33

Not only was the comparison group here provided with more support than in the original study,12 but the PCM intervention itself was also modified in ways that might be expected to decrease its impact. First, telephone contacts were limited to no more than 3 over 8 months, whereas in the earlier study, the number of contacts was unlimited and could be provided over 18 months. Second, attempts to contact women, up to 8 in the earlier study, were limited here to 3. As a result, fewer than one-half of the women were successfully contacted even once. This lower contact rate was predicted by MMCO staff based on previous outreach experience and differed substantially from that in our original study, in which 91% of women assigned to PCM received at least 1 contact. Other studies that have made 10 or even 15 attempts to reach individuals before considering them unreachable29,34 have achieved much higher contact rates.

Differences in the impact of PCM across screening tests are worthy of note. It is no surprise that mammography rates at follow-up were similar between groups because both received the established MMCO mammography outreach program including a financial incentive. Baseline rates for colorectal cancer screening were the lowest of the 3 and thus had the most potential for improvement, as was shown in the intent-to-treat analysis. The subgroup comparison for this test among women contacted at least once did not achieve statistical significance, although the sample size of those reached was small. Cervical cancer screening at follow-up adjusted for age and baseline status favored the PCM group in the subgroup analysis among women contacted at least once, but not in the intent-to-treat analysis. For this service, baseline up-to-date rates exceeded 50% and increased about 10 percentage points for both groups in the intent-to-treat analysis.

Limitations of this study include its reliance on administrative data, which may be incomplete.35 Use of deidentified administrative data also limited the socioeconomic data available on study participants and the exploration of differences across the 6 health centers where the women received primary care. In addition, we did not have the resources to collect detailed cost-effectiveness data. The study, furthermore, was restricted to women in 1 metropolitan area served by 1 MMCO, limiting the generalizability of findings. Finally, there are scant published data on the proportion of HMOs and MMCOs that currently provide telephone outreach to members.32 Although our own informal surveys of industry associations have indicated that telephone outreach is increasingly common, the effort required to incorporate PCM into an HMO that lacked an established telephone outreach program would be substantial.

Certain study strengths should also be noted. This effectiveness trial36 was conducted in a real-world setting with the intervention provided by established outreach staff who were not hired by or receiving fidelity monitoring from an external research team. Packaging the 3 screenings into a single intervention increased telephone outreach efficiency while providing a consistent approach for women across tests. Further, the target population—drawn from lower socioeconomic groups and having a high proportion of minorities—has low rates of cancer screening and deserves a high priority for attention.

This study replicated the original finding that PCM can increase cancer screening and thus supports the idea that a telephone care management intervention on cancer screening can be translated to a real-world infrastructure. This study also suggests that administrative data can be used to help target women needing services and to monitor whether they receive needed services over time. The impact of the intervention was modest but statistically and clinically meaningful, despite a substantial “voltage drop”37 from the original PCM intervention. Future research should explore the impact of both similarly abbreviated and more robust PCM interventions in a range of sustainable settings. Additional studies should consider how to incorporate the PCM intervention with other health plan disease management and health promotion activities that seek to improve the quality of care.

## Acknowledgments

We gratefully acknowledge the assistance of Carolyn Cocotas, MPA, Maribel Mercado, and Melissa Torres of Affinity Health Plan; Richard G. Younge, MD, MPH, Clinical Directors Network and Montefiore Medical Group/Fordham Family Practice; Carrie Klabunde, PhD, of the Division of Cancer Control and Population Sciences, National Cancer Institute; and the participating Community Health Centers: Jacobi Health Center at Tremont, Martin Luther King, Jr, Health Center, Montefiore Comprehensive Family Care Center, Morris Heights Health Center, Soundview Community Health Center, Urban Health Plan.

## Footnotes

*   *Conflicts of interest: none reported* 

*   **Funding support:** This project was supported by a National Cancer Institute dissemination supplement, RO1 CA087776-04S1. Clinical Trials Registry number: [NCT00376909](http://www.annfammed.org/lookup/external-ref?link_type=CLINTRIALGOV&access_num=NCT00376909&atom=%2Fannalsfm%2F5%2F4%2F320.atom) (ClinicalTrials.gov).

*   Received for publication October 25, 2006.
*   Revision received February 16, 2007.
*   Accepted for publication March 18, 2007.


*   © 2007 Annals of Family Medicine, Inc.

## REFERENCES

1.  Jacobellis J, Cutter G. Mammography screening and differences in stage of disease by race/ethnicity. Am J Public Health. 2002;92(7):1144–1150.
    
    [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=12084699&link_type=MED&atom=%2Fannalsfm%2F5%2F4%2F320.atom) 
    
    [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000176521400033&link_type=ISI) 

2.  O’Malley AS, Forrest CB, Feng S, Mandelblatt J. Disparities despite coverage: gaps in colorectal cancer screening among Medicare beneficiaries. Arch Intern Med. 2005;165(18):2129–2135.
    
    [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1001/archinte.165.18.2129&link_type=DOI) 
    
    [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=16217003&link_type=MED&atom=%2Fannalsfm%2F5%2F4%2F320.atom) 
    
    [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000232576800011&link_type=ISI) 

3.  *National Healthcare Disparities Report, 2003*. U.S. Department of Health and Human Services, Agency for Healthcare Research and Quality; 2003. [http://www.ahrq.gov/qual/nhdr03/nhdr03.htm](http://www.ahrq.gov/qual/nhdr03/nhdr03.htm). Accessed 20 October 2006.
    
    

4.  Mayberry RM, Coates RJ, Hill HA, et al. Determinants of black/white differences in colon cancer survival. J Natl Cancer Inst. 1995;87(22):1686–1693.
    
    [Abstract/FREE Full Text](http://www.annfammed.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiam5jaSI7czo1OiJyZXNpZCI7czoxMDoiODcvMjIvMTY4NiI7czo0OiJhdG9tIjtzOjIyOiIvYW5uYWxzZm0vNS80LzMyMC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

5.  Smedley BD, Stith AY, Nelson AR, eds. Committee on Understanding and Eliminating Racial and Ethnic Disparities in Health Care, and Board on Health Sciences Policy, Institute of Medicine. *Unequal Treatment: Confronting Racial and Ethnic Disparities in Health Care.* Washington, DC: National Academies Press; 2003.
    
    

6.  Chien C, Morimoto LM, Tom J, Li CI. Differences in colorectal carcinoma stage and survival by race and ethnicity. Cancer. 2005;104(3):629–639.
    
    [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1002/cncr.21204&link_type=DOI) 
    
    [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=15983985&link_type=MED&atom=%2Fannalsfm%2F5%2F4%2F320.atom) 
    
    [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000230631700023&link_type=ISI) 

7.  Hiatt RA, Pasick RJ, Stewart S, et al. Community-based cancer screening for underserved women: design and baseline findings from the Breast and Cervical Cancer Intervention Study. Prev Med. 2001;33(3):190–203.
    
    [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1006/pmed.2001.0871&link_type=DOI) 
    
    [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=11522160&link_type=MED&atom=%2Fannalsfm%2F5%2F4%2F320.atom) 
    
    [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000170730600008&link_type=ISI) 

8.  Centers for Disease Control and Prevention. Breast cancer screening and socioeconomic status—35 metropolitan areas, 2000 and 2002. MMWR Morb Mortal Wkly Rep. 2005;54(39):981–985.
    
    [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=16208309&link_type=MED&atom=%2Fannalsfm%2F5%2F4%2F320.atom) 

9.  Thorpe LE, Mostashari F, Feldman G, et al. Cancer screening in New York City: we can do much better. NYC Vital Signs. 2003;2(2):2003.
    
    

10. Mitchell MK, Gregersen PK, Johnson S, Parsons R, Vlahov D. The New York Cancer Project: rationale, organization, design, and baseline characteristics. J Urban Health. 2004;81(2):301–310.
    
    [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=15136663&link_type=MED&atom=%2Fannalsfm%2F5%2F4%2F320.atom) 
    
    [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000221768600015&link_type=ISI) 

11. Karpati A, Kerker B, Mostashari F, Singh T, Hajat A, Thorpe L. *Health Disparities in New York City 2004*. New York, NY: New York City Department of Health and Mental Hygiene; 2004.
    
    

12. Dietrich AJ, Tobin JN, Cassells A, et al. Telephone care management to improve cancer screening among low-income women: a randomized, controlled trial. Ann Intern Med. 2006;144(8):563–571.
    
    [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.7326/0003-4819-144-8-200604180-00006&link_type=DOI) 
    
    [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=16618953&link_type=MED&atom=%2Fannalsfm%2F5%2F4%2F320.atom) 
    
    [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000237017900003&link_type=ISI) 

13. Davis K. A need to transform the U.S. health care system: improving access, quality, and efficiency. Plenary address to the National Association of Community Health Centers Strategic Planning Retreat, Washington, DC, March 27, 2006.
    
    

14. Tunis SR, Stryer DB, Clancy CM. Practical clinical trials: increasing the value of clinical research for decision making in clinical and health policy. JAMA. 2003;290(12):1624–1632.
    
    [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1001/jama.290.12.1624&link_type=DOI) 
    
    [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=14506122&link_type=MED&atom=%2Fannalsfm%2F5%2F4%2F320.atom) 
    
    [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000185461300028&link_type=ISI) 

15. Glasgow RE, Magid DJ, Beck A, Ritzwoller D, Estabrooks PA. Practical clinical trials for translating research to practice: design and measurement recommendations. Med Care. 2005;43(6):551–557.
    
    [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1097/01.mlr.0000163645.41407.09&link_type=DOI) 
    
    [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=15908849&link_type=MED&atom=%2Fannalsfm%2F5%2F4%2F320.atom) 
    
    [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000229379200005&link_type=ISI) 

16. Kell SH, Allison JJ, Brown KC, Weissman NW, Farmer R, Kiefe C. Measurement of mammography rates for quality improvement. Qual Manag Health Care. 1999;7(2):11–19.
    
    [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=12222348&link_type=MED&atom=%2Fannalsfm%2F5%2F4%2F320.atom) 

17. Diamond C, Rask K, Kohler S. Use of paper medical records versus administrative data for measuring and improving health care quality: are we still searching for a gold standard? Dis Manage. 2001;4(3):121–130.
    
    [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1089/10935070152596043&link_type=DOI) 

18. Insinga RP, Glass AG, Rush BB. Pap screening in a U.S. health plan. Cancer Epidemiol Biomarkers Prev. 2004;13(3):355–360.
    
    [Abstract/FREE Full Text](http://www.annfammed.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiY2VicCI7czo1OiJyZXNpZCI7czo4OiIxMy8zLzM1NSI7czo0OiJhdG9tIjtzOjIyOiIvYW5uYWxzZm0vNS80LzMyMC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

19. Roetzheim RG, Christman LK, Jacobsen PB, et al. A randomized controlled trial to increase cancer screening among attendees of community health centers. Ann Fam Med. 2004;2(4):294–300.
    
    [Abstract/FREE Full Text](http://www.annfammed.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYW5uYWxzZm0iO3M6NToicmVzaWQiO3M6NzoiMi80LzI5NCI7czo0OiJhdG9tIjtzOjIyOiIvYW5uYWxzZm0vNS80LzMyMC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

20. Roetzheim RG, Christman LK, Jacobsen PB, Schroeder J, Abdulla R, Hunter S. Long-term results from a randomized controlled trial to increase cancer screening among attendees of community health centers. Ann Fam Med. 2005;3(2):109–114.
    
    [Abstract/FREE Full Text](http://www.annfammed.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYW5uYWxzZm0iO3M6NToicmVzaWQiO3M6NzoiMy8yLzEwOSI7czo0OiJhdG9tIjtzOjIyOiIvYW5uYWxzZm0vNS80LzMyMC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

21. Crabtree BF, Miller WL, Tallia AF, et al. Delivery of clinical preventive services in family medicine offices. Ann Fam Med. 2005;3(5):430–435.
    
    [Abstract/FREE Full Text](http://www.annfammed.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYW5uYWxzZm0iO3M6NToicmVzaWQiO3M6NzoiMy81LzQzMCI7czo0OiJhdG9tIjtzOjIyOiIvYW5uYWxzZm0vNS80LzMyMC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

22. Sardell A. Clinical networks and clinician retention: the case of CDN. J Community Health. 1996;21(6):437–451.
    
    [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1007/BF01702604&link_type=DOI) 
    
    [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=8912120&link_type=MED&atom=%2Fannalsfm%2F5%2F4%2F320.atom) 
    
    [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=A1996VP48800004&link_type=ISI) 

23. Humphrey LL, Helfand M, Chan BK, Woolf SH. Breast cancer screening: a summary of the evidence for the U.S. Preventive Services Task Force. Ann Intern Med. 2002;137(5 Part 1):347–360.
    
    [CrossRef](http://www.annfammed.org/lookup/external-ref?access\_num=10.7326/0003-4819-137-5_Part_1-200209030-00012&link_type=DOI) 
    
    [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=12204020&link_type=MED&atom=%2Fannalsfm%2F5%2F4%2F320.atom) 
    
    [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000177865600007&link_type=ISI) 

24. U.S. Preventive Services Task Force. *Screening for Cervical Cancer: Recommendations and Rationale.* Rockville, Md: Agency for Healthcare Research and Quality; 2003.
    
    

25. U.S. Preventive Services Task Force. Screening for colorectal cancer: recommendation and rationale. Ann Intern Med. 2002;137(2):129–131.
    
    [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.7326/0003-4819-137-2-200207160-00014&link_type=DOI) 
    
    [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=12118971&link_type=MED&atom=%2Fannalsfm%2F5%2F4%2F320.atom) 
    
    [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000176969300009&link_type=ISI) 

26. National Committee for Quality Assurance. HEDIS 2005 Summary Table of Measures and Product Lines. 2005. [http://www.ncqa.org/Programs/HEDIS/2005/MeasuresList.pdf](http://www.ncqa.org/Programs/HEDIS/2005/MeasuresList.pdf). Accessed 20 October 2006.
    
    

27. Ogedegbe G, Cassells AN, Robinson CM, et al. Perceptions of barriers and facilitators of cancer early detection among low-income minority women in community health centers. J Natl Med Assoc. 2005;97(2):162–170.
    
    [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=15712779&link_type=MED&atom=%2Fannalsfm%2F5%2F4%2F320.atom) 

28. Stata Statistical Software; release 8.0 program. College Station, Tex: Stata Corp; 2003.
    
    

29. Luckmann R, Savageau JA, Clemow L, Stoddard AM, Costanza ME. A randomized trial of telephone counseling to promote screening mammography in two HMOs. Cancer Detect Prev. 2003;27(6):442–450.
    
    [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1016/j.cdp.2003.09.003&link_type=DOI) 
    
    [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=14642552&link_type=MED&atom=%2Fannalsfm%2F5%2F4%2F320.atom) 
    
    [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000187247300005&link_type=ISI) 

30. Lipkus IM, Rimer BK, Halabi S, Strigo TS. Can tailored interventions increase mammography use among HMO women? Am J Prev Med. 2000;18(1):1–10.
    
    [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=10736533&link_type=MED&atom=%2Fannalsfm%2F5%2F4%2F320.atom) 
    
    [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000086133200001&link_type=ISI) 

31. Valanis BG, Glasgow RE, Mullooly J, et al. Screening HMO women overdue for both mammograms and Pap tests. Prev Med. 2002;34(1):40–50.
    
    [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1006/pmed.2001.0949&link_type=DOI) 
    
    [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=11749095&link_type=MED&atom=%2Fannalsfm%2F5%2F4%2F320.atom) 
    
    [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000173235300006&link_type=ISI) 

32. Goins KV, Zapka JG, Geiger AM, et al. Implementation of systems strategies for breast and cervical cancer screening services in health maintenance organizations. Am J Manag Care. 2003;9(11):745–755.
    
    [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=14626472&link_type=MED&atom=%2Fannalsfm%2F5%2F4%2F320.atom) 
    
    [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000186522500005&link_type=ISI) 

33. Altman DG. Sustaining interventions in community systems: on the relationship between researchers and communities. Health Psychol. 1995;14(6):526–536.
    
    [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1037/0278-6133.14.6.526&link_type=DOI) 
    
    [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=8565927&link_type=MED&atom=%2Fannalsfm%2F5%2F4%2F320.atom) 
    
    [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=A1995TD87400006&link_type=ISI) 

34. Costanza ME, Stoddard AM, Luckmann R, White MJ, Spitz Avrunin J, Clemow L. Promoting mammography: results of a randomized trial of telephone counseling and a medical practice intervention. Am J Prev Med. 2000;19(1):39–46.
    
    [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1016/S0749-3797(00)00150-1&link_type=DOI) 
    
    [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=10865162&link_type=MED&atom=%2Fannalsfm%2F5%2F4%2F320.atom) 
    
    [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000087719700006&link_type=ISI) 

35. Walsh EG, Osber DS, Nason CA, Porell MA, Asciutto AJ. Quality improvement in a primary care case management program. Health Care Financ Rev. 2002;23(4):71–84.
    
    [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=12500471&link_type=MED&atom=%2Fannalsfm%2F5%2F4%2F320.atom) 

36. Glasgow RE, Lichtenstein E, Marcus AC. Why don’t we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. Am J Public Health. 2003;93(8):1261–1267.
    
    [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.2105/AJPH.93.8.1261&link_type=DOI) 
    
    [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=12893608&link_type=MED&atom=%2Fannalsfm%2F5%2F4%2F320.atom) 
    
    [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000184549100023&link_type=ISI) 

37. Eisenberg JM, Power EJ. Transforming insurance coverage into quality health care: voltage drops from potential to delivered quality. JAMA. 2000;284(16):2100–2102.
    
    [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1001/jama.284.16.2100&link_type=DOI) 
    
    [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=11042759&link_type=MED&atom=%2Fannalsfm%2F5%2F4%2F320.atom) 
    
    [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000089902100031&link_type=ISI)