Skip to main content

Main menu

  • Home
  • Current Issue
  • Content
    • Current Issue
    • Early Access
    • Multimedia
    • Podcast
    • Collections
    • Past Issues
    • Articles by Subject
    • Articles by Type
    • Supplements
    • Plain Language Summaries
    • Calls for Papers
  • Info for
    • Authors
    • Reviewers
    • Job Seekers
    • Media
  • About
    • Annals of Family Medicine
    • Editorial Staff & Boards
    • Sponsoring Organizations
    • Copyrights & Permissions
    • Announcements
  • Engage
    • Engage
    • e-Letters (Comments)
    • Subscribe
    • Podcast
    • E-mail Alerts
    • Journal Club
    • RSS
    • Annals Forum (Archive)
  • Contact
    • Contact Us
  • Careers

User menu

  • My alerts

Search

  • Advanced search
Annals of Family Medicine
  • My alerts
Annals of Family Medicine

Advanced Search

  • Home
  • Current Issue
  • Content
    • Current Issue
    • Early Access
    • Multimedia
    • Podcast
    • Collections
    • Past Issues
    • Articles by Subject
    • Articles by Type
    • Supplements
    • Plain Language Summaries
    • Calls for Papers
  • Info for
    • Authors
    • Reviewers
    • Job Seekers
    • Media
  • About
    • Annals of Family Medicine
    • Editorial Staff & Boards
    • Sponsoring Organizations
    • Copyrights & Permissions
    • Announcements
  • Engage
    • Engage
    • e-Letters (Comments)
    • Subscribe
    • Podcast
    • E-mail Alerts
    • Journal Club
    • RSS
    • Annals Forum (Archive)
  • Contact
    • Contact Us
  • Careers
  • Follow annalsfm on Twitter
  • Visit annalsfm on Facebook
Research ArticleOriginal Research

A Community Engagement Method to Design Patient Engagement Materials for Cardiovascular Health

Aimee F. English, L. Miriam Dickinson, Linda Zittleman, Donald E. Nease, Alisha Herrick, John M. Westfall, Matthew J. Simpson, Douglas H. Fernald, Robert L. Rhyne and W. Perry Dickinson
The Annals of Family Medicine April 2018, 16 (Suppl 1) S58-S64; DOI: https://doi.org/10.1370/afm.2173
Aimee F. English
1Department of Family Medicine, University of Colorado School of Medicine, Aurora, Colorado
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
L. Miriam Dickinson
1Department of Family Medicine, University of Colorado School of Medicine, Aurora, Colorado
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Linda Zittleman
1Department of Family Medicine, University of Colorado School of Medicine, Aurora, Colorado
MSPH
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Donald E. Nease Jr
1Department of Family Medicine, University of Colorado School of Medicine, Aurora, Colorado
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Alisha Herrick
2Department of Family Medicine, University of New Mexico, Albuquerque, New Mexico
MPH
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
John M. Westfall
1Department of Family Medicine, University of Colorado School of Medicine, Aurora, Colorado
MD, MPH
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Matthew J. Simpson
1Department of Family Medicine, University of Colorado School of Medicine, Aurora, Colorado
MD, MPH
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Douglas H. Fernald
1Department of Family Medicine, University of Colorado School of Medicine, Aurora, Colorado
MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Robert L. Rhyne
2Department of Family Medicine, University of New Mexico, Albuquerque, New Mexico
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
W. Perry Dickinson
1Department of Family Medicine, University of Colorado School of Medicine, Aurora, Colorado
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • eLetters
  • Info & Metrics
  • PDF
Loading

Abstract

PURPOSE EvidenceNOW Southwest is a cluster-randomized trial evaluating the differential impact on cardiovascular disease (CVD) care of engaging patients and communities in practice transformation in addition to standard practice facilitation support. The trial included development of locally tailored CVD patient engagement materials through Boot Camp Translation (BCT), a community engagement process that occurred before practice recruitment but after cluster randomization.

METHODS We introduce a cluster randomization method performed before recruitment of small to medium-size primary care practices in Colorado and New Mexico, which allowed for balanced study arms while minimizing contamination. Engagement materials for the enhanced study arm were developed by means of BCT, which included community members, practice members, and public health professionals from (1) metropolitan Denver, (2) rural northeast Colorado, (3) Albuquerque, and (4) rural southeast New Mexico. Outcome measures were messages and materials from BCTs and population characteristics of study arms after using geographic-based covariate constrained randomization.

RESULTS The 4 BCTs’ messages and materials developed by the BCT groups uniquely reflected each community and ranged from family or spiritual values to early prevention or adding relevance to CVD risk. The geographic-based covariate of a cluster randomization method constrained randomization-assigned regions to study arms, allowing BCTs to precede practice recruitment, reduce contamination, and balance populations.

CONCLUSIONS Cluster-randomized trials with community-based interventions present study design and implementation challenges. The BCTs elicited unique contextual messages and materials, suggesting that interventions designed to help primary care practices decrease CVD risk may not be one size fits all.

  • patient engagement
  • community engagement
  • cardiovascular disease risk reduction
  • practice transformation
  • primary health care

INTRODUCTION

Communities, patients, and families can play a role in practice improvement, and there have been increasing calls to engage them in practice transformation efforts, including by the Institute of Medicine,1 Patient-Centered Medical Home standards,2 and the requirements of the Centers for Medicare & Medicaid Services program Comprehensive Primary Care Plus.3 The benefits of engaging patients and families in the care of individual patients is well established.4–11 The outcomes of engaging communities, patients, and families at the practice level, however, are less well documented.12,13 The EvidenceNOW: Advancing Heart Health in Primary Care is an Agency for Healthcare Research and Quality grant initiative dedicated to using the latest evidence to improve the heart health of Americans. EvidenceNOW Southwest is a regional cooperative that has sought to test the differential impacts on cardiovascular disease (CVD) of interventions focused on patient, family, and community engagement to standard practice transformation approaches.

In EvidenceNOW Southwest, enhanced-arm practices received practice facilitation plus additional support to engage patients and families in practice transformation. These practices were able to order free heart health materials that were developed through a community engagement method known as Boot Camp Translation (BCT) in 4 communities within the enhanced-arm geographic regions (2 in Colorado, 2 in New Mexico). Community members and health professionals worked together to learn about complex health topics and national guidelines so the community-academic partnership could then translate those messages into ones that are relevant and meaningful to their local community.14,15 The process aimed not to seek perfect community representation but rather to harness local expertise to create locally tailored products and messaging.

There were 3 major study design challenges in our randomized trial to evaluate the impact of a community engagement method on practices. First, cluster randomized trials, commonly used in practice-based studies that involve randomization at the level of the practice,16–18 incur risk of contamination if used with interventions occurring at the community level where there might be standard and enhanced-arm practices in close proximity. Second, in our study, communities in which the community engagement method occurred needed to be identified before practice recruitment. In this case, BCT communities had to be selected so that materials would be ready for use by the enhanced-arm practices at the start of the intervention period. A potential solution to these problems was to define geographic regions as the units for randomization. This raises the third issue, however, of potentially having unbalanced study arms. Randomization methods that improve study arm balance in terms of underlying populations and regional differences are essential for community-based trials.19

We describe (1) the results of 4 BCTs in unique communities across diverse regions of Colorado and New Mexico and (2) approaches to study design challenges for a randomized trial evaluating the effect of patient, family, and community engagement on practice transformation and cardiovascular risk reduction.

METHODS

Study Setting

The EvidenceNOW Southwest Cooperative is a collaborative effort between Colorado and New Mexico and covers the diverse geographic and cultural regions across both states. It is one of 7 regional cooperatives funded by the Agency for Healthcare Research and Quality to help small and medium-size primary care practices across the country use the latest evidence to improve cardiovascular health. The project was approved by both the Colorado Multiple Institutional Review Board and the University of New Mexico Human Research Protections Office.

EvidenceNOW Southwest Intervention

Practices within both the standard and enhanced arms received the following: ongoing practice transformation support from a trained practice facilitator, support from a clinical health information technology advisor, connection to a regional health extension agent (regional health connector in Colorado, health extension rural officer or HERO in New Mexico), and opportunity to attend biannual collaborative learning sessions in which knowledge is shared across practice teams (also attended by practice facilitators, regional health connectors/health extension regional officers, and clinical health information technology advisors).

Enhanced-arm practices received additional support to increase patient, family, and community engagement within their practice transformation efforts through the use of BCT materials and support to engage patients and families in practice transformation efforts. Because CVD guidelines are relatively inaccessible to the general population owing to medical complexity and jargon, the intention of the BCTs was to allow communities to create materials to provide CVD education in a way that may be more relevant to enhanced-arm communities and practices. Throughout the project, printed BCT materials from all 4 BCTs were available for order at no cost to all enhanced practices (regardless of their geographic proximity to the BCT). Processes and outcomes related to utilization of BCT materials are being tracked and will be reported in a later publication after the completion of the study.

EvidenceNOW Southwest Study Design

Because of the intent to implement the community engagement method (ie, BCT) at the community and regional level, randomization at the level of the primary care practice was not feasible. There was concern about the strong potential for contamination between study arms if standard intervention practices were located in regions from which BCT participants would be recruited and their products would be promoted. Additionally, because the timeline of the study required beginning BCT activities before actual practice recruitment and enrollment, it was necessary to select regions for the BCTs that would include only those practices from the enhanced intervention study arm. We therefore defined geographic regions (ie, cluster) as the unit of randomization. Finally, regional differences across 2 states in underlying population characteristics were considerable, and simple randomization could result in unbalanced study arms, requiring approaches for achieving balanced study arms in terms of the underlying populations and resources.

Covariate Constrained Randomization

Because EvidenceNOW Southwest is a cooperative study across 2 states, and local knowledge about geographic regions was key to informing design decisions, randomization was carried out separately in each state.

In Colorado, we used data from the most recent US Census, Health Landscapes, the Cold Spotting Colorado project,20 and local knowledge about geography and proximity to health care services to define 26 regions consisting of 1 or more counties that are roughly equivalent to the Colorado Health Statistics Regions. These were split into 2 strata for randomization: (1) Front Range and Eastern Plains and (2) mountains and Western Slope. Within each stratum, we used covariate constrained randomization21,22 to achieve balanced study arms with respect to population and health resource characteristics. Variables included total population of the region, average county population, percentage at or below poverty level, median income, percentage white, percentage Hispanic, number of primary care physicians per 10,000 population, number of physician assistants/nurse practitioners per 10,000 population, unemployment rate, and number of uninsured adults aged 18 to 64 years old. The goal was to define clusters as groups of counties that were relatively homogeneous and large enough to facilitate implementation of BCTs without undue risk of contamination into the standard intervention counties, as well as to achieve balanced study arms on underlying population characteristics.

In New Mexico, using data from the US Census Bureau and the US Department of Labor’s Bureau of Labor Statistics, we divided the state’s 33 counties into 16 regions based upon population size, geography, and proximity to health care services. Using knowledge of local communities and regional differences within the state, we paired the regions into 8 groups and randomized regions within each group, resulting in an even number of regions (8 each) per study arm.

EvidenceNOW Southwest BCT Communities

Once all regions of both states had been assigned to enhanced or standard intervention arms, the regions for the BCTs were identified. Four BCTs were conducted, 2 in each state, with regions selected to represent diverse populations. The limited number of BCTs conducted was due to resource limitations to conduct the BCT and produce the resulting materials. Each region in which a BCT occurred had been randomized to the enhanced study arm.

BCTs were conducted in Hobbs, New Mexico, the South Valley region of Albuquerque, northeast Colorado, and the Denver metropolitan area. These regions differed in ethnic diversity, industry, population, and rural-urban mix. Individual community descriptions can be found in Table 1.

View this table:
  • View inline
  • View popup
Table 1

Population Characteristics of Standard and Enhanced Regions

BCT Process

The goal of the EvidenceNOW Southwest BCT was to take evidence-based CVD prevention strategies and translate that content into messaging and materials that are relevant and understandable for community members. Through participation in BCT, community members become better prepared to discuss CVD within their communities, and participants developed unique materials for practices and other community agencies to use for patient/community engagement.14,15 BCT participants also included practice clinicians and staff, as well as local public health officers, to ensure that the messages and materials would be relevant for use by the practices and local public health.

Each BCT began with an all-day kickoff retreat. For one-half of the retreat, a medical expert presented the current evidence and guidelines for the prevention of CVD, specifically focusing on the ABCS (aspirin use, blood pressure control, cholesterol management, smoking cessation) guidelines. Although each BCT had a different medical expert, presenters used the same set of informational slides across all presentations. After the presentation, the remaining retreat time was spent brainstorming answers to (1) what does our community need to know about CVD prevention, and (2) what actions do we want people to take around CVD prevention?

After the kickoff retreat, each group had a series of 4 to 6 conference calls interspersed with 3 to 4 in-person meetings over a 6- to 9-month period during which they continued to refine key messages and products. Through these follow-up sessions, each group created a set of locally relevant actionable messages and materials.

Recruitment of BCT Participants

Within each state, participants were recruited through use of different organizations, based on which organizations would have better ties with the community. As a result, in New Mexico, with its well-established health extension system, the health extension rural officers recruited participants. In Colorado, with its long history of community-engaged research, practice-based research networks recruited participants. Participants were selected based on their availability to participate for the duration of the BCT, their ability to engage and be present, their interest in the topic, and the absence of a hidden agenda.

RESULTS

Colorado and New Mexico have a combined population of approximately 7.3 million. Sociodemographic characteristics of the 2 states show considerable diversity in terms of ethnicity, education, population density, disease burden, and health care resources. Covariate-constrained randomization procedures resulted in reasonably well-balanced study arms with respect to key regional population characteristics that might affect study implementation or outcomes (Table 2).

View this table:
  • View inline
  • View popup
Table 2

Population Characteristics of Standard and Enhanced Regions

BCT Partners

Community members with varying amounts of experience with CVD were included in the BCT. They had differing skill sets and expertise, as shown in Table 3.

View this table:
  • View inline
  • View popup
Table 3

Boot Camp Translation Participants by Boot Camp Translation Site

BCT Key Messages and Materials

Each BCT was tasked with translating evidence-based cardiovascular risk-reduction strategies into messaging and materials relevant to their local communities to be used by practices for patient engagement. The resulting materials varied considerably from one BCT to another.

The Hobbs, New Mexico, BCT included messaging about spirituality and universality of risk regardless of background, producing 3 products, including a heart-shaped fan that could be taken to football games (Table 1). In the South Valley region of New Mexico, messages aimed to elicit feelings around the importance of and responsibility to Latino communities and family. Prevention was a key message, particularly in the context of family. They produced 4 products including a grocery bag with “Cuídalo” printed on it (translation: “Take care of it”). It was culturally important to the participants that this bag be in Spanglish, a combination of Spanish and English. The northeast Colorado BCT emphasized early intervention but focused heavily on numbers (eg, individual CVD risk score, cholesterol levels) and putting those numbers into an easily interpretable context. The group created 2 products, including a heart chart, a personal tracking tool for recording blood pressure, cholesterol, body mass index, and 10-year risk of CVD similar to pediatric growth curves to provide comparison to normal age-related risk over time. The metropolitan Denver BCT also sought to raise awareness and empower patients to act now to lower their risk. They produced 3 products, including a risk factor checklist with questions prompting patients to think about their own CVD risk factors. Table 1 displays a complete description of key messages and products.

Practice Recruitment

After the BCTs were completed, a total of 211 primary care practices were recruited and enrolled from Colorado (n = 158) and New Mexico (n = 53) across the diverse geographic regions of the 2 states. BCT materials were available only to practices in the enhanced intervention arm until study completion.

DISCUSSION

Designing a randomized control trial involving community engagement is especially challenging across 2 states with diverse populations, with the need to minimize contamination and to ensure that key population groups are included in the community engagement activities. We defined clusters as geographic regions through a combination of census data and knowledge of local communities, and we used covariate-constrained randomization procedures to allocate regions to balanced study arms before initiating the community engagement method and recruiting practices. By minimizing overall differences between study arms, this procedure enriches heterogeneity within study arms, thus ensuring representation of diverse populations in both study arms.

Unique BCT messages and materials were produced in the 4 selected communities for use by enhanced intervention practices throughout the EvidenceNOW Southwest project. Messages ranged from family values and spirituality to early prevention and identifying a need for context of CVD risk. Materials written in English were translated into Spanish, and their form ranged from brochures to patient-held health records to novelties, such as fans and grocery bags. Though products from each site were unique—reflecting the key features each community group believed would resonate with their local audiences—each site incorporated the ABCS into at least 1 product. Also, a sense of urgency and importance that heart disease is preventable was observed across all sites. The diverse products were reflective of cultural differences and varying priorities across the regions. We believe tailoring patient engagement materials to specific communities will enhance primary care practices’ capacity to improve evidence-based care by making the messages more relevant for their populations.

There are some key limitations of this study. Randomization of geographic clusters was a necessary study design adaptation. The necessity of completing randomization to identify regions in which to carry out the BCT activities before actual practice recruitment, however, meant that practice-level information, such as CVD burden in their patients, was not available at the time of randomization and could not be included in the procedure. Additionally, available resources limited the number of BCTs to 4 across the 2 states. Given the geographic and ethnic diversity of Colorado and New Mexico, this number was not suffi-cient to engage all key populations, such as the Native American community.

Future work will evaluate how practices used the BCT materials, how often they used which materials, and the geographic spread of the materials across all enhanced study regions. Future publications will also report on the differential impact of the enhanced intervention as a whole, which includes both the practices’ access to BCT materials and support for practices to engage patients and families in practice transformation efforts.

In conclusion, solutions to study design challenges were feasible and facilitated implementation of a community engagement method while maintaining study integrity. BCT materials from 4 different regions resulted in strong heterogeneity, suggesting that one-size-fits-all program design to help primary care practices decrease CVD risk may not be the best approach.

Acknowledgments

The authors would like to thank Elizabeth W. Sta-ton, MSTC, medical writer, for her assistance in refining this manuscript.

Footnotes

  • Conflicts of interest: authors report none.

  • Funding support: Publication of this article was supported by the Agency for Healthcare Research and Quality (AHRQ) through contract No. HHSA290201200019I, and grant No. R18 HS023904.

  • Disclaimer: This work represents the opinions of the authors and should not be interpreted as official positions of the AHRQ or the US Department of Health and Human Services.

  • Previous presentations: Presented at the North American Primary Care Research Group Practice-Based Research Network Conference, July 11–12, 2016, Bethesda, Maryland; and the 2016 North American Primary Care Research Group Annual Meeting, November 12–16, 2016, Colorado Springs, Colorado.

  • Trial registration: US trial registration number: NCT02515578.

  • © 2018 Annals of Family Medicine, Inc.

References

  1. ↵
    Institute of Medicine. Patients Charting the Course: Citizen Engagement in the Learning Health System - Workshop Summary. Washington, DC, 2011.
  2. ↵
    National Committee for Quality Assurance. Patient-Centered Medical Home: Recognition Programs. http://www.ncqa.org/programs/recognition/practices/patient-centered-medical-home-pcmh. Accessed May 18, 2016.
  3. ↵
    Centers for Medicare & Medicaid Services. CPC+ Practice Care Delivery Requirements. https://innovation.cms.gov/Files/x/cpcplus-practicecaredlvreqs.pdf. Published 2015. Accesssed Apr 17, 2017.
  4. ↵
    1. Mosen DM,
    2. Schmittdiel J,
    3. Hibbard J,
    4. Sobel D,
    5. Remmers C,
    6. Bellows J
    . Is patient activation associated with outcomes of care for adults with chronic conditions? J Ambul Care Manage. 2007;30(1):21–29.
    OpenUrlCrossRefPubMed
    1. Tabrizi JS,
    2. Wilson AJ,
    3. O’Rourke PK
    . Customer quality and type 2 diabetes from the patients’ perspective: a cross-sectional study. J Res Health Sci. 2010;10(2):69–76.
    OpenUrlPubMed
    1. Gerber LM,
    2. Barrón Y,
    3. Mongoven J,
    4. et al
    . Activation among chronically ill older adults with complex medical needs: challenges to supporting effective self-management. J Ambul Care Manage. 2011; 34(3):292–303.
    OpenUrlCrossRefPubMed
    1. Munson GW,
    2. Wallston KA,
    3. Dittus RS,
    4. Speroff T,
    5. Roumie CL
    . Activation and perceived expectancies: correlations with health outcomes among veterans with inflammatory bowel disease. J Gen Intern Med. 2009;24(7):809–815.
    OpenUrlPubMed
    1. Begum N,
    2. Donald M,
    3. Ozolins IZ,
    4. Dower J
    . Hospital admissions, emergency department utilisation and patient activation for self-management among people with diabetes. Diabetes Res Clin Pract. 2011;93(2):260–267.
    OpenUrlCrossRefPubMed
    1. Stepleman L,
    2. Rutter MC,
    3. Hibbard J,
    4. Johns L,
    5. Wright D,
    6. Hughes M
    . Validation of the patient activation measure in a multiple sclerosis clinic sample and implications for care. Disabil Rehabil. 2010;32(19): 1558–1567.
    OpenUrlCrossRefPubMed
    1. Skolasky RL,
    2. Green AF,
    3. Scharfstein D,
    4. Boult C,
    5. Reider L,
    6. Wegener ST
    . Psychometric properties of the patient activation measure among multimorbid older adults. Health Serv Res. 2011;46(2): 457–478.
    OpenUrlCrossRefPubMed
  5. ↵
    1. Hibbard JH,
    2. Greene J,
    3. Overton V
    . Patients with lower activation associated with higher costs; delivery systems should know their patients’ ‘scores’. Health Aff (Millwood). 2013;32(2):216–222.
    OpenUrlAbstract/FREE Full Text
  6. ↵
    1. Sharma AE,
    2. Grumbach K
    . Engaging patients in primary care practice transformation: theory, evidence and practice. Fam Pract. 2016.
  7. ↵
    1. Boivin A,
    2. Lehoux P,
    3. Lacombe R,
    4. Burgers J,
    5. Grol R
    . Involving patients in setting priorities for healthcare improvement: a cluster randomized trial. Implement Sci. 2014;9:24.
    OpenUrlCrossRefPubMed
  8. ↵
    1. Westfall JM,
    2. Zittleman L,
    3. Felzien M,
    4. et al
    . Reinventing The Wheel Of Medical Evidence: How The Boot Camp Translation Process Is Making Gains. Health Aff (Millwood). 2016;35(4):613–618.
    OpenUrlAbstract/FREE Full Text
  9. ↵
    1. Norman N,
    2. Bennett C,
    3. Cowart S,
    4. Felzien M,
    5. Flores M,
    6. Flores R,
    7. et al
    . Boot camp translation: a method for building a community of solution. J Am Board Fam Med. 2013;26(3):254–63.
    OpenUrlAbstract/FREE Full Text
  10. ↵
    1. Murray D
    , ed. Design and Analysis of Group-Randomized Trials. New York, NY: Oxford University Press; 1998.
    1. Glynn RJ,
    2. Brookhart MA,
    3. Stedman M,
    4. Avorn J,
    5. Solomon DH
    . Design of cluster-randomized trials of quality improvement interventions aimed at medical care providers. Med Care. 2007;45(10)(Supl 2):S38–S43.
    OpenUrlCrossRefPubMed
  11. ↵
    1. Campbell MK,
    2. Piaggio G,
    3. Elbourne DR,
    4. Altman DG,
    5. Group C
    ; CONSORT Group. Consort 2010 statement: extension to cluster randomised trials. BMJ. 2012;345:e5661.
    OpenUrlFREE Full Text
  12. ↵
    1. Ivers NM,
    2. Halperin IJ,
    3. Barnsley J,
    4. et al
    . Allocation techniques for balance at baseline in cluster randomized trials: a methodological review. Trials. 2012;13(1):120.
    OpenUrlCrossRefPubMed
  13. ↵
    1. Westfall JM
    . Cold-spotting: linking primary care and public health to create communities of solution. J Am Board Fam Med. 2013;26(3): 239–40.
    OpenUrlAbstract/FREE Full Text
  14. ↵
    1. Dickinson LM,
    2. Beaty B,
    3. Fox C,
    4. Pace W,
    5. Dickinson WP,
    6. Emsermann C,
    7. et al
    . Pragmatic cluster randomized trials using covariate constrained randomization: a method for practice-based research networks (PBRNs). J Am Board Fam Med. 2015;28(5):663–72.
    OpenUrlAbstract/FREE Full Text
  15. ↵
    1. Li F,
    2. Lokhnygina Y,
    3. Murray DM,
    4. Heagerty PJ,
    5. DeLong ER
    . An evaluation of constrained randomization for the design and analysis of group-randomized trials. Stat Med. 2016;35(10):1565–1579.
    OpenUrl
  16. United States Census Bureau. American Community Survey 5-Year Estimates. 2009–2013. https://factfinder.census.gov/faces/tableservices/jsf/pages/productview.xhtml?pid=ACS_13_5YR_B03002&prodType=table. Accessed Feb 14, 2017.
  17. United States Department of Labor, Bureau of Labor Statistics. Local Area Unemployment Statistics (annual rate). https://www.bls.gov/lau/laucnty13.txt. Published 2013. Accessed Feb 14, 2017.
  18. United States Census Bureau. Small Area Health Insurance Estimates. https://www.census.gov/library/publications/2017/demo/p30-01.html. Published 2013. Accessed May 12, 2015.
  19. New Mexico Health Care Workforce Committee 2014 Annual Report. http://www.nmms.org/sites/default/files/images/2014_10_1nm_health_care_workforce_cmt_report_-_final_print.pdf. Published 2014 Accessed Apr 17, 2017.
PreviousNext
Back to top

In this issue

The Annals of Family Medicine: 16 (Suppl 1)
The Annals of Family Medicine: 16 (Suppl 1)
Vol. 16, Issue Suppl 1
April 2018
  • Table of Contents
  • Index by author
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on Annals of Family Medicine.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
A Community Engagement Method to Design Patient Engagement Materials for Cardiovascular Health
(Your Name) has sent you a message from Annals of Family Medicine
(Your Name) thought you would like to see the Annals of Family Medicine web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
1 + 3 =
Solve this simple math problem and enter the result. E.g. for 1+3, enter 4.
Citation Tools
A Community Engagement Method to Design Patient Engagement Materials for Cardiovascular Health
Aimee F. English, L. Miriam Dickinson, Linda Zittleman, Donald E. Nease, Alisha Herrick, John M. Westfall, Matthew J. Simpson, Douglas H. Fernald, Robert L. Rhyne, W. Perry Dickinson
The Annals of Family Medicine Apr 2018, 16 (Suppl 1) S58-S64; DOI: 10.1370/afm.2173

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Get Permissions
Share
A Community Engagement Method to Design Patient Engagement Materials for Cardiovascular Health
Aimee F. English, L. Miriam Dickinson, Linda Zittleman, Donald E. Nease, Alisha Herrick, John M. Westfall, Matthew J. Simpson, Douglas H. Fernald, Robert L. Rhyne, W. Perry Dickinson
The Annals of Family Medicine Apr 2018, 16 (Suppl 1) S58-S64; DOI: 10.1370/afm.2173
Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • INTRODUCTION
    • METHODS
    • RESULTS
    • DISCUSSION
    • Acknowledgments
    • Footnotes
    • References
  • Figures & Data
  • eLetters
  • Info & Metrics
  • PDF

Related Articles

  • No related articles found.
  • PubMed
  • Google Scholar

Cited By...

  • Practice-Based Research Networks: Asphalt on the Blue Highways of Primary Care Research
  • Using a Community Engagement Approach to Enhance Contraception Awareness in Rural Western North Carolina
  • Engaging practices and communities in the development of interventions to promote HPV vaccine uptake: a protocol for implementing Boot Camp Translation in the private practice setting
  • Practice Transformation Support and Patient Engagement to Improve Cardiovascular Care: From EvidenceNOW Southwest (ENSW)
  • Primary Care Practices' Implementation of Patient-Team Partnership: Findings from EvidenceNOW Southwest
  • Practice-based Research Network (PBRN) Engagement: 20+ Years and Counting
  • The Capacity of Primary Care for Improving Evidence-Based Care: Early Findings From AHRQs EvidenceNOW
  • Finding a Parsimonious Path for Primary Care Practice Transformation
  • Google Scholar

More in this TOC Section

  • Shared Decision Making Among Racially and/or Ethnically Diverse Populations in Primary Care: A Scoping Review of Barriers and Facilitators
  • Convenience or Continuity: When Are Patients Willing to Wait to See Their Own Doctor?
  • Feasibility and Acceptability of the “About Me” Care Card as a Tool for Engaging Older Adults in Conversations About Cognitive Impairment
Show more Original Research

Similar Articles

Subjects

  • Domains of illness & health:
    • Prevention

Keywords

  • patient engagement
  • community engagement
  • cardiovascular disease risk reduction
  • practice transformation
  • primary health care

Content

  • Current Issue
  • Past Issues
  • Early Access
  • Plain-Language Summaries
  • Multimedia
  • Podcast
  • Articles by Type
  • Articles by Subject
  • Supplements
  • Calls for Papers

Info for

  • Authors
  • Reviewers
  • Job Seekers
  • Media

Engage

  • E-mail Alerts
  • e-Letters (Comments)
  • RSS
  • Journal Club
  • Submit a Manuscript
  • Subscribe
  • Family Medicine Careers

About

  • About Us
  • Editorial Board & Staff
  • Sponsoring Organizations
  • Copyrights & Permissions
  • Contact Us
  • eLetter/Comments Policy

© 2025 Annals of Family Medicine