Skip to main content

Main menu

  • Home
  • Current Issue
  • Content
    • Current Issue
    • Early Access
    • Multimedia
    • Podcast
    • Collections
    • Past Issues
    • Articles by Subject
    • Articles by Type
    • Supplements
    • Plain Language Summaries
    • Calls for Papers
  • Info for
    • Authors
    • Reviewers
    • Job Seekers
    • Media
  • About
    • Annals of Family Medicine
    • Editorial Staff & Boards
    • Sponsoring Organizations
    • Copyrights & Permissions
    • Announcements
  • Engage
    • Engage
    • e-Letters (Comments)
    • Subscribe
    • Podcast
    • E-mail Alerts
    • Journal Club
    • RSS
    • Annals Forum (Archive)
  • Contact
    • Contact Us
  • Careers

User menu

  • My alerts

Search

  • Advanced search
Annals of Family Medicine
  • My alerts
Annals of Family Medicine

Advanced Search

  • Home
  • Current Issue
  • Content
    • Current Issue
    • Early Access
    • Multimedia
    • Podcast
    • Collections
    • Past Issues
    • Articles by Subject
    • Articles by Type
    • Supplements
    • Plain Language Summaries
    • Calls for Papers
  • Info for
    • Authors
    • Reviewers
    • Job Seekers
    • Media
  • About
    • Annals of Family Medicine
    • Editorial Staff & Boards
    • Sponsoring Organizations
    • Copyrights & Permissions
    • Announcements
  • Engage
    • Engage
    • e-Letters (Comments)
    • Subscribe
    • Podcast
    • E-mail Alerts
    • Journal Club
    • RSS
    • Annals Forum (Archive)
  • Contact
    • Contact Us
  • Careers
  • Follow annalsfm on Twitter
  • Visit annalsfm on Facebook
Research ArticleOriginal Research

Methods for Evaluating Practice Change Toward a Patient-Centered Medical Home

Carlos Roberto Jaén, Benjamin F. Crabtree, Raymond F. Palmer, Robert L. Ferrer, Paul A. Nutting, William L. Miller, Elizabeth E. Stewart, Robert Wood, Marivel Davila and Kurt C. Stange
The Annals of Family Medicine May 2010, 8 (Suppl 1) S9-S20; DOI: https://doi.org/10.1370/afm.1108
Carlos Roberto Jaén
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Benjamin F. Crabtree
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Raymond F. Palmer
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Robert L. Ferrer
MD, MPH
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Paul A. Nutting
MD, MSPH
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
William L. Miller
MD, MA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Elizabeth E. Stewart
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Robert Wood
DrPH
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Marivel Davila
MPH
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kurt C. Stange
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • eLetters
  • Info & Metrics
  • PDF
Loading

Article Figures & Data

Tables

  • Additional Files
    • View popup
    Table 1.

    Overview of Measures Used For the National Demonstration Project

    Practice StructureOutcomes
    Measure (Time Interval)Change ModelChange ProcessPractice CharacteristicsModel ContentPatient ExperiencePractice ExperienceQuality of Carea
    a Preventive care, chronic illness care, acute illness care, depression care.
    b Facilitated practices.
    c Self-directed practices.
    Quantitative
    Baseline practice survey (BPS)b,c (before 1/06)X–XX–X–
    Medical record auditb,c (baseline: 7/06; 9 months: 4/07; 26 months: 8/08)––––––X
    Patient outcomes survey (POS)b,c (baseline, 9 months, 26 months)–––XX–X
    Clinician staff questionnaire (CSQ)b,c (baseline, 9 months, 26 months)X–X––X–
    Financial surveyb,c (4/08)X–X––––
    Qualitative
    Facilitator-generated data
        Observation field notesb (7/06-12/07)XXX––X–
        Stakeholders interviewsb (7/06-8/06)XXX––X–
        Practice environment checklist (PEC)b (7/06-12/07)XXX––X–
    Evaluation team–generated data
        Regular monthly conference callsb (7/06-5/08)XXX––––
        E-mail streamsb (7/06-5/08)XXX––––
        Learning sessions (observational field notes/interviews)b (6/06, 10/06, 9/07, 4/08c)XXXX–––
        Evaluation team conference callsb,c (7/06-12/07)–XX––––
        Multiday site visits (observations/interviews)b,c (7/07-12/07; 6/08-10/08)XXXX–––
    Artifact data
        Web sites, practice documentsb,cXXXX–X–
    Multimethod
    TransforMED implementation indexb,c (7/06-3/08)–––X–––
    • View popup
    Table 2.

    Results of the Factor Analysis of the Clinician Staff Questionnaire

    Factors and ItemsAttribute Assessed
    Adaptive reserve (items loading >.40 across all samples; Cronbach α =.97)
        1. We regularly take time to consider ways to improve how we do thingsMindfulness
        2. People in our practice actively seek new ways to improve how we do thingsMindfulness
        3. People at all levels of this office openly talk about what is and isn’t workingMindfulness
        4. People are aware of how their actions affect others in this practiceHeedful interactions
        5. Most people in this practice are willing to change how they do things in response to feedback from othersRespectful interaction
        6. This practice encourages everyone (front office staff, clinical staff, nurses, and clinicians) to share ideasCognitive diversity
        7. I can rely on the other people in this practice to do their jobs wellTrust
        8. Difficult problems are solved through face-to-face discussions in this practiceCommunication
        9. We regularly take time to reflect on how we do thingsReflection
        10. After trying something new, we take time to think about how it workedReflection
        11. The practice leadership makes sure that we have the time and space necessary to discuss changes to improve careLeadership
        12. Leadership in this practice creates an environment where things can be accomplishedLeadership
        13. Practice leadership promotes an environment that is an enjoyable place to workLeadership
        14. Leadership strongly supports practice change effortsLeadership
        15. This practice learns from its mistakesLearning culture
        16. It is hard to get things to change in our practice (reverse score)Learning culture
        17. Mistakes have led to positive changes hereLearning culture
        18. People in this practice have the information that they need to do their jobs wellSensemaking
        19. When we experience a problem in the practice, we make a serious effort to figure out what’s really going onSensemaking
        20. I have many opportunities to grow in my workTeamwork (emergent property)
        21. People in this practice operate as a real teamTeamwork (emergent property)
        22. Most of the people who work in our practice seem to enjoy their workWork environment (emergent property)
        23. This practice is a place of joy and hopeWork environment (emergent property)
    Community knowledge (items loading >.60 across all samples; Cronbach α =.82)–
        1. This practice works effectively together as a team with community organizations–
        2. This practice utilizes community resources to meet the health care needs of patients–
        3. This practice is aware of community resources that are accessible to patients–
        4. People in this practice are connected with community organizations that serve patients–
    Health information technology integration (items loading >.60 across all samples; Cronbach α =.73)–
        1. The electronic medical record is well integrated into the practice’s daily work flow–
        2. The use of the electronic medical record during patient visits interferes with the doctor-patient relationship–
        3. I have what I need to do my work well–
        4. The practice can easily identify patients with a particular disease or medication–
    Cultural sensitivity (items loading >.60 across all samples; Cronbach α =.68)–
        1. I am aware of my racial/ethnic/cultural stereotypes–
        2. I believe cultural issues are important in my interaction with health professional colleagues–
        3. I believe cultural issues are important in my interactions with patients–
    Patient safety culture (items loading >.60 across all samples; Cronbach α =.81)–
        1. Staff feel like their mistakes are held against them–
        2. It is just by chance that more serious mistakes don’t happen in our practice–
        3. Staff worry that mistakes they make are kept in their personal file–
        4. Staff are afraid to ask questions when something does not seem right–
        5. We tend to let setbacks and problems stop our change efforts–

Additional Files

  • Tables
  • Supplemental Appendixes 1-10

    Supplemental Appendix 1. Baseline Practice Survey; Appendix 2. Medical Record Audit; Appendix 3. Depression Measures; Appendix 4. Clinician Staff Questionnaire; Appendix 5. Financial Survey; Appendix 6. Practice Environment Checklist; Appendix 7. TransforMED Key Stakeholder Interview Guide; Appendix 8. TransforMED Practice Interview Guide; Appendix 9. NDP Evaluation Team Site Visit Guide; Appendix 10. TransforMED Implementation Index

    Files in this Data Supplement:

    • Supplemental data: Appendix 1 - PDF file, 19 pages, 2.2MB
    • Supplemental data: Appendix 10 - PDF file, 10 pages, 1.5MB
    • Supplemental data: Appendix 2 - PDF file, 14 pages, 2.3MB
    • Supplemental data: Appendix 3 - PDF file, 2 pages 1.4MB
    • Supplemental data: Appendix 4 - PDF file, 8 pages, 1MB
    • Supplemental data: Appendix 5 - PDF file, 5 pages, 960KB
    • Supplemental data: Appendix 6 - PDF file, 16 pages, 2.5MB
    • Supplemental data: Appendix 7 - PDF file, 2 pages, 965KB
    • Supplemental data: Appendix 8 - PDF file, 5 pages, 1.6MB
    • Supplemental data: Appendix 9 - PDF file, 3 pages, 707KB
  • Shorter Adaptive Reserve Measures

    Shorter Adaptive Reserve Measures

    Files in this Data Supplement:

    • Shorter Adaptive Reserve Measures - PDF file, 2 pages
PreviousNext
Back to top

In this issue

The Annals of Family Medicine: 8 (Suppl 1)
The Annals of Family Medicine: 8 (Suppl 1)
Vol. 8, Issue Suppl 1
1 May 2010
  • Table of Contents
  • Index by author
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on Annals of Family Medicine.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Methods for Evaluating Practice Change Toward a Patient-Centered Medical Home
(Your Name) has sent you a message from Annals of Family Medicine
(Your Name) thought you would like to see the Annals of Family Medicine web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
3 + 15 =
Solve this simple math problem and enter the result. E.g. for 1+3, enter 4.
Citation Tools
Methods for Evaluating Practice Change Toward a Patient-Centered Medical Home
Carlos Roberto Jaén, Benjamin F. Crabtree, Raymond F. Palmer, Robert L. Ferrer, Paul A. Nutting, William L. Miller, Elizabeth E. Stewart, Robert Wood, Marivel Davila, Kurt C. Stange
The Annals of Family Medicine May 2010, 8 (Suppl 1) S9-S20; DOI: 10.1370/afm.1108

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Get Permissions
Share
Methods for Evaluating Practice Change Toward a Patient-Centered Medical Home
Carlos Roberto Jaén, Benjamin F. Crabtree, Raymond F. Palmer, Robert L. Ferrer, Paul A. Nutting, William L. Miller, Elizabeth E. Stewart, Robert Wood, Marivel Davila, Kurt C. Stange
The Annals of Family Medicine May 2010, 8 (Suppl 1) S9-S20; DOI: 10.1370/afm.1108
Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • INTRODUCTION
    • METHODS
    • RESULTS
    • DISCUSSION
    • Acknowledgments
    • Footnotes
    • REFERENCES
  • Figures & Data
  • eLetters
  • Info & Metrics
  • PDF

Related Articles

  • PubMed
  • Google Scholar

Cited By...

  • How Does Prior Experience Pay Off in Large-Scale Quality Improvement Initiatives?
  • The EvidenceNOW Practice Support Initiative: The Heart of Virginia Healthcare
  • How Does Prior Experience Pay Off in Large-Scale Quality Improvement Initiatives?
  • The 3 Cs of Content, Context, and Concepts: A Practical Approach to Recording Unstructured Field Observations
  • Does Ownership Make a Difference in Primary Care Practice?
  • Evaluation of an Electronic Health Record (EHR) Tool for Integrated Behavioral Health in Primary Care
  • Correlates of Burnout in Small Independent Primary Care Practices in an Urban Setting
  • The Capacity of Primary Care for Improving Evidence-Based Care: Early Findings From AHRQs EvidenceNOW
  • Organizational Leadership and Adaptive Reserve in Blood Pressure Control: The Heart Health NOW Study
  • Quality of Cardiovascular Disease Care in Small Urban Practices
  • Use of Quality Improvement Strategies Among Small to Medium-Size US Primary Care Practices
  • Federally Qualified Health Center Clinicians And Staff Increasingly Dissatisfied With Workplace Conditions
  • Integrating Quantitative and Qualitative Results in Health Science Mixed Methods Research Through Joint Displays
  • Health IT-Enabled Care Coordination: A National Survey of Patient-Centered Medical Home Clinicians
  • Recommendations for a Mixed Methods Approach to Evaluating the Patient-Centered Medical Home
  • Perspectives in Primary Care: Implementing Patient-Centered Care Coordination for Individuals with Multiple Chronic Medical Conditions
  • Organizational Culture Associated With Provider Satisfaction
  • Team Structure and Culture Are Associated With Lower Burnout in Primary Care
  • Practice Facilitation to Improve Diabetes Care in Primary Care: A Report From the EPIC Randomized Clinical Trial
  • A Positive Deviance Approach to Understanding Key Features to Improving Diabetes Care in the Medical Home
  • Medical Home Transformation in Pediatric Primary Care--What Drives Change?
  • The Role of the Champion in Primary Care Change Efforts: From the State Networks of Colorado Ambulatory Practices and Partners (SNOCAP)
  • Correlation of the Care by Design™ Primary Care Practice Redesign Model and the Principles of the Patient-Centered Medical Home
  • Google Scholar

More in this TOC Section

  • Family-Based Interventions to Promote Weight Management in Adults: Results From a Cluster Randomized Controlled Trial in India
  • Teamwork Among Primary Care Staff to Achieve Regular Follow-Up of Chronic Patients
  • Shared Decision Making Among Racially and/or Ethnically Diverse Populations in Primary Care: A Scoping Review of Barriers and Facilitators
Show more Original Research

Similar Articles

Subjects

  • Domains of illness & health:
    • Chronic illness
  • Methods:
    • Quantitative methods
    • Mixed methods
  • Other research types:
    • Health policy
  • Core values of primary care:
    • Access
    • Continuity
    • Personalized care
  • Other topics:
    • Health informatics
    • Quality improvement
    • Organizational / practice change
    • Patient-centered medical home
    • Mindfulness and reflection

Content

  • Current Issue
  • Past Issues
  • Early Access
  • Plain-Language Summaries
  • Multimedia
  • Podcast
  • Articles by Type
  • Articles by Subject
  • Supplements
  • Calls for Papers

Info for

  • Authors
  • Reviewers
  • Job Seekers
  • Media

Engage

  • E-mail Alerts
  • e-Letters (Comments)
  • RSS
  • Journal Club
  • Submit a Manuscript
  • Subscribe
  • Family Medicine Careers

About

  • About Us
  • Editorial Board & Staff
  • Sponsoring Organizations
  • Copyrights & Permissions
  • Contact Us
  • eLetter/Comments Policy

© 2025 Annals of Family Medicine