Skip to main content

Main menu

  • Home
  • Current Issue
  • Content
    • Current Issue
    • Early Access
    • Multimedia
    • Podcast
    • Collections
    • Past Issues
    • Articles by Subject
    • Articles by Type
    • Supplements
    • Plain Language Summaries
    • Calls for Papers
  • Info for
    • Authors
    • Reviewers
    • Job Seekers
    • Media
  • About
    • Annals of Family Medicine
    • Editorial Staff & Boards
    • Sponsoring Organizations
    • Copyrights & Permissions
    • Announcements
  • Engage
    • Engage
    • e-Letters (Comments)
    • Subscribe
    • Podcast
    • E-mail Alerts
    • Journal Club
    • RSS
    • Annals Forum (Archive)
  • Contact
    • Contact Us
  • Careers

User menu

  • My alerts

Search

  • Advanced search
Annals of Family Medicine
  • My alerts
Annals of Family Medicine

Advanced Search

  • Home
  • Current Issue
  • Content
    • Current Issue
    • Early Access
    • Multimedia
    • Podcast
    • Collections
    • Past Issues
    • Articles by Subject
    • Articles by Type
    • Supplements
    • Plain Language Summaries
    • Calls for Papers
  • Info for
    • Authors
    • Reviewers
    • Job Seekers
    • Media
  • About
    • Annals of Family Medicine
    • Editorial Staff & Boards
    • Sponsoring Organizations
    • Copyrights & Permissions
    • Announcements
  • Engage
    • Engage
    • e-Letters (Comments)
    • Subscribe
    • Podcast
    • E-mail Alerts
    • Journal Club
    • RSS
    • Annals Forum (Archive)
  • Contact
    • Contact Us
  • Careers
  • Follow annalsfm on Twitter
  • Visit annalsfm on Facebook
Research ArticleOriginal Research

A New Comprehensive Measure of High-Value Aspects of Primary Care

Rebecca S. Etz, Stephen J. Zyzanski, Martha M. Gonzalez, Sarah R. Reves, Jonathan P. O’Neal and Kurt C. Stange
The Annals of Family Medicine May 2019, 17 (3) 221-230; DOI: https://doi.org/10.1370/afm.2393
Rebecca S. Etz
1Larry A. Green Center for the Advancement of Primary Health Care for the Public Good
2Department of Family Medicine and Population Health, Virginia Commonwealth University, Richmond, Virginia
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: rebecca.etz@vcuhealth.org
Stephen J. Zyzanski
3Center for Community Health Integration, Departments of Family Medicine & Community Health, Population & Quantitative Health Sciences, Case Western Reserve University, Cleveland, Ohio
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Martha M. Gonzalez
1Larry A. Green Center for the Advancement of Primary Health Care for the Public Good
2Department of Family Medicine and Population Health, Virginia Commonwealth University, Richmond, Virginia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sarah R. Reves
1Larry A. Green Center for the Advancement of Primary Health Care for the Public Good
2Department of Family Medicine and Population Health, Virginia Commonwealth University, Richmond, Virginia
MSN, FNP-C
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jonathan P. O’Neal
1Larry A. Green Center for the Advancement of Primary Health Care for the Public Good
2Department of Family Medicine and Population Health, Virginia Commonwealth University, Richmond, Virginia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kurt C. Stange
1Larry A. Green Center for the Advancement of Primary Health Care for the Public Good
3Center for Community Health Integration, Departments of Family Medicine & Community Health, Population & Quantitative Health Sciences, Case Western Reserve University, Cleveland, Ohio
4Departments of General Medical Sciences and Sociology, and Case Comprehensive Cancer Center, Case Western Reserve University, Cleveland, Ohio
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • eLetters
  • Info & Metrics
  • PDF
Loading

Published eLetters

If you would like to comment on this article, click on Submit a Response to This article, below. We welcome your input.

Submit a Response to This Article
Compose eLetter

More information about text formats

Plain text

  • No HTML tags allowed.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Lines and paragraphs break automatically.
Author Information
First or given name, e.g. 'Peter'.
Your last, or family, name, e.g. 'MacMoody'.
Your email address, e.g. higgs-boson@gmail.com
Your role and/or occupation, e.g. 'Orthopedic Surgeon'.
Your organization or institution (if applicable), e.g. 'Royal Free Hospital'.
Statement of Competing Interests
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Image CAPTCHA
Enter the characters shown in the image.

Vertical Tabs

Jump to comment:

  • Visit length and PCPCM score- might this be interesting?
    Melissa Weakland
    Published on: 12 September 2019
  • Author response Re: The Importance of Language
    Rebecca S. Etz
    Published on: 06 June 2019
  • The importance of language in representing the results of research
    Eamon C. Armstrong
    Published on: 04 June 2019
  • A New Comprehensive Measure but...
    John H Wasson
    Published on: 04 June 2019
  • Re:An important step in rational measurement of primary care
    Sherry M. Adkins
    Published on: 29 May 2019
  • An important step in rational measurement of primary care
    L Gordon Moore
    Published on: 20 May 2019
  • Published on: (12 September 2019)
    Page navigation anchor for Visit length and PCPCM score- might this be interesting?
    Visit length and PCPCM score- might this be interesting?
    • Melissa Weakland, Family Medicine Physician

    I'd like to thank the authors for their work and for helping forward the conversation in metrics and quality measures. Having followed the work of Dr Wasson in this arena, I'm glad to see additional research that will hopefully be additive to his and others quest for true measurements of caring for people that actually helps improve quality and guide cost reduction.

    As a busy clinical primary care physician, it...

    Show More

    I'd like to thank the authors for their work and for helping forward the conversation in metrics and quality measures. Having followed the work of Dr Wasson in this arena, I'm glad to see additional research that will hopefully be additive to his and others quest for true measurements of caring for people that actually helps improve quality and guide cost reduction.

    As a busy clinical primary care physician, it is a discouraging daily battle providing quality medicine to my patients while having to defend my care with data and measures that are inadequate and have been shown to have no correlation with improved outcomes or cost reduction. It is hard as a clinician to stay inspired in daily work when this is the environment. This article was a pleasant dose of fresh air that we as primary physicians are being heard and that the path of quality metrics has the possibility of finding a new and helpful route.

    I fully agree with Dr Moore's comment that now is the time to expand the use of this elegant tool and study its relationship to cost and utilization.

    I would add that I would like to see the additional parameter of visit length included in the cross analysis. I believe this would be an important additional hypothesis to test and could be influential in helping to guide the future of how we provide primary care. If a positive association between longer visit times and a higher PCPCM score were found, and if higher PCPCM scores are shown to be correlated with reduced overall healthcare costs, this could dramatically affect the path of future primary care delivery models and reimbursement.

    Competing interests: None declared

    Show Less
    Competing Interests: None declared.
  • Published on: (6 June 2019)
    Page navigation anchor for Author response Re: The Importance of Language
    Author response Re: The Importance of Language
    • Rebecca S. Etz, Co-Director

    We thank Dr. Armstrong for her interest in and support of our work on the Person-Centered Primary Care measure.

    The use of the word "parsimonious" in our article refers to parsimonious theory and the principle of parsimony, sometimes referred to as Occam's razor. Within research and science, the principle of parsimony is based on limiting assumptions and limiting unnecessary elements when identifying a scientifi...

    Show More

    We thank Dr. Armstrong for her interest in and support of our work on the Person-Centered Primary Care measure.

    The use of the word "parsimonious" in our article refers to parsimonious theory and the principle of parsimony, sometimes referred to as Occam's razor. Within research and science, the principle of parsimony is based on limiting assumptions and limiting unnecessary elements when identifying a scientific solution - the simplest answer is often the best. This principle has been identified and promoted within US healthcare and measures work, as exemplified by the concluding statement with the Institute of Medicine's report (now the National Academy of Medicine), Vital Signs: Core Metrics for Health and Health Care Progress (1):

    A parsimonious and standardized set of core measures aimed substantially at outcomes could improve the ability of both decision makers and the public to direct their attention and understanding to the most important issues in health and health care.

    (1) Institute of Medicine. Vital signs: Core metrics for health and health care progress. Washington DC: The National Academies Press;2015.

    Competing interests: None declared

    Show Less
    Competing Interests: None declared.
  • Published on: (4 June 2019)
    Page navigation anchor for The importance of language in representing the results of research
    The importance of language in representing the results of research
    • Eamon C. Armstrong, Family Physician

    The article by Etz et al. is a well done study which adds to what we know about what constitutes comprehensive and effective primary care. I was confused however by the repeated use of the word 'parsimonious' in the methods, results and conclusions sections of the abstract. 'Parsimonious' as I understand it is has a negative connotation - and according to the Online Merriam Webster dictionary is an adjective meaning "unwi...

    Show More

    The article by Etz et al. is a well done study which adds to what we know about what constitutes comprehensive and effective primary care. I was confused however by the repeated use of the word 'parsimonious' in the methods, results and conclusions sections of the abstract. 'Parsimonious' as I understand it is has a negative connotation - and according to the Online Merriam Webster dictionary is an adjective meaning "unwilling to spend money or use resources; stingy or frugal." Synonyms include terms like "meanness, miserliness, close-fistedness, penny-pinching, and frugality - leave no doubt as to what the word means. Given this, I came away confused as to what the author's intended meaning was. The results of good research are diminished when not communicated in a clear and succinct fashion.

    Competing interests: None declared

    Show Less
    Competing Interests: None declared.
  • Published on: (4 June 2019)
    Page navigation anchor for A New Comprehensive Measure but...
    A New Comprehensive Measure but...
    • John H Wasson, Emeritus Professor Medicine and Community and Family Medicine

    Etz et al. are to be congratulated for their tour de force entitled: A New Comprehensive Measure of High-Value Aspects of Primary Care. (1) I was asked to comment and emphasize that this new multi-item measure was associated with a very brief "What Matters Index" (or WMI in their text): a measure that is strongly associated with patients' quality of life, explicitly guides care, and predicts future costly emergency and h...

    Show More

    Etz et al. are to be congratulated for their tour de force entitled: A New Comprehensive Measure of High-Value Aspects of Primary Care. (1) I was asked to comment and emphasize that this new multi-item measure was associated with a very brief "What Matters Index" (or WMI in their text): a measure that is strongly associated with patients' quality of life, explicitly guides care, and predicts future costly emergency and hospital utilization. (2)

    I would be remiss, however, if I did not point out that the authors assertion that this New Comprehensive Measure "provides a practical approach that allows the breadth of general practice to be assessed without the untenable burden of representing each construct with multiple measures" seems an overstatement. It may be true that this "crowd-sourced", 11 item compilation by clinicians, patients, payers, and experts is better and shorter than many others, but it its administration and scoring would be many times more expensive and burdensome than a single item. And, though each of its 11 items make both statistical and "crowd-sourced" sense, the very high inter-correlations suggest that patients satisfied or dissatisfied with their overall experience will probably be unable to differentiate very well among different constructs of care.

    In other words, if this new comprehensive measure for primary care is used to rank practices, future investigators must demonstrate that, for the benefit of clinicians, each item reliably and usefully discriminates between attributes and deficiencies of services. They must also rigorously compare its cost-effectiveness with a proved single item, patient-reported measure for ranking practices. (3) Absent real-world proof of value, another multi-item measure will neither modify the measurement paradigm nor question its very assumptions. (4)

    1. Etz RS, Zyzanski SJ, Gonzalez MM, Reves SR, O'Neal JP and Stange KC. A New Comprehensive Measure of High-Value Aspects of Primary Care Ann Fam Med May/June 2019 17:221-230; doi:10.1370/afm.2393. http://www.annfammed.org/content/17/3/221.full

    2. Wasson JH, Ho L, Soloway L, Moore LG (2018) Validation of the What Matters Index: A brief, patient-reported index that guides care for chronic conditions and can substitute for computer-generated risk models. PLoS ONE 13(2): e0192475. https://doi.org/10.1371/journal.pone.0192475

    3. Lynn Ho, MD; Adam Swartz, MD; John H. Wasson, MD. The Right Tool for the Right Job:The Value of Alternative Patient Experience Measures. 2013. J Ambulatory Care Manage Vol. 36, No. 3, pp. 241-244. https://www.researchgate.net/publication/262043479_The_right_tool_for_the_right_job_The_value_of_alternative_patient_experience_measures

    4. Kurt C. Stange. Modifying the Measurement Paradigm or Questioning its Very Assumptions Ann Fam Med July/August 2015 13:384-385; doi:10.1370/afm.1827. http://www.annfammed.org/content/13/4/384.full

    Competing interests: None declared

    Show Less
    Competing Interests: None declared.
  • Published on: (29 May 2019)
    Page navigation anchor for Re:An important step in rational measurement of primary care
    Re:An important step in rational measurement of primary care
    • Sherry M. Adkins, family physician

    It is exciting to consider an objective measure concerned with the aspects of medicine that patients and physicians value most. This kind of a measure gets me and what I want to create and see in my practice.

    Competing interests: None declared

    Competing Interests: None declared.
  • Published on: (20 May 2019)
    Page navigation anchor for An important step in rational measurement of primary care
    An important step in rational measurement of primary care
    • L Gordon Moore, Medical Director

    The US health care system spends too much time measuring processes and minutia in an attempt to get a handle on costs and quality. Much of this burden is focused on a very stressed primary care workforce, diverting precious effort from patient care.

    Quality measurement is a good idea given the amount of waste and the opportunities for improvement exposed in many studies, yet our current paradigm of quality mea...

    Show More

    The US health care system spends too much time measuring processes and minutia in an attempt to get a handle on costs and quality. Much of this burden is focused on a very stressed primary care workforce, diverting precious effort from patient care.

    Quality measurement is a good idea given the amount of waste and the opportunities for improvement exposed in many studies, yet our current paradigm of quality measurement as a raft of small metrics is sinking under its own weight.

    Barbara Starfield and others published extensively on the value of primary care as a foundation of high performing health systems, but the measurement of primary care cannot be reduced to a handful of process indicators and laboratory values.

    Etz et al present an elegantly simple tool that can simultaneously plumb the depths and span the breadth of primary care. Now is the time to expand its use and study its relationship to cost and utilization.

    It is high time we adopt a new paradigm of measurement better aligned with the outcomes we want and need: less spending and effort on minutia, more care for people.

    Competing interests: None declared

    Show Less
    Competing Interests: None declared.
PreviousNext
Back to top

In this issue

The Annals of Family Medicine: 17 (3)
The Annals of Family Medicine: 17 (3)
Vol. 17, Issue 3
May/June 2019
  • Table of Contents
  • Index by author
  • Back Matter (PDF)
  • Front Matter (PDF)
  • In Brief
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on Annals of Family Medicine.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
A New Comprehensive Measure of High-Value Aspects of Primary Care
(Your Name) has sent you a message from Annals of Family Medicine
(Your Name) thought you would like to see the Annals of Family Medicine web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
8 + 9 =
Solve this simple math problem and enter the result. E.g. for 1+3, enter 4.
Citation Tools
A New Comprehensive Measure of High-Value Aspects of Primary Care
Rebecca S. Etz, Stephen J. Zyzanski, Martha M. Gonzalez, Sarah R. Reves, Jonathan P. O’Neal, Kurt C. Stange
The Annals of Family Medicine May 2019, 17 (3) 221-230; DOI: 10.1370/afm.2393

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Get Permissions
Share
A New Comprehensive Measure of High-Value Aspects of Primary Care
Rebecca S. Etz, Stephen J. Zyzanski, Martha M. Gonzalez, Sarah R. Reves, Jonathan P. O’Neal, Kurt C. Stange
The Annals of Family Medicine May 2019, 17 (3) 221-230; DOI: 10.1370/afm.2393
Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • INTRODUCTION
    • METHODS
    • RESULTS
    • DISCUSSION
    • Acknowledgments
    • Footnotes
    • References
  • Figures & Data
  • eLetters
  • Info & Metrics
  • PDF

Related Articles

  • PubMed
  • Google Scholar

Cited By...

  • Convenience or Continuity: When Are Patients Willing to Wait to See Their Own Doctor?
  • Development of the Tool for Advancing Practice Performance, a practice-level survey to assess primary care structures and processes
  • Dutch Translation and Psychometric Evaluation of the Person-Centered Primary Care Measure
  • Missing the person: Are preventive medicine and clinical practice guidelines contributing to physician burnout?
  • Omettre la personne: La medecine preventive et les lignes directrices de pratique clinique contribuent-elles a lepuisement professionnel des medecins?
  • Treatment burden in multiple long-term conditions: a mixed-methods study protocol
  • Time for Family Medicine to Stop Enabling a Dysfunctional Health Care System
  • How the Novel Person-Centered Primary Care Measure Performs in Canada
  • Clinical Quality Measures: A Challenge for-and to-Family Physicians
  • Measuring Primary Care Across 35 OECD Countries
  • Exploration of the psychometric properties of the Person-Centred Primary Care Measure (PCPCM) in a Chinese primary care population in Hong Kong: a cross-sectional validation study
  • Developing measures to capture the true value of primary care
  • Standardization vs Customization: Finding the Right Balance
  • Cultural adaptation and content validity of a Chinese translation of the "Person-Centered Primary Care Measure": findings from cognitive debriefing
  • Exploring the psychometric properties of the Working Alliance Inventory in general practice: a cross-sectional study
  • Protocol for an implementation and realist evaluation of a new organisational model for primary care practices in the canton of Vaud, Switzerland
  • Cultural adaptation and content validity of a Chinese translation of the 'Person-Centered Primary Care Measure: findings from cognitive debriefing
  • Assessing the Longitudinal Impact of Physician-Patient Relationship on Functional Health
  • Primary Care Is an Essential Ingredient to a Successful Population Health Improvement Strategy
  • Physical Distancing With Social Connectedness
  • In This Issue: Changing Prescriptions for Change
  • Google Scholar

More in this TOC Section

  • Adverse Outcomes Associated With Inhaled Corticosteroid Use in Individuals With Chronic Obstructive Pulmonary Disease
  • Family-Based Interventions to Promote Weight Management in Adults: Results From a Cluster Randomized Controlled Trial in India
  • Teamwork Among Primary Care Staff to Achieve Regular Follow-Up of Chronic Patients
Show more Original Research

Similar Articles

Subjects

  • Methods:
    • Quantitative methods
    • Mixed methods
    • Cross-disciplinary
  • Other research types:
    • Professional practice
  • Core values of primary care:
    • Access
    • Continuity
    • Comprehensiveness
    • Coordination / integration of care
    • Personalized care
    • Relationship
  • Other topics:
    • Patient-centered medical home
    • Patient perspectives

Keywords

  • measurement
  • metrics
  • primary care
  • population health
  • quality

Content

  • Current Issue
  • Past Issues
  • Early Access
  • Plain-Language Summaries
  • Multimedia
  • Podcast
  • Articles by Type
  • Articles by Subject
  • Supplements
  • Calls for Papers

Info for

  • Authors
  • Reviewers
  • Job Seekers
  • Media

Engage

  • E-mail Alerts
  • e-Letters (Comments)
  • RSS
  • Journal Club
  • Submit a Manuscript
  • Subscribe
  • Family Medicine Careers

About

  • About Us
  • Editorial Board & Staff
  • Sponsoring Organizations
  • Copyrights & Permissions
  • Contact Us
  • eLetter/Comments Policy

© 2025 Annals of Family Medicine