Skip to main content

Main menu

  • Home
  • Content
    • Current Issue
    • Online First
    • Multimedia
    • Collections
    • Past Issues
    • Articles by Subject
    • Articles by Type
    • Supplements
    • Plain Language Summaries
    • Call for Papers
  • Info for
    • Authors
    • Reviewers
    • Media
    • Job Seekers
  • About
    • Annals of Family Medicine
    • Editorial Staff & Boards
    • Sponsoring Organizations
    • Copyrights & Permissions
    • Announcements
  • Engage
    • Engage
    • e-Letters (Comments)
    • Subscribe
    • RSS
    • Email Alerts
    • Journal Club
    • Annals Forum (Archive)
  • Contact
    • Feedback
    • Contact Us
  • Careers

User menu

  • My alerts

Search

  • Advanced search
Annals of Family Medicine
  • My alerts
Annals of Family Medicine

Advanced Search

  • Home
  • Content
    • Current Issue
    • Online First
    • Multimedia
    • Collections
    • Past Issues
    • Articles by Subject
    • Articles by Type
    • Supplements
    • Plain Language Summaries
    • Call for Papers
  • Info for
    • Authors
    • Reviewers
    • Media
    • Job Seekers
  • About
    • Annals of Family Medicine
    • Editorial Staff & Boards
    • Sponsoring Organizations
    • Copyrights & Permissions
    • Announcements
  • Engage
    • Engage
    • e-Letters (Comments)
    • Subscribe
    • RSS
    • Email Alerts
    • Journal Club
    • Annals Forum (Archive)
  • Contact
    • Feedback
    • Contact Us
  • Careers
  • Follow annalsfm on Twitter
  • Visit annalsfm on Facebook
Research ArticleOriginal Research

Risk Stratification Methods and Provision of Care Management Services in Comprehensive Primary Care Initiative Practices

Ashok Reddy, Laura Sessums, Reshma Gupta, Janel Jin, Tim Day, Bruce Finke and Asaf Bitton
The Annals of Family Medicine September 2017, 15 (5) 451-454; DOI: https://doi.org/10.1370/afm.2124
Ashok Reddy
1Center for Medicare & Medicaid Innovation, Baltimore, Maryland
2Division of General Internal Medicine, University of Washington, Seattle, Washington
3Center for Scholarship in Patient Care Quality and Safety, University of Washington Medicine, Seattle, Washington
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: reddya@uw.edu
Laura Sessums
1Center for Medicare & Medicaid Innovation, Baltimore, Maryland
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Reshma Gupta
1Center for Medicare & Medicaid Innovation, Baltimore, Maryland
4VA/Robert Wood Johnson Clinical Scholars Program, Chapel Hill, North Carolina
5Department of Medicine, University of California Los Angeles, Los Angeles, California
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Janel Jin
1Center for Medicare & Medicaid Innovation, Baltimore, Maryland
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tim Day
1Center for Medicare & Medicaid Innovation, Baltimore, Maryland
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Bruce Finke
1Center for Medicare & Medicaid Innovation, Baltimore, Maryland
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Asaf Bitton
1Center for Medicare & Medicaid Innovation, Baltimore, Maryland
6Department of Health Policy, Harvard Medical School, Boston, Massachusetts
7Division of General Medicine, Brigham and Women’s Hospital, Boston, Massachusetts
8Ariadne Labs, Brigham and Women’s Hospital and Harvard School of Public Health, Boston, Massachusetts
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Info & Metrics
  • eLetters
  • PDF
Loading

Abstract

PURPOSE Risk-stratified care management is essential to improving population health in primary care settings, but evidence is limited on the type of risk stratification method and its association with care management services.

METHODS We describe risk stratification patterns and association with care management services for primary care practices in the Comprehensive Primary Care (CPC) initiative. We undertook a qualitative approach to categorize risk stratification methods being used by CPC practices and tested whether these stratification methods were associated with delivery of care management services.

RESULTS CPC practices reported using 4 primary methods to stratify risk for their patient populations: a practice-developed algorithm (n = 215), the American Academy of Family Physicians’ clinical algorithm (n = 155), payer claims and electronic health records (n = 62), and clinical intuition (n = 52). CPC practices using practice-developed algorithm identified the most number of high-risk patients per primary care physician (282 patients, P = .006). CPC practices using clinical intuition had the most high-risk patients in care management and a greater proportion of high-risk patients receiving care management per primary care physician (91 patients and 48%, P =.036 and P =.128, respectively).

CONCLUSIONS CPC practices used 4 primary methods to identify high-risk patients. Although practices that developed their own algorithm identified the greatest number of high-risk patients, practices that used clinical intuition connected the greatest proportion of patients to care management services.

  • primary health care
  • comprehensive health care
  • patient care management
  • chronic care
  • payment reform

INTRODUCTION

The Comprehensive Primary Care (CPC) initiative is a multipayer initiative of the Center for Medicare & Medicaid Innovation (CMMI) designed to improve primary care payment to and care delivery by more than 2,000 practitioners who serve approximately 2.5 million patients.1 Medicare and other CPC payer partners pay participating practices a population-based care management fee that supports enhanced services not traditionally paid for by fee for service, including care management. A key care delivery requirement in CPC is to provide risk-stratified care management. CPC requires practices to stratify their patient population into tiers of health care risk using an approach of their choice and then to provide care management to patients most likely to benefit.

Implementation of risk-stratified care management can help target limited practice resources to patients most in need of services and potentially reduce costs and improve patient outcomes.2 This study describes the types of various risk stratification methods used in CPC practices and associates risk stratification methods with the provision of care management services. We conducted an analysis of risk stratification methods CPC practices adopted in the first year of the program (October 2012 to December 2013).

METHODS

In early 2014, CPC practices submitted documentation describing their approach to risk stratification of their patient population and responded to questions on implementation of care management services. We used a modified grounded theory approach and a constant comparative method to analyze CPC practices’ responses.3–4 Two members of the research team (A.R., A.B.) determined the methods to categorize risk stratification used by practices. If a practice used multiple methods to stratify risk, both researchers reviewed the documents and, through consensus, assigned a primary method.

Practices were given the opportunity to place patients in up to 6 different risk tiers, including tiers for low risk/no risk and not assigned to risk tier. The practice reported the number of patients in each tier. We used the highest 2 risk tiers to define high-risk patients to capture patients with rising risk who may benefit from care management services. Additionally, we acknowledge that some patients at highest risk may not engage in care management services, in part because of underlying medical or psychosocial conditions. CPC practices attested to the number of patients in each tier who received care management services.

For our main analysis, we used one-way analysis of variance to determine whether the number of high-risk patients, the number of high-risk patients receiving care management services, and the percentage of high-risk patients receiving care management services differed by primary risk stratification method. We calculated variables for each outcome using full-time equivalent physicians per practice.5 We conducted an additional analysis controlling for available practice-level data using a generalized linear equation to test whether the risk stratification method was associated with differences in outcomes.

RESULTS

Of 492 practices participating as of December 2013 in CPC, 484 submitted complete data on risk stratification method, number of patients in the highest 2 risk tiers, and number of patients in the highest 2 risk tiers receiving care management services. The responding CPC practices are a diverse group, including solo primary care practices (16%) and large primary group practices (more than 7 physicians, 19%). Approximately 40% of practices had medical home recognition from their state or from the National Committee for Quality Assurance (NCQA),6 and most practices were located in metropolitan areas (Table 1).

View this table:
  • View inline
  • View popup
Table 1

Comprehensive Primary Care Initiative Practice Demographics

Practices used a variety of approaches to stratify their patient into tiers of risk. We categorized the approach by first assessing whether a practice used a preexisting computer or claims-based algorithm to define high risk. Relatively few practices (13%, Table 2) used existing electronic health record (EHR) software tools or a risk score algorithm based on claims. Next, we categorized the remaining practices based on whether they (1) created their own score or algorithm to define high-risk patients (practice-developed algorithm), (2) used the American Academy of Family Physicians’ (AAFP) risk stratification algorithm,7 or (3) defined risk solely by clinical intuition. Most CPC practices (44%) created their own algorithm using a combination of patient’s chronic conditions, age, and hospitalizations in the past year, then scored by stratifying patients into tiers based on these factors. Approximately 30% used the AAFP risk stratification algorithm, which assigns patients to 1 of 6 risk tiers based on primary health care needs (ranging from “primary prevention” to “catastrophic”).10,11 Few practices (11%) used clinician intuition as the primary method to identify high-risk patients.

View this table:
  • View inline
  • View popup
Table 2

Comprehensive Primary Care Practice Risk Stratification Method

Practices that developed their own algorithm identified more patients in the highest 2 risk tiers (mean per physician = 282 patients) than practices that used the AAFP algorithm (mean per physician = 181 patients), an algorithm derived from claims and EHR data (mean per physician = 171 patients), or clinical intuition (mean per physician = 218 patients) (Table 2). Practices using a practice-developed algorithm, however, had significantly fewer patients receiving care management (mean per physician = 69 patients) when compared with practices using clinical intuition (mean per physician = 91 patients). Moreover, the overall percentage of high-risk patients who received care management differed by risk stratification method: clinical intuition (48%), payer claims and EHRs (43%), practice-developed algorithm (37%), and AAFP clinical algorithm (36%). After adjusting for practice-level characteristics, the results were not meaningfully different (data not shown).

DISCUSSION

We found that CPC practices used 1 of 4 primary methods to identify high-risk patients for care management: a practice-developed algorithm, the AAFP algorithm, existing claims and EHR-based tools, and clinical intuition. At the end of the first year, practices that developed their own algorithm identified the greatest number of high-risk patients. Practices that primarily used clinical intuition, potentially cheaper and faster to implement, provided care management to the greatest proportion of high-risk patients.

Our study highlights 2 major steps in implementing risk-stratified care management: (1) identifying the high-risk patients, and (2) effectively connecting these patients with care management. Current widely used methods to characterize high-risk patients focus on claims-based algorithms that account primarily for health care utilization patterns.8 These methods do not necessarily align with clinicians’ definition of complexity, which includes behavioral, social, and economic needs.9–13 Moreover, busy primary care practices may need longer than 1 year to create new workflows to review empaneled patients, categorize patients into different risk tiers, and establish care management services.

Our study has several limitations. First, the data gathered are primarily self-reported by CPC practices. Practices, however, reported these data with the understanding that random audits of their reported data would occur. Second, ours is a descriptive study of cross-sectional data, which limits our ability to examine causality. Third, although our sample is large and geographically diverse, it is not nationally representative of primary care practices. Practices that participated in CPC were willing to devote resources to changing practice care delivery and met selection criteria.

Despite these limitations, our results offer important insights into primary care implementation of risk-stratified care management. The experience of CPC practices suggests that risk-stratified care management requires stable funding mechanisms from multiple payers.14,15 CPC laid the foundation for practice requirements in Comprehensive Primary Care Plus (CPC+), a new CMMI initiative extending the work of CPC.15,16 Clinicians in track 2 of CPC+ will use both intuition and an algorithm as part of a 2-step process of risk stratification, which has been found to be more effective at identifying high-risk patients.17–19 As payers shift reimbursement from volume-based to a value-driven care, we expect more primary care practices to focus on finding the best ways to implement high-risk care management.

Footnotes

  • Conflicts of interest: authors report none.

  • Received for publication November 29, 2016.
  • Revision received February 22, 2017.
  • Accepted for publication May 3, 2017.
  • © 2017 Annals of Family Medicine, Inc.

References

  1. ↵
    1. Taylor EF,
    2. Dale S,
    3. Peikes D,
    4. et al
    . Evaluation of the Comprehensive Primary Care initiative: first annual report. Math Policy Res January 2015. 2015. https://www.mathematica-mpr.com/~/media/publications/pdfs/health/cpci_1stannualrpt.pdf. Accessed Mar 9, 2016.
  2. ↵
    1. Powers BW,
    2. Chaguturu SK,
    3. Ferris TG
    . Optimizing high-risk care management. JAMA. 2015;313(8):795–796.
    OpenUrlPubMed
  3. ↵
    1. Strauss AL
    . Qualitative Analysis for Social Scientists.Cambridge, UK: Cambridge University Press; 1987.
  4. ↵
    1. Hsieh H-F,
    2. Shannon SE
    . Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–1288.
    OpenUrlCrossRefPubMed
  5. ↵
    1. Peikes DN,
    2. Reid RJ,
    3. Day TJ,
    4. et al
    . Staffing patterns of primary care practices in the comprehensive primary care initiative. Ann Fam Med. 2014;12(2):142–149.
    OpenUrlAbstract/FREE Full Text
  6. ↵
    1. Rittenhouse DR,
    2. Shortell SM
    . The patient-centered medical home: will it stand the test of health reform? JAMA. 2009;301(19): 2038–2040.
    OpenUrlCrossRefPubMed
  7. ↵
    American Academy of Family Physicians. Risk-Stratified Care Management. 2014. https://nf.aafp.org/Shop/practice-transformation/risk-stratified-care-mgmt-rubric.
  8. ↵
    1. Loeb DF,
    2. Binswanger IA,
    3. Candrian C,
    4. Bayliss EA
    . Primary care physician insights into a typology of the complex patient in primary care. Ann Fam Med. 2015;13(5):451–455.
    OpenUrlAbstract/FREE Full Text
  9. ↵
    1. Johnson TL,
    2. Rinehart DJ,
    3. Durfee J,
    4. et al
    . For many patients who use large amounts of health care services, the need is intense yet temporary. Health Aff (Millwood). 2015;34(8):1312–1319.
    OpenUrlAbstract/FREE Full Text
  10. ↵
    1. Grant RW,
    2. Ashburner JM,
    3. Hong CS,
    4. Chang Y,
    5. Barry MJ,
    6. Atlas SJ
    . Defining patient complexity from the primary care physician’s perspective: a cohort study. Ann Intern Med. 2011;155(12):797–804.
    OpenUrlCrossRefPubMed
  11. ↵
    1. Peek CJ,
    2. Baird MA,
    3. Coleman E
    . Primary care for patient complexity, not only disease. Fam Syst Health. 2009;27(4):287–302.
    OpenUrlCrossRefPubMed
    1. Zulman DM,
    2. Asch SM,
    3. Martins SB,
    4. Kerr EA,
    5. Hoffman BB,
    6. Goldstein MK
    . Quality of care for patients with multiple chronic conditions: the role of comorbidity interrelatedness. J Gen Intern Med. 2014;29(3):529–537. doi:10.1007/s11606-013-2616-9.
    OpenUrlCrossRefPubMed
  12. ↵
    1. Grembowski D,
    2. Schaefer J,
    3. Johnson KE,
    4. et al
    ; AHRQ MCC Research Network. A conceptual model of the role of complexity in the care of patients with multiple chronic conditions. Med Care. 2014;52 (Suppl 3):S7–S14.
    OpenUrlCrossRefPubMed
  13. ↵
    1. Dale SB,
    2. Ghosh A,
    3. Peikes DN,
    4. et al
    . Two-year costs and quality in the Comprehensive Primary Care Initiative. N Engl J Med. 2016;374 (24):2345–2356.
    OpenUrl
  14. ↵
    1. Sessums LL,
    2. McHugh SJ,
    3. Rajkumar R
    . Medicare’s vision for advanced primary care: new directions for care delivery and payment. JAMA. 2016;315(24):2665–2666.
    OpenUrlCrossRefPubMed
  15. ↵
    CMS Innovation Center. CPC plus requirements. https://innovation.cms.gov/Files/x/cpcplus-practicecaredlvreqs.pdf
  16. ↵
    1. Haime V,
    2. Hong C,
    3. Mandel L,
    4. et al
    . Clinician considerations when selecting high-risk patients for care management. Am J Manag Care. 2015;21(10):e576–e582.
    OpenUrl
    1. Vogeli C,
    2. Spirt J,
    3. Brand R,
    4. et al
    . Implementing a hybrid approach to select patients for care management: variations across practices. Am J Manag Care. 2016;22(5):358–365.
    OpenUrl
  17. ↵
    1. Hong CS,
    2. Atlas SJ,
    3. Ashburner JM,
    4. et al
    . Evaluating a model to predict primary care physician-defined complexity in a large academic primary care practice-based research network. J Gen Intern Med. 2015;30(12):1741–1747.
    OpenUrl
PreviousNext
Back to top

In this issue

The Annals of Family Medicine: 15 (5)
The Annals of Family Medicine: 15 (5)
Vol. 15, Issue 5
September/October 2017
  • Table of Contents
  • Index by author
  • Back Matter (PDF)
  • Front Matter (PDF)
  • In Brief
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on Annals of Family Medicine.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Risk Stratification Methods and Provision of Care Management Services in Comprehensive Primary Care Initiative Practices
(Your Name) has sent you a message from Annals of Family Medicine
(Your Name) thought you would like to see the Annals of Family Medicine web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
5 + 3 =
Solve this simple math problem and enter the result. E.g. for 1+3, enter 4.
Citation Tools
Risk Stratification Methods and Provision of Care Management Services in Comprehensive Primary Care Initiative Practices
Ashok Reddy, Laura Sessums, Reshma Gupta, Janel Jin, Tim Day, Bruce Finke, Asaf Bitton
The Annals of Family Medicine Sep 2017, 15 (5) 451-454; DOI: 10.1370/afm.2124

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Get Permissions
Share
Risk Stratification Methods and Provision of Care Management Services in Comprehensive Primary Care Initiative Practices
Ashok Reddy, Laura Sessums, Reshma Gupta, Janel Jin, Tim Day, Bruce Finke, Asaf Bitton
The Annals of Family Medicine Sep 2017, 15 (5) 451-454; DOI: 10.1370/afm.2124
Reddit logo Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • INTRODUCTION
    • METHODS
    • RESULTS
    • DISCUSSION
    • Footnotes
    • References
  • Figures & Data
  • Info & Metrics
  • eLetters
  • PDF

Related Articles

  • PubMed
  • Google Scholar

Cited By...

  • Implementing Risk Stratification in Primary Care: Challenges and Strategies
  • In This Issue: Tools to Help Focus on What is Valuable
  • Google Scholar

More in this TOC Section

  • Proactive Recruitment Strategy for Patient Identification for Lung Cancer Screening
  • Patient-Reported Social Risks and Clinician Decision Making: Results of a Clinician Survey in Primary Care Community Health Centers
  • Validity and Reliability of the Assessment of Burden of Chronic Conditions Scale in the Netherlands
Show more Original Research

Similar Articles

Subjects

  • Domains of illness & health:
    • Chronic illness
    • Prevention
  • Person groups:
    • Vulnerable populations
  • Methods:
    • Mixed methods
  • Core values of primary care:
    • Personalized care
  • Other topics:
    • Health informatics
    • Quality improvement

Keywords

  • primary health care
  • comprehensive health care
  • patient care management
  • chronic care
  • payment reform

Content

  • Current Issue
  • Past Issues
  • Past Issues in Brief
  • Multimedia
  • Articles by Type
  • Articles by Subject
  • Multimedia
  • Supplements
  • Online First
  • Calls for Papers

Info for

  • Authors
  • Reviewers
  • Media
  • Job Seekers

Engage

  • E-mail Alerts
  • e-Letters (Comments)
  • RSS
  • Journal Club
  • Submit a Manuscript
  • Subscribe
  • Family Medicine Careers

About

  • About Us
  • Editorial Board & Staff
  • Sponsoring Organizations
  • Copyrights & Permissions
  • Contact Us
  • eLetter/Comments Policy

© 2023 Annals of Family Medicine