Skip to main content

Main menu

  • Home
  • Current Issue
  • Content
    • Current Issue
    • Early Access
    • Multimedia
    • Podcast
    • Collections
    • Past Issues
    • Articles by Subject
    • Articles by Type
    • Supplements
    • Plain Language Summaries
    • Calls for Papers
  • Info for
    • Authors
    • Reviewers
    • Job Seekers
    • Media
  • About
    • Annals of Family Medicine
    • Editorial Staff & Boards
    • Sponsoring Organizations
    • Copyrights & Permissions
    • Announcements
  • Engage
    • Engage
    • e-Letters (Comments)
    • Subscribe
    • Podcast
    • E-mail Alerts
    • Journal Club
    • RSS
    • Annals Forum (Archive)
  • Contact
    • Contact Us
  • Careers

User menu

  • My alerts

Search

  • Advanced search
Annals of Family Medicine
  • My alerts
Annals of Family Medicine

Advanced Search

  • Home
  • Current Issue
  • Content
    • Current Issue
    • Early Access
    • Multimedia
    • Podcast
    • Collections
    • Past Issues
    • Articles by Subject
    • Articles by Type
    • Supplements
    • Plain Language Summaries
    • Calls for Papers
  • Info for
    • Authors
    • Reviewers
    • Job Seekers
    • Media
  • About
    • Annals of Family Medicine
    • Editorial Staff & Boards
    • Sponsoring Organizations
    • Copyrights & Permissions
    • Announcements
  • Engage
    • Engage
    • e-Letters (Comments)
    • Subscribe
    • Podcast
    • E-mail Alerts
    • Journal Club
    • RSS
    • Annals Forum (Archive)
  • Contact
    • Contact Us
  • Careers
  • Follow annalsfm on Twitter
  • Visit annalsfm on Facebook
EditorialEditorials

The Implications of Measuring Complexity

Lee A. Green
The Annals of Family Medicine July 2010, 8 (4) 291-292; DOI: https://doi.org/10.1370/afm.1147
Lee A. Green
MD, MPH
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • eLetters
  • Info & Metrics
  • PDF
Loading

Published eLetters

If you would like to comment on this article, click on Submit a Response to This article, below. We welcome your input.

Submit a Response to This Article
Compose eLetter

More information about text formats

Plain text

  • No HTML tags allowed.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Lines and paragraphs break automatically.
Author Information
First or given name, e.g. 'Peter'.
Your last, or family, name, e.g. 'MacMoody'.
Your email address, e.g. higgs-boson@gmail.com
Your role and/or occupation, e.g. 'Orthopedic Surgeon'.
Your organization or institution (if applicable), e.g. 'Royal Free Hospital'.
Statement of Competing Interests
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Image CAPTCHA
Enter the characters shown in the image.

Vertical Tabs

Jump to comment:

  • Complexity, whether patient or visit
    Lee A Green
    Published on: 03 August 2010
  • Complexity of patient illness versus complexity of patient visits
    Barbara Starfield
    Published on: 02 August 2010
  • Published on: (3 August 2010)
    Page navigation anchor for Complexity, whether patient or visit
    Complexity, whether patient or visit
    • Lee A Green, Ann Arbor, MI, USA

    Starfield and Lemke point out distinctions between their intended uses of the ADG/ACG system and Katerndahl, Wood, & Jaen's examination of within-visit complexity. However, my accompanying editorial was not limited to issues of within-visit complexity. Rather, my concern is the impact of how the work of primary care is measured upon the management and policy decisions that are driven by those measures. The ADG/ACG we...

    Show More

    Starfield and Lemke point out distinctions between their intended uses of the ADG/ACG system and Katerndahl, Wood, & Jaen's examination of within-visit complexity. However, my accompanying editorial was not limited to issues of within-visit complexity. Rather, my concern is the impact of how the work of primary care is measured upon the management and policy decisions that are driven by those measures. The ADG/ACG website itself promotes the ACG system for uses including "evaluating provider performance and setting equitable payment rates", and hence its application does directly impact the measurement and valuation of primary care work.

    As Starfield and Lemke point out, the ADGs themselves are categorical. However, in concluding that that means ADGs are "not linear", they appear to confound linear systems with simple continuous linear equations. ADGs are described in the relevant publications as having been derived from multivariate modeling techniques, and when applied for their expressly intended quantitative purposes such as performance evaluation they are being used as categorical variables in multivariate statistical models. Hence both in derivation and application, the ADG/ACG system is grounded in linear stochastic mathematics, dependent upon assumptions such as the Central Limit Theorem that do not hold in complex nonlinear systems. That does not in any way detract from the ADG/ACG system's sophistication nor the value of its patient-centered method, it merely describes the fundamental mathematics upon which the system is based and contrasts them to complex nonlinear dynamics.

    There are two important implications that matter greatly in the management of health care and in the formulation of health policy as we make major changes to the system. First, previously accurate statistical models may suddenly deliver misleading results. Second, even when they accurately represent the behavior of the system, statistical models' equations may not be at all representing how the system produces that behavior, and hence may mislead us as to how to change it. Both of these concerns are of course dependent upon the "if" in the editorial: if primary care is a complex nonlinear system. Hence the importance of work such as Katerndahl, Wood, & Jaen's, exploring alternatives to linear stochastic models.

    Competing interests:   None declared

    Show Less
    Competing Interests: None declared.
  • Published on: (2 August 2010)
    Page navigation anchor for Complexity of patient illness versus complexity of patient visits
    Complexity of patient illness versus complexity of patient visits
    • Barbara Starfield, Baltmore, MD, USA
    • Other Contributors:

    In his editorial concerning the article by Dr. Katerndahl et al, Dr, Green asserts that the Ambulatory Diagnostic Groups are based on a ‘linear model and (is) not only inaccurate..fundamentally wrong as a measure of primary care.’ His comment reflects a lack of understanding of the Ambulatory Diagnostic Groups and the larger system of which it is a part. (For information about the system, see www.acg.jhsph.edu). The ADG...

    Show More

    In his editorial concerning the article by Dr. Katerndahl et al, Dr, Green asserts that the Ambulatory Diagnostic Groups are based on a ‘linear model and (is) not only inaccurate..fundamentally wrong as a measure of primary care.’ His comment reflects a lack of understanding of the Ambulatory Diagnostic Groups and the larger system of which it is a part. (For information about the system, see www.acg.jhsph.edu). The ADG approach groups diagnoses by their clinical type, primarily (but not only) on the basis of their likelihood of persistence. There is nothing quantitative about this and ADGs cannot be ‘linear’ in the statistical meaning of the term. The Adjusted Clinical Groups (ACGs) carry this categorization one step further by deriving about 100 different combinations of the 32 ADGs to provide an estimate of morbidity in individuals and populations over time. ACGs are not ‘linear’, and their purpose is to describe patient complexity of illness based on the pattern of different types of morbidity over a period of time. Dr. Green uses the terminology ‘complex’, ‘linear’, and ‘non-linear’ differently than most statisticians would. The implication that a linear model is any model that isn’t generated by complexity science would be a distortion.

    Dr. Katerndahl’s intriguing measure of complexity is a measure of VISIT complexity whereas the ACG system (of which ADGs are one part) is a measure of the complexity of patient’s (and, by aggregation population) diagnostic complexity over a period of time. Whereas the Katerndahl et al measure of complexity of visits seems to be an innovative approach to provider reimbursement, it is not intended to and does not describe the burden of morbidity experienced by patients and populations. Whereas the Katerndahl et al measure could be used as a basis for developing a reimbursement strategy for VISITS to different types of specialists, the ADGs (and ACGs) would not be used that way, since they are PERSON-FOCUSED over time; they might be used to in a time-based reimbursement system dependent on patient and population morbidity burden. Contrary to the assumption made by Dr. Green, we are not aware of any attempt to use ADGs to pay for visits. We believe that the ACG system has much potential for documenting the increased challenges of primary care (as distinguished from other specialty care) but in a different and complementary way than that developed by Katerndahl and colleagues. Indeed, we hope that family physicians and other primary care practitioners come to appreciate how the ACG system can further buttress arguments for the increased importance of primary care.

    Barbara Starfield

    Klaus Lemke

    References: Green L. The implications of measuring complexity. Ann Fam Med 2010; 8:291-2

    Katerndahl D, Wood R, Jaen C. A method for estimating relative complexity of ambulatory care. Ann Fam Med 2010; 8: 341-47

    Competing interests:   Both Starfield and Lemke have and continue to be involved in deveoping the Johns Hopkins Adjusted Clinical Groups (ACGs). Neither have equity in the entities licensing or selling the software.

    Show Less
    Competing Interests: None declared.
PreviousNext
Back to top

In this issue

The Annals of Family Medicine: 8 (4)
The Annals of Family Medicine: 8 (4)
Vol. 8, Issue 4
1 Jul 2010
  • Table of Contents
  • Index by author
  • In Brief
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on Annals of Family Medicine.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
The Implications of Measuring Complexity
(Your Name) has sent you a message from Annals of Family Medicine
(Your Name) thought you would like to see the Annals of Family Medicine web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
12 + 7 =
Solve this simple math problem and enter the result. E.g. for 1+3, enter 4.
Citation Tools
The Implications of Measuring Complexity
Lee A. Green
The Annals of Family Medicine Jul 2010, 8 (4) 291-292; DOI: 10.1370/afm.1147

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Get Permissions
Share
The Implications of Measuring Complexity
Lee A. Green
The Annals of Family Medicine Jul 2010, 8 (4) 291-292; DOI: 10.1370/afm.1147
Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Footnotes
    • REFERENCES
  • eLetters
  • Info & Metrics
  • PDF

Related Articles

  • No related articles found.
  • PubMed
  • Google Scholar

Cited By...

  • Capturing complexity in clinician case-mix: classification system development using GP and physician associate data
  • The Challenges of Measuring, Improving, and Reporting Quality in Primary Care
  • Ethics, Support for Care, Prevention, and What's Important
  • Google Scholar

More in this TOC Section

  • Thank You, Reviewers and Commenters
  • Returning to a Patient-Centered Approach in the Management of Hypothyroidism
  • Recruiting, Educating, and Taking Primary Care to Rural Communities
Show more Editorials

Similar Articles

Subjects

  • Methods:
    • Quantitative methods
  • Other research types:
    • Health policy
    • Health services
    • Professional practice

Content

  • Current Issue
  • Past Issues
  • Early Access
  • Plain-Language Summaries
  • Multimedia
  • Podcast
  • Articles by Type
  • Articles by Subject
  • Supplements
  • Calls for Papers

Info for

  • Authors
  • Reviewers
  • Job Seekers
  • Media

Engage

  • E-mail Alerts
  • e-Letters (Comments)
  • RSS
  • Journal Club
  • Submit a Manuscript
  • Subscribe
  • Family Medicine Careers

About

  • About Us
  • Editorial Board & Staff
  • Sponsoring Organizations
  • Copyrights & Permissions
  • Contact Us
  • eLetter/Comments Policy

© 2025 Annals of Family Medicine