Measures of Multimorbidity and Morbidity Burden for Use in Primary Care and Community Settings: A Systematic Review and Guide ============================================================================================================================= * Alyson L. Huntley * Rachel Johnson * Sarah Purdy * Jose M. Valderas * Chris Salisbury ## Abstract **PURPOSE** Many patients consulting in primary care have multiple conditions (multimorbidity). Aims of this review were to identify measures of multimorbidity and morbidity burden suitable for use in research in primary care and community populations, and to investigate their validity in relation to anticipated associations with patient characteristics, process measures, and health outcomes. **METHODS** Studies were identified using searches in MEDLINE and EMBASE from inception to December 2009 and bibliographies. **RESULTS** Included were 194 articles describing 17 different measures. Commonly used measures included disease counts (n = 98), Chronic Disease Score (CDS)/RxRisk (n = 17), Adjusted Clinical Groups (ACG) System (n = 25), the Charlson index (n = 38), the Cumulative Index Illness Rating Scale (CIRS; n = 10) and the Duke Severity of Illness Checklist (DUSOI; n = 6). Studies that compared measures suggest their predictive validity for the same outcome differs only slightly. Evidence is strongest for the ACG System, Charlson index, or disease counts in relation to care utilization; for the ACG System in relation to costs; for Charlson index in relation to mortality; and for disease counts or Charlson index in relation to quality of life. Simple counts of diseases or medications perform almost as well as complex measures in predicting most outcomes. Combining measures can improve validity. **CONCLUSIONS** The measures most commonly used in primary care and community settings are disease counts, Charlson index, ACG System, CIRS, CDS, and DUSOI. Different measures are most appropriate according to the outcome of interest. Choice of measure will also depend on the type of data available. More research is needed to directly compare performance of different measures. * comorbidity * multimorbidity * diagnosis-related groups * ambulatory care * primary health care * family practice ## INTRODUCTION There is increasing interest in the concept of multimorbidity, which is the co-occurrence of multiple diseases or medical conditions within 1 person.1 Multimorbidity is particularly important in generalist settings, such as primary care, where family practitioners act as the first point of contact for people with a wide range of conditions and frequently manage patients with multiple coexisting conditions. Most patients consulting in family practice have multimorbidity, and the number of coexisting conditions increases with age.2–4 The presence of multimorbidity is associated with increased health service utilization and poorer health outcomes.5–8 To assess the impact of multimorbidity, it is necessary to measure it. Measures of multimorbidity broadly fall into 2 types: simple counts of diseases in each individual (based on patient self-report or clinician assessment), and indices to assess morbidity burden that differentially weight a range of conditions or diseases, using weights based on mortality, severity, or likely resource utilization.1 Many measures of multimorbidity and comorbidity were originally developed and validated among selected patients in hospital settings. The reliability and validity of some of these measures in a range of settings have previously been reviewed by de Groot et al,9 but the findings may not be relevant to primary care, as the validity of a measure depends on the patient group and context in which it is assessed. Furthermore, their review was based on articles published before September 2000 and needs updating. The current review focuses on the use of measures of multimorbidity in family practice, generalist ambulatory care settings, and community dwelling populations. In the context of this review, we have defined primary care and community settings broadly to ensure relevance to the different health systems providing primary care in different countries. The aims of this review were (1) to identify and describe measures of multimorbidity that are most suitable for use in research in primary care and community populations, taking into account the data and resources they require; and (2) to investigate the validity of these measures in terms of whether they have demonstrated anticipated associations with patient characteristics, process measures, and health outcomes. ## METHODS ### Inclusion Criteria We included studies with empirical data that enabled us to assess the validity and/or reliability of measures of multimorbidity when used in generalist primary care or population settings. Assessment of validity depends on determining whether a measure is able to demonstrate associations that support an underlying theory about the relationship between the construct being measured and other variables.10 Because the nature of these anticipated relationships will vary in different settings, rather than addressing the validation of a measure, it is appropriate to assess the validity of a measure in a specific group of people and a specific context.11 For this review, we included studies that provided data about associations between measures of multimorbidity and (1) patient sociodemographic characteristics, such as age, sex, and deprivation; (2) worse health outcomes; and (3) process measures, such as utilization of health care, costs, and quality of care. It was anticipated that a valid measure of multimorbidity would demonstrate associations with these variables. We also sought to identify articles comparing one measure of multimorbidity against another. Finally, we sought to identify articles that demonstrated the test-retest, intrarater or interrater reliability of these measures when used in a primary care or community context. We included quantitative studies of any design that were predominantly based on adults. Participants had to be identified either from a generalist primary care setting or a population sample. We did not restrict searches by country or language, although we did require an English abstract. ### Exclusion Criteria We excluded studies in which participants were identified through their contact with specialist services or hospital admission. We also excluded studies of measures in which the presence of an index disease was integral to the measure (for example, measures specific to diabetes); studies of comorbidity (an additional disease in patients with a specified index disease); studies in which the multimorbidity measure was only used to show associations with variables related to secondary care (for example, in-patient mortality); and studies that described the prevalence of multimorbidity without studying associations with other variables. ### Searches We conducted a systematic review through searches in MEDLINE and EMBASE from inception to December 2009. Searches were undertaken in 3 stages, which were then combined. MeSH headings and free text were used to identify terms relating to (1) multimorbidity or comorbidity; (2) measures or indexes and terms for measures that we had already identified; and (3) ambulatory, outpatient, primary, or community care or general/community population. The searches were developed iteratively to identify the combinations of terms that achieved an acceptable level of sensitivity and specificity. We repeatedly checked articles identified through different strategies against relevant articles already identified and articles identified through existing bibliographies.12–14 We also selected other articles from our personal files, contacted other researchers, and checked reference lists from relevant articles. The final search strategy is shown in the Supplemental Appendix, available at [http://annfammed.org/content/10/2/134/suppl/DC1](http://annfammed.org/content/10/2/134/suppl/DC1). ### Data Management and Extraction One author (A.H.) conducted a preliminary screen of titles and abstracts to exclude articles that were clearly irrelevant. Abstracts from the remaining studies were screened independently by 2 authors to identify potentially relevant articles that were then reviewed independently in full text. Disagreements were resolved between the 2 authors, with discussion with a third author as necessary. We extracted data about the characteristics of the study population, setting, outcome variables, study design, and main results into a Microsoft Access database. We describe the measures identified below. Supporting tables provide details about the information needed to calculate each measure, along with details of which measures have shown evidence of validity by demonstrating associations with the specified patient, process, or outcome variables. ## RESULTS The searches yielded 11,191 references, of which 314 were potentially relevant and were reviewed in full text, leading to the inclusion of 194 articles that described 184 studies, some describing more than 1 multimorbidity measure (Supplemental Figure 1, PRISMA, available at [http://annfammed.org/content/10/2/134/suppl/DC1](http://annfammed.org/content/10/2/134/suppl/DC1)). The majority of studies were of cross-sectional or longitudinal design. Of the included studies, 76 were based on patients identified through their contact with generalist primary care, and 108 were conducted among people living in the community (not as patients). One-half of the studies (n = 97, 53%) were conducted in the United States, with almost all of the remaining studies being conducted in Canada, Europe, or Australia. Six measures were used in at least 5 studies. The characteristics and application of these measures are described in Table 1. The Appendix lists all the measures identified, including the lesser-used measures. Supplemental Tables 1, 2, and 3 (available at [http://annfammed.org/content/10/2/134/suppl/DC1](http://annfammed.org/content/10/2/134/suppl/DC1)) describe whether each measure has demonstrated validity through showing anticipated associations with patient demographic characteristics, health outcomes, or health care utilization. View this table: [Table 1](http://www.annfammed.org/content/10/2/134/T1) Table 1 Characteristics and Application of the Most Commonly Studied Multimorbidity Measures in Outpatient Settings View this table: [Appendix](http://www.annfammed.org/content/10/2/134/T2) Appendix Measures of Multimorbidity Identified ### Disease Counts: 98 Studies Disease counts were defined as a simple unweighted enumeration of the number of diseases. Disease counts specify whether the person has 1 or more of a limited list of conditions, but the conditions included in this list varied in different studies from 9 to 35 different items. These items may have been individual conditions, diseases, health problems, or categories of conditions or diseases. Disease counts may be self-rated, clinician-rated, or extracted from records. Disease counts are the most commonly used measure of multimorbidity and have been used mainly in relation to patient demographic characteristics and health outcomes and to a lesser extent process measures. ### Chronic Disease Score (9 Studies)/RxRisk (8 Studies) The Chronic Disease Score (CDS) uses pharmacy dispensing data to identify classes of medication that are taken as proxies for the existence of chronic disease (Table 1). The CDS has shown anticipated relationships with self-rated health status, functional status, hospitalization rates, and mortality.15,16,43,47–52 The original version15 considered 17 disease states with weights predefined by an expert panel. Notable subsequent versions include Clark et al’s revised CDS16 and RxRisk.17 Clark and colleagues considered an expanded number of diseases using weights for health utilization and costs derived empirically using health maintenance organization data. The RxRisk score, developed by Fishman et al, further expanded and revised the CDS, focusing on the estimation of future health care costs and increasing applicability to a wider range of pharmacy data sets and to children. Studies using the RxRisk model have shown anticipated associations with a wide range of variables (Supplemental Tables 1, 2, and 3). ### Charlson Index and Variations: 38 Studies Charlson et al developed this score for evaluating prognosis based on age and weightings for specific comorbid conditions.18 The validity of the Charlson index has been studied more extensively than other measures, particularly in hospital and specialist settings. Although it was developed and validated in hospitalized patients, it has since been adapted and validated in primary care and community populations.19,50,51,53 There are several variations of the Charlson index, but studies comparing these variations suggest they produce similar results.21,51,54–56 The majority of studies using the Charlson index described the effect of multimorbidity on health outcomes, particularly mortality. ### Adjusted Clinical Groups System: 25 Studies The Adjusted Clinical Groups (ACG) System, a population/patient case-mix adjustment system based on medical records or insurance claims, measures health status by grouping diagnoses into clinically cogent groups. The ACG System was originally designed to predict future morbidity and use of health care resources.25 Most studies of the ACG System described predictive models for a range of cost or process outcomes associated with multimorbidity. ### Cumulative Index Illness Rating Scale: 10 Studies The Cumulative Index Illness Rating Scale (CIRS) index uses a scoring system that includes 14 body system domains and a severity scale for each domain. The CIRS can be applied directly in consultations or from medical records (Table 1). Studies of the CIRS have found associations with a range of patient demographic characteristics, measures of process and health care utilization, and health outcomes. One study compared CIRS scored through direct patient observation or chart review and also assessed interrater and intrarater reliability. All methods produced comparable results. 57 ### Duke Severity of Illness: 6 Studies Duke Severity of Illness (DUSOI) is a tool for measuring a person’s illness severity that comprises 4 parameters of each diagnosis, namely, symptoms, complications, prognosis without treatment, and treatment potential. DUSOI can be completed at a consultation or from chart review. A few studies of the DUSOI demonstrated associations with age and sex, health care utilization, and quality of life. Parkerson et al found good interrater reliability for the DUSOI when rated by a physician or an auditor.28,29 ### Other Measures: 21 Studies Eleven other types of multimorbidity measure were used in studies, often in comparison with other measures (Appendix). These studies all described associations also found by more commonly used multimorbidity measures. ### Comparison Studies: 15 Studies Several studies have directly compared how different measures of multimorbidity were associated with relevant variables in generalist primary care or community settings.* Most of these articles suggested that the performance of the different measures studied was similar.17,29,44,47,50,51,58,61 The Charlson index and the ACG System appeared to be the strongest predictors of mortality,47,50 whereas the ACG System and measures based on medication prescribed (Appendix) were strongest at predicting health care utilization.17,50,51,53 Measures that include an assessment of functional status or subjective disease burden appear to be stronger predictors of a range of health outcomes than those that count diseases without adjustment for their severity or impact.41,58–60 Some studies have shown that combining different types of measures improves the overall predictive performance of models.29,41,51,60 Two studies have suggested that simple measures perform almost as well as more complex measures, for example, using a count of prescribed medications to predict health care utilization or a simple count from a list of major chronic diseases to predict mortality.47,50 ## DISCUSSION ### Summary of Main Findings This review provides an index of previous literature for investigators seeking to use a multimorbidity measure in relation to a particular outcome. Researchers interested in the relationship between multimorbidity and health care utilization will find most evidence for the validity of the Charlson index, the ACG System, and disease counts. Evidence of validity in relation to patient or health service costs is strongest for the ACG System. For studies of the relationship between multimorbidity and mortality, the evidence is strongest for the Charlson index. The most commonly used measures of multimorbidity in relation to patient functioning or quality of life are disease counts and the Charlson index, but some studies have suggested that the CIRS is actually superior,58,62 as are measures that incorporate self-reported disease impact and severity.41 That other measures have been used less often in relation to these outcomes does not necessarily mean that they are less valid, but their performance has been less well established. ### Choice of Measure The choice of measure is likely to be based on the suitability of the measure for the data available as well as the outcome of interest. The Charlson index, ACG System, disease counts, and prescription counts can all be calculated from patient records, and these measures are particularly suitable for cross-sectional studies based on electronic records or administrative data. Both the CIRS and DUSOI, however, require judgment about individual patients (also requiring manuals and training to ensure reliability) and cannot be automated for use with large volumes of data. Measures based on routine data may be easy to use, but ease of use needs to be balanced against the quality of the data. All measures are dependent on the range of conditions recorded, how accurately and recently these conditions were recorded, and whether there is information about the severity and impact of conditions. Measures using clinician ratings or patient self-report will be up-to-date and may be more accurate at predicting functional outcomes if they include assessment of severity or disability. These measures, however, are often based on a more restricted list of diseases than measures based on records. There are limitations to measures that use complex scoring. Changes to disease coding systems may mean that weights need to be reestimated, and relevant drugs used in medication-based measures are constantly changing, so scoring algorithms need regular updating. Proprietary risk adjustment systems, such as the ACG System, tend to use scoring systems that are not transparent and often have considerable costs to end-users. The most common approach to measuring multi-morbidity is disease counts. Even so, it is hard to compare findings between studies, as different authors have included very different numbers of diseases, sometimes providing no details about which diseases are included or the criteria for inclusion.63 Most studies are based on counting so-called chronic diseases, but chronicity is rarely defined. The number of diseases is also related to the level of disease abstraction—for example, some measures count cancer as one condition, whereas others count each malignancy separately.63 It might be anticipated that such measures as the Charlson index, the ACG System, and the DUSOI, which weight different conditions, would be more effective at predicting outcomes than simple counts, which weight all conditions equally. Some studies, however, have concluded that simple measures, such as a simple count of chronic diseases or of prescribed medications, are almost as effective at predicting mortality and health care utilization as more sophisticated methods and may be much simpler (and also less expensive) to use despite the reservations outlined above.47,50 Part of the problem in choosing an appropriate measure is due to the abstract nature of the concept of multimorbidity and how it relates to other concepts, such as disease burden and patient complexity.1 It is important that measures are based on an underlying conceptualization of why and how multimorbidity is expected to have an impact on other variables. For example, the impact of multimorbidity on quality of life is likely to be most appropriately assessed using a self-report measure that takes account of functional ability,41 whereas the impact on health care utilization is likely to be best assessed using a measure that was derived using empirical weights to predict this outcome.64,65 Relatively few studies have directly compared the performance of different measures in a primary care context, and the findings do not show the clear superiority of one measure over another. Evidence about the reliability of these measures when used in a primary care or population setting is also limited. Evidence about the reliability of measures when used in hospitalized patients and specialist secondary care settings9 may not necessarily pertain to primary care settings, where patient characteristics, disease classifications, record systems, and staffing are very different. ### Strengths and Limitations This article builds on previous reviews of comorbidity measures in the context of specific index diseases9,66,67 by assessing the use of multimorbidity measures in generalist primary care and population settings. Multimorbidity is not well indexed in the literature, so it is unlikely that we have found all studies that would fit our inclusion criteria. We are aware that a number of risk adjustment models have been developed within the US health insurance system which have not been used frequently within academic research.68 Included studies used a variety of methods, and we have not set out to assess individual study quality. The methods used to derive each measure also differ considerably; therefore, comparing measures directly is fraught with both the inherent biases in the original studies plus the potential biases introduced by a systematic review, especially one of observational studies that have used different study designs. In some cases it was debatable whether the setting of a study should be considered as primary care; we resolved such issues through discussion. We are confident that our review reflects the range and application of multimorbidity measures in the primary care and population context. ### Implications Different measures are needed to assess associations with different outcomes and the choice of measure will also depend on the type of data available. The measures that have been most widely used and for which there is greatest evidence of validity are the Charlson index, disease counts, and the ACG System. Other measures such as the CIRS and the DUSOI are more complex to administer, and their advantages over easier methods have not been well established. Measures based on counts of prescribed medication appear promising but need further research. ## Footnotes * * References 17,29,44,47,49–51,53,55,58–60. * Conflicts of interest: authors report none. * **Funding support:** This study was funded by the National Institute for Health Research, School for Primary Care Research. * **Prior presentation:** Preliminary data from this report have been presented as a poster at the annual meeting of the Society of Academic Primary Care (SAPC), April 2010, Norwich, England. * Received for publication June 8, 2011. * Revision received November 10, 2011. * Accepted for publication November 30, 2011. * © 2012 Annals of Family Medicine, Inc. ## References 1. Valderas JM, Starfield B, Sibbald B, Salisbury C, Roland M. Defining comorbidity: implications for understanding health and health services. Ann Fam Med. 2009;7(4):357–363. [Abstract/FREE Full Text](http://www.annfammed.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYW5uYWxzZm0iO3M6NToicmVzaWQiO3M6NzoiNy80LzM1NyI7czo0OiJhdG9tIjtzOjIzOiIvYW5uYWxzZm0vMTAvMi8xMzQuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 2. Fortin M, Lapointe L, Hudon C, Vanasse A. Multimorbidity is common to family practice: is it commonly researched? Can Fam Physician. 2005;51:244–245. [Abstract/FREE Full Text](http://www.annfammed.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiY2ZwIjtzOjU6InJlc2lkIjtzOjg6IjUxLzIvMjQ0IjtzOjQ6ImF0b20iO3M6MjM6Ii9hbm5hbHNmbS8xMC8yLzEzNC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 3. Salisbury C, Johnson L, Purdy S, Valderas JM, Montgomery AA. Epidemiology and impact of multimorbidity in primary care: a retrospective cohort study. Br J Gen Pract. 2011;61(582):e12–e21. [Abstract/FREE Full Text](http://www.annfammed.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiYmpncCI7czo1OiJyZXNpZCI7czoxMDoiNjEvNTgyL2UxMiI7czo0OiJhdG9tIjtzOjIzOiIvYW5uYWxzZm0vMTAvMi8xMzQuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 4. Fortin M, Bravo G, Hudon C, Vanasse A, Lapointe L. Prevalence of multimorbidity among adults seen in family practice. Ann Fam Med. 2005;3(3):223–228. [Abstract/FREE Full Text](http://www.annfammed.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYW5uYWxzZm0iO3M6NToicmVzaWQiO3M6NzoiMy8zLzIyMyI7czo0OiJhdG9tIjtzOjIzOiIvYW5uYWxzZm0vMTAvMi8xMzQuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 5. Wolff JL, Starfield B, Anderson G. Prevalence, expenditures, and complications of multiple chronic conditions in the elderly. Arch Intern Med. 2002;162(20):2269–2276. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1001/archinte.162.20.2269&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=12418941&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000179148300001&link_type=ISI) 6. Fortin M, Lapointe L, Hudon C, Vanasse A, Ntetu AL, Maltais D. Multimorbidity and quality of life in primary care: a systematic review. Health Qual Life Outcomes. 2004;2:51. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1186/1477-7525-2-51&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=15380021&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) 7. Fortin M, Dubois MF, Hudon C, Soubhi H, Almirall J. Multimorbidity and quality of life: a closer look. Health Qual Life Outcomes. 2007;5:52. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1186/1477-7525-5-52&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=17683600&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) 8. Keles H, Ekici A, Ekici M, Bulcun E, Altinkaya V. Effect of chronic diseases and associated psychological distress on health-related quality of life. Intern Med J. 2007;37(1):6–11. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1111/j.1445-5994.2006.01215.x&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=17199838&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) 9. de Groot V, Beckerman H, Lankhorst GJ, Bouter LM. How to measure comorbidity. a critical review of available methods. J Clin Epidemiol. 2003;56(3):221–229. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1016/S0895-4356(02)00585-1&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=12725876&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000182631700003&link_type=ISI) 10. McDowell I. Measuring Health: A Guide to Rating Scales and Questionnaires. 3rd ed. Cambridge: Oxford University Press; 2006. 11. Streiner DL, Norman GR. Health Measurement Scales: A Practical Guide to Their Development and Use. 4th ed. Cambridge: Oxford University Press; 2008. 12. International Research Community on Multimorbidity. [http://www.usherbrooke.ca/crmcspl/en/international-research-community-on-multimorbidity/](http://www.usherbrooke.ca/crmcspl/en/international-research-community-on-multimorbidity/). Accessed Nov 2, 2010. 13. John Hopkins ACG system. [http://www.acg.jhsph.org/](http://www.acg.jhsph.org/). Accessed Nov 2, 2010. 14. From the Centers for Disease Control. From the Centers for Disease Control. Comorbidity of chronic conditions and disability among older persons—United States, 1984. JAMA. 1990;263(2):209–210. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1001/jama.1990.03440020033012&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=2136758&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) 15. Von Korff M, Wagner EH, Saunders K. A chronic disease score from automated pharmacy data. J Clin Epidemiol. 1992;45(2):197–203. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1016/0895-4356(92)90016-G&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=1573438&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=A1992HN32100016&link_type=ISI) 16. Clark DO, Von Korff M, Saunders K, Baluch WM, Simon GE. A chronic disease score with empirically derived weights. Med Care. 1995;33(8):783–795. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1097/00005650-199508000-00004&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=7637401&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=A1995RN21900004&link_type=ISI) 17. Fishman PA, Goodman MJ, Hornbrook MC, Meenan RT, Bachman DJ, O’Keeffe Rosetti MC. Risk adjustment using automated ambulatory pharmacy data: the RxRisk model. Med Care. 2003;41(1):84–99. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1097/00005650-200301000-00011&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=12544546&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000180243000011&link_type=ISI) 18. Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40(5):373–383. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1016/0021-9681(87)90171-8&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=3558716&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=A1987G855900002&link_type=ISI) 19. Charlson ME, Charlson RE, Peterson JC, Marinopoulos SS, Briggs WM, Hollenberg JP. The Charlson comorbidity index is adapted to predict costs of chronic disease in primary care patients. J Clin Epidemiol. 2008;61(12):1234–1240. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1016/j.jclinepi.2008.01.006&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=18619805&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000261219700007&link_type=ISI) 20. Romano PS, Roos LL, Jollis JG. Adapting a clinical comorbidity index for use with ICD-9-CM administrative data: differing perspectives. J Clin Epidemiol. 1993;46(10):1075–1079, discussion 1081–1090. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1016/0895-4356(93)90103-8&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=8410092&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=A1993MC57100001&link_type=ISI) 21. Deyo RA, Cherkin DC, Ciol MA. Adapting a clinical comorbidity index for use with *ICD-9-CM* administrative databases. J Clin Epidemiol. 1992;45(6):613–619. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1016/0895-4356(92)90133-8&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=1607900&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=A1992JA22600006&link_type=ISI) 22. D’Hoore W, Sicotte C, Tilquin C. Risk adjustment in outcome assessment: the Charlson comorbidity index. Methods Inf Med. 1993;32(5): 382–387. [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=8295545&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=A1993MJ02000007&link_type=ISI) 23. Ghali WA, Hall RE, Rosen AK, Ash AS, Moskowitz MA. Searching for an improved clinical comorbidity index for use with ICD-9-CM administrative data. J Clin Epidemiol. 1996;49(3):273–278. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1016/0895-4356(95)00564-1&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=8676173&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=A1996UF86900002&link_type=ISI) 24. Rius C, Rodriquez-Sanz M, Fernandez E. Comorbidity index was successfully validated among men but not in women. J Clin Epidemiol. 2008;61(8):798–802. 25. Starfield B, Weiner J, Mumford L, Steinwachs D. Ambulatory care groups: a categorization of diagnoses for research and management. Health Serv Res. 1991;26(1):53–74. [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=1901841&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=A1991FK09100004&link_type=ISI) 26. Linn BS, Linn MW, Gurel L. Cumulative illness rating scale. J Am Geriatr Soc. 1968;16(5):622–626. [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=5646906&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=A1968B134400016&link_type=ISI) 27. Miller MD, Paradis CF, Houck PR, et al. Rating chronic medical illness burden in geropsychiatric practice and research: application of the Cumulative Illness Rating Scale. Psychiatry Res. 1992;41(3):237–248. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1016/0165-1781(92)90005-N&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=1594710&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=A1992HP20600005&link_type=ISI) 28. Parkerson GR Jr., Broadhead WE, Tse CK. The Duke Severity of Illness Checklist (DUSOI) for measurement of severity and comorbidity. J Clin Epidemiol. 1993;46(4):379–393. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1016/0895-4356(93)90153-R&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=8483003&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=A1993LA60400007&link_type=ISI) 29. Parkerson GR Jr., Harrell FE Jr., Hammond WE, Wang XQ. Characteristics of adult primary care patients as predictors of future health services charges. Med Care. 2001;39(11):1170–1181. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1097/00005650-200111000-00004&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=11606871&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) 30. Parkerson GR Jr., Michener JL, Wu LR, et al. Associations among family support, family stress, and personal functional health status. J Clin Epidemiol. 1989;42(3):217–229. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1016/0895-4356(89)90058-9&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=2785165&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=A1989U324800006&link_type=ISI) 31. Elixhauser A, Steiner C, Harris DR, Coffey RM. Comorbidity measures for use with administrative data. Med Care. 1998;36(1):8–27. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1097/00005650-199801000-00004&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=9431328&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000071181500004&link_type=ISI) 32. Selim AJ, Fincke G, Ren XS, et al. Comorbidity assessments based on patient report: results from the Veterans Health Study. J Ambul Care Manage. 2004;27(3):281–295. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1097/00004479-200407000-00011&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=15287217&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) 33. Yeo J, Karimova G, Bansal S. Co-morbidity in older patients with COPD—its impact on health service utilisation and quality of life, a community study. Age Ageing. 2006;35(1):33–37. [Abstract/FREE Full Text](http://www.annfammed.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NjoiYWdlaW5nIjtzOjU6InJlc2lkIjtzOjc6IjM1LzEvMzMiO3M6NDoiYXRvbSI7czoyMzoiL2FubmFsc2ZtLzEwLzIvMTM0LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 34. Groll DL, To T, Bombardier C, Wright JG. The development of a comorbidity index with physical function as the outcome. J Clin Epidemiol. 2005;58(6):595–602. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1016/j.jclinepi.2004.10.018&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=15878473&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000229350000007&link_type=ISI) 35. Rozzini R, Frisoni GB, Ferrucci L, et al. Geriatric Index of Comorbidity: validation and comparison with other measures of comorbidity. Age Ageing. 2002;31(4):277–285. [Abstract/FREE Full Text](http://www.annfammed.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NjoiYWdlaW5nIjtzOjU6InJlc2lkIjtzOjg6IjMxLzQvMjc3IjtzOjQ6ImF0b20iO3M6MjM6Ii9hbm5hbHNmbS8xMC8yLzEzNC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 36. Pope GC, Ellis RP, Ash AS, et al. Diagnostic Cost Group Hierarchical Condition Category Models for Medicare Risk Adjustment. Final Report to the Health Care Financing Adminstration Under Contract Number 500–95–048. Waltham, MA; Health Economics Research, Inc, December, 2000. 37. Greenfield S, Sullivan L, Dukes KA, Silliman R, D’Agostino R, Kaplan SH. Development and testing of a new measure of case mix for use in office practice. Med Care. 1995;33(4 Suppl):AS47–AS55. [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=7723461&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=A1995QU75500008&link_type=ISI) 38. Fan VS, Au D, Heagerty P, Deyo RA, McDonell MB, Fihn SD. Validation of case-mix measures derived from self-reports of diagnoses and health. J Clin Epidemiol. 2002;55(4):371–380. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1016/S0895-4356(01)00493-0&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=11927205&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000174517000008&link_type=ISI) 39. DeSalvo KB, Fan VS, McDonell MB, Fihn SD. Predicting mortality and healthcare utilization with a single question. Health Serv Res. 2005;40(4):1234–1246. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1111/j.1475-6773.2005.00404.x&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=16033502&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000230292400017&link_type=ISI) 40. Sangha O, Stucki G, Liang MH, Fossel AH, Katz JN. The Self-Administered Comorbidity Questionnaire: a new method to assess comorbidity for clinical and health services research. Arthritis Rheum. 2003;49(2):156–163. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1002/art.10993&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=12687505&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000182171700003&link_type=ISI) 41. Bayliss EA, Ellis JL, Steiner JF. Seniors’ self-reported multimorbidity captured biopsychosocial factors not incorporated into two other data-based morbidity measures. J Clin Epidemiol. 2009;62(5):550–557, e1. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1016/j.jclinepi.2008.05.002&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=18757178&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) 42. Bayliss EA, Ellis JL, Steiner JF, Main DS. Initial validation of an instrument to identify barriers to self-management for persons with co-morbidities. Chronic Illn. 2005;1(4):315–320. [Abstract/FREE Full Text](http://www.annfammed.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NToic3BjaGkiO3M6NToicmVzaWQiO3M6NzoiMS80LzMxNSI7czo0OiJhdG9tIjtzOjIzOiIvYW5uYWxzZm0vMTAvMi8xMzQuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 43. Schubert CC, Boustani M, Callahan CM, et al. Comorbidity profile of dementia patients in primary care: are they sicker? J Am Geriatr Soc. 2006;54(1):104–109. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1111/j.1532-5415.2005.00543.x&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=16420205&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000234404300015&link_type=ISI) 44. Vitry A, Wong SA, Roughead EE, Ramsay E, Barratt J. Validity of medication-based co-morbidity indices in the Australian elderly population. Aust N Z J Public Health. 2009;33(2):126–130. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1111/j.1753-6405.2009.00357.x&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=19413854&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) 45. George J, Vuong T, Bailey MJ, Kong DC, Marriott JL, Stewart K. Development and validation of the medication-based disease burden index. Ann Pharmacother. 2006;40(4):645–650. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1345/aph.1G204&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=16569815&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000237005900008&link_type=ISI) 46. Akner G. Analysis of multimorbidity in individual elderly nursing home residents. Development of a multimorbidity matrix. Arch Gerontol Geriatr. 2009;49(3):413–419. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1016/j.archger.2008.12.009&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=19185359&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) 47. Di Bari M, Virgillo A, Matteuzzi D, et al. Predictive validity of measures of comorbidity in older community dwellers: the Insufficienza Cardiaca negli Anziani Residenti a Dicomano Study. J Am Geriatr Soc. 2006;54(2):210–216. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1111/j.1532-5415.2005.00572.x&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=16460370&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000235098300002&link_type=ISI) 48. Harpole LHW, Williams JW Jr., Olsen MK, et al. Improving depression outcomes in older adults with comorbid medical illness. Gen Hosp Psychiatry. 2005;27(1):4–12. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1016/j.genhosppsych.2004.09.004&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=15694213&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000227253700003&link_type=ISI) 49. Mayo NE, Nadeau L, Levesque L, Miller S, Poissant L, Tamblyn R. Does the addition of functional status indicators to case-mix adjustment indices improve prediction of hospitalization, institutionalization, and death in the elderly? Med Care. 2005;43(12):1194–1202. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1097/01.mlr.0000185749.04875.cb&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=16299430&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000233711100006&link_type=ISI) 50. Perkins AJK, Kroenke K, Unützer J, et al. Common comorbidity scales were similar in their ability to predict health care costs and mortality. J Clin Epidemiol. 2004;57(10):1040–1048. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1016/j.jclinepi.2004.03.002&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=15528055&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000225276100006&link_type=ISI) 51. Schneeweiss S, Wang PS, Avorn J, Maclure M, Levin R, Glynn RJ. Consistency of performance ranking of comorbidity adjustment scores in Canadian and U.S. utilization data. J Gen Intern Med. 2004;19(5 Pt 1):444–450. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1111/j.1525-1497.2004.30109.x&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=15109342&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000221137900007&link_type=ISI) 52. Koike AK, Unützer J, Wells KB. Improving the care for depression in patients with comorbid medical illness. Am J Psychiatry. 2002;159(10): 1738–1745. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1176/appi.ajp.159.10.1738&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=12359681&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000178382700019&link_type=ISI) 53. Dominick KL, Dudley TK, Coffman CJ, Bosworth HB. Comparison of three comorbidity measures for predicting health service use in patients with osteoarthritis. Arthritis Rheum. 2005;53(5):666–672. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1002/art.21440&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=16208675&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000233137300008&link_type=ISI) 54. Dorr DA, Jones SS, Burns L, et al. Use of health-related, quality-of-life metrics to predict mortality and hospitalizations in community-dwelling seniors. J Am Geriatr Soc. 2006;54(4):667–673. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1111/j.1532-5415.2006.00681.x&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=16686880&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000236585100016&link_type=ISI) 55. Tang J, Wan JY, Bailey JE. Performance of comorbidity measures to predict stroke and death in a community-dwelling, hypertensive Medicaid population. Stroke. 2008;39(7):1938–1944. [Abstract/FREE Full Text](http://www.annfammed.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6OToic3Ryb2tlYWhhIjtzOjU6InJlc2lkIjtzOjk6IjM5LzcvMTkzOCI7czo0OiJhdG9tIjtzOjIzOiIvYW5uYWxzZm0vMTAvMi8xMzQuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 56. Walter LC, Lindquist K, Nugent S, et al. Impact of age and comorbidity on colorectal cancer screening among older veterans. Ann Intern Med. 2009;150(7):465–473. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.7326/0003-4819-150-7-200904070-00006&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=19349631&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000265117600004&link_type=ISI) 57. Hudon C, Fortin M, Vanasse A. Cumulative Illness Rating Scale was a reliable and valid index in a family practice context. J Clin Epidemiol. 2005;58(6):603–608. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1016/j.jclinepi.2004.10.017&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=15878474&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000229350000008&link_type=ISI) 58. Fortin M, Hudon C, Dubois MF, Almirall J, Lapointe L, Soubhi H. Comparative assessment of three different indices of multimorbidity for studies on health-related quality of life. Health Qual Life Outcomes. 2005;3:74. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1186/1477-7525-3-74&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=16305743&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) 59. Bayliss EA, Ellis JL, Steiner JF. Subjective assessments of comorbidity correlate with quality of life health outcomes: initial validation of a comorbidity assessment instrument. Health Qual Life Outcomes. 2005;3:51–58. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1186/1477-7525-3-51&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=16137329&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) 60. Gabriel SE, Crowson CS, O’Fallon WM. A comparison of two comorbidity instruments in arthritis. J Clin Epidemiol. 1999;52(12):1137–1142. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1016/S0895-4356(99)00124-9&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=10580776&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000083817000003&link_type=ISI) 61. Yan Y, Birman-Deych E, Radford MJ, Nilasena DS, Gage BF. Comorbidity indices to predict mortality from Medicare data: results from the national registry of atrial fibrillation. Med Care. 2005;43(11):1073–1077. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1097/01.mlr.0000182477.29129.86&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=16224299&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000233268500002&link_type=ISI) 62. Fortin M, Bravo G, Hudon C, Lapointe L, Dubois MF, Almirall J. Psychological distress and multimorbidity in primary care. Ann Fam Med. 2006;4(5):417–422. [Abstract/FREE Full Text](http://www.annfammed.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYW5uYWxzZm0iO3M6NToicmVzaWQiO3M6NzoiNC81LzQxNyI7czo0OiJhdG9tIjtzOjIzOiIvYW5uYWxzZm0vMTAvMi8xMzQuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 63. Diederichs C, Berger K, Bartels DB. The measurement of multiple chronic diseases—a systematic review on existing multimorbidity indices. J Gerontol A Biol Sci Med Sci. 2011;66(3):301–311. [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=21112963&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000288415800007&link_type=ISI) 64. Byles J, D’Ester C, Parkinson L, O’Connell R, Treloar C. Single index of multimorbidity did not predict multiple outcomes. J Clin Epidemiol 2005; 58(10):-997. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1016/j.jclinepi.2005.02.025&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=16168345&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000232209000005&link_type=ISI) 65. Tooth L, Hockey R, Byles J, Dobson A. Weighted multimorbidity indexes predicted mortality, health service use, and health-related quality of life in older women. J Clin Epidemiol. 2008;61(2):151–159. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1016/j.jclinepi.2007.05.015&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=18177788&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000252333700008&link_type=ISI) 66. Harboun M, Ankri J. Comorbidity indexes: review of the literature and application to studies of elderly population. Rev Epidemiol Sante Publique. 2001;49(3):287–298. [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=11427831&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000169759500008&link_type=ISI) 67. Extermann M. Measuring comorbidity in older cancer patients. Eur J Cancer. 2000;36(4):453–471. [CrossRef](http://www.annfammed.org/lookup/external-ref?access_num=10.1016/S0959-8049(99)00319-6&link_type=DOI) [PubMed](http://www.annfammed.org/lookup/external-ref?access_num=10717521&link_type=MED&atom=%2Fannalsfm%2F10%2F2%2F134.atom) [Web of Science](http://www.annfammed.org/lookup/external-ref?access_num=000086227800011&link_type=ISI) 68. Institute for Health Policy. Risk adjustment methods and their relevance to “ pay or play”. Supplement E to the report: Challenges and Alternatives for Employer Pay or Play Program Design: An Implementation and Alternative Scenario Analysis of California’s “ Health Insurance Act of 2003” (SB 2). [http://www.chcf.org/~/media/MEDIA%20LIBRARY%20Files/PDF/M/PDF%20MRMIBSB2SupERiskAdj.PDF](http://www.chcf.org/~/media/MEDIA%20LIBRARY%20Files/PDF/M/PDF%20MRMIBSB2SupERiskAdj.PDF). Accessed Nov 9, 2011.