Abstract
PURPOSE Case management (CM) interventions are effective for frequent users of health care services, but little is known about which intervention characteristics lead to positive outcomes. We sought to identify characteristics of CM that yield positive outcomes among frequent users with chronic disease in primary care.
METHODS For this systematic review of both quantitative and qualitative studies, we searched MEDLINE, CINAHL, Embase, and PsycINFO (1996 to September 2017) and included articles meeting the following criteria: (1)population: adult frequent users with chronic disease, (2)intervention: CM in a primary care setting with a postintervention evaluation, and (3)primary outcomes: integration of services, health care system use, cost, and patient outcome measures. Independent reviewers screened abstracts, read full texts, appraised methodologic quality (Mixed Methods Appraisal Tool), and extracted data from the included studies. Sufficient and necessary CM intervention characteristics were identified using configurational comparative methods.
RESULTS Of the 10,687 records retrieved, 20 studies were included; 17 quantitative, 2 qualitative, and 1 mixed methods study. Analyses revealed that it is necessary to identify patients most likely to benefit from a CM intervention for CM to produce positive outcomes. High-intensity intervention or the presence of a multidisciplinary/interorganizational care plan was also associated with positive outcomes.
CONCLUSIONS Policy makers and clinicians should focus on their case-finding processes because this is the essential characteristic of CM effectiveness. In addition, value should be placed on high-intensity CM interventions and developing care plans with multiple types of care providers to help improve patient outcomes.
INTRODUCTION
In developed countries, the bulk of health care system expenses is attributable to a small proportion of the population. Specifically, frequent users of health care services account for approximately 10% of the population but upward of 70% of health care expenditures.1–3 Many frequent users have chronic physical diseases that are further complicated by mental health comorbidities and/or social vulnerabilities, which increase their overall health care needs.4,5 These individuals are more likely to experience fragmentation of care,6,7 suffer from disability,8 and have a general decrease in quality of life9 and an increased risk of death.10,11
A variety of interventions have been developed to improve the health and social care of frequent users, the most common of which are case management (CM), individualized care plans, patient education and counseling, problem solving, and information sharing.12–17 Case management is a promising and effective intervention to improve the health and social care of frequent users12–17; it is a collaborative approach to ensure, coordinate, and integrate care and services for patients, in which a case manager evaluates, plans, implements, coordinates, and prioritizes services on the basis of patients’ needs in close collaboration with other health care providers.18
Many literature reviews have reported the effectiveness of CM interventions, citing such benefits as reductions in emergency department (ED)visits and hospital admissions, overall reductions in expenditures, and improved patient outcomes such as quality of life and patient satisfaction.12–15,19,20 However, CM is a complex intervention, with various characteristics interacting in a nonlinear manner.21,22 To design and implement effective CM interventions, we need to understand the characteristics of CM that are associated with positive outcomes. The objective of the present study was to conduct a systematic review to identify characteristics of CM that yield positive outcomes among adult frequent users with chronic disease in primary care.
METHODS
We conducted a systematic review including quantitative, qualitative, and mixed methods studies, with a data-based convergent synthesis design.23 This type of design, combining the strengths of quantitative and qualitative research, helps to develop a rich and deep understanding of complex health interventions.23,24 Our complete methods are detailed in a peer-reviewed systematic review protocol that is registered on PROS-PERO (CRD42016048006).25
Eligibility Criteria
The eligibility criteria were as follows: (1)population: adult frequent users (aged ≥18 years)with physical chronic disease and receiving care in primary, secondary, tertiary, or community care settings, (2)intervention: CM in a primary care setting (including ED)with a postintervention evaluation, and (3)primary outcomes: integration of services, health care system use, financial cost, and patient outcomes (eg, self-management, patient experience of care, health-related quality of life, etc). To increase homogeneity of the sample of included studies and comparability of CM characteristics between studies, pediatric, frail elderly, and homeless populations were excluded because these populations might have distinct sets of needs. In addition, specific disease-oriented CM interventions were excluded because primary care aims to improve whole-person health.
Information Sources and Search Strategy
A bibliographic database search was conducted of the online databases MEDLINE, CINAHL, Embase, and PsycINFO for empirical studies (experimental, quasi-experimental, qualitative, and mixed methods studies)published in English or French and limited to the past ~20 years (ie, 1996 to September 2017). An information specialist for Cochrane Canada Francophone developed and ran specific search strategies for each database, combining the search concepts “frequent use” and “evaluation studies.” The MEDLINE search strategy is presented in Supplemental Appendix 1 (http://www.AnnFamMed.org/content/17/5/448/suppl/DC1/). Relevant studies were identified via a hand search of the reference lists of studies selected via the electronic search to be included in the review. To capture more information on CM interventions, companion documents (eg, protocols, reports, website pages, news articles) for each included study were retrieved by searching Google, ResearchGate, Scopus, and PubMed, as well as e-mailing the corresponding authors.
Study Selection and Data Extraction
Four reviewers participated in the study selection using Covidence systematic review software. Two independent reviewers (L.L., M-J.C; see acknowledgment in end copy for reviewers listed in this section) screened titles and abstracts using the eligibility criteria, and 2 other independent reviewers (M.S., V.G.) assessed full texts of the selected studies for eligibility. At both stages, discrepancies were resolved by a third reviewer (M.L.). Eligible studies were retained for data extraction and methodologic quality assessment. Two reviewers extracted the following data using a standardized data extraction form: study characteristics (eg, first author, year of publication, country, setting, design); definition of frequent users; population characteristics such as age and sex; sample size; type, objective, frequency, and content of intervention; length of intervention sessions; duration of patient follow-up; case-finding process; health care providers involved; intervention offered to control group; data analysis; outcome characteristics and assessment instruments; and intervention effectiveness according to reported outcomes (quantitative or qualitative). Data extraction was double-checked by a second reviewer.
Quality Appraisal and Data Synthesis
Two independent reviewers used the Mixed Methods Appraisal Tool (MMAT)26–29 to assess eligible studies and determine an overall methodologic quality score for each. When necessary, disagreements between reviewers were resolved by a third reviewer. The MMAT was specifically designed to concomitantly appraise studies with diverse designs and has been validated and reliability tested.26–29 We used the 2011 version of the MMAT, which includes 2 initial screening questions and 19 items. Studies that did not meet the 2 initial screening questions were deemed not empirical and were excluded. We performed a sensitivity analysis to assess the effect of methodologic quality on the results by replicating the analysis without the low-quality studies (MMAT score ≤25%).30 The MMAT has recently been updated and revalidated using a conceptual framework on the quality of qualitative, quantitative, and mixed methods studies included in mixed studies reviews31; qualitative research32 with MMAT users worldwide; and a Delphi study with international experts.33 This led to the 2018 version of the MMAT.34 We used the original version for the present study.
Sufficient and necessary characteristics of CM interventions were identified using configurational comparative methods (CCM) 35; this is used to study a small to intermediate number of cases (eg, 5-50), among which an outcome of interest has been identified,36 allowing for the integration of quantitative and qualitative results.23 The use of CCM helps to identify configurations, that is, a combination of conditions that produces the presence or absence of the outcome of interest across cases. This allows for reduction of the complexity of data sets in small N situations by using Boolean algebra37 to explore different combinations of conditions and to identify necessary and sufficient conditions associated with the outcome of interest. A necessary condition is one that is always present when the outcome occurs, that is, the outcome cannot occur without this condition. A condition (or combination of conditions)is considered sufficient to produce an outcome if the outcome always occurs when the condition (or combination of conditions)is present.38 In the present study, the characteristics of CM interventions were the conditions we explored. Supplemental Appendix 2 (http://www.AnnFamMed.org/content/17/5/448/suppl/DC1/)provides definitions of CCM terms.
The CCM followed the 6 steps described by Rihoux and Ragin35 (a complete description of each step is detailed in Supplemental Appendix 3, http://www.AnnFamMed.org/content/17/5/448/suppl/DC1/): (1)building a raw data table, (2)constructing a truth table, (3)resolving contradictory configurations, (4)conducting Boolean minimization using fuzzy set/qualitative comparative analysis (fs/QCA)software, (5)bringing in the logical remainders cases (TOS-MANA software was used to create a visual representation of our results), and (6)interpreting the results. Following best practices in CCM, the selection of conditions used in the analysis, and the way each condition was defined, was informed by case-based knowledge (data extraction)and CM theory.38 The number of conditions was limited so that the ratio between the number of possible logical combinations of conditions and the number of cases was kept sufficiently low.37,39 For example, for the thematic synthesis step of the present review, we identified main characteristics of CM interventions in the included studies (Table 1). Of those, we identified 4 initial conditions that were most commonly reported in the included studies (informed by the team’s experience with CM and prior research on CM for frequent users). The definitions of these conditions were developed iteratively by drawing from prior research, going back to the cases to explore how they were defined, and drawing on the substantive and field knowledge of the team members. One condition (effective communication between health care providers) was removed because it was not reported or we were not able to conclude its absence/presence across all cases. Finally, the definitions of the 3 remaining main conditions were used to develop a codebook that was independently tested for clarity and comprehensiveness by reviewers outside the team. The final list of conditions and outcomes is presented in Supplemental Appendix 4 (http://www.AnnFamMed.org/content/17/4/448/suppl/DC1/).
RESULTS
We identified 10,687 unique records, of which 10,548 did not meet the inclusion criteria (Figure 1). Among the 139 full-text articles selected, 117 were excluded based on the inclusion criteria, 1 was excluded because it did not meet the 2 initial MMAT screening questions,60 and another was excluded from the CCM analysis, owing to lack of information about the conditions (characteristics)of CM intervention in the documents.61 Thus, 20 studies (18 CM interventions)were included in the synthesis. Table 1 presents a description of these studies. Seventeen were quantitative (7 before-after studies, 5 nonrandomized controlled trials, and 5 randomized controlled trials), 2 were qualitative, and 1 was a mixed methods study. Twelve were conducted in United States, 2 each in Sweden and Canada, and 1 each in Switzerland, Australia, New Zealand, and the United Kingdom. The studies included 17 to 12,181 participants, with a mean age range of 20 to 66 years. The proportion of men varied from 23% to 75%. All of the studies included development and implementation of a care plan, 15 involved an interdisciplinary team,40–43,45–47,49–51,53,55–58 and 11 were conducted in an ED setting.41,43,44,47,49–52,55,57,58
For the majority of studies (n = 17), CM intervention participants were identified using a threshold of number of health care visits.40–44,46–50,52–57,59 To determine eligibility, 9 studies required patients be evaluated by a health care provider to assess their likelihood of benefiting from the CM intervention.42,44,47–49,51,52,55,58 Ten studies included patients with a complex/vulnerable situation such as the presence of physical, psychiatric, and/or psychosocial issues.40,42,43,45,46,48,51–54 The methodologic quality of the included studies ranged from 25% to 100% (median, 50%).
Fifteen studies reported positive outcomes such as health and functional status,52 patient satisfaction,40,52 self-management,45,46,48 ED42–45,47,49,51–55,58 and clinic visits,40,44,45,52 hospital admission42,44,45,53 and length of stay,42,45,52 and ED43,44,52–55,57,58 and inpatient cost.43,44,45,52–54 Regarding the conditions, 16 studies implemented a high-intensity CM intervent ion40–46,48,49,51–54,56,57,59 including at least 3 of the following criteria: caseload of fewer than 60 patients, ≥50% of the time spent face-to-face with the patient, initial assessment in person, and multidisciplinary team meetings or frequent contact with the patient. Fifteen studies identified patients who could benefit the most from the CM40,42–49,51–55,58 on the basis of their identification as frequent users (with no clear definition)with complex care needs or based on providers’ assessment that the CM intervention would be beneficial. Finally, 17 studies included a multidisciplinary/interorganizational care plan40–43,45–51,53,55–59 documenting patient needs and goals as well as the available resources to respond to patients’ needs and including at least 2 health care providers from disciplines other than the family physician or case manager.
Table 2 shows 5 configurations for which the case-finding condition was always present when a positive outcome occurred. In addition, the CCM revealed that the multidisciplinary/interdisciplinary care plan and the CM intensity conditions were often present when a positive outcome occurred. These results remained the same when we removed the studies with low methodologic quality.42,44,50,51 Supplemental Appendix 5 (http://www.AnnFamMed.org/content/17/5/448/suppl/DC1/)illustrates the relation between the conditions and the-outcomes based on the results presented in Table 2.
The analysis revealed that the case-finding characteristic (ie, high frequency of health care visits)and complexity of health care needs are necessary to produce a positive outcome. Moreover, in our cases, positive outcomes were associated with the following 2 sufficient characteristics when each was combined with this necessary condition: high-intensity CM intervention and presence of a multidisciplinary/interorganizational care plan.
DISCUSSION
Our findings suggest that CM should be offered to patients such as those who are uninsured, have a low income, or who a health care provider deems in need and who frequently use health care services and have complex health care needs. Such appropriate case finding should be combined with a high-intensity intervention and/or the presence of a multidisciplinary/interorganizational care plan.
Previous research,60,62–64 as well our prior thematic analysis review on key factors of CM interventions,65 have recognized the importance of appropriate patient identification. Previous studies, however, have defined the appropriateness of patient identification on the basis of patients’ risk of frequent health care use and associated cost to health care systems.63,66,67 In addition to these criteria, our present results recommend a case-finding process based also on patient complex care needs (eg, combination of physical, psychiatric, and social conditions; poverty, polymedication, lack of social support, or clinical judgment).68 A combination of quantitative (eg, prediction tools and thresholds)and qualitative (eg, clinical judgment)techniques might be the best approach to identify patients for whom CM interventions will likely be most beneficial.64
The association between high-intensity CM and its effectiveness has been examined in other populations. In a systematic mixed studies review exploring the relations between positive outcomes and barriers to CM implementation designed for patients with dementia and their caregivers in home care programs, high-intensity CM identified with CCM was shown to be a necessary and sufficient condition to produce positive clinical outcomes and to reduce health care use.69 Similar to our present results, the importance of small caseload, regular follow-up, and multidisciplinary team meetings was highlighted.69 In addition, reviews on the effect of CM in reducing hospital use,70 and on the effectiveness of interventions in reducing ED use,16 reported that regular in-person contacts with a case manager, a criterion for high-intensity CM, might contribute to positive patient outcomes. However, others62 have reported equivocal results regarding the effect of high-intensity CM for patients with complex care needs and highlighted that evidence from CM interventions remains unclear. This might explain why our present CCM analysis did not identify high-intensity CM intervention as a necessary condition to produce positive outcomes.
Multidisciplinary teams have been recognized as an important part of CM interventions,18 providing the opportunity to learn from each other and offering holistic and comprehensive care for patients with complex care needs.62–64,71,72 As the coordinator of the multidisciplinary team, the case manager must ensure that patients receive coordinated and integrated care processes that guarantee quality and cost effectiveness.63 To this end, the development and implementation of a care plan is a strategy used by the case manager and best suited to align the goals of the different health care services.63 Our present review suggests that a care plan provided by health care providers from different disciplines, combined with appropriate case finding, is a strategy that will more likely be effective and result in positive CM outcomes.
To our knowledge, this is the first systematic review aimed at identifying characteristics of CM interventions associated with positive outcomes. Whereas a meta-analysis of quantitative results would have led to an estimate of the magnitude of the effect of CM, it would not have revealed the characteristics that are necessary and sufficient to yield the effect size. The present review used an innovative method of data analysis, CCM, which allowed us to combine quantitative, qualitative, randomized, and uncontrolled study designs in a single analysis scheme to clarify how CM leads to positive outcomes. All steps of this systematic review were confirmed by at least 2 members of the team to ensure reproducibility of the results. In addition, the systematic review process lends credence to our results, as does our sensitivity analysis, which showed that the methodologic quality of the included studies did not affect the results.
Limitations
In the present review, all outcomes were considered equal and were not analyzed individually. Second, we considered all of the eligible CM intervention studies regardless of methodologic quality. The sensitivity analysis, however, indicated that the studies with low methodologic quality did not influence the results. Third, given that the majority of the studies were implemented at a single site, results might not be generalizable to multisite health care settings. Fourth, the present review did not address the knowledge gap concerning who should deliver CM or where. Fifth, even though frequent users are a primary target of case management research, the present review did not evaluate case management for individuals with complex health care needs who are not frequent users. Finally, the primary publications often did not include enough contextual information to make a broader consideration of context possible.
CONCLUSIONS
On the basis of our results, we recommend that policy makers and clinicians focus on their case-finding processes because these comprise the essential characteristic of effective CM. Moreover, value should be placed on high-intensity CM intervention (ie, small caseload, frequent face-to-face contact with the patient, initial assessment in person, and/or multidisciplinary team meetings) and developing care plans with multiple types of care providers to help improve patient outcomes. All policy makers and clinicians directly or indirectly involved in CM now or in the future should consider adapting their decisions or practices accordingly. Further research could address how different primary care settings (eg, ED vs clinic) influence CM outcomes.
Acknowledgments
Special thanks to Roxanne Lépine for the development of the search strategy, as well as Léa Langlois, Véronique Gauthier, Marie-Joelle Cossi, and Michele Schemilt for screening titles and abstracts, and Catherine Vandal and the Unité de Recherche Clinique et épidémiologique du CRCHUS for administrative support.
Footnotes
Conflicts of interest: authors report none.
To read or post commentaries in response to this article, see it online at http://www.AnnFamMed.org/content/17/5/448.
Author contributions: C.H. and M-C.C. conceived the review and participated in its design and coordination. F.L. and H.T.V.Z. coordinated the systematic review methods. P.P., R.S., and B.R. guided the methodologic steps of the configurational comparative methods. C.H., M-C.C., P.P., R.S., B.R., and M.L. participated in the synthesis of the data. M.L. conducted the data collection, and R.S. conducted the data analysis. M.L. drafted the manuscript under the guidance of C.H. and M-C.C. All authors made substantial contributions to the conception and design of the work and were involved in drafting and revising the manuscript.
Funding support: This project was funded by the Quebec SPOR-SUPPORT Unit, one of the methodologic platforms of the Canadian Institutes of Health Research (CIHR) for the Strategy for Patient-Oriented Research (SPOR).73 Members of the Unit are coauthors and offered methodologic support to design and conduct this systematic mixed studies review. The governance structures of the Unit, however, had no role in the writing of the manuscript or the decision to submit it for publication. All authors had full access to all of the data and are responsible for the decision to submit for publication.
PROSPERO registration: CRD42016048006
Supplemental materials: Available at http://www.AnnFamMed.org/content/17/5/448/suppl/DC1/.
- Received for publication October 12, 2018.
- Revision received February 28, 2019.
- Accepted for publication March 29, 2019.
- © 2019 Annals of Family Medicine, Inc.