Abstract
PURPOSE The paradox of primary care is the observation that primary care is associated with apparently low levels of evidence-based care for individual diseases, but systems based on primary care have healthier populations, use fewer resources, and have less health inequality. The purpose of this article is to explore, from a complex systems perspective, mechanisms that might account for the effects of primary care beyond disease-specific care.
METHODS In an 8-session, participatory group model-building process, patient, caregiver, and primary care clinician community stakeholders worked with academic investigators to develop and refine an agent-based computer simulation model to test hypotheses about mechanisms by which features of primary care could affect health and health equity.
RESULTS In the resulting model, patients are at risk for acute illness, acute life-changing illness, chronic illness, and mental illness. Patients have changeable health behaviors and care-seeking tendencies that relate to their living in advantaged or disadvantaged neighborhoods. There are 2 types of care available to patients: primary and specialty. Primary care in the model is less effective than specialty care in treating single diseases, but it has the ability to treat multiple diseases at once. Primary care also can provide disease prevention visits, help patients improve their health behaviors, refer to specialty care, and develop relationships with patients that cause them to lower their threshold for seeking care. In a model run with primary care features turned off, primary care patients have poorer health. In a model run with all primary care features turned on, their conjoint effect leads to better population health for patients who seek primary care, with the primary care effect being particularly pronounced for patients who are disadvantaged and patients with multiple chronic conditions. Primary care leads to more total health care visits that are due to more disease prevention visits, but there are reduced illness visits among people in disadvantaged neighborhoods. Supplemental appendices provide a working version of the model and worksheets that allow readers to run their own experiments that vary model parameters.
CONCLUSION This simulation model provides insights into possible mechanisms for the paradox of primary care and shows how participatory group model building can be used to evaluate hypotheses about the behavior of such complex systems as primary health care and population health.
INTRODUCTION
Multiple studies have found that primary care is associated with poorer quality care for individual diseases than is care provided by clinicians focused primarily on those diseases.1–6 Yet, other evidence shows that systems based on primary care have better quality of care, better population health, greater equity, and lower cost.7–11 This discrepancy between apparently poor disease-specific care and advantageous outcomes at the level of the whole person and system has been called the paradox of primary care.12 Primary care is thought to be particularly important for disadvantaged populations and for people with multiple chronic conditions.13–15
Thus, it appears the complex interaction of primary care features can lead to emergent properties16,17 that provide value beyond disease-specific care. These features have been called the tenets of primary care,10,18–21 and include the following:
Accessibility as the first contact with the health care system
Accountability for addressing a great majority of personal health care needs (comprehensiveness)
Coordination of care across settings and integration of care for acute and (often multiple) chronic illnesses, mental health, and prevention, guiding access to more narrowly focused care when needed
Sustained partnership and personal relationships over time with patients known in the context of family and community
Management of specific diseases is far easier to conceptualize and measure than is the value added by the complex interaction of primary care’s elements. During a time of rapid health system change, it is critical to understand the complex mechanisms of primary care that appear to provide its added value22–26 so that efforts to incentivize and improve the quality of (disease) care do not unintentionally diminish the effects of primary care that do not relate solely to the care of individual diseases.22–26
Conceptualizing primary care as a complex system17,27–29 can be helpful in overcoming the pitfalls of a simplistic, linear, reductionist understanding that cannot account for the emergent properties identified in the paradox of primary care.30 Computational simulation modeling can be a helpful tool for developing and testing hypotheses about how emergent properties might happen in complex systems.31 In particular, agent-based models, which specify the characteristics of people and their environment and which examine outcomes emerging from agent-agent-environment interactions over time are well-suited to understanding the complex phenomena of health care and health.32,33
Recently, principles from community-based participatory research34–36 have been used to engage stakeholders, with deep personal knowledge of the phenomenon under study, to work with scientists to develop, refine, and use models to test relevant hypotheses.38,39 These participatory group model-building methods,30,39,40 however, have not been applied to the development of agent-based models.41
We therefore set out to engage a team of academicians and community-based patients, caregivers, and primary care clinicians in a participatory process of developing an agent-based model of the paradox of primary care and in using the evolving model to test hypotheses about possible mechanisms by which primary care might affect population health and equity. Our purpose was not to compare specialty care with primary care, but to elucidate possible mechanisms for the effects of primary care beyond disease care.
METHODS
Beginning with a practice-based research network serving disadvantaged populations in Cleveland, Ohio, the Safety Net Providers’ Strategic Alliance,42 we conducted focus groups and individual interviews with patients, caregivers, and primary care clinicians to begin to identify features of primary care that might be important in addition to disease-specific care. We oversampled patients with multiple chronic conditions and expanded the initial sampling frame to maximize diversity in age, sex, socioeconomic status, and experience with primary and specialty care; and we sought clinicians from different community practice and health care system settings. From the focus groups and interviews, we selected a maximum diversity sample to participate in group model-building sessions.
These group model-building participants met approximately monthly for 8, 2-hour sessions to develop hypotheses and conceptual models of how people become ill and seek health care, as well as how health care, particularly primary care, affects health. Between sessions, these conceptual models were operationalized by programming an agent-based computer model using the NetLogo public domain software.43 Each model iteration was shared with the group at the following session and interactively refined over time. The content of the group’s 8 sessions is outlined in Supplemental Appendix 1, available at http://www.annfammed.org/content/13/5/456/suppl/DC1.
Below we describe 2 different runs using the final model from this process. We begin with results from a base model with primary care features turned off, and then we show a more fully developed model that simulates what happens when patients receive components of primary care hypothesized by the group model-building participants to provide added value. We examine model outputs of population health, health equity, and number of visits, and we examine the effects in advantaged and disadvantaged neighborhoods and for people with multiple chronic conditions.44
As appendices, we provide detailed technical summary of the model (Supplemental Appendix 2), the computer model (Supplemental Appendix 3) and instructions for downloading the free NetLogo software to run it (Supplemental Appendix 4), and worksheets for performing prespecified and user-initiated experiments, to allow readers to test their own hypotheses (Supplemental Appendix 5). All supplemental appendices are available at http://www.annfammed.org/content/13/5/456/suppl/DC1.
RESULTS
The participatory group model-building process was successful in engaging 8 female and 1 male patients and caregivers (often with multiple roles) with a variety of medical conditions, and 3 female and 3 male clinicians (5 family physicians and 1 nurse practitioner) in working with academicians to develop, refine, and test hypotheses with an agent-based model. In this process, they shared their experience as patients, caregivers, clinicians, health care administrators, etc, focusing on articulating simple methods to operationalize the mechanisms by which primary care operates.
Description of Model Elements
To be comprehensible and transparent, we created as simple a model as possible to operationalize health, illness, health care, and various primary care mechanisms. The model includes 3 types of agents: patients, primary care clinicians, and specialty clinicians. Below we give a brief description of the characteristics and actions of each.
Patients
Patients are characterized by the following traits:
Health behaviors, which affect the probability of contracting an illness
Care-seeking threshold—how much of a decline in health patients must suffer before seeking care for an illness
Preference for care—either primary or specialty care (does not change over time)
A patient’s health, represented by a number between 0 and 1 (with 1 being perfect health), which changes when patients contract or recover from an illness
Patients are at risk for acquiring 4 different types of diseases: acute, acute life-changing, chronic, and mental illness, as shown in Supplemental Appendix 2. Disease burdens differ based on their initial effect on a patient’s health and on the type of treatment delivered. Patients’ probability of contracting each type of disease depends on their health behavior and other risk factors.
Patients can suffer from multiple diseases at once. They seek care with their chosen clinician once the combined effects of their illnesses have caused their health to decrease below their individual care-seeking threshold.
Specialty Clinicians
Specialty-seeking patients visit a specialty clinician only when they are ill. Specialty clinicians focus their treatment on the disease that is having the biggest effect on patients’ health.
Primary Care Clinicians
Primary care clinicians treat multiple illnesses in a single visit, but in the model runs shown in this article, they are less effective than specialists in treating any particular disease. Primary care clinicians also potentially have the ability to do the following:
Help patients improve their health behavior, which will decrease their probability of contracting illness
Develop a relationship with patients which, over time, will cause patients to reduce their care-seeking threshold and seek care earlier in an illness
Refer a patient to specialty care for treatment, if treatment by a specialist will provide a greater health benefit than treatment by primary care
Primary care–seeking patients visit a primary care clinician when they are ill, but they also have the option of making regular check-up visits. At these check-up visits, health problems may be identified and treated even if they have not lowered health below the patient’s care-seeking threshold.
A summary of the main mechanisms of the model is shown in Figure 1.
The NetLogo Model
The full details of implementation of the model in NetLogo are provided in Supplemental Appendix 2. Supplemental Appendix 6 shows screen shots of the model. “Sliders” allow users to control the input variables for each type of agent, and a graphical interface shows agents in the 4 neighborhoods (Supplemental Appendix 7). Supplemental Appendix 8 shows sample health output graphs. Variables that define the specific characteristics of each type of agent, allowing the model user to conduct various experiments, are listed in Table 1. The model contains 2,000 patients, 1 primary care clinician, and 1 specialty clinician. We split patients evenly into 2 “neighborhoods,” labeled A and B. Patients in each neighborhood have their own user-defined health behaviors and care-seeking tendency. Within these neighborhoods, patients are split evenly between primary care-seekers and specialty-seekers. Each time step in the model represents 1 week; the model runs for 2,500 time steps, or about 48 years.
As the model runs, it tracks the following outputs for each neighborhood and each type of care-seeker:
Average health of all patients
Average health of patients with 3 or more nonacute diseases
Average number of total clinician visits per patient
Average number of sick visits that occurred because patients’ health declined below their care-seeking threshold
For primary care–seeking patients, the model output tracks the number of visits that resulted in referrals to specialty care.
Results From 2 NetLogo Simulations
We ran a number of different experiments to test how the average population health and average number of clinician visits per patient were affected when we changed the primary care input variables one at a time. The specific values for each of the input variables for each experiment are included in the worksheets in Supplemental Appendix 5.
Below we will describe the results from experiments 1, a simple base model, and experiment 6, a model that includes multiple primary care mechanisms. (Experiments 2 to 5 add individual primary care mechanisms to the base model.)
In experiment 1, all mechanisms of primary care beyond disease care are turned off, meaning that primary care cannot help patients change their health behaviors or care-seeking tendencies and cannot refer to specialty care, and patients do not make regular well-care visits to primary care. Furthermore, although primary care can treat multiple diseases per visit, it is less effective than specialty care in treating a single disease.
In experiment 6, all the aforementioned attributes of primary care are turned on.
In each of these simulations, patients in neighborhood A have a low care-seeking threshold and average health behavior, whereas patients in neighborhood B have a high care-seeking threshold (and thus lower access to care) and poorer health behavior. Thus neighborhood A represents a relatively advantaged neighborhood and neighborhood B represents a relatively disadvantaged neighborhood.
Graphs from both experiments of the average health in each neighborhood for each type of care-seeker are shown in Figure 2. In experiment 1, the health of primary care–seeking patients is worse than the health of specialty-seeking patients in both neighborhoods for the entirety of the model run. This finding is not surprising; in experiment 1, although primary care treats multiple diseases in a visit, it is less effective than specialty in treating a single disease and does not offer any additional benefits.
In experiment 6, the opposite result occurs—primary care-seekers have better average health in both neighborhoods. In this model, we see that the conjoint effect of multiple primary care features is able to compensate for its lesser disease-specific care.
The health of primary care patients increases more from experiment 1 to experiment 6 for patients in the disadvantaged than the advantaged neighborhood. As a result of their poor health behaviors, patients in neighborhood B are sick more often than those in neighborhood A; additionally, because of their high care-seeking threshold, they tend to wait longer to seek care for an illness.
The primary care effect is greater for people with multiple chronic conditions, as seen in Figure 3, which shows the average health of patients with 3 or more nonacute diseases in each neighborhood for both experiments. In experiment 1, the health of primary care–seeking patients is lower than the health of specialty care–seeking patients, whereas in experiment 6, the opposite is true. This finding is similar to what was observed in the overall average health of each neighborhood, but the effect is more pronounced. The difference in health between primary and specialty care patients in experiment 6 is greater for patients in neighborhood B (the disadvantaged neighborhood). This difference is greater for patients in neighborhood B with multiple diseases than for the overall neighborhood, which suggests that the primary care benefit in the model is greatest for disadvantaged patients with multiple diseases.
Figure 4 shows the average number of clinician visits. In experiment 1, primary and specialty care seekers have essentially the same number of visits, because in this base model both types of patients seek care only when they are ill and have similar rates of illness. As a result of their poor health behaviors, patients in neighborhood B are more likely to develop illnesses and therefore have more visits than patients in neighborhood A.
In experiment 6, with all the primary care features activated, the number of visits for primary care seekers increases because of regular preventive visits. Unlike experiment 1, primary care patients in neighborhood A have more visits than primary care patients in neighborhood B. In experiment 6, primary care patients decrease their care-seeking threshold over time as they develop a relationship with the primary care clinician, which causes their number of visits to increase, particularly for neighborhood A, in which patients initially have a relatively low care-seeking threshold.
Figure 5 shows the average number of sick visits for each neighborhood for each type of patient for both experiments. In experiment 1, the number of sick visits is the same for primary care and specialty patients.
The results are more interesting in experiment 6, with the number of sick visits for primary care patients in neighborhood A increasing from experiment 1. This result is not because the primary care patients in neighborhood A are sick more often in experiment 6; in fact, they contract fewer illnesses because their health behaviors are improved from experiment 1. This change is due to patients in neighborhood A decreasing their care-seeking threshold as they develop a relationship with their primary care clinician.
In contrast, the number of sick visits for primary care patients in neighborhood B decreases from experiment 1 to experiment 6. In experiment 6, primary care patients in neighborhood B decrease their care-seeking threshold, which causes their number of sick visits to increase. At the same time, however, they improve their health behavior, which causes their number of illnesses, and subsequently their number of sick visits, to decrease. Because primary care patients in neighborhood B start with a higher care-seeking threshold than patients in neighborhood A, the effect of health behavior change predominates in determining the number of sick visits for patients in neighborhood B. The overall effect is a reduction of sick visits in this disadvantaged neighborhood.
DISCUSSION
We were able to engage diverse patient, caregiver, clinician, and academic stakeholders in an iterative, participatory process to build an agent-based model. The model operationalizes in a simple but explicit way some of the key features of primary care and allows testing hypotheses about how different primary care mechanisms can combine to add value beyond disease treatment and how these mechanisms affect the health of different types of people. The model can be used to generate an understanding of (primary) health care as a complex system in which factors in addition to disease care can affect outcomes such as health, equity, and resource use.
The model shows possible mechanisms by which non–disease-specific aspects of primary care can produce the emergent properties that have been observed in epidemiological and ecological studies.45,46 The resulting understanding could help to overcome some of the reductionist biases47–49 that have resulted in measuring primary care quality based on 1 disease at a time, rather than assessing quality in ways that fully consider the complex conjoint effects of multiple mechanisms.27,47–49 Greater understanding of the complexity of primary care could be used to develop systems to support care that is integrated, personalized, preventive, and of high value.
Limitations
The model incorporates the wisdom of diverse health care users and providers, but it is limited to primary care clinicians and patients in a single geographic area, as well as by many simplifying assumptions needed to make the model transparent and easy to describe and understand. Primary care involves the complex interaction of many other mechanisms than those proposed here. A group model-building team that included other viewpoints, such as disease specialists, would likely have come up with different parameters and ways to operationalize of primary care, some of which could equally well predict the paradox. The model’s parameters reflect general stylized facts from the health and health care literature, but it is limited in not being based on empirical health services and outcome data. Development of a data-driven model remains an important area for future research.
In the meantime, the model allows users to develop and test hypotheses that would be difficult or impossible to test in the real world. We encourage readers to download the model, software, and worksheets from the appendices and to undertake their own experiments by developing their own hypotheses, varying the related model parameters, running the model, using the worksheets to keep track of the results, and reporting their findings in the Annals eLetter discussion related to this article (TRACK). The resulting insights can be used not only to develop more sophisticated models, but to guide empirical research and to advance more nuanced understanding of the value of primary care and the possible complex interactive mechanisms by which that value emerges over time.
Acknowledgments
NICH members (http://sitemaker.umich.edu/nich/network_members) and Robert Ferrer, MD, MPH, David Katerndahl, MD, and Carlos Jaén, MD, PhD, were vitally helpful in the NICH pilot, which provided important initial conceptualizations for this work.
Footnotes
Conflicts of interest: authors report none.
Funding support: This research is funded by Contract Number 1IP2PI000216-01 from the Patient-Centered Outcomes Research Institute (PCORI). An earlier pilot study was supported by a grant from the Network on Inequalities, Complexity and Health (NICH), which is supported by the NIH Office of Behavioral and Social Science Research. Dr Stange’s time is supported in part by a Clinical Research Professorship from the American Cancer Society, and as a Scholar of The Institute for Integrative Health. This publication additionally was made possible by support from the Clinical and Translational Science Collaborative of Cleveland, UL1TR000439 from the National Center for Advancing Translational Sciences (NCATS) component of the National Institutes of Health and NIH roadmap for Medical Research.
Disclaimer: The contents of this article are solely the responsibility of the authors and do not necessarily represent the official views of the NIH. All statements in this report, including its findings and conclusions, are solely those of the authors and do not necessarily represent the views of the Patient-Centered Outcomes Research Institute (PCORI), its Board of Governors or Methodology Committee.
Supplementary materials: Available at http://www.AnnFamMed.org/content/13/5/456/suppl/DC1/
- Received for publication July 7, 2014.
- Revision received May 19, 2015.
- Accepted for publication June 21, 2015.
- © 2015 Annals of Family Medicine, Inc.