|
|
||||||||
1 Division of General Internal Medicine and Geriatrics, Indiana University School of Medicine, Indianapolis, Ind
2 Regenstrief Institute, Inc, Indianapolis, Ind
3 National Opinion Research Center, Washington, DC
4 Department of Family Medicine, The University of Chicago, Chicago, Ill
5 Agency for Healthcare Research and Quality, Gaithersburg, Md
CORRESPONDING AUTHOR: William M. Tierney, MD, Room M200-OPW, 1001 West Tenth Street, Indianapolis, IN 46202, wtierney{at}iupui.edu
| ABSTRACT |
|---|
|
|
|---|
METHODS We performed a Web-based survey and structured interviews with PBRN directors and administrative officers, assessing PBRNs history, size, location, organization, resources, operations, and productivity (funding obtained, studies performed, and articles published).
RESULTS Of 111 primary care PBRNs identified, 89 (80%) responded to the survey. The 86 (77%) meeting the criteria for primary care PBRNs contained 1,871 practices, 12,957 physicians (mean 152 per PBRN, median 100), and 14.7 million patients (mean 229,880 per PBRN, median 105,000). Minority and underinsured patients were overrepresented. The average PBRN was young (4.4 ± 5.7 years): one-half had performed 3 or fewer studies. Three-quarters were affiliated with universities. Common research foci included prevention, diabetes, cardiovascular risk factors, and mental health. Respondent PBRNs had published more than 600 articles in peer-reviewed journals. PBRNs studying questions posed by outside researchers had more federal funding (84% vs 27%, P=.006). PBRNs citing funding as a weakness relied more on local resources to fund research projects (70% vs 40%, P=.036).
CONCLUSIONS American primary care PBRNs are mainly young, diverse, and pursuing a variety of research foci. Most have university links and provide a dynamic town-gown relationship that could be a vital national resource for improving primary care, translating research into practice, and meeting the National Institutes of Health Roadmap goals. PBRNs merit further attention from both private and public funding agencies and researchers interested in studying the delivery of primary care.
Key Words: Research networks primary care survey research practice-based research
| INTRODUCTION |
|---|
|
|
|---|
The disconnect between research and everyday practice is in large part because most research is performed in academic medical centers, where less than 1% of Americans visiting physicians receive their health care.4 Such research often excludes patients commonly seen in community-based primary care: elders, patients with multiple medical conditions, patients nonadherent to treatment, and those suffering from substance abuse or psychiatric disorders.5 Studies performed in academic centers also tend to examine patient and clinician behaviors under controlled situations. It is not surprising, then, that the results of such studies are often not applicable to many community-based primary care patients or their clinicians. Kroenke et al6 have shown that most patients seeking primary care have nonspecific complaints to which the results of published research may not be relevant. Thus, primary care physicians trying to practice evidence-based medicine are frequently hampered by having little evidence to apply to the problems they face. As a consequence, their patients often leave unsatisfied.7
There are therefore 2 major disconnects between research and practice: research may not translate expeditiously to everyday practice, and clinical problems encountered in everyday practice are often underinvestigated. PBRNs were established in the United Kingdom in the 1960s to overcome these disconnects and subsequently spread to other European countries.9 The first major PBRNs in the United States came in the 1970s: the Family Medicine Information System10 and the Cooperative Information Project.11 These PBRNs were comprised mainly of community-based family medicine practices that had joined together to perform research relevant to the problems of delivering community-based primary care. In the United States, however, where federally funded research remained focused on academic medical centers, PBRNs have been slow to catch on.
In 2000, Congress responded by charging the Agency for Healthcare Research and Quality (AHRQ) to identify and support primary care practice-based research networks as a resource for accelerating the translation of research into practice and performing research relevant to everyday primary care.8 This act specifically states:
In order to address the full continuum of care and outcomes research, to link research to practice improvement, and to speed the dissemination of research findings to community practice settings, the Agency shall employ research strategies and mechanisms that will link research directly with clinical practice in geographically diverse locations throughout the United States, including ... provider-based research networks, including plan, facility, or delivery system sites of care (especially primary care), that can evaluate outcomes and evaluate and promote quality improvement....
AHRQ pursued this congressional directive by providing specific funding opportunities for primary care PBRNs, first in 2000 and again in 2002. The first round offered 19 PBRNs 1-year grants to "assist new or established PBRNs in planning for activities to enhance their capacity to conduct research in primary care settings and translate research findings into practice." AHRQ also collaborated with the Robert Wood Johnson Foundation to fund additional PBRNs to participate in a multisite research project focused on promoting healthy behaviors among patients in primary care settings.12 More than 100 PBRNs applied for these funding opportunities, suggesting to AHRQ that there was an expanding number of PBRNs that might help fulfill their congressional mandate to translate research into everyday practice. To identify and describe existing US primary care PBRNs, AHRQ funded this systematic survey of all active primary care PBRNs in the United States. The goal was to describe their diversity in specialty, structure, function, and history, as well as their potential for translating research into practice and answering questions of importance to primary care practitioners and their patients.
| METHODS |
|---|
|
|
|---|
To find primary care PBRNs, we looked for those currently or previously funded by AHRQ or the Robert Wood Johnson Foundations Prescription for Health Initiative,12 those belonging to the Federation of Practice Based Research Networks (the Federation) affiliated with the American Academy of Family Physicians,14 those we found through published articles, and as many other PBRNs as we could find through discussions with AHRQ, leaders of the Federation, and existing PBRNs.
We developed a Web-based questionnaire that collected the following information from the PBRNs director and/or administrator: descriptions of the PBRN (name, office location, age, administrative structure); the member practices and clinicians (number and locations of practices, number of physicians or other primary care clinicians, and clinicians medical specialties); patients served (number per practice and demographic data including age, sex, race/ethnicity, insurance status, if known); types and sources of research funding; productivity (number of studies performed and number of subjects included); and research foci, including research themes (eg, specific population age or research methodology) and specific diseases and nondisease health conditions (based on a closed-ended list of common research foci). We also queried the PBRN directors or administrators on self-assessed strengths and weaknesses, whether their member practices had incorporated research results into their practices, and barriers to translating research into practice. Response categories were developed based on the research teams knowledge of practicing PBRNs. Thirty-five of the 45 questions were closed-ended to facilitate efficient completion of the questionnaire and data analysis. The survey questionnaire was pilot tested with 5 PBRNs and revised to reflect their input on interpretability, clarity, and feasibility of completion. The final instrument is available from the authors upon request.
We administered the questionnaire using UltimateApps (Prezza Technologies, Cambridge, Mass) by sending an e-mail to the director of each PBRN we identified, and we invited him or her to complete the questionnaire by clicking on a link to the survey Web site. Each director gave consent on the first page before proceeding to the questionnaire. We sent reminders to all PBRN directors who did not complete the questionnaire within 1 month. After 1 additional month, one of the authors called each nonresponding PBRN director and invited him or her to complete the questionnaire; if desired, they could complete it on paper and return it by mail or fax.
After a PBRN director or administrator completed the questionnaire, we invited the director to participate in a semistructured telephone interview using a standard protocol that included questions about current and anticipated research projects, decision-making procedures at the network, current challenges facing the network, and potential interest in participation in a national study. Qualitative data from the telephone conversations were used to supplement the survey data and, in some cases, complete missing items from the questionnaire.
We tabulated and analyzed all data using SAS version 8.02 (SAS Institute, Carey, NC). We assessed differences using corrected
2 tests and Fisher exact tests for categorical variables and Student t tests for continuous variables. Differences associated with P values >.05 were considered statistically significant. When cell sizes were small, we collapsed multilevel variables to create the most relevant dichotomous variables.
| RESULTS |
|---|
|
|
|---|
|
|
Originally PBRNs were established as a structure in which their members could perform research15; however, only 1 in 7 of the responding PBRNs relied solely on their leaders or members for research ideas (so-called bottom-up PBRNs). For one-quarter of respondent PBRNs, research ideas came mainly from outside investigators (top-down). Most relied on both their members and outside investigators for generating research ideas. Of note, only 27% of the self-described bottom-up PBRNs had ever received federal funding for research compared with 84% of PBRNs having a top-down or mixed method for generating research proposals (P = .006).
Sixty PBRNs reported having a general research theme, the most common being a specific disease or treatment. A substantial minority focused on a particular research method, such as interventional or observational studies. Eight-five PBRNs reported on the clinical focus of their research, the most common being prevention, diabetes, cardiovascular risk, and mental health.
Patient Characteristics
Sixty PBRNs (70% of respondents) provided demographic information on the patients in their practices (Table 2
). Compared with 2002 national population estimates16 and persons seeking health care (as determined by the National Health Interview Study),17 PBRNs serve a more diverse patient population. PBRN patients tended to be slightly younger than the general population and more often of minority race and of Hispanic ethnicity compared with both the general population and persons seeking health care. PBRN patients have lower socioeconomic status (as indicated by a greater share of patients having insurance through state or federal programs, mainly Medicaid) than the general population seeking care.
|
|
Table 4
contains examples of active research projects at the time of the survey that the authors believe represent the spectrum of PBRN research. They were a mixture of health services research, prevention research, and research answering clinical questions. PBRN projects often focused on improving clinical practice and patient outcomes in areas where there is a known intervention that has been shown to be effective in some situations but is not a routine aspect of everyday clinical practice.
|
|
| DISCUSSION |
|---|
|
|
|---|
Existing PBRNs use a mixture of their own clinicians (bottom-up) and outside investigators (top-down) to choose research foci and individual projects. As a result, using PBRNs as a research resource will require efforts to establish more-effective communication among funding agencies, investigators, PBRN administrators, and PBRN clinicians. Furthermore, this communication should be bidirectional: (1) the PBRNs and their clinicians should be cognizant of the research interests and needs of federal and other funding agencies, and embrace those that are consistent with the needs and capabilities of the PBRNs and their practices; and (2) the funding agencies should use the PBRNs and their practices to better understand (and direct funds toward answering) the questions that everyday clinicians need answered so they can deliver high-quality, cost-effective care.
Although most PBRNs are affiliated with universities, the 2 largest we surveyed are affiliated with professional organizations. Specifically, the American Academy of Family Physicians has established the AAFP National Research Network (formerly the National Network for Family Practice and Primary Care Research18), which includes 206 practices and 200,000 patients; and Pediatric Research in Office Settings19 is affiliated with the American Academy of Pediatrics and contains 1,760 practices and 2.7 million patients. The American College of Physicians also supports the American College of Physicians Network,20 which at the time of this survey was 1 year old and growing, with 400 practices and 34,000 patients; as of this writing, it has 730 practices representing all 50 states. Affiliation with a national organization can facilitate a PBRNs involving a great many disparate practices with a wide geographic distribution that would improve external validity and generalizability of research results. In return, the PBRN provides the organization with a specialty-focused research venue that can serve the organizations specific research goals and objectives.
Funding PBRN activities, infrastructure, operations, and research projects is the principal barrier to realizing a PBRNs potential as a research resource. Affiliation with universities and professional organizations provides some security to PBRNs, but this support could come with demands on access to the practices and research directions. Thus, financial dependency could deflect the PBRNs from their research mission and be responsible for the preponderance of top-down or mixed models of decision making about research directions and individual projects. Through a peer learning group facilitated by the AHRQ National Resource Center for Practice-Based Research Networks,21 the PBRNs are sharing experiences and evolving to more stable financial configurations.
This study has limitations. There was no central resource for identifying primary care PBRNs, and the definitions of what constitutes primary care and what is a PBRN, although formally established by AHRQ, are somewhat arbitrary. Our focus on primary care excluded the expanding number of disease-specific PBRNs, eg, those studying cancer22 and asthma,23 and those by disciplines other than medicine, eg, dentistry.24 Moreover, 20% of those primary care PBRNs we did identify declined to participate in this survey, which could bias our results. Also, many of the PBRNs we surveyed were young and could have matured or failed since the survey. Finally, our results may not be typical for primary care PBRNs in other countries, where PBRNs are older and more mature, and the relationships between generalists and specialists may differ substantially from those in the United States.
Nonetheless, PBRNs are gaining momentum and recognition both nationally and internationally.25 There is increasing interest in using PBRNs as a test-bed to address clinical and public health issues that are of great national interest. For example, one primary care PBRN and a consortium of primary care PBRNs were among the 12 research networks funded by the NIH Roadmap program, Re-Engineering the Clinical Research Enterprise, to initiate a national electronic research infrastructure.26 The Robert Wood Johnson Foundation funded 19 primary care PBRNs to study methods to help enhance patients healthy behaviors.12 PBRNs have attracted the attention of several NIH institutes (including the National Institute of Mental Health, National Institute of Diabetes and Digestive and Kidney Diseases, National Heart, Lung, and Blood Institute, and National Cancer Institute) whose leaders see the potential of PBRNs as bidirectional venues for translating research into practice and practice into research. The funders of PBRN research and the PBRN community should collaborate on establishing a cogent research agenda, and the funding agencies should target funding programs toward PBRNs. The PBRNs should also collaborate among themselves to enhance their value as a network of PBRNs by sharing experiences (grasping opportunities and overcoming barriers) and collaborating on individual studies. Creative local and national investment in PBRNs will be necessary to continue their evolution into effective and productive primary care research laboratories and fulfill the NIH and AHRQ vision of "putting research into practice and practice into research."27
| FOOTNOTES |
|---|
Funding support: This work was supported by contract number 290-02-0007 to Indiana University from the Agency for Healthcare Research and Quality.
Disclaimer: The opinions expressed are solely those of the authors and do not necessarily represent their institutions or the funding agency.
Received for publication February 7, 2006. Revision received October 25, 2006. Accepted for publication November 11, 2006.
| REFERENCES |
|---|
|
|
|---|
Read all TRACK Comments
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |