Skip to main content

Main menu

  • Home
  • Content
    • Current Issue
    • Online First
    • Multimedia
    • Collections
    • Past Issues
    • Articles by Subject
    • Articles by Type
    • Supplements
    • The Issue in Brief (Plain Language Summaries)
    • Call for Papers
  • Info for
    • Authors
    • Reviewers
    • Media
    • Job Seekers
  • About
    • Annals of Family Medicine
    • Editorial Staff & Boards
    • Sponsoring Organizations
    • Copyrights & Permissions
    • Announcements
  • Engage
    • Engage
    • e-Letters (Comments)
    • Subscribe
    • RSS
    • Email Alerts
    • Journal Club
  • Contact
    • Feedback
    • Contact Us
  • Careers

User menu

  • My alerts

Search

  • Advanced search
Annals of Family Medicine
  • My alerts
Annals of Family Medicine

Advanced Search

  • Home
  • Content
    • Current Issue
    • Online First
    • Multimedia
    • Collections
    • Past Issues
    • Articles by Subject
    • Articles by Type
    • Supplements
    • The Issue in Brief (Plain Language Summaries)
    • Call for Papers
  • Info for
    • Authors
    • Reviewers
    • Media
    • Job Seekers
  • About
    • Annals of Family Medicine
    • Editorial Staff & Boards
    • Sponsoring Organizations
    • Copyrights & Permissions
    • Announcements
  • Engage
    • Engage
    • e-Letters (Comments)
    • Subscribe
    • RSS
    • Email Alerts
    • Journal Club
  • Contact
    • Feedback
    • Contact Us
  • Careers
  • Follow annalsfm on Twitter
  • Visit annalsfm on Facebook
Review ArticleSystematic Review

Barriers and Facilitators to the Use of Clinical Decision Support Systems in Primary Care: A Mixed-Methods Systematic Review

Pierre-Yves Meunier, Camille Raynaud, Emmanuelle Guimaraes, François Gueyffier and Laurent Letrilliart
The Annals of Family Medicine January 2023, 21 (1) 57-69; DOI: https://doi.org/10.1370/afm.2908
Pierre-Yves Meunier
1Collège universitaire de médecine générale, Université Claude Bernard Lyon 1, Lyon, France
2Research on Healthcare Performance (RESHAPE), INSERM U1290, Université Claude Bernard Lyon 1, Lyon, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: pierre-yves.meunier@univ-lyon1.fr
Camille Raynaud
1Collège universitaire de médecine générale, Université Claude Bernard Lyon 1, Lyon, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Emmanuelle Guimaraes
1Collège universitaire de médecine générale, Université Claude Bernard Lyon 1, Lyon, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
François Gueyffier
3Laboratoire de biométrie et biologie évolutive, département biostatistiques et modélisation pour la santé et l’environnement, CNRS UMR5558, Université Claude Bernard Lyon 1, Lyon, France
4Fédération de Recherche Santé Lyon Est, PAM Santé Publique, Hospices Civils de Lyon, Lyon, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Laurent Letrilliart
1Collège universitaire de médecine générale, Université Claude Bernard Lyon 1, Lyon, France
2Research on Healthcare Performance (RESHAPE), INSERM U1290, Université Claude Bernard Lyon 1, Lyon, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • Info & Metrics
  • eLetters
  • PDF
Loading

Abstract

PURPOSE To identify and quantify the barriers and facilitators to the use of clinical decision support systems (CDSSs) by primary care professionals (PCPs).

METHODS A mixed-methods systematic review was conducted using a sequential synthesis design. PubMed/MEDLINE, PsycInfo, Embase, CINAHL, and the Cochrane library were searched in July 2021. Studies that evaluated CDSSs providing recommendations to PCPs and intended for use during a consultation were included. We excluded CDSSs used only by patients, described as concepts or prototypes, used with simulated cases, and decision supports not considered as CDSSs. A framework synthesis was performed according to the HOT-fit framework (Human, Organizational, Technology, Net Benefits), then a quantitative synthesis evaluated the impact of the HOT-fit categories on CDSS use.

RESULTS A total of 48 studies evaluating 45 CDSSs were included, and 186 main barriers or facilitators were identified. Qualitatively, barriers and facilitators were classified as human (eg, perceived usefulness), organizational (eg, disruption of usual workflow), and technological (eg, CDSS user-friendliness), with explanatory elements. The greatest barrier to using CDSSs was an increased workload. Quantitatively, the human and organizational factors had negative impacts on CDSS use, whereas the technological factor had a neutral impact and the net benefits dimension a positive impact.

CONCLUSIONS Our findings emphasize the need for CDSS developers to better address human and organizational issues, in addition to technological challenges. We inferred core CDSS features covering these 3 factors, expected to improve their usability in primary care.

Key words:
  • primary health care
  • information technology
  • medical informatics
  • quality of health care
  • decision support systems, clinical

INTRODUCTION

Achieving best practice in primary care is a challenge because primary care professionals (PCPs) face a variety of health care issues and cannot always identify and access all the relevant information within the timeframe of the consultation.1,2 Clinical decision support systems (CDSSs) are software designed to be a direct aid to clinical decision making, in which an inference engine matches the features of an individual patient to a computerized clinical knowledge base or a machine learning algorithm and then presents patient-specific assessments or recommendations to the clinician or the patient for a decision.3,4 Clinical decision support systems are intended to improve the quality, safety, and efficiency of care.5-7 In primary care, they have not yet proven effectiveness on clinical outcomes, such as morbidity or mortality.8,9 However, according to a large recent meta-analysis of controlled trials in any settings, CDSSs increase the proportion of patients receiving the desired element of care by 5.8% overall, with a trend toward a worse outcome in the outpatient setting.10

Qualitative evaluations are needed to obtain a comprehensive understanding of the barriers and facilitators to CDSS use, which are key to their implementation success.11,12 For this purpose, several systematic reviews focused on specific types of CDSS (knowledge-based CDSSs,13 clinical reminders14), specific processes of care (drug prescription,15,16 diagnosis17), or specific health issues (antibiotics prescription,18 HIV management19), without any restriction to their context of use. However, health information systems implementation or evaluation models such as the HOT-fit framework (Human, Organization, Technology, Net Benefits20) and others21-25 emphasize the influence of context-specific factors in the use of health information systems. This is even more important for the primary care setting owing to the unique combination of the diversity and complexity of health issues managed (often multiple in the same consultation), its patient-centered care approach, and its particular decision-making context,26 which may generate specific needs for decision support systems.

The objective of the present systematic review was therefore to identify and quantify the barriers and facilitators to the use of CDSSs by PCPs. From a qualitative synthesis based on the HOT-fit framework, we derived a quantitative synthesis assessing the mean impacts of the human, organizational, technological factors, and the net benefits dimension on CDSS use by PCPs.

METHODS

The present study was a mixed-methods systematic review that followed the Preferred Reporting Items for Systematic Review and Meta-Analysis (PRISMA) reporting guideline. The study protocol was registered on PROSPERO on July 14, 2020 (CRD42020185199).

Search Strategy

The search strategy was built in cooperation with medical librarians. We searched PubMed/MEDLINE, PsycInfo, Embase, CINAHL, and the Cochrane library for relevant studies. We tracked citations from included records to identify additional relevant references. The search was performed on July 5, 2021 without date limitation. The complete search strategy for each database is available in Supplemental Appendix 1.

Eligibility Criteria

We included all qualitative, quantitative, and mixed methods studies and only original articles for which the primary or secondary objectives were to identify barriers and facilitators to the use of CDSSs in primary care. For studies involving various professions or specialties, we only considered those that had at least 50% PCPs in the study sample. We included CDSSs that provided recommendations to PCPs (and possibly to patients) and were intended for use during the consultation.

We excluded publication types that were posters, dissertations or theses, conference proceedings, commentaries, letters, or editorials. We excluded the following decision supports that were not considered as being CDSSs: drug-drug interaction alert systems, risk assessment tools that provided assessments but not recommendations, and clinical decision supports without inference engine. We excluded the following CDSSs: decision aids only used by patients, CDSSs described as concepts or prototypes, and CDSSs evaluated with simulated clinical scenarios.

Selection Process

The selection process was performed using Covidence software (Veritas Innovation Ltd).27 After automatic removal of duplicates, 2 authors (P-Y.M. and C.R.) independently screened titles and abstracts and excluded irrelevant records. They independently screened potentially relevant articles in full text while documenting reasons for exclusion. The concordance (Embedded Image) was 0.62 for title and abstract screening and 0.72 for full text screening. The disagreements were resolved by seeking consensus between the 2 authors.

Quality Appraisal

The quality of the included studies was independently appraised by 2 authors (P-Y.M. and C.R.) using the Covidence software. We applied the QuADS tool that has been designed to appraise the methodological and reporting quality of qualitative, quantitative, and mixed-methods studies in systematic reviews, based on 13 common criteria.28 Each criterion is assessed according to the 4 following proposals: no mention at all, very slightly, moderately, complete. The concordance (Embedded Image) was 0.39. The disagreements were resolved by seeking consensus between the 2 authors.

Data Extraction

We used a structured data collection form to extract CDSS features (Supplemental Table 1) and methodological features of the included studies. The extraction process was performed independently by 2 authors (P-Y.M. and C.R.); disagreements were resolved by seeking consensus between them. We contacted the main authors of the included studies to obtain data on CDSS features not reported in the published article.

The HOT-fit Framework

The HOT-fit framework describes the interdependent human, organizational, and technological factors related to health information system adoption. These 3 factors are described through 7 dimensions: system use and user satisfaction related to the human factor; environment and structure related to the organizational factor; system, information and service quality related to the technological factor. The framework is complemented by an additional dimension, net benefits, which captured the positive and negative effects of CDSS recommendations on PCPs (Figure 1).20 Each HOT-fit dimension includes several evaluation measures. The HOT-fit framework was chosen as it assesses barriers and facilitators to the use of health information systems from a pragmatic, user-centered approach.

Figure 1:
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 1:

HOT-fit framework (derived from Yusof et al29).

HOT-fit = human, organization, technology, net benefits.

Note: The HOT-fit framework describes the interdependent human, organizational, and technological factors related to health information system adoption. A fit between the human, organizational, technological factors and the net benefit dimension is required for the adoption of these systems.

Data Synthesis

The review followed a sequential synthesis design, using a framework synthesis to inform a quantitative synthesis (Figure 2).30-32 First, a convergent integrated approach built up a common set of qualitative data from the included qualitative and quantitative data. It involved data transformation through a narrative interpretation of quantitative data.31 The resulting framework synthesis was based on the HOT-fit framework. Second, we performed a quantitative synthesis by calculating the difference between barriers and facilitators categorized according to the HOT-fit framework.

Figure 2.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 2.

Mixed-methods synthesis design.

CDSS = clinical decision support system; HOT-fit = human, organization, technology, net benefits.

The framework synthesis was performed using NVivo (QSR International), released in March 2020.33 Barriers and facilitators to the use of CDSSs were coded inductively as concepts and then classified into the appropriate HOT-fit evaluation measures.32 This was done independently by 2 authors (P-Y.M. and E.G.), who reviewed together every coded citation and reached consensus on the concepts and the associated HOT-fit evaluation measures. We extended the HOT-fit framework to include a few concepts we were unable to classify in existing evaluation measures. Due to the various level of detail in the description of the barriers and facilitators to CDSS use in the included studies, certain codes were considered as explanatory elements of higher concepts that we named main barriers and facilitators.

From the framework synthesis results, we first quantified the individual impacts of the 3 HOT-fit factors (human, organization, technology) and the net benefits dimension on the use of each CDSS. In practice, facilitators to CDSS use were quantified as +1 and barriers as −1. For example, if a given CDSS had X barriers and Y facilitators classified in the human factor, this factor’s impact on the use of this CDSS was calculated as Y-X. For each CDSS, barriers and facilitators were considered only once, regardless of the number of their occurrences in the included studies. Then, we calculated the mean impact of each HOT-fit factor and the net benefits dimension on the use of the whole sample of CDSSs included, with a confidence interval (CI).

RESULTS

A total of 48 studies assessing 45 CDSSs were included in the review (Figure 3).34-81 Of these, 29 were mixed-methods studies, 15 were qualitative studies, and 4 were quantitative studies. Included studies were published from 1998 to 2021 (median year: 2016). Three CDSSs (EBMeDS, NHGDoc, and PRIMA-EDS) were assessed in 2 studies.

Figure 3.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 3.

PRISMA flow chart.

CDSS = clinical decision support system; PRISMA = Preferred Reporting Items for Systematic Review and Meta-Analysis.

Description of the CDSSs

Clinical decision support systems were mainly developed (n = 18) and used (n = 17) in the United States. The main users were primary care physicians (n = 37) and nurses (n = 22). Clinical decision support systems were used for preventive care (n = 27), treatment (n = 21), management of chronic disease(s) (n = 13), and/or diagnosis (n = 7). All CDSSs were knowledge based; none integrated a machine learning algorithm. Updates to the knowledge database were made in 11/33 CDSSs for which this information was available. The strength of evidence of CDSS recommendations was provided in 4/19 studies for which the information was available. Twenty-three CDSSs provided a direct link to the source of recommendations. Thirteen CDSSs provided educational materials to help patients with shared decision making. Primary care professionals were trained to the use of 36 CDSSs. Most CDSSs were partially or fully integrated in the electronic health record (EHR) (n = 28). The main features of the included CDSS are described in Table 1. Detailed features are presented in Supplemental Appendix 2.

View this table:
  • View inline
  • View popup
Table 1.

Main Features of the 45 Identified CDSSs

Quality Assessment

The rationale for the choice of the data collection tool was not mentioned at all in 18 studies and very slightly in 6 studies. The format and content of the data collection tool was estimated as completely appropriate to meet the stated research objectives in 27 studies, and moderately appropriate in 19 studies. The appraisal of the 13 quality criteria of the QuADS tool is presented in Supplemental Table 2. The methodological features of the included studies are presented in Supplemental Table 3.

Framework Synthesis

In total, 186 main barriers and facilitators and 69 explanatory elements were identified. All CDSSs reported technological barriers or facilitators, but 4 CDSSs did not assess the human factor, 4 did not assess the organizational factor, and 3 did not assess the net benefits dimension. Among the 186 main barriers and facilitators, 43 were classified as human factors, 49 as organizational factors, 70 as technological factors, and 24 in the net benefits dimension. The full list is presented in Supplemental Appendix 3, and barriers and facilitators (or their pairs) identified in at least 7 CDSSs are described in Tables 2 and 3 with their explanatory elements. The mean number of main barriers and facilitators identified per CDSS was 28.9; this ranged from 8 to 86 (Supplemental Table 4). We complemented the HOT-fit framework by adding an evaluation measure called “hardware” in the dimension “structure” of the factor “organization” to describe barriers and facilitators related to hardware issues in PCPs facilities.

View this table:
  • View inline
  • View popup
Table 2.

Main Facilitators Reported in More Than 7 CDSSs, and Their Explanatory Elements, Classified According to the HOT-Fit Framework

View this table:
  • View inline
  • View popup
Table 3.

Main Barriers Reported in at Least 7 CDSSs, and Their Explanatory Elements, Classified According to the HOT-Fit Framework

From the human perspective, PCPs valued CDSSs for which they were trained and perceived to be useful. Conversely, they did not appreciate CDSS that provided recommendations conflicting with their beliefs or expertise. They frequently experienced alert fatigue or information overload.

From the organizational perspective, PCPs appreciated that the CDSS was well integrated into the clinical workflow and physicians appreciated that other professionals eased their workload. Conversely, PCPs expressed difficulties in using CDSSs with patients managed by other specialists because of disagreements between CDSS recommendations and specialists’ prescriptions.

From the technological perspective, PCPs appreciated fully integrated and easy-to-use CDSSs, providing reminders for PCPs and educational materials to patients, and relevant and reliable recommendations. Conversely, they disliked CDSSs that were slow, or targeting only a few health issues. They sometimes questioned the reliability of the recommendations, which they attributed to the quality and completeness of the information collected. PCPs frequently requested CDSS customization features.

From the net benefits perspective, PCPs felt that using CDSSs increased workload during the consultation for 33 of the 45 included CDSSs. Despite this major barrier, PCPs largely agreed on the benefits of CDSSs in terms of their potential to improve quality of care, particularly for preventive care. Primary care clinicians also felt that CDSSs improved the automatic identification of all useful information that they did not systematically recognize at the moment the clinical decision is made, as well as shared medical decision making through the provision of educational material to patients and their adherence to guidelines.

Quantitative Synthesis

Organizational and human HOT-fit factors had an overall negative impact on CDSS use by PCPs. The technological factor had a neutral overall impact, and the net benefits dimension an overall positive impact on CDSS use (Table 4). Individual impacts of the 3 HOT-fit factors and the net benefits dimension on the use of each CDSS are presented in Supplemental Table 5.

View this table:
  • View inline
  • View popup
Table 4.

Mean Impacts of HOT-Fit Categories on CDSS Use by PCPs

DISCUSSION

All barriers and facilitators to CDSS use by PCPs were distributed across the 3 HOT-fit factors and the net benefits dimension, with a predominance of the technological factor, that was the only factor explored in all studies. However, the overall impact of the technological factor on the use of CDSSs by PCPs was neutral, which indicates a balance between technological barriers and facilitators, while the human and organizational factors had overall negative impacts and the net benefit dimension an overall positive impact. The net benefits reported by PCPs support the potential effectiveness of CDSSs in improving quality and safety of care. However, they seem unable to improve care efficiency since they are believed to increase PCP workload.

Comparison With Other Studies

This review is the first to identify and quantify barriers and facilitators to the use of CDSSs specifically in the primary care setting. In 2017, Kilsdonk et al conducted a systematic review and gap analysis of barriers and facilitators to the use of knowledge-based CDSSs in any setting (including hospitals) according to the HOT-fit framework, including CDSS evaluations based on simulated clinical scenarios.13 The quantitative gap analysis revealed the predominance of technological and human factors, and a knowledge gap regarding the organizational factor and the net benefits dimension. However, no conclusion could be drawn on the relative impact of these factors on CDSS use. In the present review, the organizational factor was not less frequently identified than the human factor, and the quantitative synthesis assessed for the first time the relative impact of the HOT-fit factors on CDSS use. In 2013, Moxey et al analyzed both health care providers’ general views on, and use of, CDSSs including computerized guidelines and risk assessment tools, in various settings.15 These systematic reviews identified barriers and facilitators mostly concerning time consumption, workflow, integration in the EHR, user friendliness, and relevance of the recommendations. Moxey et al conducted a subgroup analysis that identified the lack of CDSS integration into the EHR and patient negative opinion as barriers specific to the ambulatory care setting.15 Poor CDSS integration was confirmed as a main technological barrier in our review. The diversity of EHRs developed for primary care may explain the persistence of this barrier over time.82 Patient negative opinion was less frequently reported in our review, presumably because of the increasing acceptance over time of the use of health information systems during consultations.83

Other barriers and facilitators identified in the present review are original as compared with previous reviews.13,15 First, teamwork needs for and benefits of using CDSSs were frequently reported. The importance of teamwork could not be identified previously since it is just emerging in primary care in many health care systems, contrarily to the hospital setting.84,85 Second, PCPs expressed difficulties in using CDSSs with patients co-managed by specialists, due to discrepancies between specialist and CDSS recommendations or to outdated patient information in the EHR. Third, PCPs expected CDSSs covering a large array of conditions in agreement with the diversity of the health issues they manage. Fourth, the contribution of CDSSs to reporting on quality measures was valued by PCPs, in a context of evaluation programs implemented in primary care.

Strengths and Weaknesses

The scope of this review was limited to strictly defined CDSSs providing recommendations to PCPs based on individual patient characteristics, according to a medical decision-making perspective. Two previous systematic reviews13,15 also included decision supports providing individualized assessments (risks) or general recommendations (not personalized to the patient), which presumably increased the heterogeneity of the barriers and facilitators identified. They also have included decision supports used in any care setting (including hospitals), and those evaluated using simulated clinical scenarios. In the present review, only CDSSs used in clinical settings and in the specific context of primary care were included, which further strengthens the external validity of the results. It may, however, not be fully representative of the various CDSSs developed for primary care, as some of them were probably not studied regarding barriers and facilitators to their use.

Frequency-based indicators of the impact of HOT-fit categories on CDSS use were useful for comparison purposes; they were, however, limited by the heterogeneity of CDSS barriers and facilitators and by the difficulty to weight them individually according to their perceived importance by PCPs. In addition, PCPs reported some barriers such as conflicts between CDSS recommendations and their own expertise or lack of computer skills, while the first barrier is more likely related to the use of guidelines86 and the second to the uptake of EHRs.87,88 The classification of barrier and facilitators in the evaluation measures was sometimes subjective because of similarities between, or lack of clear definition of some HOT-fit evaluation measures, as already reported by other authors.13 For instance, the HOT-fit evaluation measure “clinical process” in the dimension “structure” of the organizational factor is close to the evaluation measure “clinical practice” of the net benefits dimension.

Implications

The present systematic review highlights barriers and facilitators to the use of CDSSs related to its feasibility (eg, increased workload), acceptability (eg, conflicts with PCPs expertise or beliefs), meaningfulness (eg, relevance of recommendations), and effectiveness (net benefits dimension). These different forms of evidence refer to the feasibility, appropriateness, meaningfulness, and effectiveness (FAME) evidence-based model,89 which is useful to understand complex interventions such as implementing CDSSs. Based on these findings, we inferred an operational list of 11 intrinsic and contextual CDSS features expected to make them more feasible, acceptable, meaningful, and effective in primary care (Table 5). They are spread across the 3 interdependent human, organizational, and technological factors. Among intrinsic features, the expectation of decision support for preventive care is consistent with the great importance of prevention in primary care practice. The expectation of a large array of conditions covered by CDSSs is explained by the preference of PCPs for a single comprehensive system rather than several CDSSs with limited clinical coverage displaying recommendations in separate windows, each requiring a specific training. Information overload refers to PCPs facing more information than they have the time or cognitive ability to process.90,91 Clinical decision support systems aim at both rationalizing patient management while avoiding overwhelming PCPs with information, which can be achieved by CDSSs providing concise recommendations and prioritizing the most appropriate interventions recommended for each patient.92 In addition, the feature of providing patients with educational material supports shared decision making within a patient-centered approach. Among contextual features, developing CDSSs in close collaboration with PCPs according to a bottom-up approach is needed to improve their perceived usefulness and user-friendliness and the relevance of their recommendations. Providing the rationale for selecting the sources of the CDSS knowledge base is expected to increase CDSS reliability. This seems critical, even more for future non–knowledge-based CDSSs, as health care professionals are exposed to automation bias, which consists of over-relying on automated advice.93 Teamwork for data collection and use of CDSSs may ease physician workload and make EHR patient data more complete and reliable. Several of these intrinsic and contextual features may allow the leading barrier, increased workload, to be overcome. Since the findings of the present review show that human and organizational factors are the most impeding to CDSS use, we recommend that CDSS developers investigate the human and organizational requirements in the early stages of CDSS development and that evaluation studies of CDSS use systematically evaluate these factors. In addition, quantitative studies are particularly needed to assess the weight of the main barriers and facilitators identified through the present framework synthesis.

View this table:
  • View inline
  • View popup
Table 5.

Expected Features of a CDSS for Primary Care

CONCLUSION

Although benefits reported by PCPs support the potential effectiveness of CDSS use in improving quality and safety of care, they also highlight its lack of efficiency due to increased workload. Our findings emphasize the need for CDSS developers to better address human and organizational issues in addition to technological stakes. Covering theses 3 factors, we inferred core intrinsic and contextual CDSS features expected to improve their usability in primary care.

Acknowledgments

We would like to thank Mathieu Fauvernier and Maxime Bonjour (Service de Biostatistiques des Hospices Civils de Lyon, France; UMR5558, Laboratoire de Biométrie et Biologie Évolutive, Équipe Biostatistique-Santé, Villeurbanne, France) for their comments on the data synthesis method. We would like to thank Colin Sidre and Bastien Blanchon (BIU Santé Médecine, Paris, France) for help with the search strategy. We also thank Philip Robinson (DRS, Hospices Civils de Lyon) for help in manuscript preparation.

Footnotes

  • Conflicts of interest: authors report none.

  • Read or post commentaries in response to this article.

  • Funding support: The study funder was a public health institution (Agence Régionale de Santé Auvergne-Rhône-Alpes) through a grant attributed to Pierre-Yves Meunier.

  • Disclaimer: The study funder did not interfere in the conduct of this study. All authors confirm the independence of researchers from funders. All authors had full access to all of the data (including tables) in the study and can take responsibility for the integrity of the data and the accuracy of the data analysis.

  • Trial registration: Protocol registered on PROSPERO (CRD42020185199) (no amendments to information provided in the protocol).

  • Supplemental materials

  • Received for publication April 4, 2022.
  • Revision received September 8, 2022.
  • Accepted for publication October 10, 2022.
  • © 2023 Annals of Family Medicine, Inc.

REFERENCES

  1. 1.↵
    1. World Health Organisation
    . Technical Series on Primary Health Care: Quality in Primary Health Care. World Health Organisation; 2018. Accessed Oct 5, 2021. https://www.who.int/docs/default-source/primary-health-care-conference/quality.pdf
  2. 2.↵
    1. van der Keylen P,
    2. Tomandl J,
    3. Wollmann K, et al.
    The online health information needs of family physicians: systematic review of qualitative and quantitative studies. J Med Internet Res. 2020; 22(12): e18816. doi:10.2196/18816
    OpenUrlCrossRef
  3. 3.↵
    1. Sim I,
    2. Gorman P,
    3. Greenes RA, et al.
    Clinical decision support systems for the practice of evidence-based medicine. J Am Med Inform Assoc. 2001; 8(6): 527-534. doi:10.1136/jamia.2001.0080527
    OpenUrlCrossRefPubMed
  4. 4.↵
    1. Sutton RT,
    2. Pincock D,
    3. Baumgart DC,
    4. Sadowski DC,
    5. Fedorak RN,
    6. Kroeker KI.
    An overview of clinical decision support systems: benefits, risks, and strategies for success. NPJ Digit Med. 2020; 3(1): 17. doi:10.1038/s41746-020-0221-y
    OpenUrlCrossRefPubMed
  5. 5.↵
    1. World Health Organisation
    . WHO Guideline : Recommendations on Digital Interventions for Health System Strenghtening. World Health Organisation; 2019. Accessed Oct 5, 2021. https://apps.who.int/iris/handle/10665/331883
  6. 6.
    1. Osheroff JA,
    2. Teich JM,
    3. Middleton B,
    4. Steen EB,
    5. Wright A,
    6. Detmer DE.
    A roadmap for national action on clinical decision support. J Am Med Inform Assoc. 2007; 14(2): 141-145. doi:10.1197/jamia.M2334
    OpenUrlCrossRefPubMed
  7. 7.↵
    1. Tcheng JE, National Academy of Medicine
    , eds. Optimizing Strategies for Clinical Decision Support: Summary of a Meeting Series. National Academy of Medicine; 2017.
  8. 8.↵
    1. Heselmans A,
    2. Van de Velde S,
    3. Donceel P,
    4. Aertgeerts B,
    5. Ramaekers D.
    Effectiveness of electronic guideline-based implementation systems in ambulatory care settings - a systematic review. Implement Sci. 2009; 4(1): 82. doi:10.1186/1748-5908-4-82
    OpenUrlCrossRefPubMed
  9. 9.↵
    1. Souza NM,
    2. Sebaldt RJ,
    3. Mackay JA, et al; CCDSS Systematic Review Team
    . Computerized clinical decision support systems for primary preventive care: a decision-maker-researcher partnership systematic review of effects on process of care and patient outcomes. Implement Sci. 2011; 6(1): 87. doi:10.1186/1748-5908-6-87
    OpenUrlCrossRefPubMed
  10. 10.↵
    1. Kwan JL,
    2. Lo L,
    3. Ferguson J, et al.
    Computerised clinical decision support systems and absolute improvements in care: meta-analysis of controlled clinical trials. BMJ. 2020; 370: m3216. doi:10.1136/bmj.m3216
    OpenUrlAbstract/FREE Full Text
  11. 11.↵
    1. Lobach DF.
    The road to effective clinical decision support: are we there yet? BMJ. 2013; 346: f1616. doi:10.1136/bmj.f1616
    OpenUrlFREE Full Text
  12. 12.↵
    1. Sarkar U,
    2. Samal L.
    How effective are clinical decision support systems? BMJ. 2020; 370: m3499. doi:10.1136/bmj.m3499
    OpenUrlFREE Full Text
  13. 13.↵
    1. Kilsdonk E,
    2. Peute LW,
    3. Jaspers MWM.
    Factors influencing implementation success of guideline-based clinical decision support systems: A systematic review and gaps analysis. Int J Med Inform. 2017; 98: 56-64. doi:10.1016/j.ijmedinf.2016.12.001
    OpenUrlCrossRefPubMed
  14. 14.↵
    1. Saleem JJ,
    2. Patterson ES,
    3. Militello L,
    4. Render ML,
    5. Orshansky G,
    6. Asch SM.
    Exploring barriers and facilitators to the use of computerized clinical reminders. J Am Med Inform Assoc. 2005; 12(4): 438-447. doi:10.1197/jamia.M1777
    OpenUrlCrossRef
  15. 15.↵
    1. Moxey A,
    2. Robertson J,
    3. Newby D,
    4. Hains I,
    5. Williamson M,
    6. Pearson SA.
    Computerized clinical decision support for prescribing: provision does not guarantee uptake. J Am Med Inform Assoc. 2010; 17(1): 25-33. doi:10.1197/jamia.M3170
    OpenUrlCrossRefPubMed
  16. 16.↵
    1. Westerbeek L,
    2. Ploegmakers KJ,
    3. de Bruijn GJ, et al.
    Barriers and facilitators influencing medication-related CDSS acceptance according to clinicians: a systematic review. Int J Med Inform. 2021; 152: 104506. doi:10.1016/j.ijmedinf.2021.104506
    OpenUrlCrossRef
  17. 17.↵
    1. Nurek M,
    2. Kostopoulou O,
    3. Delaney BC,
    4. Esmail A.
    Reducing diagnostic errors in primary care. A systematic meta-review of computerized diagnostic decision support systems by the LINNEAUS collaboration on patient safety in primary care. Eur J Gen Pract. 2015; 21(Suppl): 8-13. doi:10.3109/13814788.2015.1043123
    OpenUrlCrossRefPubMed
  18. 18.↵
    1. Laka M,
    2. Milazzo A,
    3. Merlin T.
    Factors that impact the adoption of clinical decision support systems (CDSS) for antibiotic management. Int J Environ Res Public Health. 2021; 18(4): 1901. doi:10.3390/ijerph18041901
    OpenUrlCrossRef
  19. 19.↵
    1. Oluoch T,
    2. Santas X,
    3. Kwaro D, et al.
    The effect of electronic medical record-based clinical decision support on HIV care in resource-constrained settings: a systematic review. Int J Med Inform. 2012; 81(10): e83-e92. doi:10.1016/j.ijmedinf.2012.07.010
    OpenUrlCrossRefPubMed
  20. 20.↵
    1. Yusof MM,
    2. Kuljis J,
    3. Papazafeiropoulou A,
    4. Stergioulas LK.
    An evaluation framework for Health Information Systems: human, organization and technology-fit factors (HOT-fit). Int J Med Inform. 2008; 77(6): 386-398. doi:10.1016/j.ijmedinf.2007.08.011
    OpenUrlCrossRefPubMed
  21. 21.↵
    1. William H. Delone,
    2. Ephraim R. McLean
    . The DeLone and McLean model of information systems success: a ten-year update. J Manage Inf Syst. 2003; 19(4): 9-30. doi:10.1080/07421222.2003.11045748
    OpenUrlCrossRef
  22. 22.
    1. Damschroder LJ,
    2. Aron DC,
    3. Keith RE,
    4. Kirsh SR,
    5. Alexander JA,
    6. Lowery JC.
    Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009; 4: 50. doi:10.1186/1748-5908-4-50
    OpenUrlCrossRefPubMed
  23. 23.
    1. Sittig DF,
    2. Singh H.
    A new sociotechnical model for studying health information technology in complex adaptive healthcare systems. Qual Saf Health Care. 2010; 19(Suppl 3): i68-i74. doi:10.1136/qshc.2010.042085
    OpenUrlAbstract/FREE Full Text
  24. 24.
    1. Venkatesh V,
    2. Thong J,
    3. Xu X.
    Unified theory of acceptance and use of technology: a synthesis and the road ahead. J Assoc Inf Syst. 2016; 17(5). doi:10.17705/1jais.00428
    OpenUrlCrossRef
  25. 25.↵
    1. Greenhalgh T,
    2. Wherton J,
    3. Papoutsi C, et al.
    Beyond adoption: a new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies. J Med Internet Res. 2017; 19(11): e367. doi:10.2196/jmir.8775
    OpenUrlCrossRefPubMed
  26. 26.↵
    1. Allen J,
    2. Gay B,
    3. Crebolder H, et al.
    The european definition of general practice/family medicine. Published 2011. Accessed Feb 20, 2022. https://www.woncaeurope.org/file/520e8ed3-30b4-4a74-bc35-87286d3de5c7/Definition%203rd%20ed%202011%20with%20revised%20wonca%20tree.pdf
  27. 27.↵
    1. Veritas Health Innovation
    . Covidence systematic review software. www.covidence.org
  28. 28.↵
    1. Harrison R,
    2. Jones B,
    3. Gardner P,
    4. Lawton R.
    Quality assessment with diverse studies (QuADS): an appraisal tool for methodological and reporting quality in systematic reviews of mixed- or multi-method studies. BMC Health Serv Res. 2021; 21(1): 144. doi:10.1186/s12913-021-06122-y
    OpenUrlCrossRefPubMed
  29. 29.↵
    1. Yusof MM.
    A case study evaluation of a Critical Care Information System adoption using the socio-technical and fit approach. Int J Med Inform. 2015; 84(7): 486-499. doi:10.1016/j.ijmedinf.2015.03.001
    OpenUrlCrossRef
  30. 30.↵
    1. Hong QN,
    2. Pluye P,
    3. Bujold M,
    4. Wassef M.
    Convergent and sequential synthesis designs: implications for conducting and reporting systematic reviews of qualitative and quantitative evidence. Syst Rev. 2017; 6(1): 61. doi:10.1186/s13643-017-0454-2
    OpenUrlCrossRefPubMed
  31. 31.↵
    1. Aromataris E,
    2. Munn Z
    1. Lizarondo L,
    2. Stern C,
    3. Carrier J, et al.
    Chapter 8: mixed methods systematic reviews. In: Aromataris E, Munn Z, eds. JBI Manual for Evidence Synthesis. JBI; 2020. doi:10.46658/JBIMES-20-09
    OpenUrlCrossRef
  32. 32.↵
    1. Dixon-Woods M.
    Using framework-based synthesis for conducting reviews of qualitative studies. BMC Med. 2011; 9(1): 39. doi:10.1186/1741-7015-9-39
    OpenUrlCrossRefPubMed
  33. 33.↵
    1. QSR International Pty Ltd.
    NVivo. Published 2021. https://www.qsrinternational.com/nvivo-qualitative-data-analysis-software/home
  34. 34.↵
    1. Abimbola S,
    2. Patel B,
    3. Peiris D, et al.
    The NASSS framework for ex post theorisation of technology-supported change in healthcare: worked example of the TORPEDO programme. BMC Med. 2019; 17(1): 233. doi:10.1186/s12916-019-1463-x
    OpenUrlCrossRefPubMed
  35. 35.
    1. af Klercker T,
    2. Zetraeus S.
    Dilemmas in introducing World Wide Web-based information technology in primary care: a focus group study. Fam Pract. 1998; 15(3): 205-210. doi:10.1093/fampra/15.3.205
    OpenUrlCrossRefPubMed
  36. 36.
    1. Alagiakrishnan K,
    2. Wilson P,
    3. Sadowski C, et al.
    Physicians’use of computerized clinical decision supports to improve medication management in the elderly; the Seniors Medication Alert and Review Technology intervention. Clin Interv Aging. 2016; (11): 73-81. doi:10.2147/CIA.S94126
    OpenUrlCrossRef
  37. 37.
    1. Arts DL,
    2. Medlock SK,
    3. van Weert HCPM,
    4. Wyatt JC,
    5. Abu-Hanna A.
    Acceptance and barriers pertaining to a general practice decision support system for multiple clinical conditions: a mixed methods evaluation. PLoS One. 2018; 13(4): e0193187. doi:10.1371/journal.pone.0193187
    OpenUrlCrossRefPubMed
  38. 38.
    1. Ash JS,
    2. Sittig DF,
    3. Wright A, et al.
    Clinical decision support in small community practice settings: a case study. J Am Med Inform Assoc. 2011; 18(6): 879-882. doi:10.1136/amiajnl-2010-000013
    OpenUrlCrossRef
  39. 39.
    1. Bandong AN,
    2. Mackey M,
    3. Leaver A, et al.
    an interactive website for whiplash management (My Whiplash Navigator): process evaluation of design and implementation. JMIR Form Res. 2019; 3(3): e12216. doi:10.2196/12216
    OpenUrlCrossRef
  40. 40.
    1. Bessat C,
    2. Zonon NA,
    3. D’Acremont V.
    Large-scale implementation of electronic Integrated Management of Childhood Illness (eIMCI) at the primary care level in Burkina Faso: a qualitative study on health worker perception of its medical content, usability and impact on antibiotic prescription and resistance. BMC Public Health. 2019; 19(1): 449. doi:10.1186/s12889-019-6692-6
    OpenUrlCrossRefPubMed
  41. 41.
    1. Bindels R,
    2. Hasman A,
    3. Derickx M,
    4. Van Wersch JW,
    5. Winkens RA.
    User satisfaction with a real-time automated feedback system for general practitioners: a quantitative and qualitative study. Int J Qual Health Care. 2003; 15(6): 501-508. doi:10.1093/intqhc/mzg076
    OpenUrlCrossRefPubMed
  42. 42.
    1. Curry L,
    2. Reed MH.
    Electronic decision support for diagnostic imaging in a primary care setting. J Am Med Inform Assoc. 2011; 18(3): 267-270. doi:10.1136/amiajnl-2011-000049
    OpenUrlCrossRef
  43. 43.
    1. Dixon BE,
    2. Simonaitis L,
    3. Goldberg HS, et al.
    A pilot study of distributed knowledge management and clinical decision support in the cloud. Artif Intell Med. 2013; 59(1): 45-53. doi:10.1016/j.artmed.2013.03.004
    OpenUrlCrossRefPubMed
  44. 44.
    1. Doerr M,
    2. Edelman E,
    3. Gabitzsch E,
    4. Eng C,
    5. Teng K.
    Formative evaluation of clinician experience with integrating family history-based clinical decision support into clinical practice. J Pers Med. 2014; 4(2): 115-136. doi:10.3390/jpm4020115
    OpenUrlCrossRef
  45. 45.
    1. Edelman EA,
    2. Lin BK,
    3. Doksum T, et al.
    Evaluation of a novel electronic genetic screening and clinical decision support tool in prenatal clinical settings. Matern Child Health J. 2014; 18(5): 1233-1245. doi:10.1007/s10995-013-1358-y
    OpenUrlCrossRef
  46. 46.
    1. Feldstein AC,
    2. Schneider JL,
    3. Unitan R, et al.
    Health care worker perspectives inform optimization of patient panel-support tools: a qualitative study. Popul Health Manag. 2013; 16(2): 107-119. doi:10.1089/pop.2012.0065
    OpenUrlCrossRef
  47. 47.
    1. Guenter D,
    2. Abouzahra M,
    3. Schabort I, et al.
    Design process and utilization of a novel clinical decision support system for neuropathic pain in primary care: mixed methods observational study. JMIR Med Inform. 2019; 7(3): e14141. doi:10.2196/14141
    OpenUrlCrossRef
  48. 48.
    1. Helldén A,
    2. Al-Aieshy F,
    3. Bastholm-Rahmner P, et al.
    Development of a computerised decisions support system for renal risk drugs targeting primary healthcare. BMJ Open. 2015; 5(7): e006775. doi:10.1136/bmjopen-2014-006775
    OpenUrlAbstract/FREE Full Text
  49. 49.
    1. Heselmans A,
    2. Delvaux N,
    3. Laenen A, et al.
    Computerized clinical decision support system for diabetes in primary care does not improve quality of care: a cluster-randomized controlled trial. Implement Sci. 2020; 15(1): 5. doi:10.1186/s13012-019-0955-6
    OpenUrlCrossRefPubMed
  50. 50.
    1. Jensen C,
    2. McKerrow NH,
    3. Wills G.
    Acceptability and uptake of an electronic decision-making tool to support the implementation of IMCI in primary healthcare facilities in KwaZulu-Natal, South Africa. Paediatr Int Child Health. 2019; 40(4): 215-226. doi:10.1080/20469047.2019.1697573
    OpenUrlCrossRef
  51. 51.
    1. Jenssen BP,
    2. Bryant-Stephens T,
    3. Leone FT,
    4. Grundmeier RW,
    5. Fiks AG.
    Clinical decision support tool for parental tobacco treatment in primary care. Pediatrics. 2016; 137(5): e20154185-e20154185. doi:10.1542/peds.2015-4185
    OpenUrlCrossRefPubMed
  52. 52.
    1. Kempe A,
    2. Hurley LP,
    3. Cardemil CV, et al.
    Use of immunization information systems in primary care. Am J Prev Med. 2017; 52(2): 173-182. doi:10.1016/j.amepre.2016.07.029
    OpenUrlCrossRef
  53. 53.
    1. Koskela T,
    2. Sandström S,
    3. Mäkinen J,
    4. Liira H.
    User perspectives on an electronic decision-support tool performing comprehensive medication reviews - a focus group study with physicians and nurses. BMC Med Inform Decis Mak. 2016; 16: 6. doi:10.1186/s12911-016-0245-z
    OpenUrlCrossRefPubMed
  54. 54.
    1. Lam Shin Cheung J,
    2. Paolucci N,
    3. Price C,
    4. Sykes J,
    5. Gupta S; Canadian Respiratory Research Network
    . A system uptake analysis and GUIDES checklist evaluation of the Electronic Asthma Management System: a point-of-care computerized clinical decision support system. J Am Med Inform Assoc. 2020; 27(5): 726-737. doi:10.1093/jamia/ocaa019
    OpenUrlCrossRef
  55. 55.
    1. Lemke AA,
    2. Thompson J,
    3. Hulick PJ, et al.
    Primary care physician experiences utilizing a family health history tool with electronic health record-integrated clinical decision support: an implementation process assessment. J Community Genet. 2020; 11(3): 339-350. doi:10.1007/s12687-020-00454-8
    OpenUrlCrossRefPubMed
  56. 56.
    1. Litvin CB,
    2. Hyer JM,
    3. Ornstein SM.
    Use of clinical decision support to improve primary care identification and management of chronic kidney disease (CKD). J Am Board Fam Med. 2016; 29(5): 604-612. doi:10.3122/jabfm.2016.05.160020
    OpenUrlAbstract/FREE Full Text
  57. 57.
    1. Litvin CB,
    2. Ornstein SM,
    3. Wessell AM,
    4. Nemeth LS,
    5. Nietert PJ.
    Adoption of a clinical decision support system to promote judicious use of antibiotics for acute respiratory infections in primary care. Int J Med Inform. 2012; 81(8): 521-526. doi:10.1016/j.ijmedinf.2012.03.002
    OpenUrlCrossRefPubMed
  58. 58.
    1. Lugtenberg M,
    2. Weenink JW,
    3. van der Weijden T,
    4. Westert GP,
    5. Kool RB.
    Implementation of multiple-domain covering computerized decision support systems in primary care: a focus group study on perceived barriers. BMC Med Inform Decis Mak. 2015; 15: 82. doi:10.1186/s12911-015-0205-z
    OpenUrlCrossRef
  59. 59.
    1. Lugtenberg M,
    2. Pasveer D,
    3. van der Weijden T,
    4. Westert GP,
    5. Kool RB.
    Exposure to and experiences with a computerized decision support intervention in primary care: results from a process evaluation. BMC Fam Pract. 2015; 16(1): 141. doi:10.1186/s12875-015-0364-0
    OpenUrlCrossRefPubMed
  60. 60.
    1. Maia JX,
    2. de Sousa LAP,
    3. Marcolino MS, et al.
    The impact of a clinical decision support system in diabetes primary care patients in a developing country. Diabetes Technol Ther. 2016; 18(4): 258-263. doi:10.1089/dia.2015.0253
    OpenUrlCrossRef
  61. 61.
    1. Marcolino MS,
    2. Oliveira JAQ,
    3. Cimini CCR, et al.
    Development and implementation of a decision support system to improve control of hypertension and diabetes in a resource-constrained area in Brazil: mixed methods study. J Med Internet Res. 2021; 23(1): e18872. doi:10.2196/18872
    OpenUrlCrossRef
  62. 62.
    1. Minian N,
    2. Noormohamed A,
    3. Lingam M, et al.
    Integrating a brief alcohol intervention with tobacco addiction treatment in primary care: qualitative study of health care practitioner perceptions. Addict Sci Clin Pract. 2021; 16(1): 17. doi:10.1186/s13722-021-00225-x
    OpenUrlCrossRef
  63. 63.
    1. Montini T,
    2. Schenkel AB,
    3. Shelley DR.
    Feasibility of a computerized clinical decision support system for treating tobacco use in dental clinics. J Dent Educ. 2013; 77(4): 458-462. doi:10.1002/j.0022-0337.2013.77.4.tb05491.x
    OpenUrlAbstract/FREE Full Text
  64. 64.
    1. Pannebakker MM,
    2. Mills K,
    3. Johnson M,
    4. Emery JD,
    5. Walter FM.
    Understanding implementation and usefulness of electronic clinical decision support (eCDS) for melanoma in English primary care: a qualitative investigation. BJGP Open. 2019; 3(1): X101635. doi:10.3399/bjgpopen18X101635
    OpenUrlCrossRef
  65. 65.
    1. Peiris D,
    2. Williams C,
    3. Holbrook R, et al.
    A web-based clinical decision support tool for primary health care management of back pain: development and mixed methods evaluation. JMIR Res Protoc. 2014; 3(2): e17. doi:10.2196/resprot.3071
    OpenUrlCrossRef
  66. 66.
    1. Praveen D,
    2. Patel A,
    3. Raghu A, et al.
    SMARTHealth India: development and field evaluation of a mobile clinical decision support system for cardiovascular diseases in rural India. JMIR Mhealth Uhealth. 2014; 2(4): e54. doi:10.2196/mhealth.3568
    OpenUrlCrossRef
  67. 67.
    1. Price M,
    2. Davies I,
    3. Rusk R,
    4. Lesperance M,
    5. Weber J.
    Applying STOPP guidelines in primary care through electronic medical record decision support: randomized control trial highlighting the importance of data quality. JMIR Med Inform. 2017; 5(2): e15. doi:10.2196/medinform.6226
    OpenUrlCrossRef
  68. 68.
    1. Richardson S,
    2. Feldstein D,
    3. McGinn T, et al.
    Live usability testing of two complex clinical decision support tools: observational study. JMIR Hum Factors. 2019; 6(2): e12471. doi:10.2196/12471
    OpenUrlCrossRef
  69. 69.
    1. Rieckert A,
    2. Sommerauer C,
    3. Krumeich A,
    4. Sönnichsen A.
    Reduction of inappropriate medication in older populations by electronic decision support (the PRIMA-eDS study): a qualitative study of practical implementation in primary care. BMC Fam Pract. 2018; 19(1): 110. doi:10.1186/s12875-018-0789-3
    OpenUrlCrossRefPubMed
  70. 70.
    1. Rieckert A,
    2. Teichmann AL,
    3. Drewelow E, et al.
    Reduction of inappropriate medication in older populations by electronic decision support (the PRIMA-eDS project): a survey of general practitioners’ experiences. J Am Med Inform Assoc. 2019; 26(11): 1323-1332. doi:10.1093/jamia/ocz104
    OpenUrlCrossRef
  71. 71.
    1. Rousseau N,
    2. McColl E,
    3. Newton J,
    4. Grimshaw J,
    5. Eccles M.
    Practice based, longitudinal, qualitative interview study of computerised evidence based guidelines in primary care. BMJ. 2003; 326(7384): 314-314. doi:10.1136/bmj.326.7384.314
    OpenUrlAbstract/FREE Full Text
  72. 72.
    1. Rubin MA,
    2. Bateman K,
    3. Donnelly S, et al.
    Use of a personal digital assistant for managing antibiotic prescribing for outpatient respiratory tract infections in rural communities. J Am Med Inform Assoc. 2006; 13(6): 627-634. doi:10.1197/jamia.M2029
    OpenUrlCrossRefPubMed
  73. 73.
    1. Silveira DV,
    2. Marcolino MS,
    3. Machado EL, et al.
    Development and evaluation of a mobile decision support system for hypertension management in the primary care setting in Brazil: mixed-methods field study on usability, feasibility, and utility. JMIR Mhealth Uhealth. 2019; 7(3): e9869-e9869. doi:10.2196/mhealth.9869
    OpenUrlCrossRef
  74. 74.
    1. Sukums F,
    2. Mensah N,
    3. Mpembeni R, et al.
    Promising adoption of an electronic clinical decision support system for antenatal and intrapartum care in rural primary healthcare facilities in sub-Saharan Africa: the QUALMAT experience. Int J Med Inform. 2015; 84(9): 647-657. doi:10.1016/j.ijmedinf.2015.05.002
    OpenUrlCrossRef
  75. 75.
    1. Toth-Pal E,
    2. Wårdh I,
    3. Strender LE,
    4. Nilsson G.
    Implementing a clinical decision-support system in practice: a qualitative analysis of influencing attitudes and characteristics among general practitioners. Inform Health Soc Care. 2008; 33(1): 39-54. doi:10.1080/17538150801956754
    OpenUrlCrossRefPubMed
  76. 76.
    1. Trafton J,
    2. Martins S,
    3. Michel M, et al.
    Evaluation of the acceptability and usability of a decision support system to encourage safe and effective use of opioid therapy for chronic, noncancer pain by primary care providers. Pain Med. 2010; 11(4): 575-585. doi:10.1111/j.1526-4637.2010.00818.x
    OpenUrlCrossRefPubMed
  77. 77.
    1. Trinkley KE,
    2. Kroehl ME,
    3. Kahn MG, et al.
    Applying clinical decision support design best practices with the practical robust implementation and sustainability model versus reliance on commercially available clinical decision support tools: randomized controlled trial. JMIR Med Inform. 2021; 9(3): e24359. doi:10.2196/24359
    OpenUrlCrossRef
  78. 78.
    1. Wan Q,
    2. Makeham M,
    3. Zwar NA,
    4. Petche S.
    Qualitative evaluation of a diabetes electronic decision support tool: views of users. BMC Med Inform Decis Mak. 2012; 12(1): 61. doi:10.1186/1472-6947-12-61
    OpenUrlCrossRefPubMed
  79. 79.
    1. Williams PA,
    2. Furberg RD,
    3. Bagwell JE,
    4. LaBresh KA.
    Usability testing and adaptation of the pediatric cardiovascular risk reduction clinical decision support tool. JMIR Hum Factors. 2016; 3(1): e17. doi:10.2196/humanfactors.5440
    OpenUrlCrossRef
  80. 80.
    1. Wilson A,
    2. Duszynski A,
    3. Turnbull D,
    4. Beilby J.
    Investigating patients’ and general practitioners’ views of computerised decision support software for the assessment and management of cardiovascular risk. Inform Prim Care. 2007; 15(1): 33-44. doi:10.14236/jhi.v15i1.642
    OpenUrlCrossRefPubMed
  81. 81.↵
    1. Zheng K,
    2. Padman R,
    3. Johnson MP,
    4. Diamond HS.
    Understanding technology adoption in clinical care: clinician adoption behavior of a point-of-care reminder system. Int J Med Inform. 2005; 74(7-8): 535-543. doi:10.1016/j.ijmedinf.2005.03.007
    OpenUrlCrossRefPubMed
  82. 82.↵
    1. Turbow S,
    2. Hollberg JR,
    3. Ali MK.
    Electronic health record interoperability: how did we get here and how do we move forward? JAMA Health Forum. 2021; 2(3): e210253. doi:10.1001/jamahealthforum.2021.0253
    OpenUrlCrossRef
  83. 83.↵
    1. Luchenski SA,
    2. Reed JE,
    3. Marston C,
    4. Papoutsi C,
    5. Majeed A,
    6. Bell D.
    Patient and public views on electronic health records and their uses in the United kingdom: cross-sectional survey. J Med Internet Res. 2013; 15(8): e160. doi:10.2196/jmir.2701
    OpenUrlCrossRefPubMed
  84. 84.↵
    1. Zijl ALV,
    2. Vermeeren B,
    3. Koster F,
    4. Steijn B.
    Interprofessional teamwork in primary care: the effect of functional heterogeneity on performance and the role of leadership. J Interprof Care. 2021; 35(1): 10-20. doi:10.1080/13561820.2020.1715357
    OpenUrlCrossRefPubMed
  85. 85.↵
    1. Harris M,
    2. Advocat J,
    3. Crabtree B, et al.
    Interprofessional teamwork innovations for primary health care practices and practitioners: evidence from a comparison of reform in three countries. J Multidiscip Healthc. 2016(9): 35-46. doi:10.2147/JMDH.S97371
    OpenUrlCrossRef
  86. 86.↵
    1. Cabana MD,
    2. Rand CS,
    3. Powe NR, et al.
    Why don’t physicians follow clinical practice guidelines? A framework for improvement. JAMA. 1999; 282(15): 1458-1465. doi:10.1001/jama.282.15.1458
    OpenUrlCrossRefPubMed
  87. 87.↵
    1. Ancker JS,
    2. Kern LM,
    3. Edwards A, et al; HITEC Investigators
    . How is the electronic health record being used? Use of EHR data to assess physician-level variability in technology use. J Am Med Inform Assoc. 2014; 21(6): 1001-1008. doi:10.1136/amiajnl-2013-002627
    OpenUrlCrossRef
  88. 88.↵
    1. Boonstra A,
    2. Broekhuis M.
    Barriers to the acceptance of electronic medical records by physicians from systematic review to taxonomy and interventions. BMC Health Serv Res. 2010; 10(1): 231. doi:10.1186/1472-6963-10-231
    OpenUrlCrossRefPubMed
  89. 89.↵
    1. Pearson A,
    2. Wiechula R,
    3. Court A,
    4. Lockwood C.
    The JBI model of evidence-based healthcare. Int J Evid Based Healthc. 2005; 3(8): 207-215. doi:10.1111/j.1479-6988.2005.00026.x
    OpenUrlCrossRefPubMed
  90. 90.↵
    1. Schick AG,
    2. Gordon LA,
    3. Haka S.
    Information overload: a temporal approach. Account Organ Soc. 1990; 15(3): 199-220. doi:10.1016/0361-3682(90)90005-F
    OpenUrlCrossRef
  91. 91.↵
    1. Eppler MJ,
    2. Mengis J.
    The concept of information overload - a review of literature from organization science, accounting, marketing, MIS, and related disciplines (2004). Info Soc. 2004(20)5: 1-20. doi:10.1007/978-3-8349-9772-2_15
    OpenUrlCrossRef
  92. 92.↵
    1. Taksler GB,
    2. Hu B,
    3. DeGrandis F Jr., et al.
    Effect of individualized preventive care recommendations vs usual care on patient interest and use of recommendations: a pilot randomized clinical trial. JAMA Netw Open. 2021; 4(11): e2131455. doi:10.1001/jamanetworkopen.2021.31455
    OpenUrlCrossRef
  93. 93.↵
    1. Goddard K,
    2. Roudsari A,
    3. Wyatt JC.
    Automation bias: empirical results assessing influencing factors. Int J Med Inform. 2014; 83(5): 368-375. doi:10.1016/j.ijmedinf.2014.01.001
    OpenUrlCrossRefPubMed
PreviousNext
Back to top

In this issue

Annals of Family Medicine: 21 (1)
Annals of Family Medicine: 21 (1)
Vol. 21, Issue 1
January/February 2023
  • Table of Contents
  • Index by author
  • Front Matter (PDF)
  • Plain-Language Article Summaries
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on Annals of Family Medicine.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Barriers and Facilitators to the Use of Clinical Decision Support Systems in Primary Care: A Mixed-Methods Systematic Review
(Your Name) has sent you a message from Annals of Family Medicine
(Your Name) thought you would like to see the Annals of Family Medicine web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
9 + 1 =
Solve this simple math problem and enter the result. E.g. for 1+3, enter 4.
Citation Tools
Barriers and Facilitators to the Use of Clinical Decision Support Systems in Primary Care: A Mixed-Methods Systematic Review
Pierre-Yves Meunier, Camille Raynaud, Emmanuelle Guimaraes, François Gueyffier, Laurent Letrilliart
The Annals of Family Medicine Jan 2023, 21 (1) 57-69; DOI: 10.1370/afm.2908

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Get Permissions
Share
Barriers and Facilitators to the Use of Clinical Decision Support Systems in Primary Care: A Mixed-Methods Systematic Review
Pierre-Yves Meunier, Camille Raynaud, Emmanuelle Guimaraes, François Gueyffier, Laurent Letrilliart
The Annals of Family Medicine Jan 2023, 21 (1) 57-69; DOI: 10.1370/afm.2908
Reddit logo Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • INTRODUCTION
    • METHODS
    • RESULTS
    • DISCUSSION
    • CONCLUSION
    • Acknowledgments
    • Footnotes
    • REFERENCES
  • Figures & Data
  • Info & Metrics
  • eLetters
  • PDF

Related Articles

  • PubMed
  • Google Scholar

Cited By...

  • No citing articles found.
  • Google Scholar

More in this TOC Section

  • Examining How Social Risk Factors Are Integrated Into Clinical Settings Using Existing Data: A Scoping Review
  • Rural Patient Experiences of Accessing Care for Chronic Conditions: A Systematic Review and Thematic Synthesis of Qualitative Studies
Show more Systematic Review

Similar Articles

Subjects

  • Methods:
    • Mixed methods
  • Other research types:
    • Health services
  • Other topics:
    • Health informatics
    • Communication / decision making

Keywords

  • primary health care
  • information technology
  • medical informatics
  • quality of health care
  • decision support systems, clinical

Content

  • Current Issue
  • Past Issues
  • Past Issues in Brief
  • Multimedia
  • Articles by Type
  • Articles by Subject
  • Multimedia
  • Supplements
  • Online First
  • Calls for Papers

Info for

  • Authors
  • Reviewers
  • Media
  • Job Seekers

Engage

  • E-mail Alerts
  • e-Letters (Comments)
  • RSS
  • Journal Club
  • Submit a Manuscript
  • Subscribe
  • Family Medicine Careers

About

  • About Us
  • Editorial Board & Staff
  • Sponsoring Organizations
  • Copyrights & Permissions
  • Contact Us
  • eLetter/Comments Policy

© 2023 Annals of Family Medicine