Skip to main content

Main menu

  • Home
  • Current Issue
  • Content
    • Current Issue
    • Early Access
    • Multimedia
    • Podcast
    • Collections
    • Past Issues
    • Articles by Subject
    • Articles by Type
    • Supplements
    • Plain Language Summaries
    • Calls for Papers
  • Info for
    • Authors
    • Reviewers
    • Job Seekers
    • Media
  • About
    • Annals of Family Medicine
    • Editorial Staff & Boards
    • Sponsoring Organizations
    • Copyrights & Permissions
    • Announcements
  • Engage
    • Engage
    • e-Letters (Comments)
    • Subscribe
    • Podcast
    • E-mail Alerts
    • Journal Club
    • RSS
    • Annals Forum (Archive)
  • Contact
    • Contact Us
  • Careers

User menu

  • My alerts

Search

  • Advanced search
Annals of Family Medicine
  • My alerts
Annals of Family Medicine

Advanced Search

  • Home
  • Current Issue
  • Content
    • Current Issue
    • Early Access
    • Multimedia
    • Podcast
    • Collections
    • Past Issues
    • Articles by Subject
    • Articles by Type
    • Supplements
    • Plain Language Summaries
    • Calls for Papers
  • Info for
    • Authors
    • Reviewers
    • Job Seekers
    • Media
  • About
    • Annals of Family Medicine
    • Editorial Staff & Boards
    • Sponsoring Organizations
    • Copyrights & Permissions
    • Announcements
  • Engage
    • Engage
    • e-Letters (Comments)
    • Subscribe
    • Podcast
    • E-mail Alerts
    • Journal Club
    • RSS
    • Annals Forum (Archive)
  • Contact
    • Contact Us
  • Careers
  • Follow annalsfm on Twitter
  • Visit annalsfm on Facebook
Research ArticleResearch Briefs

Investigating Patient Experience, Satisfaction, and Trust in an Integrated Virtual Care (IVC) Model: A Cross-Sectional Survey

Samantha Buchanan, Cayden Peixoto, Christopher Belanger, Douglas Archibald, Lise Bjerre and Jonathan Fitzsimon
The Annals of Family Medicine July 2023, 21 (4) 338-340; DOI: https://doi.org/10.1370/afm.2978
Samantha Buchanan
1University of Ottawa Faculty of Medicine, Ottawa, Ontario, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Cayden Peixoto
2Institut du Savoir Montfort, Ottawa, Ontario, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Christopher Belanger
1University of Ottawa Faculty of Medicine, Ottawa, Ontario, Canada
2Institut du Savoir Montfort, Ottawa, Ontario, Canada
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Douglas Archibald
3Department of Family Medicine, University of Ottawa, Ottawa, Ontario, Canada
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lise Bjerre
1University of Ottawa Faculty of Medicine, Ottawa, Ontario, Canada
2Institut du Savoir Montfort, Ottawa, Ontario, Canada
MDCM, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jonathan Fitzsimon
1University of Ottawa Faculty of Medicine, Ottawa, Ontario, Canada
3Department of Family Medicine, University of Ottawa, Ottawa, Ontario, Canada
MBChB
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: jfitzsi2@uottawa.ca
  • Article
  • Figures & Data
  • eLetters
  • Info & Metrics
  • PDF
Loading

Abstract

To improve access to primary care in underserved communities, we established a hybrid model of delivering team-based, comprehensive primary care using both in-person and virtual care options with family physician leadership. Using a cross-sectional online survey (n = 121), results showed high levels (90%) of patient satisfaction. Our findings suggest that a similar hybrid model for primary care delivery can provide levels of patient satisfaction comparable to traditional in-person models of primary care. This can be achieved regardless of whether patients had previously been attached to the same family physician before receiving care through the hybrid model.

Annals “Online First” article

Key words:
  • primary care
  • telehealth
  • telemedicine, rural health care, integrated virtual care
  • quality improvement
  • quality of care
  • practice-based research
  • clinical quality measures
  • quadruple aim

INTRODUCTION

Health care systems worldwide have struggled to provide access to and continuity of primary care, particularly in rural and remote communities.1 In rural Renfrew County, Ontario, roughly 20% of the population does not have a family physician.2 To increase access to care in underserved, rural Renfrew County, we established a model of team-based, comprehensive primary care with family physician leadership. We utilize a hybrid of in-person and virtual care options from a patient’s home and in a local clinic. In this integrated virtual care (IVC) model, patients enroll with a named family physician who delivers care predominantly by virtual means. Virtual care includes secure messaging, telephone, video, and enhanced video through telemedicine arrangements in-clinic, assisted by allied health professionals and digital equipment such as Bluetooth (Bluetooth SIC Inc) otoscopes and stethoscopes. In-person options are provided by physicians, nurse practitioners, community paramedics, and other allied health professionals within the local family health team. This hybrid model provides personalized care to previously unattached patients, meaning those who are not enrolled with and may not have access to a family physician or alternative primary care practitioner. Their new IVC family physician always retains overall responsibility for coordinating their care.

Previous studies have shown consistently high levels of patient satisfaction in the virtual setting.3-6 Many of these patients, however, were attached to their family physician before shifting virtually, possibly contributing to higher patient satisfaction.3,4,7

The objective of this study was to evaluate the overall experience, satisfaction, and trust of patients receiving comprehensive primary care through IVC. A secondary objective was to determine if a difference exists between patients who were previously attached to their family physician before shifting to IVC, and those who met their family physician for the first time in a virtual setting.

METHODS

An anonymous, cross-sectional, Likert scale satisfaction survey was developed by experienced researchers of the IVC team, using questions adapted from previously validated surveys.3-8 Elements of the survey included (1) experience with family physician and allied health team, (2) trust in family physician, (3) primary care with IVC vs prior in-person care, (4) demographics, and (5) feedback. Responses were scored on a 4-point Likert scale, with higher scores indicating greater patient satisfaction or greater trust in their physician.

The survey was administered electronically to IVC patients aged >18 years in underserved Renfrew County, Ontario. Patients were split into 2 analysis groups: Group A included patients who were previously attached to the same family physician before shifting to IVC, and Groups B and C included patients who were meeting their family physician for the first time virtually.

To determine differences between groups, Brown-Forsythe, Welch ANOVA, and Tukey Honest Significant Difference (HSD) were conducted using corresponding numerical values of each Likert option.9 Feedback open-text responses were analyzed using thematic analysis. Demographic variables were analyzed with frequency and Pearson’s regression analyses.

RESULTS

The survey response rate was 50%, providing 121 eligible responses. Most of the patient population was White (99.2%), aged >55 years old (81%), identified as female (52.5%), and listed college or trade school as their highest level of completed education (44.6%). Of the demographic variables, only “self-perceived health” was significantly correlated with overall satisfaction of IVC (β = 0.257, P < 0.05; r2 = 0.245). Demographic characteristics are summarized in Supplemental Table 1.

Across all groups, 90% of patients were very satisfied or satisfied with care from their family physician, and 89% with care from their allied health team. When comparing previous health care experiences, 75% of respondents believe that their encounters with IVC were better than or the same as any prior, in-person health care encounters.

The results of patients’ experience with their family physician and allied health team, and trust in their family physician are shown in Table 1.

View this table:
  • View inline
  • View popup
Table 1.

ANOVA Analysis Results

Thematic analysis of open text responses (n = 66) identified 2 main themes: (1) Increased video encounters and (2) Scheduled, yearly in-person appointments. See the Supplemental Appendix for figures detailing the above results.

DISCUSSION

The results of this study show high levels of both patient experience and trust in their family physician across all patient groups accessing care through IVC. Notably, patient experience was not influenced by forming pre-existing relationships with family physicians before moving virtually. This result is promising for the future of IVC and other hybrid models delivering comprehensive primary care where patients are meeting their named family physician for the first time virtually.

Analysis of demographic variables showed a significant positive correlation only between self-perceived health and patient experience; however, the effect size was small. Notably, most patients described their health as “average,” which is lower than in previous literature and possibly negatively impacted satisfaction results.5,6

Some limitations of this study should be considered. Generalization to other populations may be hindered by our smaller sample size (n = 121), small geographic area, and homogeneity of demographic variables. Furthermore, the cross-sectional nature of the study cannot show causality or change over time.

Integrated virtual care must be evaluated over time using all 4 dimensions of the internationally recognized Quadruple Aim framework.10 Further study is planned to evaluate provider experience, clinical outcomes, and cost-effectiveness of the hybrid model, in addition to ongoing evaluation of the experience of previously unattached patients receiving care through IVC over time.

Our findings suggest that a hybrid model of in-person and virtual care options to deliver team-based, comprehensive primary care with family physician leadership can provide a high level of patient experience and satisfaction, at least comparable to traditional in-person models of primary care. This can be achieved regardless of whether patients had previously been attached to the same family physician before receiving care through the hybrid model.

Acknowledgments

We would like to thank Lisa Hawkins, BA, for help with survey organization and administration, and Emma Sypes, MSc, and Kush Patel, BASc, for their contributions to the project.

Footnotes

  • Conflicts of interest: authors report none.

  • Read or post commentaries in response to this article.

  • Funding support: This work was supported by the University of Ottawa Faculty of Medicine and University of Ottawa Department of Family Medicine

  • Disclaimer: The views expressed are solely those of the authors and do not necessarily represent official views of the authors’ affiliated institutions or funder.

  • Previous presentations: Preliminary results of this work were presented at the University of Ottawa Faculty of Medicine Virtual Research Day; September 24, 2021; Ottawa, Ontario, Canada (virtual)

  • Supplemental materials

  • Received for publication June 1, 2022.
  • Revision received January 13, 2023.
  • Accepted for publication January 18, 2023.
  • © 2023 Annals of Family Medicine, Inc.

REFERENCES

  1. 1.↵
    1. Young L,
    2. Peel R,
    3. O’Sullivan B,
    4. Reeve C.
    Building general practice training capacity in rural and remote Australia with underserved primary care services: a qualitative investigation. BMC Health Serv Res. 2019; 19(1): 338. doi:10.1186/S12913-019-4078-1/TABLES/7
    OpenUrlCrossRefPubMed
  2. 2.↵
    1. Ontario Ministry of Health and Long-term Care
    . IntelliHealth Ontario. Published 2015. Accessed May 8, 2021. https://intellihealth.moh.gov.on.ca/
  3. 3.↵
    1. Volcy J,
    2. Smith W,
    3. Mills K, et al.
    Assessment of patient and provider satisfaction with the change to telehealth from in-person visits at an academic safety net institution during the COVID-19 pandemic. J Am Board Fam Med. 2021; 34(Suppl): S71-S76. doi:10.3122/JABFM.2021.S1.200393
    OpenUrlAbstract/FREE Full Text
  4. 4.↵
    1. Orrange S,
    2. Patel A,
    3. Mack WJ,
    4. Cassetta J.
    Patient satisfaction and trust in telemedicine during the COVID-19 pandemic: retrospective observational study. JMIR Hum Factors. 2021; 8(2): e28589. doi:10.2196/28589
    OpenUrlCrossRefPubMed
  5. 5.↵
    1. Isautier JMJ,
    2. Copp T,
    3. Ayre J, et al.
    People’s experiences and satisfaction with telehealth during the COVID-19 pandemic in Australia: cross-sectional survey study. J Med Internet Res. 2020; 22(12): e24531. doi:10.2196/24531
    OpenUrlCrossRefPubMed
  6. 6.↵
    1. Imlach F,
    2. McKinlay E,
    3. Middleton L, et al.
    Telehealth consultations in general practice during a pandemic lockdown: survey and interviews on patient experiences and preferences. BMC Fam Pract. 2020; 21(1): 269. doi:10.1186/S12875-020-01336-1
    OpenUrlCrossRefPubMed
  7. 7.↵
    1. Wetmore S,
    2. Boisvert L,
    3. Graham E, et al.
    Patient satisfaction with access and continuity of care in a multidisciplinary academic family medicine clinic. Can Fam Physician. 2014; 60(4): e230. Accessed May 13, 2021. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4046539/
    OpenUrlAbstract/FREE Full Text
  8. 8.↵
    1. College of Family Physicians of Canada (CFPC)
    . Summary of a new vision for Canada: family practice - the patient’s medical home 2019. Published Mar 18, 2019. https://www.cfpc.ca/en/resources/patient-s-medical-home/a-new-vision-for-canada-family-practice-the-patien
  9. 9.↵
    1. Sullivan GM,
    2. Artino AR Jr.
    Analyzing and interpreting data from likert-type scales. J Grad Med Educ. 2013; 5(4): 541-542. doi:10.4300/jgme-5-4-18
    OpenUrlCrossRefPubMed
  10. 10.↵
    1. Bodenheimer T,
    2. Sinsky C.
    From triple to quadruple aim: care of the patient requires care of the provider. Ann Fam Med. 2014; 12(6): 573-576. doi:10.1370/AFM.1713
    OpenUrlAbstract/FREE Full Text
View Abstract
PreviousNext
Back to top

In this issue

The Annals of Family Medicine: 21 (4)
The Annals of Family Medicine: 21 (4)
Vol. 21, Issue 4
July/August 2023
  • Table of Contents
  • Index by author
  • Front Matter (PDF)
  • Plain-Language Summaries
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on Annals of Family Medicine.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Investigating Patient Experience, Satisfaction, and Trust in an Integrated Virtual Care (IVC) Model: A Cross-Sectional Survey
(Your Name) has sent you a message from Annals of Family Medicine
(Your Name) thought you would like to see the Annals of Family Medicine web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
9 + 5 =
Solve this simple math problem and enter the result. E.g. for 1+3, enter 4.
Citation Tools
Investigating Patient Experience, Satisfaction, and Trust in an Integrated Virtual Care (IVC) Model: A Cross-Sectional Survey
Samantha Buchanan, Cayden Peixoto, Christopher Belanger, Douglas Archibald, Lise Bjerre, Jonathan Fitzsimon
The Annals of Family Medicine Jul 2023, 21 (4) 338-340; DOI: 10.1370/afm.2978

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Get Permissions
Share
Investigating Patient Experience, Satisfaction, and Trust in an Integrated Virtual Care (IVC) Model: A Cross-Sectional Survey
Samantha Buchanan, Cayden Peixoto, Christopher Belanger, Douglas Archibald, Lise Bjerre, Jonathan Fitzsimon
The Annals of Family Medicine Jul 2023, 21 (4) 338-340; DOI: 10.1370/afm.2978
Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • INTRODUCTION
    • METHODS
    • RESULTS
    • DISCUSSION
    • Acknowledgments
    • Footnotes
    • REFERENCES
  • Figures & Data
  • eLetters
  • Info & Metrics
  • PDF

Related Articles

  • PubMed
  • Google Scholar

Cited By...

  • Examining experiences and system impacts of publicly funded episodic virtual care: protocol for a cross-provincial mixed methods study
  • Google Scholar

More in this TOC Section

  • Changes in the Ambulatory Use of Antibiotics in France Due to the COVID-19 Pandemic in 2020-2022: A Nationwide Time-Series Analysis
  • Heplisav-B vs Standard Hepatitis B Vaccine Booster for Health Care Workers
  • The General Public Vastly Overestimates Primary Care Spending in the United States
Show more Research Briefs

Similar Articles

Subjects

  • Methods:
    • Qualitative methods
    • Quantitative methods
  • Other research types:
    • Health services
    • Professional practice
  • Core values of primary care:
    • Access
    • Coordination / integration of care
  • Other topics:
    • Patient perspectives

Keywords

  • primary care
  • telehealth
  • telemedicine, rural health care, integrated virtual care
  • quality improvement
  • quality of care
  • practice-based research
  • clinical quality measures
  • quadruple aim

Content

  • Current Issue
  • Past Issues
  • Early Access
  • Plain-Language Summaries
  • Multimedia
  • Podcast
  • Articles by Type
  • Articles by Subject
  • Supplements
  • Calls for Papers

Info for

  • Authors
  • Reviewers
  • Job Seekers
  • Media

Engage

  • E-mail Alerts
  • e-Letters (Comments)
  • RSS
  • Journal Club
  • Submit a Manuscript
  • Subscribe
  • Family Medicine Careers

About

  • About Us
  • Editorial Board & Staff
  • Sponsoring Organizations
  • Copyrights & Permissions
  • Contact Us
  • eLetter/Comments Policy

© 2025 Annals of Family Medicine