Skip to main content

Health TAPESTRY Ontario: protocol for a randomized controlled trial to test reproducibility and implementation

Abstract

Background

Health TAPESTRY (Health Teams Advancing Patient Experience: STRengthening qualitY) aims to help people stay healthier for longer where they live by providing person-focused care through the integration of four key program components: (1) trained volunteers who visit clients in their homes, (2) an interprofessional primary health care team, (3) use of technology to collect and share information, and (4) improved connections to community health and social services. The initial randomized controlled trial of Health TAPESTRY found promising results in terms of health care use and patient outcomes, indicating a shift from reactive to preventive care. The trial was based on one clinical academic center, thus limiting generalizability. The study objectives are (1) to test reproducibility of the established effectiveness of Health TAPESTRY on physical activity and hospitalizations, (2) to test the feasibility of, and understand the contributing factors to, the implementation of Health TAPESTRY in six diverse communities across Ontario, Canada, and (3) to determine the value for money of implementing Health TAPESTRY.

Methods

This planned study is a pragmatic parallel randomized controlled trial with a delayed intervention for control participants at 6 months. This trial will simultaneously assess effectiveness and implementation in a real-world setting (type II hybrid) in six diverse communities across Ontario. Participants 70 years of age and older will be randomized into the Health TAPESTRY intervention or the control group (usual care). Intervention clients will receive an individualized plan of care from an interprofessional care team. The plan will be based on a client’s goals and current health risks identified through volunteer visits. The study’s outcomes are mapped onto the RE-AIM framework, with levels of physical activity and number of hospitalizations as the co-primary outcomes. The main analysis will be a comparison at 6 months.

Discussion

It is important to evaluate the effectiveness and implementation of Health TAPESTRY in multiple communities prior to scaling or widespread adoption.

Trial registration

ClinicalTrials.gov NCT03397836. Registered on 12 January 2018

Peer Review reports

Background

With improved living circumstances and health care, the world’s population of older adults is increasing and expected to double by 2050 [1]. Older adults are consistently high users of the health care system and often have complex health needs [2]. As a result, health care systems and associated services are experiencing increasing pressure to meet patient needs in an effective and efficient way. Barriers to delivery of healthcare include a lack of continuity of care and coordinated transitions between health and social care domains, barriers to accessing community services, and poor coordination in addressing social determinants of health [2,3,4]. Primary care is the central focal point of the health care system for most patients. Primary care providers practice person-focused care (not disease-oriented care) over time for all conditions except very uncommon ones and coordinate and integrate their patients’ care regardless of where care takes place. Primary health care is central to a health care system that can function well to address diverse population needs and improve patient outcomes and is associated with increased population longevity and reduced health care distribution inequities [5,6,7,8,9]. Regardless of what aspect of primary health care is investigated (e.g., access, utilization, enrollment, or availability), the effects of investing in primary care are consistent [10]. Health care systems with strong primary care systems are also associated with more efficient use of services including: lower hospitalization rates, lower health care system costs, and sustainable system development [1]. Research has identified that the key elements that support these positive effects are person-focused care [11, 12], relational continuity [13,14,15], comprehensiveness [16, 17], first contact care [16], and care coordination [10, 18,19,20].

The Health TAPESTRY (Health Teams Advancing Patient Experience: STRengthening qualitY) program is a complex person-focused intervention that is anchored in primary care. Health TAPESTRY was designed with some of the current health system barriers in mind and to align with best practices from primary health care research [21, 22] and the Starfield’s principles of primary care delivery [5, 7]. Health TAPESTRY works to help people stay healthier for longer in the places where they live—the basis of engaging patients in a meaningful way is through a conversation about health goals and what matters most to patients in their lives. In an initial randomized controlled trial (RCT) that assessed effectiveness and cost-effectiveness, we found null results for the pre-specified primary outcome of goal attainment, but statistically significant improvements in pre-specified secondary outcomes related to health and health services use [23]. Specifically, we found that more minutes of walking per week and less time spent sitting per week were reported in the Health TAPESTRY group compared to the control group [24, 25]. We also found statistically significant differences in health service use with reduced hospitalizations and increased primary health care visits (including both family physicians and other health care providers) [25], suggesting that Health TAPESTRY may be shifting care from a reactive to a proactive approach.

The Health TAPESTRY program incorporates four parts:

  1. 1)

    Trained volunteers who meet with clients (i.e., patients enrolled in Health TAPESTRY) in their homes to discuss clients’ health and life goals and unidentified health and health-related social needs

  2. 2)

    The use of technology for collecting and sharing information with the primary care team

  3. 3)

    An interprofessional primary health care team (who meets regularly as a “TAP-Huddle”) to create individualized plans of care based on the data gathered, which is integrated with the patient’s longitudinal primary care

  4. 4)

    Community engagement and connections to assist clients to meet their goals and address health risks and needs.

A limitation of the initial RCT was it was only conducted in one established, well-supported academic interprofessional team environment [24]. Since primary health care is diverse in regard to team composition, work flow, and funding models, we wish to test the reproducibility of the results found in the initial trial of Health TAPESTRY set among a broader range of primary care clinics and communities.

Grounding frameworks

We used the RE-AIM framework (Reach, Effectiveness or Efficacy, Adoption, Implementation and Maintenance (RE-AIM.org) to develop the objectives, research questions, and outcome measures for this implementation study and Normalization Process Theory (NPT) will help us understand the processes of implementation [26, 27]. RE-AIM is a well-recognized framework that has been widely used for evaluating the implementation of health programs [28,29,30]. The RE-AIM framework can be used in the planning, development, implementation, and evaluation phases of programs. We will use NPT to complement the RE-AIM framework and facilitate an understanding of the implementation process of the Health TAPESTRY approach into routine practice in the different communities [26, 27]. NPT has been applied in primary care settings to study implementation [31].

Objectives and hypotheses

There are three objectives in this study, which are:

  1. 1)

    To test reproducibility of the effectiveness of Health TAPESTRY on health service utilization and physical activity compared to usual care that we found in our initial study [24, 25]

  2. 2)

    To test the feasibility of, and understand the contributing factors to, implementation of the Health TAPESTRY program in six diverse communities across Ontario, Canada

  3. 3)

    To determine the value for money of implementing Health TAPESTRY

We hypothesize that results will be reproduced from the first trial evaluation such that Health TAPESTRY will result in a reduction in hospitalizations and an increase in physical activity levels, compared to usual care at 6 months, and will be cost-effective compared to usual care.

Methods/design

Trial design

This study is a pragmatic parallel randomized controlled trial with a delayed intervention for control participants at 6 months. We will simultaneously assess effectiveness and implementation strategy in a real-world setting (type II hybrid) [32]. The main group comparisons will be at 6 months. We report this study protocol in accordance with the SPIRIT guidelines (see Additional file 1 for the checklist; see Fig. 1 for the SPIRIT Figure) [33] and TIDier checklist (see Additional file 2) [34]. We will use mixed-methods data collection, mapping onto the adoption, implementation, and maintenance domains in RE-AIM.

Fig. 1
figure 1

Study timeline and date collection time points

Study setting

To be an implementation site, a primary care practice must meet a list of inclusion and exclusion criteria (Table 1). Included in the criteria is having partnership or access to an organization responsible for oversight of volunteers to implement the home visits and data collection in Health TAPESTRY.

Table 1 Health TAPESTRY implementation site inclusion and exclusion criteria

The study will be conducted within Family Health Teams (FHTs) in six communities across Ontario, Canada. A FHT is a type of primary care delivery model within Ontario that formally connects physicians and other health care professionals (e.g., dietitians, social workers, pharmacists) to improve the quality and effectiveness of primary health care services [35]. FHT team members are often co-located, but not always.

Participant inclusion and exclusion criteria

Participants must be 70 years of age or older and rostered to a participating primary care physician. Participants will be excluded if they: live in a long-term care facility, are likely to be unavailable for follow-up for the 6-month study period, participated in the first implementation of Health TAPESTRY, or have other conditions or circumstances that would prevent them from engaging with the volunteers or completing the surveys with volunteers (e.g., severe dementia, inability to comprehend English even with caregiver translation). The inclusion and exclusion criteria for participants replicate those of the initial trial of Health TAPESTRY [24, 25].

Recruitment

The main recruitment strategy is an EMR query run to identify all patients 70 years of age or older and rostered to physicians participating in Health TAPESTRY. Implementation sites (i.e., a participating primary care practice) will develop a recruitment strategy to identify eligible patients that fits the local context. Eligible patients will be mailed an information letter and consent form on behalf of participating physicians at each FHT inviting them to participate. Patients that return a signed consent form (a copy of the consent form is available from the corresponding author by request) will be contacted by a volunteer coordinator to confirm eligibility and review all information within the consent. Secondary recruitment strategies may include providing information in waiting rooms and printed materials for health care providers to hand out.

Randomization and blinding

After informed consent is obtained, participants will be randomized by a volunteer coordinator into the intervention or control group with a ratio of 1:1 using blocked randomization with variable block sizes of 2, 4, and 6 through REDCap (Version 9.3.1, Vanderbilt University) [36]. Couples who are eligible and both decide to participate in the program will be allocated to the same group by randomizing one person and allocating the second person to the same group. For the main analysis, one person’s data will be randomly selected for inclusion. The health care providers will not be blinded; however, they will only know a participant is receiving the intervention once a Health TAPESTRY report is received. The people (volunteers, researchers) involved in research outcome data collection will not be blinded.

Intervention

Procedures and data collection

A participant (termed “client” within the program), regardless of allocation, will receive a visit in their home from two volunteers at the start of the study and again 6 months later. The volunteers will collect data using structured surveys on the Health TAPESTRY web-based application (TAP-App) covering a variety of domains (i.e., physical activity, nutrition, mobility, quality of life; see Table 2). The volunteers will enter all data into the TAP-App using a tablet computer. The volunteers may return to the client’s home multiple times until all the surveys are complete. Participants may withdraw from the study at any point by informing the volunteer coordinator.

Table 2 List of all TAP-App surveys

Intervention group

For the intervention group, once all baseline surveys are completed, the TAP-App will create a summary TAP-Report from the information provided. This summary includes the client’s reported goals, key information associated with their answers and/or specific survey scores (Table 2), and volunteer observations. The TAP-Report will be reviewed by a volunteer coordinator and then securely sent using the TAP-App to the TAP-Huddle at the client’s clinic. The TAP-Huddle is an interprofessional team of health care providers who meet approximately weekly. Each TAP-Huddle is responsible for reviewing the report and creating and implementing a plan of care for each intervention client based on this review. The plan of care can involve a number of actions including a clinic visit, telephone call with a health care provider, further assessment, sharing information about or a referral to community resources. The TAP-Huddle can deliver the plan of care themselves and/or request a volunteer to help (e.g., help clients sign up for a community program). The TAP-Huddle can share a patient-friendly report (in plain language) with the client containing the patient’s goals, open-ended responses, and next steps suggested by the TAP-Huddle. At the end of the 6 months, the Health TAPESTRY volunteers will complete another visit with clients to complete the surveys for a second time.

Control group

Once the baseline visit is complete, control clients will receive usual care. No report will go to the TAP-Huddle until the client received the intervention, nor will any volunteer follow-up take place. After, 6-month research outcomes are collected, and clients will be offered the Health TAPESTRY program.

Volunteers

To manage the incorporation of trained volunteers into the program across sites, we formed a partnership with the Canadian Red Cross and the Windsor Essex Compassion Care Community to recruit, train, manage, and retain the community volunteers. All volunteers will undergo a screening process. Volunteers meeting screening criteria will receive a blended-model training program of online and in-person training specific to the Health TAPESTRY program. A full description of the volunteer program has been published elsewhere [50].

Strategies to improve adherence to protocol

The Health TAPESTRY research team will continually monitor study participant recruitment and timelines. Bi-weekly meetings with the study team and volunteer coordinators will be held to ensure fidelity to the trial protocol and huddle process. Volunteer coordinators will provide general oversight for the TAP-Reports and address any issues volunteers may experience related to the visits. Continuing education opportunities for volunteers will be provided to clarify procedures, refresh information from initial training, and provide new information as knowledge and self-efficacy gaps become apparent. Deviations from the protocol will be documented in meeting minutes.

Data collection

Outcome data collection will occur through the structured surveys via the TAP-App, from the electronic medical record (EMR), program records, and focus groups/interviews (Table 3). Health care utilization outcomes will be measured during the 6-month period prior to study enrollment (i.e., before baseline) and during the 6-month study period. For the EMR data extraction, all researchers will undergo training and use a standardized data abstraction form that has been pilot tested. We will calculate agreement scores between auditors for a subset of the sample.

Table 3 Summary of outcomes, measures, and analysis plan using the RE-AIM framework

Study outcomes

We aim to determine the reproducibility of the effectiveness of the Health TAPESTRY program, as well as the implementation in six primary care practices. All study outcomes are mapped onto the RE-AIM framework, along with the data source (EMR, self-report, or program records) in Table 3 [30].

Reach: to determine the reach of the study into the target population. Relevant client characteristics will be assessed. Additionally, the proportions of eligible patients who participate and number of volunteer visits will be reported. This data will be collected from the TAP-App and program records.

Effectiveness: the impact of Health TAPESTRY on patient outcomes. The two primary outcomes, the number of hospitalizations during the 6-month study period and total physical activity per week (described below) at 6 months, were chosen based on results from the initial RCT [24]. Number of hospitalizations will be extracted from the EMR. The reason for each hospitalization at discharge will be categorized into ambulatory care sensitive conditions or acute care conditions as used to understand the nature of hospitalizations [51,52,53]. Physical activity will be measured using the short form version of the International Physical Activity Questionnaire (IPAQ), using the standard methods of calculating metabolic equivalent of task (MET) [38]. Secondary outcomes will include time sitting, patient enablement, quality of life, treatment burden, disease burden, emergency room/urgent care visits, falls, medications, primary care visits, and negative effects (see Table 3 for measures).

Adoption: the proportion of physicians and health care providers who consent to participate and a description of volunteer involvement throughout the study will be reported. In addition, to assess how Health TAPESTRY is taken up as normal practice in each site, the validated Normalization Measure Development (NoMAD) survey will be used [54]. TAP-Huddle members will answer questions related to implementation processes every 3 months for 1 year.

Implementation: three different ways to understand “implementation” will be completed. First, a fidelity checklist specific to this study will be used and completed during later implementation. The two-part checklist was developed by the research team based on reviewing the fidelity literature and a team discussion about the core program components. One part of the checklist specifically assesses the functioning of the TAP-Huddle. Items were generated from reviewing the literature on “best practices” for team-based care applicable to the TAP-Huddle (communication, roles, organizational support/resources, as well as processes deemed critical to Health TAPESTRY). The second part contains items related to the 4 core parts of Health TAPESTRY. All questions are scored as yes or no. The second way we will understand implementation is by interpreting the qualitative data. Primary health care team members will be invited to participate in focus groups/interview (stratified by site and role in Health TAPESTRY) at least 6 months post-implementation. The question guide will be grounded in NPT [26, 27] and center on implementation barriers and facilitators, interprofessional teamwork, collaboration, and system navigation. All focus groups/interviews will be audio-recorded and transcribed into intelligent verbatim. Finally, the third way to understand implementation is to determine the program’s value for money in regard to costs and quality-adjusted life years (QALYs).

Maintenance: we will report the proportion of providers and patients who would suggest the program to others, each implementation site’s interest in continuing the program after the study has ended. The NoMAD survey results will reflect the normalization of Health TAPESTRY into current practice by each provider and site. It will also be used as a reflection exercise for sites throughout the study by identifying areas for improvement based on collective survey responses.

Sample size

We estimated the sample sizes for both co-primary outcomes physical activity and number of hospitalizations for different effect sizes, based on the initial trial [24, 25], using Bonferroni adjustment [55], with α = 0.025 and power = 0.80, using software PASS v19.0.4 [56]. We selected the total sample sizes 488 for physical activity (corresponding to mean difference = 403 and SD = 1441) and 426 for number of hospitalizations (corresponding to mean difference = − 0.14 and SD = 0.47). Using the larger sample size estimate for physical activity and accounting for 20% lost to follow-up, we will require a sample size of 586 participants.

Data analysis

The results will be reported according to the CONSORT extension for pragmatic randomized trials [57] and non-pharmacological interventions [58]. The mean (standard deviation) or median (first quartile, third quartile) for continuous variables, depending on the distribution, and count (percent) for categorical variables will be calculated. The description of the data analysis approach below is separated based on the RE-AIM framework for effectiveness and implementation. Note that for reach, adoption, and maintenance, the analysis approach is found in Table 3.

Effectiveness: the effectiveness of Health TAPESTRY will be assessed at 6 months. We will adopt intention-to-treat (ITT) as the primary analysis approach. Multiple imputation approach using chained equations will be used to impute the missing data [59]. We will consider the fraction of missing information and determine the number of imputations needed using the two-stage approach suggested by Hippel [60]. The pooled effect estimates along with 95% confidence intervals will be reported. The co-primary outcome of a number of hospital admission will be analyzed using the Poisson regression or negative binomial regression depending on the distribution. The incidence rate ratio along with 95% confidence interval will be reported. And the co-primary outcome physical activity will be analyzed using the multiple linear regression. The mean difference between intervention and control group along with 95% confidence intervals will be reported. The continuous outcomes (sitting, patient enablement, quality of life, treatment and disease burden scores) and the count secondary outcomes (number of falls, number of primary care visits, number of emergency room or urgent care visits, number of medications) will be analyzed using the multiple linear and Poisson regression or negative binomial regression, respectively. The mean difference and incidence rate ratio along with 95% confidence intervals will be reported for continuous and count outcomes respectively.

All analyses will be adjusted for baseline values and sites. All statistical tests will be two-sided and all p values will be reported to three decimal places with those less than 0.001 reported as p < 0.001. The criterion for statistical significance will be set a priori at alpha = 0.05 and will be adjusted using the Bonferroni method for multiple testing for the co-primary outcomes. There will be no adjustment of alpha for secondary and subgroup analyses as these are exploratory. Analyses will be performed using R v3.6.1 [61].

We will perform sensitivity analyses of the primary outcomes to assess the effectiveness of Health TAPESTRY. We will adopt per-protocol approach to assess the effect of Health TAPESTRY at 6 months. In addition, we will assess the effect of Health TAPESTRY without adjusting for sites and baseline values. We will also use zero inflated Poisson or negative binomial distribution for the count data, depending on the distribution, to assess the robustness of the results.

Implementation: as noted above, implementation is assessed in three ways. For fidelity to the program, sites will be described as either high, medium, or low adherence to the program as intended. The qualitative data centered on implementation will be analyzed using a descriptive thematic analysis [62] and organized using NVivo 12 (QSR 2018) [63]. Transcripts will be independently coded inductively by two reviewers with qualitative analysis experience using open coding. A third reviewer will complete random code checking and provide oversight to ensure trustworthiness of the data. The interview questions will serve as the coding guide for the first few transcripts. The three reviewers will discuss and create a formal coding structure and review it regularly as more transcripts are coded to begin to collapse codes into over-arching themes. The themes will be aligned with the NPT constructs [26, 27].

To assess the third part of “implementation” of RE-AIM, an economic evaluation of the trial will be conducted in accordance with Canadian and international guidelines for the conduct of economic evaluations of healthcare programs [64,65,66]. This 6-month trial-based economic evaluation will compare Health TAPESTRY versus usual care in terms of costs and quality-adjusted life years (QALYs) from a public payer perspective. To calculate costs associated with the intervention, healthcare resource utilization (e.g., physician visits, emergency room visits, hospital visits) captured in the EMR (Table 3) will be multiplied by their respective unit costs. Cost associated with the delivery of Health TAPESTRY will be derived from trial data. The volunteer organizations will track front-line program costs (e.g., training, transportation costs for home visit) and research team will monitor all other costs (e.g., development of material, personnel time). Every site may not implement the program exactly the same in which case any cost differences will be accounted for. To measure the impact of Health TAPESTRY and usual care on health-related quality of life, all participants will answer the EQ-5D-5L at baseline and 6 months (Tables 2 and 3). The Canadian algorithm will be used to derive the EQ-5D health utility scores [67]. QALYs will be calculated by the weighted EQ-5D health utility scores by time spent in health state using an area under the curve approach.

Differences in costs and QALYs will be determined using parametric or non-parametric tests as appropriate, and bootstrap techniques will be used to deal with sampling uncertainty and generate 95% confidence intervals [68]. Cost-effectiveness acceptability curves will be used to present the probability of Health TAPESTRY to be cost-effective at different willingness-to-pay thresholds (e.g., $50,000/QALY gained; $100,000/QALY gained) [64, 66]. Several sensitivity analyses will be conducted to explore the impact of certain assumptions (e.g., cost of implementing Health TAPESTRY) on the results. Missing data will be imputed using multiple imputations [69]. The results will be reported as per the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) guidelines [70].

Data management and confidentiality

All electronic information will be password protected and stored on password protected computers in secure networks or on the TAP-App or REDCap software [36]. A coding system will be used to protect identifiable information. Only the Health TAPESTRY research team and volunteer coordinators will have access to the master file containing the coding system. Any electronic transfer of data will be done using a secure HTTPS protocol to mitigate risks associated with transferring information over the internet.

Data monitoring, critical and adverse events

Any critical incidents that volunteers encounter during study visits will be reported and followed up by the appropriate personnel using a standard operating procedure. Critical incidents include situations that prevent the visit from proceeding such as injury to a volunteer or client and emergency situations. Critical incidents identified by volunteers during the study will be immediately reported and monitored until the issue has been resolved.

Program-related adverse events from any source will be recorded. Adverse events are defined as “Any event that requires in-patient hospitalization or prolongation of existing hospitalization, causes congenital malformation, results in persistent or significant disability or incapacity, is life-threatening or results in death” [71]. The research team will monitor data conduct and oversee data quality and provide independent outcome adjudication of adverse events as potentially related to intervention or not, and to provide an assessment of the safety data at 6 months before the intervention is provided to the wait list control group.

Discussion

The proposed study aims to reproduce the findings of the first randomized controlled trial of Health TAPESTRY. We will also explicitly look at barriers and facilitators to implementation. By assessing Health TAPESTRY using the five domains of the RE-AIM framework, we aim to gain a comprehensive perspective on the potential spread and scalability of the program to the wider primary health care system.

This study’s co-primary outcomes, physical activity and hospitalizations, were selected based on the success of Health TAPESTRY on those outcomes in the initial evaluation trial. The way in which these outcomes are collected has limitations to acknowledge. First, physical activity will be captured using a self-report survey, on which patients typically over-estimate their physical activity levels [72]. However, the same survey will be used by both intervention and control groups and each time point. Additionally, many physical activity questionnaires have low to moderate correlations with physical activity monitors [73]. This study will use the short-form International Physical Activity Questionnaire, which has been found to be valid and reliable measure in multiple contexts and populations [38]. Second, hospitalizations and many of the secondary outcomes pertaining to the programs’ effectiveness will be extracted by auditing patient charts in the EMR. Chart audits are labor intensive, but give access to data not otherwise easily available [74, 75]. Since health care providers frequently over-report behaviors on self-report surveys [76], chart audits can provide more realistic patient data. Unfortunately, missing data in the chart will be a limitation which we will be unable to overcome.

We plan to carry out this study through FHTs, so if results are reproduced, implementation studies will be needed in other settings. Patients rostered to FHTs have access to diverse health care providers, whereas patients in other models of primary care practice may not have the same level of access. However, we anticipate the results will be generalizable to other FHTs in the Ontario health care system—approximately one quarter of attached patients in Ontario are rostered to a FHT [77]—and potentially generalizable to other primary care organizations that include team-based interprofessional care and other funding models. The FHTs participating in the study are from communities across Ontario, including both urban and rural locations, and they offer a variety of clinical programs and interprofessional to patients, creating a diverse sample of sites.

A strength of this evaluation is the inclusion of outcomes to assess possible negative outcomes associated with Health TAPESTRY, including disease burden, treatment burden, and the labeling effects of screening tools. Understanding not only the benefits of Health TAPESTRY but also the risks is important prior to spread or scale. This evaluation also includes several outcomes from the first trial so as to help to elucidate findings that were close to significant, such as falls. Another strength of the proposed study is that it will test reproducibility of results from a single site RCT in multiple diverse sites, as well as evaluate implementation. Many health care innovations are developed and found to be effective, yet are not sustained as part of routine care. This may be explained by a lack of evaluating the innovations described. Another strength is the evaluation of contributing factors to implementation (barriers and facilitators) that can be compared across sites. This will provide further insight into strategies to enhance implementation in the future and the potential need for adaptations of the intervention to address contextual factors (e.g., rural/urban, primary care team make up, local volunteer capacity). Our evaluation plan that addresses both effectiveness and implementation lessons, as well as other components of RE-AIM, will provide a solid foundation to guide the scaling of Health TAPESTRY to other communities and primary health care contexts in the future.

Trial status and dissemination policy

This trial is in the recruitment phase, and we expect the final 6-month follow-up visit for the intervention and control participants to occur in mid-2020. Recruitment began on March 15, 2018, and is expected to conclude at the end of January 2020. The study is using protocol version 2, dated July 2018. The results of this study will be published in peer-reviewed academic journals and presented at academic conferences. The datasets analyzed during the current study will be available from the corresponding author on reasonable request.

Availability of data and materials

Not applicable

Abbreviations

CHEERS:

Consolidated Health Economic Evaluation Reporting Standards

DBMA:

Disease Burden Morbidity Assessment

EMR:

Electronic medical record

FHT:

Family Health Team

Health TAPESTRY:

Health Teams Advancing Patient Experience: Strengthening Quality

IPAQ:

International Physical Activity Questionnaire

ITT:

Intention-to-treat

MET:

Metabolic equivalent of task

MTBQ:

Multimorbidity Treatment Burden Questionnaire

NoMAD:

Normalization Measure Development

NPT:

Normalization Process Theory

PEI:

Patient Enablement Instrument

RAPA:

Rapid Assessment of Physical Activity

RCT:

Randomized controlled trial

TAP-App:

Health TAPESTRY web-based application

TAP-Report:

Health TAPESTRY report

RE-AIM:

Reach, Effectiveness or Efficacy, Adoption, Implementation, Maintenance

References

  1. World Health Organization. Aging and health. 2016. https://www.who.int/news-room/fact-sheets/detail/ageing-and-health. Accessed 12 Aug 2019.

    Google Scholar 

  2. Marchildon G, DiMatteo L. Health care cost drivers: the facts: Canadian Institute for Health Information; 2011. tps://secure.cihi.ca/free_products/health_care_cost_drivers_the_facts_en.pdf. Accessed 8 Aug 2019.

  3. Ontario Medical Association. OMA policy on patient-centred care. Ont Med Rev. 2010:34–49.

  4. Adeniji C, Kenning C, Coventry P, Bower P. What are the core predictors of ‘hassles’ among patients with multimorbidity in primary care? A cross sectional study. BMC Health Serv Res. 2015;15:255. https://doi.org/10.1186/s1291301509278..

  5. Starfield B. Is primary care essential? Lancet. 1994;344:1129–33.

    CAS  PubMed  Google Scholar 

  6. Starfield B. Contribution of primary care to health systems and health. Milbank Q. 2005;83:457–502.

    PubMed  PubMed Central  Google Scholar 

  7. Starfield B. Toward international primary care reform. CMAJ. 2009;180:1091–2.

    PubMed  PubMed Central  Google Scholar 

  8. Macinko J, Starfield B, Shi LY. The contribution of primary care systems to health outcomes within organization for economic cooperation and development (OECD) countries, 1970-1998. Health Serv Res. 2003;38:831–65.

    PubMed  PubMed Central  Google Scholar 

  9. World Health Organization (WHO), United Nations Children’s Fund (UNICEF). A vision for primary health care in the 21st century: towards universal health coverage and the sustainable development goals. 2018. https://www.who.int/docs/default-source/primary-health/vision.pdf. Accessed 8 Aug 2019.

    Google Scholar 

  10. Mangin D. The contribution of primary care research to improving health services. In: Goodyear-Smith F, Marsh B, editors. International perspectives on primary care research. United States: Taylor & Francis Group; 2016. p. 7–86.

    Google Scholar 

  11. Mead N, Bower P. Patient-centredness: a conceptual framework and review of the empirical literature. Soc Sci Med. 2000;51(7):1087–110.

    CAS  PubMed  Google Scholar 

  12. Stewart M. Towards a global definition of patient centred care. BMJ. 2001;322(7284):444–5.

    CAS  PubMed  PubMed Central  Google Scholar 

  13. Parchman ML, Burge SK. The patient-physician relationship, primary care attributes, and preventive services. Fam Med. 2004;36(1):22–7.

    PubMed  Google Scholar 

  14. Rosenblatt RA, Wright GE, Baldwin LM, et al. The effect of the doctor-patient relationship on emergency department use among the elderly. Am J Public Health. 2000;90(1):97–102.

    CAS  PubMed  PubMed Central  Google Scholar 

  15. Reid R, Haggerty J, McKendry R. Defusing the confusion: concepts and measures of continuity of healthcare. 2002. https://www.cfhi-fcass.ca/Migrated/PDF/ResearchReports/CommissionedResearch/cr_contcare_e.pdf. Accessed 30 July 2019.

  16. Forrest CB, Starfield B. The effect of first-contact care with primary care clinicians on ambulatory health care expenditures. J Fam Pract. 1996;43(1):40–8.

    CAS  PubMed  Google Scholar 

  17. Starfield B, Shi L. Policy relevant determinants of health: an international perspective. Health Policy. 2002;60(3):201–18.

    PubMed  Google Scholar 

  18. Roos NP. Who should do the surgery? Tonsillectomy-adenoidectomy in one Canadian province. Inquiry. 1979;16(1):73–83.

    CAS  PubMed  Google Scholar 

  19. Trivedi D. Cochrane review summary: interventions for improving outcomes in patients with multimorbidity in primary care and community settings. Prim Health Care Res Dev. 2017;18(2):109–11. https://doi.org/10.1017/S1463423616000426..

  20. McDonald KM, Sundaram V, Bravata DM, Lewis R, Lin N, Kraft SA, et al. Closing the quality gap: a critical analysis of quality improvement strategies (vol. 7: care coordination): Agency for Healthcare Research and Quality (US); 2007. https://www.ncbi.nlm.nih.gov/sites/books/NBK44015/.

  21. Moore A, Bhamani M, Peter J, Longaphy J, Oliver D, et al. Effectiveness of primary care volunteers for improving health and health service use for older adults living in the community: a systematic review. Cancun: Oral presentation at: NAPCRG; 2015.

    Google Scholar 

  22. Jones SS, Rudin RS, Perry T, Shekelle PG. Health information technology: an updated systematic review with a focus on meaningful use. Ann Intern Med. 2014;160(1):48–54. https://doi.org/10.7326/M13-1531.

  23. Dolovich L, O’Reily D. Cost-effectiveness analysis of a trial evaluating a volunteer and enhanced primary care team-based program for older adults (Healthcare Services, Delivery, and Financing). Toronto: Oral presentation at: NAPCRG; 2019.

    Google Scholar 

  24. Dolovich L, Oliver D, Lamarche L, Agarwal G, Carr T, Chan D, et al. A protocol for a pragmatic randomized controlled trial using the Health Teams Advancing Patient Experience: Strengthening Quality (Health TAPESTRY) platform approach to promote person-focused primary healthcare for older adults. Implement Sci. 2016;11(49). https://doi.org/10.1186/s13012-016-0407-5.

  25. Dolovich L, Oliver D, Lamarche L, Thebane L, Valaitis R, Agarwal G, et al. Combining volunteers and primary care teamwork to support health goals and needs of older adults: a pragmatic randomized controlled trial. CMAJ. 2019;191:E491–500. https://doi.org/10.1503/cmaj.j181173.

  26. May C, Finch T. Implementing, embedding and integrating practices: an outline of normalization process theory. Sociology. 2009;43(3):535–54.

    Google Scholar 

  27. May C, Finch T, Mair F, Ballini L, Dowrick C, Eccles M, et al. Understanding the implementation of complex interventions in health care: the normalization process model. BMC Health Serv Res. 2007;7(148). https://doi.org/10.1186/1472-6963-7-148.

  28. Gaglio B, Shoup JA, Glasgow RE. The RE-AIM framework: a systematic review of use over time. Am J Public Health. 2013:e1–9. https://doi.org/10.2105/AJPH.2013.301299.

  29. Glasgow R, McKay HG, Piette JD, Reynolds KD. The RE-AIM framework for evaluating interventions: what can it tell us about approaches to chronic illness management? Patient Educ Couns. 2001;44(2):119–27.

    CAS  PubMed  Google Scholar 

  30. Glasgow R, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89:1322–7.

    CAS  PubMed  PubMed Central  Google Scholar 

  31. McEvoy R, Ballini L, Maltoni S, O’Donnell CA, Mair FS, MacFarlane A. A qualitative systematic review of studies using the normalization process theory to research implementation processes. Implement Sci. 2014;9(1):2. https://doi.org/10.1186/1748-5908-9-2.

  32. Bernet AC, Wilens DE, Bauer MS. Effectiveness-implementation hybrid designs: implications for quality improvement sciences. Implement Sci. 2013;8(Suppl 1):S2. https://doi.org/10.1186/1748-5908-8-S1-S2..

  33. Chan AW, Tetzlaff JM, Altman DG, Laupacis A, Gotzsche PC, Krleza-Jeric K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200–7. https://doi.org/10.7326/0003-4829-258-3-201302050-00583.

  34. Hoffman TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687.

    Google Scholar 

  35. Gocan S, Laplante MA, Woodend K. Interprofessional collaboration in Ontario’s family health teams: a review of the literature. J Res Interprof Pract Educ. 2014;3(3). https://doi.org/10.22230/jripe.2014v3n3a131.

  36. Harris P, Taylor R, Thielke R, Payne J, Gonzalez N, Conde J. Research electronic data capture (REDCap) – a metadata-driven methodology and workflow process for providing translational research informatic support. J Biomed Inform. 2009;4(2):377–81.

    Google Scholar 

  37. Szende A, Williams A, editors. Measuring self-reported population health: an international perspective based on EQ-5D. Rotterdam: Netherlands: EuroQol Group; 2004.

    Google Scholar 

  38. Craig CL, Marshall AL, Sjӧstӧm M, Baumna AE, Booth ML, Ainsworth BE, et al. Validity of the international physical activity questionnaire: 12-country reliability and validity. Med Sci Sports Exerc. 2003;35:1381–95.

    PubMed  Google Scholar 

  39. Topolski TD, LoGerfo J, Patrick DL, Williams B, Walwick J, Patrick MB. The rapid assessment of physical activity (RAPA) among older adults. Prev Chronic Dis. 2006;3(4):A118.

    PubMed  PubMed Central  Google Scholar 

  40. Howie JGR, Heaney DJ, Maxwell M, Walker JJ. A comparison of a patient enablement instrument (PEI) against two established satisfaction scales as an outcome measure of primary care consultations. Fam Pract. 1998;15(2):165–71. https://doi.org/10.1093/fampra/15.2.165.

  41. Duncan P, Salisbury C, Murphy M, Man M, Chaplin K, Mann C. Development and validation of the Multimorbidity Treatment Burden Questionnaire (MTBQ). BMJ Open. 2018;8:e019413. https://doi.org/10.1136/bmjopen-2017-019413.

  42. Bayliss EA, Ellis JL, Steiner JF. Subjective assessments of comorbidity correlate with quality of life health outcomes: initial validation of a comorbidity assessment instrument. Health Qual Life Outcomes. 2005;3(51). https://doi.org/10.1186/1477-7525-3-51.

  43. Hawthorne G. Measuring social isolation in older adults: development and initial validation of the friendship scale. Soc Indic Res. 2006;77(3):521–48. https://doi.org/10.1007/s11205-005-7746-y.

  44. Rolfson D, Majumdar S, Tsuyuki R, Tahir A, Rockwood K. Validity and reliability of the Edmonton frail scale. Age Ageing. 2006;35(5):526–9.

    PubMed  PubMed Central  Google Scholar 

  45. Keller HH, Goy R, Kane SL. Validity and reliability of SCREEN II (seniors in the community: risk evaluation for eating and nutrition version II). Eur J Clin Nutr. 2005;59(10):1149–57. https://doi.org/10.1038/sj.ejcn.1602225..

  46. Manty M, Heinonen A, Leionen R, Tormakangas T, Sakari-Rantala A, Hirvensalo M, et al. Construct and predictive validity of a self-reported measure of preclinical mobility limitation. Arch Phys Med Rehabil. 2007;88:1108–13.

    PubMed  Google Scholar 

  47. Sintonen H. The 15-D measure of health-related quality of life. II Feasibility, reliability and validity of its valuation system. Melbourne: National Centre for Health Program Evaluation; 1995. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.203.951&rep=rep1&type=pdf. Accessed 9 Sept 2019.

    Google Scholar 

  48. Hummel J, Phillips KE, Holt B, Virden M. Organized, evidence-based care supplement: oral health integration. Seattle: Qualis Health; 2016. http://www.safetynetmedicalhome.org/sites/default/files/Guide-Oral-Health-Integration.pdf. Accessed 9 Sept 2019.

  49. Markle-Reid M, Ploeg J, Fisher K, Reimer H, Kaasalainen S, Gafni A, et al. The aging, community and health research unit-community partnership program for older adults with type 2 diabetes and multiple chronic conditions: a feasibility study. Pilot Feasibility Stud. 2016;2(24). https://doi.org/10.1186/s40814-016-0063-1.

  50. Oliver D, Dolovich L, Lamarche L, Gaber J, Avilla E, Bhamni M, et al. A volunteer program to connect primary care and the home to support the health of older adults: a community case study. Front Med. 2018;5(48). https://doi.org/10.3389/fmed.2018.00048.

  51. Caminal J, Starfield B, Sanches E, Casanova C, Morales M. The roles of primary care in preventing ambulatory care sensitive conditions. Eur J Pub Health. 2004;14(3):246–51. https://doi.org/10.1093/eurpub/14.3.246.

  52. Purdy S, Griffin T, Salisbury C, Sharp D. Ambulatory care sensitive conditions: terminology and disease coding need to be more specific to aid policy makers and clinicians. Public Health. 2009;123(2):169–73. https://doi.org/10.1016/j.puhe.2008.11.001.

  53. Weissman JS, Gatsonis C, Epstein AM. Rates of avoidable hospitalization by insurance status in Massachusetts and Maryland. JAMA. 1992;268(17):2388–94.

    CAS  PubMed  Google Scholar 

  54. Finch TL, Girling M, May CR, Mair FS, Murray E, Treweek S, et al. NoMAD: implementation measure based on normalization process theory. 2015. http://www.normalizationprocess.org/.

  55. Bland JM, Altman DG. Multiple significance tests: the Bonferroni method. BMJ. 1995;310(6973):170. https://doi.org/10.1136/bmj.310.6973.170.

  56. PASS 2019 power analysis and sample size software. Kaysville: NCSS, LLC; 2019.

  57. Zwarenstein M, Treweek S, Gagnier JJ, Altman DG, Tunis S, Haynes B, et al. Improving the reporting of pragmatic trials: an extension of the CONSROT statement. BMJ. 2008;337(a2390). https://doi.org/10.1136/bmj.a2390.

  58. Boutron I, Moher D, Altman DG, Schulz KF, Ravaud P, Group C. Extending the CONSORT statement to randomized trails of nonpharmacologic treatment: explanation and elaboration. Ann Internal Med. 2008;148(4):295–309.

    Google Scholar 

  59. Azur MJ, Stuart EA, Frangakis C, Leaf PJ. Multiple imputation by chained equations: what is it and how does it work? Int J Meth Psych Res. 2011;20(1):40–9.

    Google Scholar 

  60. von Hippel PT. How many imputations do you need? A two-stage calculation using a quadratic rule. Sociol Methods Res. 2018. https://doi.org/10.1177/0049124117747303.

  61. R Core Team. R: a language and environment for statistical computing: R Foundation for Statistical Computing; 2013. http://www.R-project.org/.

  62. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psych. 2006;3(2):77–101. https://doi.org/10.1191/1478088706qp063oa.

  63. QSR International Pty Ltd. NVivo qualitative data analysis software. Version 12; 2018.

    Google Scholar 

  64. Canadian Agency for Drugs and Technologies in Health (CADTH). Guidelines for the economic evaluation of health technologies. 4th ed. Ottawa; 2017. p. 76. https://www.cadth.ca/sites/default/files/pdf/guidelines_for_the_economic_evaluation_of_health_technologies_canada_4th_ed.pdf..

  65. Drummond M, Sculpher MJ, Claxton K, Stoddart GL, Torrance GW. Methods for the economic evaluation of health care programmes. 4th ed. Oxford: Oxford University Press; 2015.

    Google Scholar 

  66. Ramsey SD, Willke RJ, Glick H, Reed SD, Augustovski F, Jonsson B, et al. Cost-effectiveness analysis alongside clinical trials II-an ISPOR Good Research Practices Task Force report. Value Health. 2015;18(2):161–72.

    PubMed  Google Scholar 

  67. Xie F, Pullenayegum E, Gaebel K, Bansback N, Bryan S, Ohinmaa A, et al. Canadian EQ-5D-5L valuation study group. A time trade-off-derived value set of the EQ-5D-5L for Canada. Med Care. 2016;54(1):98–105.

  68. Efron B, Tibshirani RJ. An introduction to the bootstrap. New York: Chapman and Hall; 1993.

    Google Scholar 

  69. Carpenter JR, Kenward MG. Multiple imputation and its application. 1st ed. Chichester: Wiley; 2013.

  70. Husereau D, Drummond M, Petrou S, Carswell C, Moher D, Greenberg D, et al. Consolidated health economic evaluation reporting standards (CHEERS) statement. BMJ. 2013;346:f1049.

    PubMed  Google Scholar 

  71. Health Canada. Reporting adverse reactions to marketed health products - guidance document for industry. 2018. https://www.canada.ca/en/health-canada/services/drugs-health-products/reports-publications/medeffect-canada/reporting-adverse-reactions-marketed-health-products-guidance-industry.html. Accessed 9 Sept 2019.

  72. Sallis JF, Saelens BE. Assessment of physical activity by self-report: status, limitations, and future directions. Res Q Exerc Sport. 2000;71(suppl 2):1–14. https://doi.org/10.1080/02701367.2000.11082780.

  73. Helmerhorst HJF, Brage S, Warren J, Besson H, Ekelund U. A systematic review of reliability and objective criterion-related validity of physical activity questionnaires. Int J Behav Nutr Phys. 2012;9:103.

    Google Scholar 

  74. Green ME, Hogg W, Savage C, Johnston S, Russell G, Jaakimainen RL. Assessing methods for measurement of clinical outcomes and quality of care in primary care practices. BMC Health Serv Res. 2012;12:214.

    PubMed  PubMed Central  Google Scholar 

  75. Hogg W, Gyorfi-Dyke E, Johnston S, Dahrouge S, Liddy C, Russell G, et al. Conducting chart audits in practice-based primary care research: a user’s guide. Can Fam Phys. 2010;56(5):495–6.

    Google Scholar 

  76. Gordon MK, Baum RA, Gardner W, Kelleher KJ, Langberg JM, Brinkman WB, et al. Comparison of performance on ADHD quality indicators: practitioner self-report versus chart review. J Atten Disord. 2016. https://doi.org/10.1177/1087054715624227.

  77. Glazier RH, Hutchison B, Kopp A. Comparison of family health teams to other Ontario primary care models 2004/05 to 2011/12. 2015. https://www.ices.on.ca/Publications/Atlases-and-Reports/2015/Comparison-of-Family-Health-Teams. Accessed 15 Aug 2019.

Download references

Acknowledgements

The authors would like to thank the Canadian Red Cross and Windsor-Essex Compassion Care Community for their significant contributions towards planning the continuation and spread of Health TAPTESTRY, most importantly agreeing to recruit and manage the Health TAPESTRY volunteers. We would also like to acknowledge the strong dedication of the healthcare providers at our six planned implementation sites: McMaster Family Health Team, Niagara North Family Health Team, Dufferin Area Family Health Team, Superior Family Health Team, Harrow Health Centre, and Windsor Family Health Team. A big thank you also to all research and administrative staff that have been so dedicated to this project.

Funding

This study was funded by the Ontario Ministry of Health and Long-Term Care and by David Braley. Neither funder will play a part in the study design; collection, management, analysis, and interpretation of data; writing of the report; and the decision to submit the report for publication.

Author information

Authors and Affiliations

Authors

Contributions

All authors provided expertise surrounding aspects of primary healthcare, care of older adults, and chronic disease management or multimorbidities, and/or research methodology and contributed to this protocol. DP, LD, and DO contributed to the conception of the idea of Health TAPESTRY. DM, DO, DP, and CR provided expertise on the clinical context for implementation and evaluation. DM, LL, DO, and JD directed all planning aspects of the study design, implementation, and/or evaluation. SB, LT, JT, and RV provided expertise on aspects of data analysis, and MH provided expertise about design and evaluation. DM, JD, LL, and SB were responsible for administrative and management oversight for the study. TB, ST, SMB, and SB were instrumental in the volunteer program aspects of Health TAPESTRY. TC, LL, and JD were instrumental in the development of the technology piece and integration of different technologies. The authors read and approved the final manuscript.

Corresponding author

Correspondence to Dee Mangin.

Ethics declarations

Ethics approval and consent to participate

This study has been reviewed by the Hamilton Integrated Research Ethics Board and received ethics clearance (#3967). This ethics clearance applies to all participating primary care sites in the study. Informed consent will be obtained from each study participate by a volunteer coordinator, prior to being enrolled in the study.

Consent for publication

Not applicable

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

SPIRIT 2013 Checklist.

Additional file 2.

TIDieR Checklist.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mangin, D., Lamarche, L., Oliver, D. et al. Health TAPESTRY Ontario: protocol for a randomized controlled trial to test reproducibility and implementation. Trials 21, 714 (2020). https://doi.org/10.1186/s13063-020-04600-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13063-020-04600-y

Keywords