Dataset Information

The impact of COVID-19 on pragmatic clinical trials: lessons learned from the NIH Health Care Systems Research Collaboratory.

ABSTRACT:

Background

The COVID-19 pandemic has considerably disrupted nearly all aspects of daily life, including healthcare delivery and clinical research. Because pragmatic clinical trials are often embedded within healthcare delivery systems, they may be at high risk of disruption due to the dual impacts on the conduct of both care and research.

Methods

We collected qualitative data using multiple methods to characterize the impact of COVID-19 on the research activities of 14 active pragmatic clinical trials in the National Institutes of Health (NIH) Health Care Systems Research Collaboratory. A COVID-19 impact questionnaire was administered electronically to principal investigators in June 2020. Text responses were analyzed thematically, and qualitative summaries were subsequently reviewed by five independent reviewers, who made iterative revisions. Additional COVID-19-related impacts were identified during virtual meetings with trial teams during April-July 2020 and combined with questionnaire responses for analysis.

Results

Impacts of the pandemic were broadly classified into two main types: healthcare operations and social distancing. In some instances, trial delays created statistical challenges, particularly with trials using stepped-wedge designs, and necessitated changing data collection strategies or modifying interventions. The majority of projects used existing stakeholder-driven approaches to adapt interventions. Several benefits of these adaptions were identified, including expanded outreach capabilities and ability to study virtual intervention delivery. All trial teams were able to adapt to pandemic-related modifications.

Conclusion

In a group of 14 ongoing pragmatic clinical trials, there was significant impact of COVID-19 on trial activities. Engaging appropriate stakeholders was critical to designing and implementing trial modifications and making continued safe progress toward meeting research objectives.

SUBMITTER: O'Brien EC

PROVIDER: S-EPMC9123729 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:The National Institutes of Health (NIH) Health Care Systems Research Collaboratory (NIH Collaboratory) seeks to produce generalizable knowledge about the conduct of pragmatic research in health systems. This analysis applied the PRECIS-2 pragmatic trial criteria to five NIH Collaboratory pragmatic trials to better understand 1) the pragmatic aspects of the design and implementation of treatments delivered in real world settings and 2) the usability of the PRECIS-2 criteria for assessing pragmatic features across studies and across time.Using the PRECIS-2 criteria, five pragmatic trials were each rated by eight raters. For each trial, we reviewed the original grant application and a required progress report written at the end of a 1-year planning period that included changes to the protocol or implementation approach. We calculated median scores and interrater reliability for each PRECIS domain and for the overall trial at both time points, as well as the differences in scores between the two time points. We also reviewed the rater comments associated with the scores.All five trials were rated to be more pragmatic than explanatory, with comments indicating that raters generally perceived them to closely mirror routine clinical care across multiple domains. The PRECIS-2 domains for which the trials were, on average, rated as most pragmatic on the 1 to 5 scale at the conclusion of the planning period included primary analysis (mean?=?4.7 (range?=?4.5 to 4.9)), recruitment (4.3 (3.6 to 4.8)), eligibility (4.1 (3.4 to 4.8)), setting (4.1 (4.0 to 4.4)), follow-up (4.1 (3.4 to 4.9)), and primary outcome (4.1 (3.5 to 4.9)). On average, the less pragmatic domains were organization (3.3 (2.6 to 4.4)), flexibility of intervention delivery (3.5 (2.1-4.5)), and flexibility of intervention adherence (3.8 (2.8-4.5)). Interrater agreement was modest but statistically significant for four trials (Gwet's AC1 statistic range 0.23 to 0.40) and the intraclass correlation coefficient ranged from 0.05 to 0.31. Rating challenges included assigning a single score for domains that may relate to both patients and care settings (that is, eligibility or recruitment) and determining to what extent aspects of complex research interventions differ from usual care.These five trials in diverse healthcare settings were rated as highly pragmatic using the PRECIS-2 criteria. Applying the tool generated insightful discussion about real-world design decisions but also highlighted challenges using the tool. PRECIS-2 raters would benefit from additional guidance about how to rate the interwoven patient and practice-level considerations that arise in pragmatic trials.Clinicaltrials.gov trial registrations: NCT02019225 , NCT01742065 , NCT02015455 , NCT02113592 , NCT02063867 .

Project description:BackgroundIntegrated Management Program Advancing Community Treatment of Atrial Fibrillation (IMPACT-AF) was a pragmatic, cluster randomized trial assessing the effectiveness of a clinical decision support (CDS) tool in primary care, Nova Scotia, Canada. We evaluated if CDS software versus Usual Care could help primary care providers (PCPs) deliver individualized guideline-based AF patient care.MethodsKey study challenges including CDS development and implementation, recruitment, and data integration documented over the trial duration are presented as lessons learned.ResultsAdequate resources must be allocated for software development, updates and feasibility testing. Development took longer than projected. End-user feedback suggested network access and broadband speeds impeded uptake; they felt further that the CDS was not sufficiently user-friendly or efficient in supporting AF care (i.e., repetitive alerts). Integration across e-platforms is crucial. Intellectual property and other issues prohibited CDS integration within electronic medical records and provincial e-health platforms. Double login and data entry were impediments to participation or reasons for provider withdrawal. Data integration challenges prevented easy and timely data access, analysis, and reporting. Primary care study recruitment is resource intensive. Altogether, 203 PCPs and 1145 of their patients participated, representing 25% of eligible providers and 12% of AF patients in Nova Scotia, respectively. The most effective provider recruitment strategy was in-office, small group lunch-and-learns. PCPs with past research experience or who led patient consent were top recruiters. The study office played a pivotal role in achieving patient recruitment targets.ConclusionsA rapid growth in healthcare data is leading to widespread development of CDS. Our experience found practical issues to address for such applications to succeed. Feasibility testing to assess the utility of any healthcare CDS prior to implementation is recommended. Adequate resources are necessary to support successful recruitment for future pragmatic trials. CDS tools that integrate multiple co-morbid guidelines across eHealth platforms should be pursued.Trial registrationClinicalTrials.gov NCT01927367. Registered on August 22, 2013.