Dataset Information

Understanding implementability in clinical trials: a pragmatic review and concept map.

ABSTRACT:

Background

The translation of evidence from clinical trials into practice is complex. One approach to facilitating this translation is to consider the 'implementability' of trials as they are designed and conducted. Implementability of trials refers to characteristics of the design, execution and reporting of a late-phase clinical trial that can influence the capacity for the evidence generated by that trial to be implemented. On behalf of the Australian Clinical Trials Alliance (ACTA), the national peak body representing networks of clinician researchers conducting investigator-initiated clinical trials, we conducted a pragmatic literature review to develop a concept map of implementability.

Methods

Documents were included in the review if they related to the design, conduct and reporting of late-phase clinical trials; described factors that increased or decreased the capacity of trials to be implemented; and were published after 2009 in English. Eligible documents included systematic reviews, guidance documents, tools or primary studies (if other designs were not available). With an expert reference group, we developed a preliminary concept map and conducted a snowballing search based on known relevant papers and websites of key organisations in May 2019.

Results

Sixty-five resources were included. A final map of 38 concepts was developed covering the domains of validity, relevance and usability across the design, conduct and reporting of a trial. The concepts drew on literature relating to implementation science, consumer engagement, pragmatic trials, reporting, research waste and other fields. No single resource addressed more than ten of the 38 concepts in the map.

Conclusions

The concept map provides trialists with a tool to think through a range of areas in which practical action could enhance the implementability of their trials. Future work could validate the strength of the associations between the concepts identified and implementability of trials and investigate the effectiveness of steps to address each concept. ACTA will use this concept map to develop guidance for trialists in Australia.

Trial registration

This review did not include health-related outcomes and was therefore not eligible for registration in the PROSPERO register.

SUBMITTER: Cumpston MS

PROVIDER: S-EPMC7995762 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundOpinions and practices vary around the issue of performing multiple statistical tests in randomised controlled trials (RCTs). We carried out a study to collate information about opinions and practices using a methodological rapid review and a survey, specifically of publicly funded pragmatic RCTs that are not seeking marketing authorisation. The aim was to identify the circumstances under which researchers would make a statistical adjustment for multiplicity.MethodsA review was performed extracting information from articles reporting primary analyses of pragmatic RCTs in one of seven high quality medical journals, in January to June (inclusive) 2018. A survey (Survey Monkey) eliciting opinions and practices around multiplicity was distributed to the 47 registered clinical trials units (CTUs) in the UK.ResultsOne hundred and thirty-eight RCTs were included in the review, and survey responses were received from 27/47 (57%) CTUs. Both the review and survey indicated that adjusting for multiplicity was considered most important for multiple treatment comparisons; adjustment was performed for 11/23 (48%) published trials, and 24/27 (89%) CTU statisticians reported they would consider adjustment. Opinions and practices varied around adjustment for multiplicity arising from multiple primary outcomes and interim analyses. Adjustment was considered less important for multiplicity due to multiple secondary outcomes (adjustment performed for 17/136 [13%] published trials and 3/27 [11%] CTU statisticians would consider adjustment) and subgroup analyses (8/85 [9%] published trials adjusted and 6/27 CTU [22%] statisticians would consider adjustment).ConclusionsThere is variation in opinions about adjustment for multiplicity among both statisticians reporting RCTs and applied statisticians working in CTUs. Further guidance is needed on the circumstances in which adjustment should be considered in relation to primary trial hypotheses, and if there are any situations in which adjustment would be recommended in the context of secondary analyses.

Project description:ImportancePragmatic clinical trials that seek informed consent after randomization (ie, postrandomization consent) are increasingly used, but debate on ethics persists because control arm patients are not specifically informed about the trials and randomization occurs before consent for the trials. The public's attitude toward postrandomization consent trials is unknown, but the way the trials are described could bias people's views.ObjectivesTo assess the attitudes of the US general public toward postrandomization informed consent for pragmatic trials and to measure potential framing and other factors associated with those attitudes.Design, setting, and participantsAn online, 2 × 2 experimental survey (fielded between February 23 and April 3, 2018) portraying 4 scenarios of postrandomization informed consent (with prior broad consent for medical record use) was conducted. These scenarios included traditional randomized clinical trial language framing vs alternative framing in a high-stakes trial (ie, survival in leukemia) or low-stakes trial (ie, blood glucose level in diabetes). A total of 3793 individuals invited to participate were part of an existing panel representative of the US general public (GfK KnowledgePanel).Main outcomes and measuresThe proportion of participants who would recommend that an ethics review board approve a postrandomization consent pragmatic trial.ResultsA total of 2042 of 3739 invitees (54.6%) responded; after exclusion of 38 incomplete surveys, 2004 participants were included in the analysis. Of these, 997 (49.8%) were women, 1440 (71.9%) were white non-Hispanic, 199 (9.9%) were black non-Hispanic, and 233 (11.6%) were Hispanic. Mean (SD) age was 47.5 (17.4) years. Across scenarios, weighted data showed that 75.4% of the participants would recommend approval of the postrandomization consent pragmatic trial, 20.4% would probably not recommend approval, and 4.2% would definitely not recommend approval. Approval was not sensitive to framing language (traditional vs new framing in high-stakes scenario, 74.3% vs 76.8%, P = .40; in low-stakes scenario, 77.7% vs 72.9%, P = .10) or to the stakes (low vs high stakes in traditional framing, 77.7% vs 74.3%, P = .25; in new framing, 72.9% vs 76.8%, P = .18). Better understanding of the postrandomization consent design was associated with higher rate of approval (78.1% vs 65.0%, P = .002 for high-stakes scenario; 77.2% vs 64.9%, P = .004 for low-stakes scenario), especially among those with less education. However, opinions about personal involvement in the control arm were more cautious (range depending on scenario, 45.6%-59.7%) and sensitive to stakes but not to framing.Conclusions and relevanceThe public's generally high rate of approval of the ethics of postrandomization informed consent for pragmatic trial designs does not appear to be affected by whether postrandomization consent design is framed using traditional randomized clinical trial terminology, regardless of the stakes of the trial. Promoting better understanding of the design may increase its acceptance by the public.

Project description:In an era focused on value-based healthcare, the quality of healthcare and resource allocation should be underpinned by empirical evidence. Pragmatic clinical trials (pRCTs) are essential in this endeavor, providing randomized controlled trial (RCT) insights that encapsulate real-world effects of interventions. The rising popularity of pRCTs can be attributed to their ability to mirror real-world practices, accommodate larger sample sizes, and provide cost advantages over traditional RCTs. By harmonizing efficacy with effectiveness, pRCTs assist decision-makers in prioritizing interventions that have a substantial public health impact and align with the tenets of value-based health care. An international network for pRCT provides several advantages, including larger and diverse patient populations, access to a broader range of healthcare settings, sharing knowledge and expertise, and overcoming ethical and regulatory barriers. The hypothesis and study design of pRCT answers the decision-maker's questions. pRCT compares clinically relevant alternative interventions, recruits participants from diverse practice settings, and collects data on various health outcomes. They are scarce because the medical products industry typically does not fund pRCT. Prioritizing these studies by expanding the infrastructure to conduct clinical research within the healthcare delivery system and increasing public and private funding for these studies will be necessary to facilitate pRCTs. These changes require more clinical and health policy decision-makers in clinical research priority setting, infrastructure development, and funding. This paper presents a comprehensive overview of pRCTs, emphasizing their importance in evidence-based medicine and the advantages of an international collaborative network for their execution. It details the development of PRIME-9, an international initiative across nine countries to advance pRCTs, and explores various statistical approaches for these trials. The paper underscores the need to overcome current challenges, such as funding limitations and infrastructural constraints, to leverage the full potential of pRCTs in optimizing healthcare quality and resource utilization.