Dataset Information

Digital tools for the recruitment and retention of participants in randomised controlled trials: a systematic map.

ABSTRACT:

Background

Recruiting and retaining participants in randomised controlled trials (RCTs) is challenging. Digital tools, such as social media, data mining, email or text-messaging, could improve recruitment or retention, but an overview of this research area is lacking. We aimed to systematically map the characteristics of digital recruitment and retention tools for RCTs, and the features of the comparative studies that have evaluated the effectiveness of these tools during the past 10 years.

Methods

We searched Medline, Embase, other databases, the Internet, and relevant web sites in July 2018 to identify comparative studies of digital tools for recruiting and/or retaining participants in health RCTs. Two reviewers independently screened references against protocol-specified eligibility criteria. Included studies were coded by one reviewer with 20% checked by a second reviewer, using pre-defined keywords to describe characteristics of the studies, populations and digital tools evaluated.

Results

We identified 9163 potentially relevant references, of which 104 articles reporting 105 comparative studies were included in the systematic map. The number of published studies on digital tools has doubled in the past decade, but most studies evaluated digital tools for recruitment rather than retention. The key health areas investigated were health promotion, cancers, circulatory system diseases and mental health. Few studies focussed on minority or under-served populations, and most studies were observational. The most frequently-studied digital tools were social media, Internet sites, email and tv/radio for recruitment; and email and text-messaging for retention. One quarter of the studies measured efficiency (cost per recruited or retained participant) but few studies have evaluated people's attitudes towards the use of digital tools.

Conclusions

This systematic map highlights a number of evidence gaps and may help stakeholders to identify and prioritise further research needs. In particular, there is a need for rigorous research on the efficiency of the digital tools and their impact on RCT participants and investigators, perhaps as studies-within-a-trial (SWAT) research. There is also a need for research into how digital tools may improve participant retention in RCTs which is currently underrepresented relative to recruitment research.

Registration

Not registered; based on a pre-specified protocol, peer-reviewed by the project's Advisory Board.

SUBMITTER: Frampton GK

PROVIDER: S-EPMC7273688 | biostudies-literature | 2020 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Digital tools for the recruitment and retention of participants in randomised controlled trials: a systematic map.

Frampton Geoff K GK Shepherd Jonathan J Pickett Karen K Griffiths Gareth G Wyatt Jeremy C JC

Trials 20200605 1

<h4>Background</h4>Recruiting and retaining participants in randomised controlled trials (RCTs) is challenging. Digital tools, such as social media, data mining, email or text-messaging, could improve recruitment or retention, but an overview of this research area is lacking. We aimed to systematically map the characteristics of digital recruitment and retention tools for RCTs, and the features of the comparative studies that have evaluated the effectiveness of these tools during the past 10 yea ...[more]

PMID: 32498690

Similar Datasets

Project description:BackgroundRecruitment and retention of participants in randomised controlled trials (RCTs) is a key determinant of success but is challenging. Trialists and UK Clinical Research Collaboration (UKCRC) Clinical Trials Units (CTUs) are increasingly exploring the use of digital tools to identify, recruit and retain participants. The aim of this UK National Institute for Health Research (NIHR) study was to identify what digital tools are currently used by CTUs and understand the performance characteristics required to be judged useful.MethodsA scoping of searches (and a survey with NIHR funding staff), a survey with all 52 UKCRC CTUs and 16 qualitative interviews were conducted with five stakeholder groups including trialists within CTUs, funders and research participants. A purposive sampling approach was used to conduct the qualitative interviews during March-June 2018. Qualitative data were analysed using a content analysis and inductive approach.ResultsResponses from 24 (46%) CTUs identified that database-screening tools were the most widely used digital tool for recruitment, with the majority being considered effective. The reason (and to whom) these tools were considered effective was in identifying potential participants (for both Site staff and CTU staff) and reaching recruitment target (for CTU staff/CI). Fewer retention tools were used, with short message service (SMS) or email reminders to participants being the most reported. The qualitative interviews revealed five themes across all groups: 'security and transparency'; 'inclusivity and engagement'; 'human interaction'; 'obstacles and risks'; and 'potential benefits'. There was a high level of stakeholder acceptance of the use of digital tools to support trials, despite the lack of evidence to support them over more traditional techniques. Certain differences and similarities between stakeholder groups demonstrated the complexity and challenges of using digital tools for recruiting and retaining research participants.ConclusionsOur studies identified a range of digital tools in use in recruitment and retention of RCTs, despite the lack of high-quality evidence to support their use. Understanding the type of digital tools in use to support recruitment and retention will help to inform funders and the wider research community about their value and relevance for future RCTs. Consideration of further focused digital tool reviews and primary research will help to reduce gaps in the evidence base.

Project description:BackgroundRecruitment of participants into randomised controlled trials (RCTs) is critical for successful trial conduct. Although there have been two previous systematic reviews on related topics, the results (which identified specific interventions) were inconclusive and not generalizable. The aim of our study was to evaluate the relative effectiveness of recruitment strategies for participation in RCTs.Methods and findingsA systematic review, using the PRISMA guideline for reporting of systematic reviews, that compared methods of recruiting individual study participants into an actual or mock RCT were included. We searched MEDLINE, Embase, The Cochrane Library, and reference lists of relevant studies. From over 16,000 titles or abstracts reviewed, 396 papers were retrieved and 37 studies were included, in which 18,812 of at least 59,354 people approached agreed to participate in a clinical RCT. Recruitment strategies were broadly divided into four groups: novel trial designs (eight studies), recruiter differences (eight studies), incentives (two studies), and provision of trial information (19 studies). Strategies that increased people's awareness of the health problem being studied (e.g., an interactive computer program [relative risk (RR) 1.48, 95% confidence interval (CI) 1.00-2.18], attendance at an education session [RR 1.14, 95% CI 1.01-1.28], addition of a health questionnaire [RR 1.37, 95% CI 1.14-1.66]), or a video about the health condition (RR 1.75, 95% CI 1.11-2.74), and also monetary incentives (RR1.39, 95% CI 1.13-1.64 to RR 1.53, 95% CI 1.28-1.84) improved recruitment. Increasing patients' understanding of the trial process, recruiter differences, and various methods of randomisation and consent design did not show a difference in recruitment. Consent rates were also higher for nonblinded trial design, but differential loss to follow up between groups may jeopardise the study findings. The study's main limitation was the necessity of modifying the search strategy with subsequent search updates because of changes in MEDLINE definitions. The abstracts of previous versions of this systematic review were published in 2002 and 2007.ConclusionRecruitment strategies that focus on increasing potential participants' awareness of the health problem being studied, its potential impact on their health, and their engagement in the learning process appeared to increase recruitment to clinical studies. Further trials of recruitment strategies that target engaging participants to increase their awareness of the health problems being studied and the potential impact on their health may confirm this hypothesis. Please see later in the article for the Editors' Summary.

Project description:AimTo quantify recruitment, retention and differential retention rates and associated trial, participant and intervention characteristics in randomised controlled trials (RCTs) evaluating the effect of exercise therapy in people with multimorbidity.Data sourcesMEDLINE, EMBASE, CINAHL and CENTRAL from 1990 to April 20, 2020.Study selectionRCTs including people with multimorbidity comparing exercise therapy with a non-exposed comparator group reporting at least one of the following outcomes: physical function, health-related quality of life, depression symptoms, or anxiety symptoms.Data extraction and synthesisRecruitment rates (proportion of people randomised/proportion of people eligible), retention rates (proportion of people providing the outcomes of interest/proportion randomised) and differential retention rates (difference in proportion of people providing the outcomes in the intervention group and comparator group) were calculated. Meta-analysis using a random-effects model was used to estimate pooled proportions. Methodological quality was assessed using Cochrane ´Risk of Bias tool 2.0´ for individual studies, and the GRADE approach was used to assess the overall quality of the evidence.ResultsTwenty-three RCTs with 3363 people were included. The pooled prevalence for recruitment rate was 75% (95%CI 66 to 84%). The pooled prevalence for retention rate was 90% (95%CI 86 to 94%) at the end of the intervention (12 weeks; interquartile range (IQR) (12 to 12)). Meta-regression analyses showed that increasing age and including a higher proportion of people with hypertension was associated with lower retention rates. Retention rates did not differ between the intervention and comparator groups. The overall quality of the evidence was deemed very low.ConclusionThree in four eligible people with multimorbidity were randomised to RCTs using exercise therapy, of which nine out of 10 provided end of treatment outcomes with no difference seen between the intervention and comparison groups. However, the results must be interpreted with caution due to large differences between the included studies.Trial registrationClinicalTrials.gov CRD42020161329 . Registered on 28 April 2020.

Project description:BackgroundNon-retention of participants seriously affects the credibility of clinical trial results and significantly reduces the potential of a trial to influence clinical practice. Non-retention can be defined as instances where participants leave the study prematurely. Examples include withdrawal of consent and loss to follow-up and thus outcome data cannot be obtained. The majority of existing interventions targeting retention fail to describe any theoretical basis for the observed improvement, or lack of improvement. Moreover, most of these interventions lack involvement of participants in their conception and/or design, raising questions about their relevance and acceptability. Many of the causes of non-retention involve people performing a behaviour (e.g. not returning a questionnaire). Behaviour change is difficult, and the importance of a strong theoretical basis for interventions that aim to change behaviour is increasingly recognised. This research aims to develop and pilot theoretically informed, participant-centred, evidence-based behaviour change interventions to improve retention in trials.MethodsThis research will generate data through semi-structured interviews on stakeholders' perspectives of the reasons for trial non-retention. It will identify perceived barriers and enablers to trial retention using the Theoretical Domains Framework. The intervention development work will involve identification of behaviour change techniques, using recognised methodology, and co-production of retention interventions through discussion groups with end-users. An evaluation of intervention acceptability and feasibility will be conducted in focus groups. Finally, a ready-to-use evaluation framework to deploy in Studies Within A Trial as well as an explanatory retention framework will be developed for identifying and tackling modifiable issues to improve trial retention.DiscussionWe believe this to be one of the first studies to apply a theoretical lens to the development of interventions to improve trial retention that have been informed by, and are embedded within, participants' experiential accounts. By developing and identifying priority interventions this study will support efforts to reduce research waste.

Project description:Background Retention of participants is essential to ensure the statistical power and internal validity of clinical trials. Poor participant retention reduces power and can bias the estimates of intervention effect. There is sparse evidence from randomised comparisons of effective strategies to retain participants in randomised trials. Currently, non-randomised evaluations of trial retention interventions embedded in host clinical trials are rejected from the Cochrane review of strategies to improve retention because it only included randomised evaluations. However, the systematic assessment of non-randomised evaluations may inform trialists’ decision-making about retention methods that have been evaluated in a trial context.Therefore, we performed a systematic review to synthesise evidence from non-randomised evaluations of retention strategies in order to supplement existing randomised trial evidence. Methods We searched MEDLINE, EMBASE, and Cochrane CENTRAL from 2007 to October 2017. Two reviewers independently screened abstracts and full-text articles for non-randomised studies that compared two or more strategies to increase participant retention in randomised trials. The retention trials had to be nested in real ‘host’ trials ( including feasibility studies) but not hypothetical trials. Two investigators independently rated the risk of bias of included studies using the ROBINS-I tool and determined the certainty of evidence using GRADE (Grading of Recommendations Assessment, Development and Evaluation) framework. Results Fourteen non-randomised studies of retention were included in this review. Most retention strategies (in 10 studies) aimed to increase questionnaire response rate. Favourable strategies for increasing questionnaire response rate were telephone follow-up compared to postal questionnaire completion, online questionnaire follow-up compared to postal questionnaire, shortened version of questionnaires versus longer questionnaires, electronically transferred monetary incentives compared to cash incentives, cash compared with no incentive and reminders to non-responders (telephone or text messaging). However, each retention strategy was evaluated in a single observational study. This, together with risk of bias concerns, meant that the overall GRADE certainty was low or very low for all included studies. Conclusions This systematic review provides low or very low certainty evidence on the effectiveness of retention strategies evaluated in non-randomised studies. Some strategies need further evaluation to provide confidence around the size and direction of the underlying effect.

Project description:Randomised control trials are regarded as the gold standard for evaluating the effectiveness and efficacy of healthcare interventions with thousands of trials published every year. Despite significant investment in infrastructure, a staggering number of clinical trials continue to face challenges with retention. Dropouts could lead to negative consequences-from lengthy delays to missing data that can undermine the results and integrity of the trial. Summarising evidence from non-randomised evaluations of retention strategies could provide complementary information to randomised evaluations that could guide trialists to the most effective ways of increasing retention of participants in clinical trials.The following electronic databases will be searched for relevant studies: EMBASE, MEDLINE, the Cochrane Controlled Trials Register, and Cochrane Methodology Register and the search will be limited to English-published studies during the last 10 years to increase relevance to current trials. Non-randomised studies (observational studies) including a comparison of two or more strategies to increase participant retention in randomised trials or comparing one or more strategies with no strategy will be included. The primary outcome will be the proportion of participants remained at the primary analysis as determined in each retention study.This review aims to gather and evaluate evidence on the effect of retention strategies examined in non-randomised studies. It is imperative to collect evidence from obseravational studies to infer whether or not these studies could be considered a practical way to complement or even replace a broadly favourable randomised design. If we find that non-randomised studies to be included in this review are of high quality with adequate control of biases, we will recommend to trialists and others not to rely exclusively on randomised studies and to give meticulous attention to the plentiful evidence that can be obtained from non-randomised studies. Should the results of this review suggest that evaluating retention strategies in observational studies provides insufficient evidence to trialists planning their retention strategies, we will be able to say that there is little point in conducting non-randomised studies and that they would do better to invest their time and resources in a randomised evaluation if possible. Where a non-randomised study design is chosen, the review authors will offer recommendations to trialists and others regarding how to ensure that these studies are conducted in a way that can minimise the risk of bias and increase confidence in the findings.PROSPERO 2017: CRD42017072775 .

Project description:Background Poor recruitment to randomised controlled trials (RCTs) is a widespread problem. Provision of interventions aimed at supporting or incentivising clinicians may improve recruitment to RCTs. Objectives To quantify the effects of strategies aimed at improving the recruitment activity of clinicians in RCTs, complemented with a synthesis of qualitative evidence related to clinicians' attitudes towards recruiting to RCTs. Data sources A systematic review of English and non-English articles identified from: The Cochrane Library, Ovid MEDLINE, Ovid EMBASE, Ovid PsycINFO, Ebsco CINAHL, Index to Theses and Open SIGLE from 2001 to March 2011. Additional reports were identified through citation searches of included articles. Study eligibility criteria Quantitative studies were included if they evaluated interventions aimed at improving the recruitment activity of clinicians or compared recruitment by different groups of clinicians. Information about host trial, study design, participants, interventions, outcomes and host RCT was extracted by one researcher and checked by another. Studies that met the inclusion criteria were assessed for quality using a standardised tool, the Effective Public Health Practice Project tool. Qualitative studies were included if they investigated clinicians' attitudes to recruiting patients to RCTs. All results/findings were extracted, and content analysis was carried out. Overarching themes were abstracted, followed by a metasummary analysis. Studies that met the inclusion criteria were assessed for quality using the Critical Appraisal Skills Programme qualitative checklist. Data extraction Data extraction was carried out by one researcher using predefined data fields, including study quality indicators, and verified by another. Results Eight quantitative studies were included describing four interventions and a comparison of recruiting clinicians. One study was rated as strong, one as moderate and the remaining six as weak when assessed for quality using the Effective Public Health Practice Project tool. Effective interventions included the use of qualitative research to identify and overcome barriers to recruitment, reduction of the clinical workload associated with participation in RCTs and the provision of extra training and protected research time. Eleven qualitative studies were identified, and eight themes were abstracted from the data: understanding of research, communication, perceived patient barriers, patient-clinician relationship, effect on patients, effect on clinical practice, individual benefits for clinicians and methods associated with successful recruitment. Metasummary analysis identified the most frequently reported subthemes to be: difficulty communicating trial methods, poor understanding of research and priority given to patient well-being. Overall, the qualitative studies were found to be of good quality when assessed using the Critical Appraisal Skills Programme checklist. Conclusions There were few high-quality trials that tested interventions to improve clinicians' recruitment activity in RCTs. The most promising intervention was the use of qualitative methods to identify and overcome barriers to clinician recruitment activity. More good quality studies of interventions are needed to add to the evidence base. The metasummary of qualitative findings identified understanding and communicating RCT methods as a key target for future interventions to improve recruitment. Reinforcement of the potential benefits, both for clinicians and for their patients, could also be a successful factor in improving recruitment. A bias was found towards investigating barriers to recruitment, so future work should also encompass a focus on successfully recruiting trials.

Dataset Information

Digital tools for the recruitment and retention of participants in randomised controlled trials: a systematic map.

Background

Methods

Results

Conclusions

Registration

Publications

Digital tools for the recruitment and retention of participants in randomised controlled trials: a systematic map.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets