Dataset Information

Does pre-notification increase questionnaire response rates: a randomised controlled trial nested within a systematic review.

ABSTRACT:

Background

Missing outcome data can lead to bias in the results of systematic reviews. One way to address missing outcome data is by requesting the data from the trial authors, but non-response is common. One way to potentially improve response rates is by sending study participants advance communication. During the update of a systematic review examining the effect of pre-notification on response rates, study authors needed to be contacted for further information. This study was nested within the systematic review by randomising authors to receive a notification of the upcoming request for information. The objective was to test if pre-notification increased response rates.

Methods

The participants were study authors included in the systematic review, whose studies were at unclear risk of bias. The intervention was a pre-notification of the request for further information, sent 1 day before the request. The outcome was defined as the proportion of authors who responded to the request for information. Authors were randomised by simple randomisation. Thirty three authors were randomised to the pre-notification arm, and 42 were randomised to the control arm. Authors were blinded to the possibility of an alternative condition.

Results

All authors randomised were analysed. 14/33 (42.4%) authors in the pre-notification arm had returned responses to the questionnaire, and 18/42 (42.9%) in the control arm. There was no evidence of a difference between these groups (absolute difference = - 0.5, 95% CI (- 23.4 to 22.5%), p = 1). We received no complaints about receiving the pre-notification.

Conclusions

This study's results do not support the hypothesis that pre-notification increases response from study authors being contacted for a request for more information. However, the study has a low power, and the results may not generalise to other contexts, methods of administering a pre-notification, or study populations.

Trial registration

Registration and protocol: This trial is not registered with any trial registry. However, the protocol was posted in advance on the Open Science Framework website and is available on the Open Science Framework website: DOI: https://doi.org/10.17605/OSF.IO/MSV2W or https://osf.io/msv2w/.

SUBMITTER: Woolf B

PROVIDER: S-EPMC8627620 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundLow completion rates of questionnaires in randomised controlled trials can compromise the reliability of the results, so ways to boost questionnaire completion are often implemented. Although there is evidence to suggest that sending a text message to participants increases completion, there is little evidence around the timing or personalisation of these text messages. Methods: A two-by-two factorial SWAT (study within a trial) was embedded within the MiQuit-3 trial, looking at smoking cessation within pregnant smokers. Participants who reached their 36-week gestational follow-up were randomised to receive a personalised or non-personalised text message, either one week or one day prior to their follow-up. Primary outcomes were completion rate of questionnaire via telephone. Secondary outcomes included: completion rate via any method, time to completion, and number of attempts to contact required. Results In total 194 participants were randomised into the SWAT to receive a text message that was personalised early(n=50), personalised late (n=47), non-personalised early(n=50), or non-personalised late(n=47). There was no evidence that timing of the text message (early: one week before; or late: one day before) had an effect on any of the outcomes. There was evidence that a personalised text message would result in fewer completions compared with a non-personalised text message when data was collected only via the telephone(adjusted OR 0.44, 95% CI 0.22-0.87, p=0.02). However, these results were not significant when looking at completion via any method (adjusted OR 0.61, 95% CI 0.30-1.24, p=0.17). There was no evidence to show that personalisation or not was better for any of the secondary outcomes. Conclusion Timing of the text message does not appear to influence the completion of questionnaires. Personalisation of a text message may be detrimental to questionnaire completion, if data is only collected via the telephone - however, more SWATs should be undertaken in this field.

Project description:BackgroundLoss to follow-up resulting in missing outcomes compromises the validity of trial results by reducing statistical power, negatively affecting generalisability and undermining assumptions made at analysis, leading to potentially biased and misleading results. Evidence that incentives are effective at improving response rates exists, but there is little evidence regarding the best approach, especially in the field of perinatal medicine. The NIHR-funded SIFT trial follow-up of infants at 2 years of age provided an ideal opportunity to address this remaining uncertainty.MethodsParticipants: parents of infants from participating neonatal units in the UK and Ireland followed up for SIFT (multicentre RCT investigating two speeds of feeding in babies with gestational age at birth < 32 weeks and/or birthweight < 1500 g).Interventionsparents were randomly allocated to receive incentives (£15 gift voucher) before or after questionnaire return. The objective was to establish whether offering an unconditional incentive in advance or promising an incentive on completion of a questionnaire (conditional) improved the response rate in parents of premature babies. The primary outcome was questionnaire response rate. Permuted block randomisation was performed (variable size blocks), stratified by SIFT allocation (slower/faster feeds) and single/multiple birth. Multiple births were given the same incentives allocation. Parents were unaware that they were in an incentives SWAT; SIFT office staff were not blinded to allocation.ResultsParents of 923 infants were randomised: 459 infants allocated to receive incentive before, 464 infants allocated to receive incentive after; analysis was by intention to treat. Allocation to the incentive before completion led to a significantly higher response rate, 83.0% (381/459) compared to the after-completion group, 76.1% (353/464); adjusted absolute difference of 6.8% (95% confidence interval 1.6% to 12.0%). Giving an incentive in advance is the more costly approach, but the mean difference of ~£3 per infant is small given the higher return.ConclusionsAn unconditional incentive in advance led to a significantly higher response rate compared to the promise of an incentive on completion. Against a backdrop of falling response rates to questionnaires, incentives can be an effective way to increase returns.Trial registrationSIFT ( ISRCTN76463425 ). Registered on March 5, 2013.; SWAT registration (SWAT 69 available from http://www.qub.ac.uk/sites/TheNorthernIrelandNetworkforTrialsMethodologyResearch/FileStore/Filetoupload,864297,en.pdf ). Registered on June 27, 2016.

Project description:To investigate staff and trainer perspectives on the barriers and facilitators to implementing a complex intervention to help staff support the recovery of service users with a primary diagnosis of psychosis in community mental health teams.Process evaluation nested within a cluster randomised controlled trial (RCT).28 interviews with mental health care staff, 3 interviews with trainers, 4 focus groups with intervention teams and 28 written trainer reports.14 community-based mental health teams in two UK sites (one urban, one semi-rural) who received the intervention.The factors influencing the implementation of the intervention can be organised under two over-arching themes: Organisational readiness for change and Training effectiveness. Organisational readiness for change comprised three sub-themes: NHS Trust readiness; Team readiness; and Practitioner readiness. Training effectiveness comprised three sub-themes: Engagement strategies; Delivery style and Modelling recovery principles.Three findings can inform future implementation and evaluation of complex interventions. First, the underlying intervention model predicted that three areas would be important for changing practice: staff skill development; intention to implement; and actual implementation behaviour. This study highlighted the importance of targeting the transition from practitioners' intent to implement to actual implementation behaviour, using experiential learning and target setting. Second, practitioners make inferences about organisational commitment by observing the allocation of resources, Knowledge Performance Indicators and service evaluation outcome measures. These need to be aligned with recovery values, principles and practice. Finally, we recommend the use of organisational readiness tools as an inclusion criteria for selecting both organisations and teams in cluster RCTs. We believe this would maximise the likelihood of adequate implementation and hence reduce waste in research expenditure.Controlled-Trials.com ISRCTN02507940.

Project description:Randomised control trials are regarded as the gold standard for evaluating the effectiveness and efficacy of healthcare interventions with thousands of trials published every year. Despite significant investment in infrastructure, a staggering number of clinical trials continue to face challenges with retention. Dropouts could lead to negative consequences-from lengthy delays to missing data that can undermine the results and integrity of the trial. Summarising evidence from non-randomised evaluations of retention strategies could provide complementary information to randomised evaluations that could guide trialists to the most effective ways of increasing retention of participants in clinical trials.The following electronic databases will be searched for relevant studies: EMBASE, MEDLINE, the Cochrane Controlled Trials Register, and Cochrane Methodology Register and the search will be limited to English-published studies during the last 10 years to increase relevance to current trials. Non-randomised studies (observational studies) including a comparison of two or more strategies to increase participant retention in randomised trials or comparing one or more strategies with no strategy will be included. The primary outcome will be the proportion of participants remained at the primary analysis as determined in each retention study.This review aims to gather and evaluate evidence on the effect of retention strategies examined in non-randomised studies. It is imperative to collect evidence from obseravational studies to infer whether or not these studies could be considered a practical way to complement or even replace a broadly favourable randomised design. If we find that non-randomised studies to be included in this review are of high quality with adequate control of biases, we will recommend to trialists and others not to rely exclusively on randomised studies and to give meticulous attention to the plentiful evidence that can be obtained from non-randomised studies. Should the results of this review suggest that evaluating retention strategies in observational studies provides insufficient evidence to trialists planning their retention strategies, we will be able to say that there is little point in conducting non-randomised studies and that they would do better to invest their time and resources in a randomised evaluation if possible. Where a non-randomised study design is chosen, the review authors will offer recommendations to trialists and others regarding how to ensure that these studies are conducted in a way that can minimise the risk of bias and increase confidence in the findings.PROSPERO 2017: CRD42017072775 .

Project description:Background Retention of participants is essential to ensure the statistical power and internal validity of clinical trials. Poor participant retention reduces power and can bias the estimates of intervention effect. There is sparse evidence from randomised comparisons of effective strategies to retain participants in randomised trials. Currently, non-randomised evaluations of trial retention interventions embedded in host clinical trials are rejected from the Cochrane review of strategies to improve retention because it only included randomised evaluations. However, the systematic assessment of non-randomised evaluations may inform trialists’ decision-making about retention methods that have been evaluated in a trial context.Therefore, we performed a systematic review to synthesise evidence from non-randomised evaluations of retention strategies in order to supplement existing randomised trial evidence. Methods We searched MEDLINE, EMBASE, and Cochrane CENTRAL from 2007 to October 2017. Two reviewers independently screened abstracts and full-text articles for non-randomised studies that compared two or more strategies to increase participant retention in randomised trials. The retention trials had to be nested in real ‘host’ trials ( including feasibility studies) but not hypothetical trials. Two investigators independently rated the risk of bias of included studies using the ROBINS-I tool and determined the certainty of evidence using GRADE (Grading of Recommendations Assessment, Development and Evaluation) framework. Results Fourteen non-randomised studies of retention were included in this review. Most retention strategies (in 10 studies) aimed to increase questionnaire response rate. Favourable strategies for increasing questionnaire response rate were telephone follow-up compared to postal questionnaire completion, online questionnaire follow-up compared to postal questionnaire, shortened version of questionnaires versus longer questionnaires, electronically transferred monetary incentives compared to cash incentives, cash compared with no incentive and reminders to non-responders (telephone or text messaging). However, each retention strategy was evaluated in a single observational study. This, together with risk of bias concerns, meant that the overall GRADE certainty was low or very low for all included studies. Conclusions This systematic review provides low or very low certainty evidence on the effectiveness of retention strategies evaluated in non-randomised studies. Some strategies need further evaluation to provide confidence around the size and direction of the underlying effect.

Project description:BACKGROUND:The NHS Health Check (NHS HC) is a cardiovascular risk assessment to prevent cardiovascular disease. Public Health England (PHE) wants to increase uptake. METHODS:We explored the impact of behaviourally informed invitation letters and pre-notification and reminder SMS on uptake of NHS HCs. Patients at 28 General Practices in the London Borough of Southwark who were eligible to receive an NHS HC between 1st November 2013 and 31st December 2014 were included. A double-blind randomised controlled trial with a mixed 2 (pre-notification SMS - yes or no) × 4 (letter - national template control, open-ended, time-limited, social norm) × 2 (reminder SMS - yes or no) factorial design was used. The open-ended letter used simplification, behavioural instruction and a personalised planning prompt for patients to record the date and time of their NHS HC. The time-limited letter was similar but stated the NHS HC was due in a named forthcoming month. The social norms letter was similar to the open-ended letter but included a descriptive social norms message and testimonials from local residents and no planning prompt. The outcome measure was attendance at an NHS HC. RESULTS:Data for 12, 244 invites were analysed. Uptake increased in almost all letter and SMS combinations compared to the control letter without SMS (Uptake 18%), with increases of up to 12 percentage points for the time-limited letter with pre-notification and reminder (Uptake 30%; Adjusted Odds Ratio AOR 1.86; 95% CI 1.45-2.83; p < 0.00); 10 percentage points for the open-ended letter with reminder (Uptake 27%; AOR 1.68; 95% CI 1.31-2.17; p < 0.00) and a 9 percentage point increase using the time-limited letter with reminder (Uptake 27%; AOR 1.61; 95% CI 1.25-2.10; p < 0.00). The reminder SMS increased uptake for all intervention letters. The pre-notification did not add to this effect. CONCLUSIONS:This large randomised controlled trial adds support to the evidence that small, low cost behaviourally informed changes to letter-based invitations can increase uptake of NHS HCs. It also provides novel evidence on the effect of SMS reminders and pre-notification on NHS HC attendance. TRIAL REGISTRATION:Retrospectively Registered (24/01/2014) ISRCTN36027094 .

Project description:BackgroundHigh participation in mammographic screening is essential for its effectiveness to detect breast cancers early and thereby, improve breast cancer outcomes. Breast density is a strong predictor of breast cancer risk and significantly reduces the sensitivity of mammography to detect the disease. There are increasing mandates for routine breast density notification within mammographic screening programs. It is unknown if breast density notification impacts the likelihood of women returning to screening when next due (i.e. rescreening rates). This study investigates the association between breast density notification and rescreening rates using individual-level data from BreastScreen Western Australia (WA), a population-based mammographic screening program.MethodsWe examined 981,705 screening events from 311,656 women aged 40+ who attended BreastScreen WA between 2008 and 2017. Mixed effect logistic regression was used to investigate the association between rescreening and breast density notification status.ResultsResults were stratified by age (younger, targeted, older) and screening round (first, second, third+). Targeted women screening for the first time were more likely to return to screening if notified as having dense breasts (Percentunadjusted notified vs. not-notified: 57.8% vs. 56.1%; Padjusted = 0.016). Younger women were less likely to rescreen if notified, regardless of screening round (all P < 0.001). There was no association between notification and rescreening in older women (all P > 0.72).ConclusionsBreast density notification does not deter women in the targeted age range from rescreening but could potentially deter younger women from rescreening. These results suggest that all breast density notification messaging should include information regarding the importance of regular mammographic screening to manage breast cancer risk, particularly for younger women. These results will directly inform BreastScreen programs in Australia as well as other population-based screening providers outside Australia who notify women about breast density or are considering implementing breast density notification.