Dataset Information

Improving postal survey response using behavioural science: a nested randomised control trial.

ABSTRACT:

Background

Systematic reviews have identified effective strategies for increasing postal response rates to questionnaires; however, most studies have isolated single techniques, testing the effect of each one individually. Despite providing insight into explanatory mechanisms, this approach lacks ecological validity, given that multiple techniques are often combined in routine practice.

Methods

We used a two-armed parallel randomised controlled trial (n = 2702), nested within a cross-sectional health survey study, to evaluate whether using a pragmatic combination of behavioural science and evidenced-based techniques (e.g., personalisation, social norms messaging) in a study invitation letter increased response to the survey, when compared with a standard invitation letter. Participants and outcome assessors were blinded to group assignment. We tested this in a sample of women testing positive for human papillomavirus (HPV) at cervical cancer screening in England.

Results

Overall, 646 participants responded to the survey (response rate [RR] = 23.9%). Logistic regression revealed higher odds of response in the intervention arm (n = 357/1353, RR = 26.4%) compared with the control arm (n = 289/1349, RR = 21.4%), while adjusting for age, deprivation, clinical site, and clinical test result (aOR = 1.30, 95% CI: 1.09-1.55).

Conclusion

Applying easy-to-implement behavioural science and evidence-based methods to routine invitation letters improved postal response to a health-related survey, whilst adjusting for demographic characteristics. Our findings provide support for the pragmatic adoption of combined techniques in routine research to increase response to postal surveys.

Trial registration

ISRCTN, ISRCTN15113095 . Registered 7 May 2019 - retrospectively registered.

SUBMITTER: McBride E

PROVIDER: S-EPMC8684081 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Minimising participant non-response in postal surveys helps to maximise the generalisability of the inferences made from the data collected. The aim of this study was to examine the effect of questionnaire length, personalisation and reminder type on postal survey response rate and quality and to compare the cost-effectiveness of the alternative survey strategies.In a pilot study for a population study of travel behaviour, physical activity and the environment, 1000 participants sampled from the UK edited electoral register were randomly allocated using a 2×2 factorial design to receive one of four survey packs: a personally addressed long (24 page) questionnaire pack, a personally addressed short (15 page) questionnaire pack, a non-personally addressed long questionnaire pack or a non-personally addressed short questionnaire pack. Those who did not return a questionnaire were stratified by initial randomisation group and further randomised to receive either a full reminder pack or a reminder postcard. The effects of the survey design factors on response were examined using multivariate logistic regression.An overall response rate of 17% was achieved. Participants who received the short version of the questionnaire were more likely to respond (OR=1.48, 95% CI 1.06 to 2.07). In those participants who received a reminder, personalisation of the survey pack and reminder also increased the odds of response (OR=1.44, 95% CI 1.01 to 1.95). Item non-response was relatively low, but was significantly higher in the long questionnaire than the short (9.8% vs 5.8%; p=.04). The cost per additional usable questionnaire returned of issuing the reminder packs was £23.1 compared with £11.3 for the reminder postcards.In contrast to some previous studies of shorter questionnaires, this trial found that shortening a relatively lengthy questionnaire significantly increased the response. Researchers should consider the trade off between the value of additional questions and a larger sample. If low response rates are expected, personalisation may be an important strategy to apply. Sending a full reminder pack to non-respondents appears a worthwhile, albeit more costly, strategy.

Project description:BackgroundUse of a person's name in a text message has been shown to be effective in instigating behaviour change. We evaluated the effectiveness of a personalised text message (including the recipient's name) versus a standardised text message for prompting a response from trial participants to complete and return postal follow-up questionnaires.MethodsUsing a randomised study within a trial (SWAT) embedded within the host GRASP (Getting it Right: Addressing Shoulder Pain) trial, participants who provided a mobile telephone number were randomised (1:1) by a central computer system to receive either (1) a personalised text message which included their name or (2) a standard text message. Text messages were sent by the trial office on the same day as the 6-month GRASP follow-up questionnaire. The primary outcome was questionnaire response rate, defined as the proportion of 6-month GRASP follow-up questionnaires returned by participants. Secondary outcomes included time to response, the proportion of participants sent a reminder follow-up questionnaire, and cost.ResultsBetween March 2017 and May 2019 (recruitment period for GRASP trial), 618 participants were randomised to a personalised (n = 309) or standard (n = 309) text message and all were included in the analysis. The overall questionnaire response rate was 87% (n = 537/618); 90% (n = 277/309) of participants responded in the personalised text message group compared to 84% (n = 260/309) in the standard text message group (relative risk (RR) 1.07; 95% CI 1.00 to 1.13). Participants randomised to receive the personalised text message were more likely to return their initial postal questionnaire than those who received the standard text message (n = 185/309; 60% vs. n = 160/309; 52%) (RR 1.16; 95% CI 1.00 to 1.33); this represents an absolute percentage difference between intervention groups of 8%. Post hoc subgroup analysis showed that males under 65 years were the group most likely to return their initial questionnaire if they received a personalised text message.ConclusionOverall, participants who received a personalised text message were more likely to return their questionnaire than those who received the standard text message.Trial registrationGRASP Trial ISRCTN16539266 ; SWAT Repository ID 35.

Project description:BACKGROUND: The feasibility of randomized trials often depends on successful patient recruitment. Although numerous recruitment barriers have been identified it is unclear which of them complicate recruitment most. Also, most surveys have focused on the patients' perspective of recruitment barriers whereas the perspective of recruiting physicians has received less attention. Therefore, our aim was to conduct a postal survey among recruiting physicians of a multi-center trial to weigh barriers according to their impact on recruitment. METHODS: We identified any potential recruitment barriers from the literature and from our own experience with a multi-center trial of respiratory rehabilitation in patients with chronic obstructive pulmonary disease. We developed and pilot-tested a self-administered questionnaire where recruiting physicians were asked to express their agreement with statements about recruitment barriers on a Likert-type scale from 1 (full agreement with statement = very substantial recruitment barrier) to 7 (no agreement with statement = no recruitment barrier). RESULTS: 38 of 55 recruiting physicians returned questionnaires (69% response rate), of which 35 could be analyzed (64% useable response rate). Recruiting physicians reported that "time constraints" (median agreement of 3, interquartile range 2-5) had the most negative impact on recruitment followed by "difficulties including identified eligible patients" (median agreement of 5, IQR 3-6). Other barriers such as "trial design barriers", "lack of access to treatment", "individual barriers of recruiting physicians" or "insufficient training of recruiting physicians" were perceived to have little or no impact on patient recruitment. CONCLUSION: Physicians perceived time constraints as the most relevant recruitment barrier in a randomized trial. To overcome recruitment barriers interventions, that are affordable for both industry- and investigator-driven trials, need to be developed and tested in randomized trials. TRIAL REGISTRATION: ISRCTN84612310.