Dataset Information

Effect of questionnaire length, personalisation and reminder type on response rate to a complex postal survey: randomised controlled trial.

ABSTRACT: Minimising participant non-response in postal surveys helps to maximise the generalisability of the inferences made from the data collected. The aim of this study was to examine the effect of questionnaire length, personalisation and reminder type on postal survey response rate and quality and to compare the cost-effectiveness of the alternative survey strategies.In a pilot study for a population study of travel behaviour, physical activity and the environment, 1000 participants sampled from the UK edited electoral register were randomly allocated using a 2×2 factorial design to receive one of four survey packs: a personally addressed long (24 page) questionnaire pack, a personally addressed short (15 page) questionnaire pack, a non-personally addressed long questionnaire pack or a non-personally addressed short questionnaire pack. Those who did not return a questionnaire were stratified by initial randomisation group and further randomised to receive either a full reminder pack or a reminder postcard. The effects of the survey design factors on response were examined using multivariate logistic regression.An overall response rate of 17% was achieved. Participants who received the short version of the questionnaire were more likely to respond (OR=1.48, 95% CI 1.06 to 2.07). In those participants who received a reminder, personalisation of the survey pack and reminder also increased the odds of response (OR=1.44, 95% CI 1.01 to 1.95). Item non-response was relatively low, but was significantly higher in the long questionnaire than the short (9.8% vs 5.8%; p=.04). The cost per additional usable questionnaire returned of issuing the reminder packs was £23.1 compared with £11.3 for the reminder postcards.In contrast to some previous studies of shorter questionnaires, this trial found that shortening a relatively lengthy questionnaire significantly increased the response. Researchers should consider the trade off between the value of additional questions and a larger sample. If low response rates are expected, personalisation may be an important strategy to apply. Sending a full reminder pack to non-respondents appears a worthwhile, albeit more costly, strategy.

SUBMITTER: Sahlqvist S

PROVIDER: S-EPMC3110121 | biostudies-literature | 2011 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Effect of questionnaire length, personalisation and reminder type on response rate to a complex postal survey: randomised controlled trial.

Sahlqvist Shannon S Song Yena Y Bull Fiona F Adams Emma E Preston John J Ogilvie David D

BMC medical research methodology 20110506

<h4>Background</h4>Minimising participant non-response in postal surveys helps to maximise the generalisability of the inferences made from the data collected. The aim of this study was to examine the effect of questionnaire length, personalisation and reminder type on postal survey response rate and quality and to compare the cost-effectiveness of the alternative survey strategies.<h4>Methods</h4>In a pilot study for a population study of travel behaviour, physical activity and the environment, ...[more]

PMID: 21548947

Similar Datasets

Project description:Background: Research outcome data is commonly collected using postal questionnaires; however, poor response can introduce bias and reduce statistical power. Text messaging is simple, cost-effective, and can be customised to the individual. Personalised, reminder text messages may improve response rates. Methods: A two-arm, parallel group 'Study within a Trial' (SWAT) was embedded within the Occupational Therapist Intervention Study (OTIS), a randomised controlled trial of a home assessment for falls prevention in older people. OTIS participants who provided a mobile phone number were randomly allocated (1:1) to receive either a personalised text message (Title, Surname, plus York Trials Unit (YTU) text) or the standard YTU text alone, prior to receiving their four-month post-randomisation follow-up postal questionnaire. The primary outcome measure was the proportion of participants who returned the questionnaire. Secondary outcomes were: time to response, completeness of response, requirement of a reminder letter, and cost-effectiveness. Binary data were compared using logistic regression and time to response by Cox proportional hazards regression. Results: A total of 403 participants were randomised: 201 to the personalised text and 202 to the standard text. Of the 283 participants included in the final analysis, 278 (98.2%) returned their questionnaire; 136 (97.8%) for the personalised text versus 142 (98.6%) for the standard text (adjusted odds ratio 0.64, 95% CI 0.10 to 3.88, p=0.63). The median time to response was nine days in both groups. In total, 271 (97.5%) participants returned a complete questionnaire; 133 (97.8%) in the personalised text versus 138 (97.2%) for the standard text. In total, 21 reminder letters were sent. The additional cost of personalised text messages was £0.04 per participant retained. Conclusions: Personalised texts were not superior to standard texts in any outcome assessed in our study. Further SWATs are needed to perform a meta-analysis and obtain more evidence. Registration: ISRCTN22202133; SWAT 35.

Project description:BackgroundLow completion rates of questionnaires in randomised controlled trials can compromise the reliability of the results, so ways to boost questionnaire completion are often implemented. Although there is evidence to suggest that sending a text message to participants increases completion, there is little evidence around the timing or personalisation of these text messages. Methods: A two-by-two factorial SWAT (study within a trial) was embedded within the MiQuit-3 trial, looking at smoking cessation within pregnant smokers. Participants who reached their 36-week gestational follow-up were randomised to receive a personalised or non-personalised text message, either one week or one day prior to their follow-up. Primary outcomes were completion rate of questionnaire via telephone. Secondary outcomes included: completion rate via any method, time to completion, and number of attempts to contact required. Results In total 194 participants were randomised into the SWAT to receive a text message that was personalised early(n=50), personalised late (n=47), non-personalised early(n=50), or non-personalised late(n=47). There was no evidence that timing of the text message (early: one week before; or late: one day before) had an effect on any of the outcomes. There was evidence that a personalised text message would result in fewer completions compared with a non-personalised text message when data was collected only via the telephone(adjusted OR 0.44, 95% CI 0.22-0.87, p=0.02). However, these results were not significant when looking at completion via any method (adjusted OR 0.61, 95% CI 0.30-1.24, p=0.17). There was no evidence to show that personalisation or not was better for any of the secondary outcomes. Conclusion Timing of the text message does not appear to influence the completion of questionnaires. Personalisation of a text message may be detrimental to questionnaire completion, if data is only collected via the telephone - however, more SWATs should be undertaken in this field.

Project description:BACKGROUND: The feasibility of randomized trials often depends on successful patient recruitment. Although numerous recruitment barriers have been identified it is unclear which of them complicate recruitment most. Also, most surveys have focused on the patients' perspective of recruitment barriers whereas the perspective of recruiting physicians has received less attention. Therefore, our aim was to conduct a postal survey among recruiting physicians of a multi-center trial to weigh barriers according to their impact on recruitment. METHODS: We identified any potential recruitment barriers from the literature and from our own experience with a multi-center trial of respiratory rehabilitation in patients with chronic obstructive pulmonary disease. We developed and pilot-tested a self-administered questionnaire where recruiting physicians were asked to express their agreement with statements about recruitment barriers on a Likert-type scale from 1 (full agreement with statement = very substantial recruitment barrier) to 7 (no agreement with statement = no recruitment barrier). RESULTS: 38 of 55 recruiting physicians returned questionnaires (69% response rate), of which 35 could be analyzed (64% useable response rate). Recruiting physicians reported that "time constraints" (median agreement of 3, interquartile range 2-5) had the most negative impact on recruitment followed by "difficulties including identified eligible patients" (median agreement of 5, IQR 3-6). Other barriers such as "trial design barriers", "lack of access to treatment", "individual barriers of recruiting physicians" or "insufficient training of recruiting physicians" were perceived to have little or no impact on patient recruitment. CONCLUSION: Physicians perceived time constraints as the most relevant recruitment barrier in a randomized trial. To overcome recruitment barriers interventions, that are affordable for both industry- and investigator-driven trials, need to be developed and tested in randomized trials. TRIAL REGISTRATION: ISRCTN84612310.

Dataset Information

Effect of questionnaire length, personalisation and reminder type on response rate to a complex postal survey: randomised controlled trial.

Publications

Effect of questionnaire length, personalisation and reminder type on response rate to a complex postal survey: randomised controlled trial.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets