Dataset Information

Does advance contact with research participants increase response to questionnaires: an updated systematic review and meta-analysis.

ABSTRACT:

Background

Questionnaires remain one of the most common forms of data collection in epidemiology, psychology and other human-sciences. However, results can be badly affected by non-response. One way to potentially reduce non-response is by sending potential study participants advance communication. The last systematic review to examine the effect of questionnaire pre-notification on response is 10 years old, and lacked a risk of bias assessment.

Objectives

Update the section of the Cochrane systematic review, Edwards et al. (2009), on pre-notification to include 1) recently published studies, 2) an assessment of risk of bias, 3) Explore if heterogeneity is reduced by: delay between pre-contact and questionnaire delivery, the method of pre-contact, if pre-contact and questionnaire delivery differ, if the pre-contact includes a foot-in-the-door manipulation, and study's the risk of bias.

Methods

Inclusion criteria: population: any population, intervention: comparison of some type of pre-notification, comparison group: no pre-notification, outcome: response rates.

Study design

randomised controlled trails.

Exclusion criteria

NA.

Data sources

Studies which cited or were included in Edwards et al. (2009); We additionally searched: CINAHL, Web of Science, PsycInfo, MEDLINE, EconLit, EMBASE, Cochrane Central, Cochrane CMR, ERIC, and Sociological Abstracts. The searches were implemented in June 2018 and May 2021. Study screening: a single reviewer screened studies, with a random 10% sample independently screened to ascertain accuracy.

Data extraction

data was extracted by a single reviewer twice, with a week between each extraction. Risk of Bias: within studies bias was assessed using the Cochrane Risk of Bias tool (ROB1) by a single unblinded reviewer, across studies bias was assessed using funnel plots. Synthesis Method: study results were meta-analysed with a random effects model using the final response rate as the outcome. Evaluation of Uncertainty: Uncertainty was evaluated using the GRADE approach.

Results

One hundred seven trials were included with 211,802 participants. Over-all pre-notification increased response, OR = 1.33 (95% CI: 1.20-1.47). However, there was a large amount of heterogeneity (I² = 97.1%), which was not explained by the subgroup analyses. In addition, when studies at high or unclear risk of bias were excluded the effect was to reduced OR = 1.09 (95% CI: 0.99-1.20). Because of the large amount of heterogeneity, even after restricting to low risk of bias studies, there is still moderate uncertainty in these results.

Conclusions

Using the GRADE evaluation, this review finds moderate evidence that pre-notification may not have an effect on response rates.

Funding

Economic and Social Research Council.

Preregistration

None.

SUBMITTER: Woolf B

PROVIDER: S-EPMC8627623 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundFormer participants in sports characterised by low intensity repetitive head impact appear to have elevated rates of later dementia, but links with other psychological health outcomes such as depression and suicide are uncertain. We quantified the occurrence of these endpoints in former contact sports athletes against general population controls using new data from a cohort study and a meta-analysis.MethodsThe cohort study comprised 2004 retired male athletes, who had competed internationally as amateurs for Finland across a range of sports, and 1385 general population controls. All study members were linked to mortality and hospitalisation registries. In the PROSPERO-registered systematic review (CRD42022352780), we searched PubMed and Embase to October 31 2022 for cohort studies that reported standard estimates of association and precision. Study-specific estimates were aggregated in a random-effect meta-analysis. The Newcastle-Ottawa Scale was used to appraise the quality of each study.FindingsIn survival analyses of the Finnish cohort data, former boxers (depression: hazard ratio 1.43 [95% CI 0.73, 2.78]; suicide: 1.75 [0.64, 4.38]), Olympic-style wrestlers (depression: 0.94 [0.44, 2.00]; suicide: 1.60 [0.64, 3.99]), and soccer players (depression: 0.62 [0.26, 1.48]; suicide: 0.50 [0.11, 2.16]) did not have statistically higher rates of major depressive disorder or suicide at follow-up relative to controls. In the systematic review, 7 cohort studies met inclusion criteria. After aggregating results with the Finnish cohort, retired soccer players appeared to have a lower risk of depression (summary risk ratio: 0.71 [0.54, 0.93]) relative to general population controls, while the rate of suicide was statistically the same across groups (0.70 [0.40, 1.23]). Past participation in American football seemed to be associated with some protection against suicide (0.58 [0.43, 0.80]) but there were insufficient studies of depression in this sport to facilitate aggregation. The aggregation of results from the soccer and American football studies showed directionally consistent relationships and there was no indication of inter-study heterogeneity (I2 = 0%).InterpretationBased on a small cluster of studies exclusively comprising men, retired soccer players had a lower rate of later depression and former American football players had a lower risk of suicide relative to comparator groups. Whether these findings are generalisable to women requires testing.FundingThe preparation of this manuscript was unfunded.

Project description:BackgroundQuestionnaires provide valuable information about physical activity (PA) behaviors in older adults. Until now, no firm recommendations for the most qualified questionnaires for older adults have been provided.ObjectivesThis review is an update of a previous systematic review, published in 2010, and aims to summarize, appraise and compare the measurement properties of all available self-administered questionnaires assessing PA in older adults.MethodsWe included the articles evaluated in the previous review and conducted a new search in PubMed, Embase, and SPORTDiscus from September 2008 to December 2019, using the following inclusion criteria (1) the purpose of the study was to evaluate at least one measurement property (reliability, measurement error, hypothesis testing for construct validity, responsiveness) of a self-administered questionnaire; (2) the questionnaire intended to measure PA; (3) the questionnaire covered at least one domain of PA; (4) the study was performed in the general, healthy population of older adults; (5) the mean age of the study population was >?55 years; and (6) the article was published in English. Based on the Quality Assessment of Physical Activity Questionnaires (QAPAQ) checklist, we evaluated the quality and results of the studies. The content validity of all included questionnaires was also evaluated using the reviewers' rating. The quality of the body of evidence was evaluated for the overall construct of each questionnaire (e.g., total PA), moderate-to-vigorous physical activity (MVPA) and walking using a modified Grading of Recommendation, Assessment, Development, and Evaluation (GRADE) approach.ResultsIn total, 56 articles on 40 different questionnaires (14 from the previous review and 26 from the update) were included. Reliability was assessed for 22, measurement error for four and hypotheses testing for construct validity for 38 different questionnaires. Evidence for responsiveness was available for one questionnaire. For many questionnaires, only one measurement property was assessed in only a single study. Sufficient content validity was considered for 22 questionnaires. All questionnaires displayed large measurement errors. Only versions of two questionnaires showed both sufficient reliability and hypotheses testing for construct validity, namely the Physical Activity Scale for the Elderly (PASE; English version, Turkish version) for the assessment of total PA, and the Physical Activity and Sedentary Behavior Questionnaire (PASB-Q; English version) for the assessment of MVPA. The quality of evidence for these results ranged from very low to high.ConclusionsUntil more high-quality evidence is available, we recommend the PASE for measuring total PA and the PASB-Q for measuring MVPA in older adults. However, they are not equally qualified among different languages. Future studies on the most promising questionnaires should cover all relevant measurement properties. We recommend using and improving existing PA questionnaires-instead of developing new ones-and considering the strengths and weaknesses of each PA measurement instrument for a particular purpose.

Project description:To establish the empirical evidence base for the information that participants want to know about medical research and to assess how this relates to current guidance from the National Research Ethics Service (NRES). Medline, Web of Science, Applied Social Sciences Index and Abstracts, Sociological abstracts, Health Management Information Consortium, Cochrane Library, thesis index's, grey literature databases, reference and cited article lists, key journals, Google Scholar and correspondence with expert authors. Original research studies published between 1950 and October 2010 that asked potential participants to indicate how much or what types of information they wanted to be told about a research study or asked them to rate the importance of a specific piece of information were included. Studies were appraised based on the generalisability of results to the UK potential research participant population. A metadata analysis using basic thematic analysis was used to split results from papers into themes based on the sections of information that NRES recommends should be included in a participant information sheet. 14 studies were included. Of the 20 pieces of information that NRES recommend should be included in patient information sheets for research pooled proportions could be calculated for seven themes. Results showed that potential participants wanted to be offered information about result dissemination (91% (95% CI 85% to 95%)), investigator conflicts of interest (48% (95% CI 27% to 69%)), the purpose of the study (76% (95% CI 27% to 100%)), voluntariness (39% (95% CI 2% to 100%)), how long the research would last (61% (95% CI 16% to 97%)), potential benefits (57% (95% CI 7% to 98%)) and confidentiality (44% (95% CI 10% to 82%)). The level of detail participants wanted to know was not explored comprehensively in the studies. There was no empirical evidence to support the level of information provision required by participants on the remaining seven items. There is limited empirical evidence on what potential participants want to know about research. The existing empirical evidence suggests that individuals may have very different needs and a more tailored evidence-based approach may be necessary.

Project description:ObjectivesTo improve clinical study developments for elderly populations, we aim to understand how they transfer their experiences into validated, standardised self-completed study measurement instruments. We analysed how women (mean 78±8 years of age) participating in a randomised controlled trial (RCT) cognised study instruments used to evaluate outcomes of the intervention.SettingThe interview study was nested in an RCT on chronic neck pain using common measurement instruments situated in an elderly community in Berlin, Germany, which comprised of units for independent and assisted-living options.ParticipantsThe sample (n=20 women) was selected from the RCT sample (n=117, 95% women, mean age 76 (SD±8) years). Interview participants were selected using a purposive sampling list based on the RCT outcomes.OutcomesWe asked participants about their experiences completing the RCT questionnaires. Interviews were analysed thematically, then compared with the questionnaires.ResultsInterviewees had difficulties in translating complex experiences into a single value on a scale and understanding the relationship of the questionnaires to study aims. Interviewees considered important for the trial that their actual experiences were understood by trial organisers. This information was not transferrable by means of the questionnaires. To rectify these difficulties, interviewees used strategies such as adding notes, adding response categories or skipping an item.ConclusionsElderly interview participants understood the importance of completing questionnaires for trial success. This led to strategies of completing the questionnaires that resulted in 'missing' or ambiguous data. To improve data collection in elderly populations, educational materials addressing the differential logics should be developed and tested. Pilot testing validated instruments using cognitive interviews may be particularly important in such populations. Finally, when the target of an intervention is a subjective experience, it seems important to create a method by which participants can convey their personal experiences. These could be nested qualitative studies.Trial registration numberISRCTN77108101807.

Project description:Systematic collection of fresh tissues for research at the time of diagnostic image-guided breast biopsy has the potential to fuel a wide variety of innovative studies. Here we report the initial experience, including safety, feasibility and laboratory proof-of-principle, with the collection and analysis of research specimens obtained via breast core needle biopsy immediately following routine clinical biopsy at a single institution over a 14-month period. Study eligibility criteria consisted of patients age 18 or older who were undergoing a clinical breast needle biopsy. Patients providing informed consent underwent one or two additional core biopsies following collection of all necessary clinical specimens. In total, 395 patients were approached and 270 consented to the research study, yielding a 68.4% consent rate. Among consenting patients, 238 lesions were biopsied for research, resulting in 446 research specimens collected. No immediate complications were observed. During the same period, zero complications were reported among the non-research procedures (1622 breast biopsy procedures). Representative research core specimens showed high diagnostic concordance with clinical core biopsies. Flow cytometry demonstrated consistent recovery of hundreds to thousands of viable cells per research core. Among a group of HER2+ tumor research specimens, HER2 assessment by flow cytometry correlated highly with immunohistochemistry (IHC) staining, and in addition revealed extensive inter- and intra-tumoral variation in HER2 levels of potential clinical relevance. Suitability for single-cell transcriptomic analysis was demonstrated for a triple-negative tumor core biopsy, revealing substantial cellular diversity in the tumor immune microenvironment, including a prognostically relevant T cell subpopulation. Thus, collection of fresh tissues for research purposes at the time of diagnostic breast biopsy is safe, feasible and efficient, and may provide a high-yield mechanism to generate a rich tissue repository for a wide variety of cross-disciplinary research.