Dataset Information

Recruiting Participants for Population Health Intervention Research: Effectiveness and Costs of Recruitment Methods for a Cohort Study.

ABSTRACT:

Background

Public health research studies often rely on population-based participation and draw on various recruitment methods to establish samples. Increasingly, researchers are turning to web-based recruitment tools. However, few studies detail traditional and web-based recruitment efforts in terms of costs and potential biases.

Objective

This study aims to report on and evaluate the cost-effectiveness, time effectiveness, and sociodemographic representation of diverse recruitment methods used to enroll participants in 3 cities of the Interventions, Research, and Action in Cities Team (INTERACT) study, a cohort study conducted in Canadian cities.

Methods

Over 2017 and 2018 in Vancouver, Saskatoon, and Montreal, the INTERACT study used the following recruitment methods: mailed letters, social media (including sponsored Facebook advertisements), news media, partner communications, snowball recruitment, in-person recruitment, and posters. Participation in the study involved answering web-based questionnaires (at minimum), activating a smartphone app to share sensor data, and wearing a device for mobility and physical activity monitoring. We describe sociodemographic characteristics by the recruitment method and analyze performance indicators, including cost, completion rate, and time effectiveness. Effectiveness included calculating cost per completer (ie, a participant who completed at least one questionnaire), the completion rate of a health questionnaire, and the delay between completion of eligibility and health questionnaires. Cost included producing materials (ie, printing costs), transmitting recruitment messages (ie, mailing list rental, postage, and sponsored Facebook posts charges), and staff time. In Montreal, the largest INTERACT sample, we modeled the number of daily recruits through generalized linear models accounting for the distributed lagged effects of recruitment campaigns.

Results

Overall, 1791 participants were recruited from 3 cities and completed at least one questionnaire: 318 in Vancouver, 315 in Saskatoon, and 1158 in Montreal. In all cities, most participants chose to participate fully (questionnaires, apps, and devices). The costs associated with a completed participant varied across recruitment methods and by city. Facebook advertisements generated the most recruits (n=687), at a cost of CAD $15.04 (US $11.57; including staff time) per completer. Mailed letters were the costliest, at CAD $108.30 (US $83.3) per completer but served to reach older participants. All methods resulted in a gender imbalance, with women participating more, specifically with social media. Partner newsletters resulted in the participation of younger adults and were cost-efficient (CAD $5.16 [US $3.97] per completer). A generalized linear model for daily Montreal recruitment identified 2-day lag effects on most recruitment methods, except for the snowball campaign (4 days), letters (15 days), and reminder cards (5 days).

Conclusions

This study presents comprehensive data on the costs, effectiveness, and bias of population recruitment in a cohort study in 3 Canadian cities. More comprehensive documentation and reporting of recruitment efforts across studies are needed to improve our capacity to conduct inclusive intervention research.

SUBMITTER: Wasfi R

PROVIDER: S-EPMC8663714 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Background/aimsPrediabetes and diabetes disproportionately impact Latino youth, yet few diabetes prevention programs have prioritized inclusion of this underrepresented population. This report describes the recruitment process, yields, associated costs, and phenotypic characteristics of Latino youth with obesity and prediabetes enrolled in a randomized controlled diabetes prevention study in the USA.MethodsRecruitment efforts included referrals from clinics, community outlets, local media, and word of mouth with the goal of enrolling 120 Latino adolescents aged 12-16 with obesity (BMI > 95th percentile) and prediabetes. Prediabetes eligibility was determined by any of the following: HbA1c between 5.7 and 6.5%, fasting glucose between 100 and 125 mg/dL, or a 2-h glucose between 120 and 199 mg/dL following a 75-g oral glucose tolerance test (OGTT), but not meeting any of the diagnostic criteria for diabetes. Eligible participants were randomized 2:1 to either a 6-month community-based lifestyle intervention that included group nutrition and health education classes (1 day/week) and group exercise classes (2 days/week) or usual care control arm. Recruitment yields were determined by review of referral source in the study screening database. Recruitment costs were determined by an after-the-fact financial review of actual and in-kind costs. Participant phenotypic characteristics (i.e., demographics, anthropometrics, and biochemical data) were compared by recruitment strategy using a one-way ANOVA.ResultsRecruitment efforts covered 160 mile2 (414 km2) across 26 ZIP codes (postcode) in the Phoenix Metropolitan Area and yielded 655 referrals from clinics (n = 344), community (n = 143), media (n = 137), and word-of-mouth (n = 31). From this pool, 26% (n = 167) did not meet general, pre-screening eligibility criteria; 29% (n = 187) declined participation; and 10% (n = 64) were unable to be contacted. A total of 237 youth were invited to the clinical research unit to determine final eligibility. Following the OGTT, 52% (n = 122) met prediabetes criteria and 117 were subsequently randomized. Clinical recruitment yielded the highest number of referrals (53%; n = 344) while word-of-mouth yielded the highest proportion (35%; n = 11) of randomized participants per referred youth. There were no significant differences in anthropometric or biochemical measures among youth by recruitment strategy. Based upon final enrollment numbers, community recruitment was the costliest approach ($486/randomized participant) followed by clinical ($248/randomized participant) and media ($236/randomized participant).ConclusionsThe ability to meet enrollment goals for a clinical trial of an underrepresented population required multiple recruitment strategies. Although strategies vary in yields and costs, it appears they produce similar phenotypical risk profiles of eligible youth.Trial registrationClinicalTrials.gov NCT02615353 . Registered on 26 November 2015.

Project description:BackgroundLimited regulatory guidance surrounding the use of social media channels for participant recruitment is an interdisciplinary challenge. Establishing stakeholder-informed procedures is essential for ethical and effective use of social media for participant recruitment.ObjectiveThis study aims to provide replicable procedures for developing and implementing guidelines for using social media to recruit participants in research studies.MethodsSocial media use cases at the university were used to identify institutional stakeholders for the initiative. After establishing workflow procedures, a scoping review of web-based materials about recruitment and research on the internet and social media from 19 peer institutions and 2 federal agencies was conducted to inform the structure of the policies and procedures. End users (investigators and study coordinators; N=14) also provided feedback on the policies and procedures and implementation.ResultsRepresentatives (n=7) from 5 institutional offices and 15 subject-matter experts from 5 areas were identified as stakeholders in the development of policies and procedures. Peers with web-based materials (n=16) identified in the scoping review revealed 4 themes that served as a basis for developing our policies and procedures. End user feedback further informed the policies and procedures and implementation. A centrally managed social media account for communicating with participants and hosting advertising campaigns on social media was also established and, when combined with the policies and procedures, resulted in 39 advertising campaigns, and 2846 participants were enrolled in health and clinical research studies.ConclusionsOur policies and procedures allow research teams to harness the potential of social media to increase study recruitment and participation; the transparent, stakeholder-informed process can be replicated by institutional administrators to establish policies and procedures that meet the interests and needs of their research community.

Project description:BackgroundSocial media is a popular online tool that allows users to communicate and exchange information. It allows digital content such as pictures, videos and websites to be shared, discussed, republished and endorsed by its users, their friends and businesses. Adverts can be posted and promoted to specific target audiences by demographics such as region, age or gender. Recruiting for health research is complex with strict requirement criteria imposed on the participants. Traditional research recruitment relies on flyers, newspaper adverts, radio and television broadcasts, letters, emails, website listings, and word of mouth. These methods are potentially poor at recruiting hard to reach demographics, can be slow and expensive. Recruitment via social media, in particular Facebook, may be faster and cheaper.ObjectiveThe aim of this study was to systematically review the literature regarding the current use and success of Facebook to recruit participants for health research purposes.MethodsA literature review was completed in March 2017 in the English language using MEDLINE, EMBASE, Web of Science, PubMed, PsycInfo, Google Scholar, and a hand search of article references. Papers from the past 12 years were included and number of participants, recruitment period, number of impressions, cost per click or participant, and conversion rate extracted.ResultsA total of 35 studies were identified from the United States (n=22), Australia (n=9), Canada (n=2), Japan (n=1), and Germany (n=1) and appraised using the Critical Appraisal Skills Programme (CASP) checklist. All focused on the feasibility of recruitment via Facebook, with some (n=10) also testing interventions, such as smoking cessation and depression reduction. Most recruited young age groups (16-24 years), with the remaining targeting specific demographics, for example, military veterans. Information from the 35 studies was analyzed with median values being 264 recruited participants, a 3-month recruitment period, 3.3 million impressions, cost per click of US $0.51, conversion rate of 4% (range 0.06-29.50), eligibility of 61% (range 17-100), and cost per participant of US $14.41. The studies showed success in penetrating hard to reach populations, finding the results representative of their control or comparison demographic, except for an over representation of young white women.ConclusionsThere is growing evidence to suggest that Facebook is a useful recruitment tool and its use, therefore, should be considered when implementing future health research. When compared with traditional recruitment methods (print, radio, television, and email), benefits include reduced costs, shorter recruitment periods, better representation, and improved participant selection in young and hard to reach demographics. It however, remains limited by Internet access and the over representation of young white women. Future studies should recruit across all ages and explore recruitment via other forms of social media.

Project description:BackgroundWeb-based behavioral programs efficiently disseminate health information to a broad population, and online tailoring may increase their effectiveness. While the number of Internet-based behavioral interventions has grown in the last several years, additional information is needed to understand the characteristics of subjects who enroll in these interventions, relative to those subjects who are invited to enroll.ObjectiveThe aim of the study was to compare the characteristics of participants who enrolled in an online dietary intervention trial (MENU) with those who were invited but chose not to participate, in order to better understand how these groups differ.MethodsThe MENU trial was conducted among five health plans participating in the HMO Cancer Research Network in collaboration with the University of Michigan Center for Health Communication Research. Approximately 6000 health plan members per site, between the ages of 21 and 65, and stratified by gender with oversampling of minority populations, were randomly selected for recruitment and were mailed an invitation letter containing website information and a US$2 bill with the promise of US$20 for completing follow-up surveys. Administrative and area-based data using geocoding along with baseline survey data were used to compare invitees (HMO members sent the introductory letter), responders (those who entered a study ID on the website), and enrollees (those who completed the enrollment process). Generalized estimating equation multivariate and logistic regression models were used to assess predictors of response and enrollment.ResultsOf 28,460 members invited to participate, 4270 (15.0%) accessed the website. Of the eligible responders, 2540 (8.9%) completed the consent form and baseline survey and were enrolled and randomized. The odds of responding were 10% lower for every decade of increased age (P < .001), while the likelihood of enrolling was 10% higher for every decade increase in age (P < .001). Women were more likely to respond and to enroll (P < .001). Those living in a census tract associated with higher education levels were more likely to respond and enroll, as well as those residing in tracts with higher income (P < .001). With a 22% (n = 566) enrollment rate for African Americans and 8% (n = 192) for Hispanics, the enrolled sample was more racially and ethnically diverse than the background sampling frame.ConclusionsRelative to members invited to participate in the Internet-based intervention, those who enrolled were more likely to be older and live in census tracts associated with higher socioeconomic status. While oversampling of minority health plan members generated an enrolled sample that was more racially and ethnically diverse than the overall health plan population, additional research is needed to better understand methods that will expand the penetration of Internet interventions into more socioeconomically diverse populations.Trial registrationClinicaltrials.gov NCT00169312; http://clinicaltrials.gov/ct2/show/NCT00169312 (Archived by WebCite at http://www.webcitation.org/5jB50xSfU).