Dataset Information

A Critical Assessment of Bias in Survey Studies Using Location-Based Sampling to Recruit Patrons in Bars.

ABSTRACT: Location-based sampling is a method to obtain samples of people within ecological contexts relevant to specific public health outcomes. Random selection increases generalizability; however, in some circumstances (such as surveying bar patrons), recruitment conditions increase risks of sample bias. We attempted to recruit representative samples of bars and patrons in six California cities, but low response rates precluded meaningful analysis. A systematic review of 24 similar studies revealed that none addressed the key shortcomings of our study. We recommend steps to improve studies that use location-based sampling: (i) purposively sample places of interest, (ii) use recruitment strategies appropriate to the environment, and (iii) provide full information on response rates at all levels of sampling.

SUBMITTER: Morrison C

PROVIDER: S-EPMC5062950 | biostudies-literature | 2015

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A Critical Assessment of Bias in Survey Studies Using Location-Based Sampling to Recruit Patrons in Bars.

Morrison Christopher C Lee Juliet P JP Gruenewald Paul J PJ Marzell Miesha M

Substance use & misuse 20150101 11

Location-based sampling is a method to obtain samples of people within ecological contexts relevant to specific public health outcomes. Random selection increases generalizability; however, in some circumstances (such as surveying bar patrons), recruitment conditions increase risks of sample bias. We attempted to recruit representative samples of bars and patrons in six California cities, but low response rates precluded meaningful analysis. A systematic review of 24 similar studies revealed tha ...[more]

PMID: 26574657

Similar Datasets

Project description:BACKGROUND:Facebook has shown promise as an economical means of recruiting participants for health research. However, few studies have evaluated this recruitment method in Canada, fewer still targeting older adults, and, to our knowledge, none specifically in Newfoundland and Labrador (NL). OBJECTIVE:This study aimed to assess Facebook advertising as an economical means of recruiting a representative sample of adults aged 35 to 74 years in NL for a cross-sectional health survey. METHODS:Facebook advertising was used to recruit for a Web-based survey on cancer awareness and prevention during April and May 2018; during recruitment, additional advertisements were targeted to increase representation of demographics that we identified as being underrepresented in our sample. Sociodemographic and health characteristics of the study sample were compared with distributions of the underlying population to determine representativeness. Cramer V indicates the magnitude of the difference between the sample and population distributions, interpreted as small (Cramer V=0.10), medium (0.30), and large (0.50). Sample characteristics were considered representative if there was no statistically significant difference in distributions (chi-square P>.01) or if the difference was small (V?0.10), and practically representative if 0.10<V?0.20. The cost per recruit of Facebook advertising was compared with a quote for a random digit dialing (RDD)-recruited postal survey to determine if this method was economical. RESULTS:Facebook advertising is feasible and economical to conduct survey research, reaching 34,012 people, of which 2067 clicked on the ad, for a final sample size of 1048 people at Can $2.18 per recruit versus the quoted Can $23,316.05 for 400 recruits (Can $35.52 per recruit) via RDD. The sample was representative of rural and urban geography (P=.02; V=0.073), practically representative of age (P=.003; V=0.145) and income (P<.001; V=0.188), and over-representative of women (P<.001; V=0.507) and higher levels of education (P<.001; V=0.488). The sample was representative of the proportion of people with a regular health care provider (P=.94; V=0.025), diabetes prevalence (P=.002; V=0.096), and having had a colonoscopy or sigmoidoscopy (P=.27; V=0.034), and it was practically representative of smoking status (P<.001; V=0.14), and body mass index (P<.001; V=0.135). The sample was not representative of arthritis prevalence (P<.001; V=0.573), perceived health (P<.001; V=0.384), or time since last seasonal flu shot (P<.001; V=0.449). CONCLUSIONS:Facebook advertising offers an easy, rapid, and economical means to recruit a partially representative (representative or practically representative of 8 of the 13 characteristics studied) sample of middle-aged and older adults for health survey research. As Facebook uses a nonrandom targeting algorithm, caution is warranted in its applications for certain types of research.

Dataset Information

A Critical Assessment of Bias in Survey Studies Using Location-Based Sampling to Recruit Patrons in Bars.

Publications

A Critical Assessment of Bias in Survey Studies Using Location-Based Sampling to Recruit Patrons in Bars.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets