Dataset Information

Assessing respondent-driven sampling.

ABSTRACT: Respondent-driven sampling (RDS) is a network-based technique for estimating traits in hard-to-reach populations, for example, the prevalence of HIV among drug injectors. In recent years RDS has been used in more than 120 studies in more than 20 countries and by leading public health organizations, including the Centers for Disease Control and Prevention in the United States. Despite the widespread use and growing popularity of RDS, there has been little empirical validation of the methodology. Here we investigate the performance of RDS by simulating sampling from 85 known, network populations. Across a variety of traits we find that RDS is substantially less accurate than generally acknowledged and that reported RDS confidence intervals are misleadingly narrow. Moreover, because we model a best-case scenario in which the theoretical RDS sampling assumptions hold exactly, it is unlikely that RDS performs any better in practice than in our simulations. Notably, the poor performance of RDS is driven not by the bias but by the high variance of estimates, a possibility that had been largely overlooked in the RDS literature. Given the consistency of our results across networks and our generous sampling conditions, we conclude that RDS as currently practiced may not be suitable for key aspects of public health surveillance where it is now extensively applied.

SUBMITTER: Goel S

PROVIDER: S-EPMC2872407 | biostudies-literature | 2010 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Assessing respondent-driven sampling.

Goel Sharad S Salganik Matthew J MJ

Proceedings of the National Academy of Sciences of the United States of America 20100329 15

Respondent-driven sampling (RDS) is a network-based technique for estimating traits in hard-to-reach populations, for example, the prevalence of HIV among drug injectors. In recent years RDS has been used in more than 120 studies in more than 20 countries and by leading public health organizations, including the Centers for Disease Control and Prevention in the United States. Despite the widespread use and growing popularity of RDS, there has been little empirical validation of the methodology. ...[more]

PMID: 20351258

Similar Datasets

Project description:Respondent-driven sampling is a novel variant of link-tracing sampling for estimating the characteristics of hard-to-reach groups, such as HIV prevalence in sex workers. Despite its use by leading health organizations, the performance of this method in realistic situations is still largely unknown. We evaluated respondent-driven sampling by comparing estimates from a respondent-driven sampling survey with total population data.Total population data on age, tribe, religion, socioeconomic status, sexual activity, and HIV status were available on a population of 2402 male household heads from an open cohort in rural Uganda. A respondent-driven sampling (RDS) survey was carried out in this population, using current methods of sampling (RDS sample) and statistical inference (RDS estimates). Analyses were carried out for the full RDS sample and then repeated for the first 250 recruits (small sample).We recruited 927 household heads. Full and small RDS samples were largely representative of the total population, but both samples underrepresented men who were younger, of higher socioeconomic status, and with unknown sexual activity and HIV status. Respondent-driven sampling statistical inference methods failed to reduce these biases. Only 31%-37% (depending on method and sample size) of RDS estimates were closer to the true population proportions than the RDS sample proportions. Only 50%-74% of respondent-driven sampling bootstrap 95% confidence intervals included the population proportion.Respondent-driven sampling produced a generally representative sample of this well-connected nonhidden population. However, current respondent-driven sampling inference methods failed to reduce bias when it occurred. Whether the data required to remove bias and measure precision can be collected in a respondent-driven sampling survey is unresolved. Respondent-driven sampling should be regarded as a (potentially superior) form of convenience sampling method, and caution is required when interpreting findings based on the sampling method.

Project description:BackgroundInternationally, wheelchair users are an emerging demographic phenomenon, due to their increased prevalence and rapidly increasing life-span. While having significant healthcare implications, basic robust epidemiological information about wheelchair users is often lacking due, in part, to this population's 'hidden' nature. Increasingly popular in epidemiological research, Respondent Driven Sampling (RDS) provides a mechanism for generating unbiased population-based estimates for hard-to-reach populations, overcoming biases inherent within other sampling methods. This paper reports the first published study to employ RDS amongst wheelchair users.MethodsBetween October 2015 and January 2016, a short, successfully piloted, internet-based national survey was initiated. Twenty seeds from diverse organisations were invited to complete the survey then circulate it to peers within their networks following a well-defined protocol. A predetermined reminder protocol was triggered when seeds or their peers failed to respond. All participants were entered into a draw for an iPad.ResultsOverall, 19 people participated (nine women); 12 initial seeds, followed by seven second-wave participants arising from four seeds . Completion time for the survey ranged between 7 and 36 minutes. Despite repeated reminders, no further people were recruited.DiscussionWhile New Zealand wheelchair user numbers are unknown, an estimated 14% of people have physical impairments that limited mobility. The 19 respondents generated from adopting the RDS methodology here thus represents a negligible fraction of wheelchair users in New Zealand, and an insufficient number to ensure equilibrium required for unbiased analyses. While successful in other hard-to-reach populations, applying RDS methodology to wheelchair users requires further consideration. Formative research exploring areas of network characteristics, acceptability of RDS, appropriate incentive options, and seed selection amongst wheelchair users is needed.

Dataset Information

Assessing respondent-driven sampling.

Publications

Assessing respondent-driven sampling.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets