Dataset Information

Participation and contribution in crowdsourced surveys.

ABSTRACT: This paper identifies trends within and relationships between the amount of participation and the quality of contributions in three crowdsourced surveys. Participants were asked to perform a collective problem solving task that lacked any explicit incentive: they were instructed not only to respond to survey questions but also to pose new questions that they thought might-if responded to by others-predict an outcome variable of interest to them. While the three surveys had very different outcome variables, target audiences, methods of advertisement, and lengths of deployment, we found very similar patterns of collective behavior. In particular, we found that: the rate at which participants submitted new survey questions followed a heavy-tailed distribution; the distribution in the types of questions posed was similar; and many users posed non-obvious yet predictive questions. By analyzing responses to questions that contained a built-in range of valid response we found that less than 0.2% of responses lay outside of those ranges, indicating that most participants tend to respond honestly to surveys of this form, even without explicit incentives for honesty. While we did not find a significant relationship between the quantity of participation and the quality of contribution for both response submissions and question submissions, we did find several other more nuanced participant behavior patterns, which did correlate with contribution in one of the three surveys. We conclude that there exists an optimal time for users to pose questions early on in their participation, but only after they have submitted a few responses to other questions. This suggests that future crowdsourced surveys may attract more predictive questions by prompting users to pose new questions at specific times during their participation and limiting question submission at non-optimal times.

SUBMITTER: Swain R

PROVIDER: S-EPMC4383627 | biostudies-literature | 2015

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Participation and contribution in crowdsourced surveys.

Swain Robert R Berger Alex A Bongard Josh J Hines Paul P

PloS one 20150402 3

This paper identifies trends within and relationships between the amount of participation and the quality of contributions in three crowdsourced surveys. Participants were asked to perform a collective problem solving task that lacked any explicit incentive: they were instructed not only to respond to survey questions but also to pose new questions that they thought might-if responded to by others-predict an outcome variable of interest to them. While the three surveys had very different outcome ...[more]

PMID: 25837602

Similar Datasets

Project description:BACKGROUND:Web-based crowdsourcing promotes the goals achieved effectively by gaining solutions from public groups via the internet, and it has gained extensive attention in both business and academia. As a new mode of sourcing, crowdsourcing has been proven to improve efficiency, quality, and diversity of tasks. However, little attention has been given to crowdsourcing in the health sector. OBJECTIVE:Crowdsourced health care information websites enable patients to post their questions in the question pool, which is accessible to all doctors, and the patients wait for doctors to respond to their questions. Since the sustainable development of crowdsourced health care information websites depends on the participation of the doctors, we aimed to investigate the factors influencing doctors' participation in providing health care information in these websites from the perspective of the elaboration-likelihood model. METHODS:We collected 1524 questions with complete patient-doctor interaction processes from an online health community in China to test all the hypotheses. We divided the doctors into 2 groups based on the sequence of the answers: (1) doctor who answered the patient's question first and (2) the doctors who answered that question after the doctor who answered first. All analyses were conducted using the ordinary least squares method. RESULTS:First, the ability of the doctor who first answered the health-related question was found to positively influence the participation of the following doctors who answered after the first doctor responded to the question (?offline1=.177, P<.001; ?offline2=.063, P=.048; ?online=.418, P<.001). Second, the reward that the patient offered for the best answer showed a positive effect on doctors' participation (?=.019, P<.001). Third, the question's complexity was found to positively moderate the relationships between the ability of the first doctor who answered and the participation of the following doctors (?=.186, P=.05) and to mitigate the effect between the reward and the participation of the following doctors (?=-.003, P=.10). CONCLUSIONS:This study has both theoretical and practical contributions. Online health community managers can build effective incentive mechanisms to encourage highly competent doctors to participate in the provision of medical services in crowdsourced health care information websites and they can increase the reward incentives for each question to increase the participation of the doctors.

Project description:BackgroundImproving response rates in epidemiologic studies is important for the generalizability of the outcome. The aim of this study was to examine whether it can be advantageous for participation to target different versions of the cover letters to different sample subgroups.MethodsA randomized trial was incorporated in a cross-sectional health survey in Denmark (n = 25,000) where a motivational sentence in the cover letter intended to heighten perceptions of relevance of the survey was varied among 11 sample subgroups (treatment groups). Ten different versions of a sentence outlining questionnaire themes were tested: each mentioned three out of five themes: stress, alcohol, sex, sleep problems, and contact with family and friends. An eleventh group, the control group, omitted this sentence.ResultsOn average, the additional motivational sentence resulted in a significantly lower response rate overall compared to the control group. However, the additional motivational sentence was found to have heterogeneous effects on survey response. Furthermore, the nature of the heterogeneity differed between the versions of the sentence. Specifically, the additional sentence tended to produce a higher response rate among the youngest age group and a lower response rate in the oldest age group compared to the generic letter. The use of alcohol in the motivational sentence tended to have a positive effect on response in the age group 16-24 years, and stress tended to have a positive effect in the age group ≥65 years. On the contrary, sex tended to have a negative effect in the age groups 45-64 years and ≥ 65 years. However, a significant interaction was only found between the use of stress and age group (p = < 0.0001).ConclusionThe findings of significant and heterogeneous effects suggest that there is potential for a targeted approach to improve both response rates and sample composition. The uneven effect of the separate themes across age groups suggests that the selection of themes to be included in the motivational sentence is important for the use of targeted appeals to be successful and warrants further research to better identify which themes works in which contexts, in which subgroups and under which circumstances.Trial registrationClinicalTrials.gov ID: NCT03046368 , retrospectively registered February 8th, 2017.

Project description:AimsBy the end of 2022, an estimated 108.4 million individuals worldwide experienced forced displacement. Identifying modifiable factors associated with the mental illness of refugees is crucial for promoting successful integration and developing effective health policies. This study aims to examine the associations between the changes in the diversity of social participation and psychological distress among refugees throughout the resettlement process, specifically focusing on gender differences.MethodsUtilizing data from three waves of a longitudinal, nationally representative cohort study conducted in Australia, this study involved 2399 refugees interviewed during Wave 1, 1894 individuals interviewed during Wave 3 and 1881 respondents during Wave 5. At each wave, we assessed psychological distress and 10 types of social participation across 3 distinct dimensions, including social activities, employment and education. The primary analysis employed mixed linear models and time-varying Cox models. Gender-stratified analyses and sensitivity analyses were performed.ResultsRefugees engaging in one type or two or more types of social participation, compared with those not engaging in any, consistently had lower psychological distress scores (β = -0.62 [95% confidence interval (CI), -1.07 to -0.17] for one type of social participation; β = -0.57 [95% CI, -1.04 to -0.10] for two or more types of social participation) and a reduced risk of experiencing psychological distress (hazard ratio [HR] = 0.81 [95% CI, 0.65-0.99] for one type of social participation; HR = 0.77 [95% CI, 0.61-0.97] for two or more types of social participation) during the resettlement period. When stratifying the results by gender, these associations in the adjusted models only remained significant in male refugees. Moreover, three specific types of social participation, namely sporting activities, leisure activities and current employment status, were most prominently associated with a reduced risk of psychological distress.ConclusionsThe findings of this cohort study suggest that social participation was consistently associated with reduced risks of psychological distress among male refugees during resettlement. These findings highlight the significance of promoting meaningful social participation and interaction may be an effective strategy to improve the mental health of refugees and facilitate their successful integration into society, especially among male refugees.

Project description:Children's after-school physical activity (PA) and sedentary behaviours (SB) are not well understood, despite the potential this period holds for intervention. This study aimed to describe children's after-school physical activity and sedentary behaviours; establish the contribution this makes to daily participation and to achieving physical activity and sedentary behaviours guidelines; and to determine the association between after-school moderate- to vigorous-intensity physical activity (MVPA), screen-based sedentary behaviours and achieving the physical activity and sedentary behaviour guidelines.Children (n = 406, mean age 8.1 years, 58% girls) wore an ActiGraph GT3X accelerometer. The percentage of time and minutes spent sedentary (SED), in light- physical activity (LPA) and MVPA between the end-of-school and 6pm (weekdays) was calculated. Parents (n = 318, 40 years, 89% female) proxy-reported their child's after-school participation in screen-based sedentary behaviours. The contribution that after-school SED, LPA, MVPA, and screen-based sedentary behaviours made to daily levels, and that after-school MVPA and screen-based sedentary behaviours made to achieving the physical activity/sedentary behaviour guidelines was calculated. Regression analysis determined the association between after-school MVPA and screen-based sedentary behaviours and achieving the physical activity/sedentary behaviours guidelines.Children spent 54% of the after-school period SED, and this accounted for 21% of children's daily SED levels. Boys spent a greater percentage of time in MVPA than girls (14.9% vs. 13.6%; p<0.05), but this made a smaller contribution to their daily levels (27.6% vs 29.8%; p<0.05). After school, boys and girls respectively performed 18.8 minutes and 16.7 minutes of MVPA, which is 31.4% and 27.8% of the MVPA (p<0.05) required to achieve the physical activity guidelines. Children spent 96 minutes in screen-based sedentary behaviours, contributing to 84% of their daily screen-based sedentary behaviours and 80% of the sedentary behaviour guidelines. After-school MVPA was positively associated with achieving the physical activity guidelines (OR: 1.31, 95%CI 1.18, 1.44, p<0.05), and after-school screen-based sedentary behaviours were negatively associated with achieving the sedentary behaviours guidelines (OR: 0.97, 95%CI: 0.96, 0.97, p<0.05).The after-school period plays a critical role in the accumulation of children's physical activity and sedentary behaviours. Small changes to after-school behaviours can have large impacts on children's daily behaviours levels and likelihood of meeting the recommended levels of physical activity and sedentary behaviour. Therefore interventions should target reducing after-school sedentary behaviours and increasing physical activity.

Dataset Information

Participation and contribution in crowdsourced surveys.

Publications

Participation and contribution in crowdsourced surveys.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets