Dataset Information

The Promise and Pitfalls of Using Crowdsourcing in Research Prioritization for Back Pain: Cross-Sectional Surveys.

ABSTRACT:

Background

The involvement of patients in research better aligns evidence generation to the gaps that patients themselves face when making decisions about health care. However, obtaining patients' perspectives is challenging. Amazon's Mechanical Turk (MTurk) has gained popularity over the past decade as a crowdsourcing platform to reach large numbers of individuals to perform tasks for a small reward for the respondent, at small cost to the investigator. The appropriateness of such crowdsourcing methods in medical research has yet to be clarified.

Objective

The goals of this study were to (1) understand how those on MTurk who screen positive for back pain prioritize research topics compared with those who screen negative for back pain, and (2) determine the qualitative differences in open-ended comments between groups.

Methods

We conducted cross-sectional surveys on MTurk to assess participants' back pain and allow them to prioritize research topics. We paid respondents US $0.10 to complete the 24-point Roland Morris Disability Questionnaire (RMDQ) to categorize participants as those "with back pain" and those "without back pain," then offered both those with (RMDQ score ?7) and those without back pain (RMDQ <7) an opportunity to rank their top 5 (of 18) research topics for an additional US $0.75. We compared demographic information and research priorities between the 2 groups and performed qualitative analyses on free-text commentary that participants provided.

Results

We conducted 2 screening waves. We first screened 2189 individuals for back pain over 33 days and invited 480 (21.93%) who screened positive to complete the prioritization, of whom 350 (72.9% of eligible) did. We later screened 664 individuals over 7 days and invited 474 (71.4%) without back pain to complete the prioritization, of whom 397 (83.7% of eligible) did. Those with back pain who prioritized were comparable with those without in terms of age, education, marital status, and employment. The group with back pain had a higher proportion of women (234, 67.2% vs 229, 57.8%, P=.02). The groups' rank lists of research priorities were highly correlated: Spearman correlation coefficient was .88 when considering topics ranked in the top 5. The 2 groups agreed on 4 of the top 5 and 9 of the top 10 research priorities.

Conclusions

Crowdsourcing platforms such as MTurk support efforts to efficiently reach large groups of individuals to obtain input on research activities. In the context of back pain, a prevalent and easily understood condition, the rank list of those with back pain was highly correlated with that of those without back pain. However, subtle differences in the content and quality of free-text comments suggest supplemental efforts may be needed to augment the reach of crowdsourcing in obtaining perspectives from patients, especially from specific populations.

SUBMITTER: Bartek MA

PROVIDER: S-EPMC5650676 | biostudies-literature | 2017 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The Promise and Pitfalls of Using Crowdsourcing in Research Prioritization for Back Pain: Cross-Sectional Surveys.

Bartek Matthew A MA Truitt Anjali R AR Widmer-Rodriguez Sierra S Tuia Jordan J Bauer Zoya A ZA Comstock Bryan A BA Edwards Todd C TC Lawrence Sarah O SO Monsell Sarah E SE Patrick Donald L DL Jarvik Jeffrey G JG Lavallee Danielle C DC

Journal of medical Internet research 20171006 10

<h4>Background</h4>The involvement of patients in research better aligns evidence generation to the gaps that patients themselves face when making decisions about health care. However, obtaining patients' perspectives is challenging. Amazon's Mechanical Turk (MTurk) has gained popularity over the past decade as a crowdsourcing platform to reach large numbers of individuals to perform tasks for a small reward for the respondent, at small cost to the investigator. The appropriateness of such crowd ...[more]

PMID: 28986339

Similar Datasets

Project description:BACKGROUND: Previous studies, in late 20th century, suggest an increase in the prevalence of neck pain and low back pain among children and adolescents, when neck and low back pain were studied separately. This study investigated time trends in adolescent spinal pain between 1991 and 2011 by classifying pain into the following three classes: neck pain alone, low back pain alone, and concomitant neck and low back pain. METHODS: Representative samples of 12 to 18-year-old Finns were sent a questionnaire in 1991, 1999, 2001, 2003, 2005, 2007, 2009 and 2011. Information was gathered about the frequency of neck and low back pain with a six-month recall period. Statistical methods used included descriptive analysis, and generalized linear models. RESULTS: The total number of respondents in these eight comparable cross-sectional surveys was 51 044 with a response proportion of 64%. The prevalence of concomitant neck and low back pain showed a steady increase from 1991 to 2009/2011; the prevalence almost quadrupled among 12-14-year-olds girls (from 2% to 7.5%), and more than doubled among 12-14-year-old boys (from 1.6% to 3.8%), and among 16-18-year old boys (from 4.2 to 9.9%) and girls (6.9% to 15.9%). The prevalence of neck pain alone only increased in the 1990s (e.g. among 16-18-year-old girls 22.9% in 1991, 29.2% in 1999, and 29.5% in 2011), while the prevalence of low back pain alone remained relatively constant during the last two decades (e.g. among 16-18-year-old girls 4% in 1991, 3.1% in 1999, and 3.7% in 2011). CONCLUSIONS: Concomitant neck and low back pain has constantly increased in the last two decades among adolescents, while single neck pain has only increased in the 1990s. Single low back pain has remained relatively constant. Thus, earlier detected increase in low back pain in the 1990s was explained by the increase in concomitant neck and low back pain. Differences in the time trends in the three pain conditions might suggest, at least partly, different risk factors and aetiology for single- and multisite spinal pain among adolescents. This hypothesis needs further investigations.

Project description:ObjectivesTo establish the prevalence of back pain in German elite athletes; examine the influence of age, sex, sports discipline and training volume; and compare elite athletes with a physically active control group.MethodsA standardized and validated online back pain questionnaire was sent by the German Olympic Sports Confederation to approximately 4,000 German national and international elite athletes, and a control group of 253 physically active but non-elite sports students.ResultsWe received responses from 1,114 elite athletes (46.5% male and 53.1% female, mean age 20.9 years ± 4.8 years, mean height 176.5 ± 11.5 cm, mean weight 71.0 ± 10.3 kg) and 166 physically active sports students (74.7% male and 24.1 female, mean age 21.2 ± 2.0 years, mean height 180.0 ± 8.0 cm, mean weight 74.0 ± 14.5 kg). In elite athletes, the lifetime prevalence of back pain was 88.5%, the 12-month prevalence was 81.1%, the 3-month prevalence was 68.3% and the point prevalence was 49.0%, compared with 80.7%, 69.9%, 59.0% and 42.8%, respectively in the control group. The lifetime, 12-month and 3-month prevalences in elite athletes were significantly higher than in the control group. Regarding the individual sports disciplines, the prevalence of back pain was significantly higher in elite rowers, dancers, fencers, gymnasts, track and field athletes, figure skaters and marksmen, and those who play underwater rugby, water polo, basketball, hockey and ice hockey compared with the control group. The prevalence of back pain was significantly lower in elite triathletes.ConclusionsBack pain is a common complaint in German elite athletes. Low back pain seems to be a problem in both elite athletes and physically active controls. A high training volume in elite athletes and a low training volume in physically active individuals might increase prevalence rates. Our findings indicate the necessity for specific prevention programs, especially in high-risk sports. Further research should investigate the optimal dose-effect relationship of sporting activity for the general population to prevent back pain.

Project description:ObjectiveTo compare oral health in the US and England and to assess levels of educational and income related oral health inequalities between both countries.DesignCross sectional analysis of US and English national surveys.SettingNon-institutionalised adults living in their own homes.ParticipantsOral health measures and socioeconomic indicators were assessed in nationally representative samples: the Adult Dental Health Survey 2009 for England, and the US National Health and Nutrition Examination Survey 2005-08. Adults aged ≥25 years were included in analyses with samples of 8719 (England) and 9786 (US) for analyses by education, and 7184 (England) and 9094 (US) for analyses by income.Main outcome measuresNumber of missing teeth, self rated oral health, and oral impacts on daily life were outcomes. Educational attainment and household income were used as socioeconomic indicators. Age standardised estimates of oral health were compared between countries and across educational and income groups. Regression models were fitted, and relative and absolute inequalities were measured using the relative index of inequality (RII) and the slope index of inequality (SII).ResultsThe mean number of missing teeth was significantly higher in the US (7.31 (standard error 0.15)) than in England (6.97 (0.09)), while oral impacts were higher in England. There was evidence of significant social gradients in oral health in both countries, although differences in oral health by socioeconomic position varied according to the oral health measure used. Consistently higher RII and SII values were found in the US than in England, particularly for self rated oral health. RII estimates for self rated oral health by education were 3.67 (95% confidence interval 3.23 to 4.17) in the US and 1.83 (1.59 to 2.11) in England. In turn, SII values were 42.55 (38.14 to 46.96) in the US and 18.43 (14.01 to 22.85) in England.ConclusionsThe oral health of US citizens is not better than the English, and there are consistently wider educational and income oral health inequalities in the US compared with England.

Project description:BACKGROUND: There is considerable clinician and researcher interest in whether the outcomes for patients with low back pain, and the efficiency of the health systems that treat them, can be improved by 'subgrouping research'. Subgrouping research seeks to identify subgroups of people who have clinically important distinctions in their treatment needs or prognoses. Due to a proliferation of research methods and variability in how subgrouping results are interpreted, it is timely to open discussion regarding a conceptual framework for the research designs and statistical methods available for subgrouping studies (a method framework). The aims of this debate article are: (1) to present a method framework to inform the design and evaluation of subgrouping research in low back pain, (2) to describe method options when investigating prognostic effects or subgroup treatment effects, and (3) to discuss the strengths and limitations of research methods suitable for the hypothesis-setting phase of subgroup studies. DISCUSSION: The proposed method framework proposes six phases for studies of subgroups: studies of assessment methods, hypothesis-setting studies, hypothesis-testing studies, narrow validation studies, broad validation studies, and impact analysis studies. This framework extends and relabels a classification system previously proposed by McGinn et al (2000) as suitable for studies of clinical prediction rules. This extended classification, and its descriptive terms, explicitly anchor research findings to the type of evidence each provides. The inclusive nature of the framework invites appropriate consideration of the results of diverse research designs. Method pathways are described for studies designed to test and quantify prognostic effects or subgroup treatment effects, and examples are discussed. The proposed method framework is presented as a roadmap for conversation amongst researchers and clinicians who plan, stage and perform subgrouping research. SUMMARY: This article proposes a research method framework for studies of subgroups in low back pain. Research designs and statistical methods appropriate for sequential phases in this research are discussed, with an emphasis on those suitable for hypothesis-setting studies of subgroups of people seeking care.

Project description:BackgroundLow back pain is an important public health issue across the world. However, it is unclear whether socioeconomic status (SES) is associated with low back pain. This study determines an association between SES and low back pain among older people.MethodsWe used cross-sectional data derived from the year 2013 across 30 Japanese municipalities. The survey was conducted between October 2013 to December 2013. Functionally independent community-dwelling older adults aged 65 and above (n?=?26,037) were eligible for the study. Multilevel Poisson regression analysis with a robust variance estimator was used to examine the association between SES and low back pain. Self-reported low back pain in the past year was used as a dependent variable. Educational attainment, past occupation, equivalized household income, wealth, and subjective economic situation represented SES and were separately analyzed as independent variables, adjusted for covariates including age and sex.ResultsThe prevalence of low back pain was 63.4%. Overall, lower SES were more likely to suffer from low back pain compared with that for the highest. First, as for the educational attainment, the prevalence ratio (PR) (95% credible interval (CI)) for the lowest level was 1.07 (1.02-1.12). Second, as for the past occupation, the PR (95% CI) for the blue-collared workers compared with professionals was 1.06 (1.01-1.11). Third, as for the equalized household income, the PRs (95% CI) for lower middle and the lowest income levels were 1.08 (1.02-1.13) and 1.16 (1.10-1.23), respectively. Fourth, as for the wealth, the PRs (95% CI) for lower middle and the lowest wealth levels were 1.11 (1.04-1.19) and 1.18 (1.11-1.27), respectively. Fifth, as for the subjective economic situation, the PRs (95% CI) for lower middle and the lowest financial conditions were 1.18 (1.10-1.26) and 1.32 (1.22-1.44), respectively.ConclusionsSignificant socioeconomic inequalities were observed in low back pain among older individuals in Japan. Policymakers and clinicians must understand the nature of these inequalities.

Dataset Information

The Promise and Pitfalls of Using Crowdsourcing in Research Prioritization for Back Pain: Cross-Sectional Surveys.

Background

Objective

Methods

Results

Conclusions

Publications

The Promise and Pitfalls of Using Crowdsourcing in Research Prioritization for Back Pain: Cross-Sectional Surveys.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure