Topical Review: Crowdsourcing as a Novel Approach to Qualitative Research.
Ontology highlight
ABSTRACT: Objective
To describe a novel, five-phase approach to collecting qualitative data from hard-to-reach populations using crowdsourcing methods.Methods
Drawing from experiences across recent studies with type 1 diabetes and congenital heart disease stakeholders, we describe five phases of crowdsourcing methodology, an innovative approach to conducting qualitative research within an online environment, and discuss relevant practical and ethical issues.Results
Phases of crowdsourcing methodology are: (I) Preparing; (II) Forming Crowds; (III) Collecting Crowdsourced Data; (IV) Coding and Analyzing Crowdsourced Data; and (V) Generating and Disseminating Findings. Iterative feedback from stakeholders is obtained in all five phases. Practical and ethical issues include accessing diverse stakeholders, emotional engagement of crowd participants, responsiveness and transparency of crowdsourcing methodology, and limited personal contact with crowd participants.Conclusions
Crowdsourcing is an innovative, efficient, feasible, and timely approach to engaging hard-to-reach populations in qualitative research.
SUBMITTER: Sood E
PROVIDER: S-EPMC7896271 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BACKGROUND:Crowdsourcing is used increasingly in health and medical research. Crowdsourcing is the process of aggregating crowd wisdom to solve a problem. The purpose of this systematic review is to summarize quantitative evidence on crowdsourcing to improve health. METHODS:We followed Cochrane systematic review guidance and systematically searched seven databases up to September 4th 2019. Studies were included if they reported on crowdsourcing and related to health or medicine. Studies were excluded if recruitment was the only use of crowdsourcing. We determined the level of evidence associated with review findings using the GRADE approach. RESULTS:We screened 3508 citations, accessed 362 articles, and included 188 studies. Ninety-six studies examined effectiveness, 127 examined feasibility, and 37 examined cost. The most common purposes were to evaluate surgical skills (17 studies), to create sexual health messages (seven studies), and to provide layperson cardio-pulmonary resuscitation (CPR) out-of-hospital (six studies). Seventeen observational studies used crowdsourcing to evaluate surgical skills, finding that crowdsourcing evaluation was as effective as expert evaluation (low quality). Four studies used a challenge contest to solicit human immunodeficiency virus (HIV) testing promotion materials and increase HIV testing rates (moderate quality), and two of the four studies found this approach saved money. Three studies suggested that an interactive technology system increased rates of layperson initiated CPR out-of-hospital (moderate quality). However, studies analyzing crowdsourcing to evaluate surgical skills and layperson-initiated CPR were only from high-income countries. Five studies examined crowdsourcing to inform artificial intelligence projects, most often related to annotation of medical data. Crowdsourcing was evaluated using different outcomes, limiting the extent to which studies could be pooled. CONCLUSIONS:Crowdsourcing has been used to improve health in many settings. Although crowdsourcing is effective at improving behavioral outcomes, more research is needed to understand effects on clinical outcomes and costs. More research is needed on crowdsourcing as a tool to develop artificial intelligence systems in medicine. TRIAL REGISTRATION:PROSPERO: CRD42017052835. December 27, 2016.
| S-EPMC6971908 | biostudies-literature
Project description:BackgroundCrowdsourcing is increasingly used to improve community engagement in HIV and sexual health research. In this scoping review, we reviewed studies using crowdsourcing approaches in HIV and sexual health research to identify strengths, opportunities for expansion, and limitations of such approaches.MethodsWe searched CINAHL, Web of Science, Embase, and PubMed. Studies were included if they involved crowdsourcing activities, were in the field of HIV or sexual health, and described the methodology in sufficient detail. We conducted a qualitative synthesis of eligible articles.ResultsOur search strategy yielded 431 nonduplicate articles. After screening, 16 articles met the inclusion criteria, including 4 publications that described research from high-income countries, 7 from middle-income countries, 1 from a low-income country, and 4 that had a global focus. There were 4 categories of crowdsourcing: open contests, hackathons, open forums, and incident reporting systems. We identified common phases for data acquisition and dissemination: (1) preparation; (2) problem framing and crowd solicitation; (3) judging submissions; and (4) sharing selected submissions. Strengths of using crowdsourcing approaches include greater innovation due to crowd heterogeneity, encouragement of multisectoral collaboration, empowerment of vulnerable populations, cost-effectiveness, and relevance to local cultures and styles. Weaknesses among some methods include reliance on the internet, temporal transience, and difficulty in sustaining long-term community engagement.ConclusionsCrowdsourcing may be useful for HIV implementation research. Further research on crowdsourcing related to HIV and sexual health is needed.
| S-EPMC6880797 | biostudies-literature
Project description:The generation of large-scale biomedical data is creating unprecedented opportunities for basic and translational science. Typically, the data producers perform initial analyses, but it is very likely that the most informative methods may reside with other groups. Crowdsourcing the analysis of complex and massive data has emerged as a framework to find robust methodologies. When the crowdsourcing is done in the form of collaborative scientific competitions, known as Challenges, the validation of the methods is inherently addressed. Challenges also encourage open innovation, create collaborative communities to solve diverse and important biomedical problems, and foster the creation and dissemination of well-curated data repositories.
| S-EPMC5918684 | biostudies-literature
Project description:As one of the six consortia funded through the NIH Fogarty International Center, the University of North Carolina at Chapel Hill, Johns Hopkins University, Morehouse School of Medicine, and Tulane University (UJMT) Fogarty Global Health Fellows Program provides postdoctoral trainees and doctoral students support and training for yearlong research attachments at selected low- and middle-income countries. To understand the current impact of this global health research training opportunity, the UJMT consortium conducted a crowdsourcing contest to gather creative messages to promote and improve the impact of the program in partnership with Social Entrepreneurship to Spur Health. Between January and March 2019, the contest received a total of 47 submissions from 14 countries; 44 were found eligible. After judging, 19 (41.2%) submissions received a mean score of 7 or higher. We examined both textual and descriptive submissions for emergent themes and identified a range of facilitators who can be used to further improve the training programs; examples include exceptional mentorship, acquisition of research skills, career development, personal development, and multisite training opportunities. In conclusion, the crowdsourcing mentorship contest demonstrated the feasibility and acceptability of leveraging existing research networks for community engagement and how useful information can be effectively collected to highlight the effectiveness of a program and expand the reach.
| S-EPMC7470547 | biostudies-literature
Project description:The potencies of topical corticosteroid products have mainly been classified using clinical data but in some instances, the US Food and Drug Administration's (FDA's) vasoconstrictor assay (VCA) to assess the skin blanching response has also been used. However, the reported skin blanching response data were often based on a single visual reading and lack information on the dose (amount/quantity) or dose duration. Although several lists classifying potencies of various topical corticosteroid products have been published, the inherent potencies of topical corticosteroid raw materials used as active pharmaceutical ingredients (APIs) have not been investigated. The objective was to rank the inherent potencies of topical corticosteroid APIs and to standardize dosing such that the relevant compounds could be compared on a normalized molar basis. The potencies of clobetasol propionate, halcinonide, mometasone furoate, and fluocinolone acetonide were compared using the resulting Emax data following the fitting of the relevant response data to the Emax model where mometasone furoate > fluocinolone acetonide = clobetasol propionate > halcinonide. This ranking lists the respective inherent potencies of the APIs, which will facilitate the choice of a suitable candidate for incorporation into an appropriate topical corticosteroid product for a specific clinical indication.
| S-EPMC8466269 | biostudies-literature
Project description:Amyotrophic lateral sclerosis (ALS) is a fatal neurodegenerative disease where substantial heterogeneity in clinical presentation urgently requires a better stratification of patients for the development of drug trials and clinical care. In this study we explored stratification through a crowdsourcing approach, the DREAM Prize4Life ALS Stratification Challenge. Using data from >10,000 patients from ALS clinical trials and 1479 patients from community-based patient registers, more than 30 teams developed new approaches for machine learning and clustering, outperforming the best current predictions of disease outcome. We propose a new method to integrate and analyze patient clusters across methods, showing a clear pattern of consistent and clinically relevant sub-groups of patients that also enabled the reliable classification of new patients. Our analyses reveal novel insights in ALS and describe for the first time the potential of a crowdsourcing to uncover hidden patient sub-populations, and to accelerate disease understanding and therapeutic development.
| S-EPMC6345935 | biostudies-literature
Project description:BackgroundCrowdsourcing involves obtaining ideas, needed services, or content by soliciting Web-based contributions from a crowd. The 4 types of crowdsourced tasks (problem solving, data processing, surveillance or monitoring, and surveying) can be applied in the 3 categories of health (promotion, research, and care).ObjectiveThis study aimed to map the different applications of crowdsourcing in health to assess the fields of health that are using crowdsourcing and the crowdsourced tasks used. We also describe the logistics of crowdsourcing and the characteristics of crowd workers.MethodsMEDLINE, EMBASE, and ClinicalTrials.gov were searched for available reports from inception to March 30, 2016, with no restriction on language or publication status.ResultsWe identified 202 relevant studies that used crowdsourcing, including 9 randomized controlled trials, of which only one had posted results at ClinicalTrials.gov. Crowdsourcing was used in health promotion (91/202, 45.0%), research (73/202, 36.1%), and care (38/202, 18.8%). The 4 most frequent areas of application were public health (67/202, 33.2%), psychiatry (32/202, 15.8%), surgery (22/202, 10.9%), and oncology (14/202, 6.9%). Half of the reports (99/202, 49.0%) referred to data processing, 34.6% (70/202) referred to surveying, 10.4% (21/202) referred to surveillance or monitoring, and 5.9% (12/202) referred to problem-solving. Labor market platforms (eg, Amazon Mechanical Turk) were used in most studies (190/202, 94%). The crowd workers' characteristics were poorly reported, and crowdsourcing logistics were missing from two-thirds of the reports. When reported, the median size of the crowd was 424 (first and third quartiles: 167-802); crowd workers' median age was 34 years (32-36). Crowd workers were mainly recruited nationally, particularly in the United States. For many studies (58.9%, 119/202), previous experience in crowdsourcing was required, and passing a qualification test or training was seldom needed (11.9% of studies; 24/202). For half of the studies, monetary incentives were mentioned, with mainly less than US $1 to perform the task. The time needed to perform the task was mostly less than 10 min (58.9% of studies; 119/202). Data quality validation was used in 54/202 studies (26.7%), mainly by attention check questions or by replicating the task with several crowd workers.ConclusionsThe use of crowdsourcing, which allows access to a large pool of participants as well as saving time in data collection, lowering costs, and speeding up innovations, is increasing in health promotion, research, and care. However, the description of crowdsourcing logistics and crowd workers' characteristics is frequently missing in study reports and needs to be precisely reported to better interpret the study findings and replicate them.
| S-EPMC5974463 | biostudies-literature
Project description:ObjectiveTo summarize the guiding theoretical frameworks included in pediatric adherence-promotion interventions and characterize targeted domains using the theoretical domains framework (TDF), a standardized system developed by adult behavior change researchers.MethodsA systematic review of PubMed, PsycINFO, and CINAHL databases identified 47 articles describing pediatric adherence-promotion interventions. Data extraction was completed independently by two authors. Targeted intervention domains were classified using the TDF.ResultsThe majority of interventions did not cite a guiding theoretical framework or cited multiple theories with overlapping domains. The TDF was a reliable categorization system and suggested that pediatric adherence-promotion interventions most commonly target knowledge, skills, and social influences.ConclusionsPediatric adherence-promotion interventions draw from a variety of theories and lack a consistent language for describing targeted domains. The adapted TDF proposed here is one method of reducing variability in intervention development and reporting and may facilitate efforts to identify the processes that improve adherence.
| S-EPMC4536847 | biostudies-literature
Project description:BackgroundCurrently, thanks to the growing number of public database resources, most evidence on planning and management, healthcare institutions, policies and practices is becoming available to everyone. However, one of the limitations for the advancement of data and literature-driven research has been the lack of flexibility of the methodological resources used in qualitative research. There is a need to incorporate friendly, cheaper and faster tools for the systematic, unbiased analysis of large data corpora, in particular regarding the qualitative aspects of the information (often overlooked).MethodsThis article proposes a series of novel techniques, exemplified by the case of the role of Institutional Committees of Bioethics to (1) massively identify the documents relevant to a given issue, (2) extract the fundamental content, focusing on qualitative analysis, (3) synthesize the findings in the published literature, (4) categorize and visualize the evidence, and (5) analyse and report the results.ResultsA critical study of the institutional role of public health policies and practices in Institutional Committees of Bioethics was used as an example application of the method. Interactive strategies were helpful to define and conceptualise variables, propose research questions and refine research interpretation. These methods are additional aids to systematic reviews, pre-coding schemes and construction of a priori diagrams to survey and analyse social science literature.ConclusionsThese novel methods have proven to facilitate the formulation and testing of hypotheses on the subjects to be studied. Such tools may allow important advances going from descriptive approaches to decision-making and even institutional assessment and policy redesign, by pragmatic reason of time and costs.
| S-EPMC6332644 | biostudies-literature
Project description:Effective and simple screening tools are needed to detect behaviors that are established early in life and have a significant influence on weight gain later in life. Crowdsourcing could be a novel and potentially useful tool to assess childhood predictors of adult obesity. This exploratory study examined whether crowdsourcing could generate well-documented predictors in obesity research and, moreover, whether new directions for future research could be uncovered. Participants were recruited through social media to a question-generation website, on which they answered questions and were able to pose new questions that they thought could predict obesity. During the two weeks of data collection, 532 participants (62% female; age ?=? 26.5±6.7; BMI ?=? 29.0±7.0) registered on the website and suggested a total of 56 unique questions. Nineteen of these questions correlated with body mass index (BMI) and covered several themes identified by prior research, such as parenting styles and healthy lifestyle. More importantly, participants were able to identify potential determinants that were related to a lower BMI, but have not been the subject of extensive research, such as parents packing their children's lunch to school or talking to them about nutrition. The findings indicate that crowdsourcing can reproduce already existing hypotheses and also generate ideas that are less well documented. The crowdsourced predictors discovered in this study emphasize the importance of family interventions to fight obesity. The questions generated by participants also suggest new ways to express known predictors.
| S-EPMC3914836 | biostudies-literature