Dataset Information

Joint international consensus statement on crowdsourcing challenge contests in health and medicine: results of a modified Delphi process

ABSTRACT:

Objectives

To develop a consensus statement to provide advice on designing, implementing and evaluating crowdsourcing challenge contests in public health and medical contexts.

Design

Modified Delphi using three rounds of survey questionnaires and one consensus workshop.

Setting

Uganda for face-to-face consensus activities, global for online survey questionnaires.

Participants

A multidisciplinary expert panel was convened at a consensus-development conference in Uganda and included 21 researchers with experience leading challenge contests, five public health sector workers, and nine Ugandan end users. An online survey was sent to 140 corresponding authors of previously published articles that had used crowdsourcing methods.

Results

A subgroup of expert panel members developed the initial statement and survey. We received responses from 120 (85.7%) survey participants, which were presented at an in-person workshop of all 21 panel members. Panelists discussed each of the sections, revised the statement, and participated in a second round of the survey questionnaire. Based on this second survey round, we held detailed discussions of each subsection with workshop participants and further revised the consensus statement. We then conducted the third round of the questionnaire among the 21 expert panelists and used the results to finalize the statement. This iterative process resulted in 23 final statement items, all with greater than 80% consensus. Statement items are organised into the seven stages of a challenge contest, including the following: considering the appropriateness, organising a community steering committee, promoting the contest, assessing contributions, recognising contributors, sharing ideas and evaluating the contest (COPARSE).

Conclusions

There is high agreement among crowdsourcing experts and stakeholders on the design and implementation of crowdsourcing challenge contests. The COPARSE consensus statement can be used to organise crowdsourcing challenge contests, improve the rigour and reproducibility of crowdsourcing research and enable large-scale collaboration.

SUBMITTER: Han L

PROVIDER: S-EPMC8573649 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThe lack of agreement regarding what constitutes successful treatment for periprosthetic joint infections (PJI) makes it difficult to compare the different strategies of management that are used in clinical practice and in research studies.Questions/purposesThe aims of this study were to create a consensus definition for success after PJI treatment, and to provide a universal, multidimensional framework for reporting of studies regarding PJI treatment.MethodsA two-round basic Delphi method was used to reach a consensus definition. We invited 159 international experts (orthopaedic surgeons, infectious disease specialists, and clinical researchers) from 17 countries to participate; 59 participated in the first round, and 42 participated in the second round. The final definition consisted of all statements that achieved strong agreement (80% or greater of participants considering a criterion relevant for defining success).ResultsThe consensus definition of a successfully treated PJI is: (1) infection eradication, characterized by a healed wound without fistula, drainage, or pain, and no infection recurrence caused by the same organism strain; (2) no subsequent surgical intervention for infection after reimplantation surgery; and (3) no occurrence of PJI-related mortality (by causes such as sepsis, necrotizing fasciitis). The Delphi panel agreed to defining midterm results as those reported 5 or more years after the definitive PJI surgery, and long-term results as those reported 10 or more years after surgery. Although no consensus was reached on the definition of short-term results, 71% of the participants agreed that 2 years after the definitive PJI surgery is acceptable to define it.ConclusionsThis multidimensional definition of success after PJI treatment may be used to report and compare results of treatment of this catastrophic complication.Level of evidenceLevel V, therapeutic study. See Guidelines for Authors for a complete description of levels of evidence.

Project description:BackgroundHealthy movement behaviours of Canadian children and youth have been found to be suboptimal; this is associated with declines in physical fitness, increases in obesity, and elevated chronic disease risk. Physical literacy is an evolving construct representing foundational domains upon which physically active lifestyles are based. Many sectors and organizations in Canada are embracing physical literacy in their programs, practices, policies, and research; however, the use of inconsistent definitions and conceptualizations of physical literacy had been identified by stakeholders as hindering promotion and advancement efforts.MethodsWith leadership from ParticipACTION, organizations from the physical activity, public health, sport, physical education, and recreation sectors collaborated to create a physical literacy consensus definition and position statement for use by all Canadian organizations and individuals. The process involved an environmental scan, survey of related evidence, stakeholder consultations, and creation of a Steering Committee. From this background work a consensus statement was drafted, shared with stakeholders, revised, and ratified.ResultsCanada's Physical Literacy Consensus Statement was launched in June 2015 at the International Physical Literacy Conference in Vancouver, British Columbia. To further promote the Consensus Statement, the Sport for Life Society developed and simultaneously released the "Vancouver Declaration", which contained additional guidance on physical literacy. Both the Consensus Statement and the Declaration endorsed the International Physical Literacy Association's definition of physical literacy, namely "the motivation, confidence, physical competence, knowledge and understanding to value and take responsibility for engagement in physical activities for life".ConclusionsSector partners hope that the Consensus Statement, with its standardized definition, brings greater harmony, synergy, and consistency to physical literacy efforts in Canada and internationally. Going forward, the impact of this initiative on the sector, and the more distal goal of increasing habitual physical activity levels, should be assessed.