Dataset Information

Crowdsourcing in Surgical Skills Acquisition: A Developing Technology in Surgical Education.

ABSTRACT: Background?:The application of crowdsourcing to surgical education is a recent phenomenon and adds to increasing demands on surgical residency training. The efficacy, range, and scope of this technology for surgical education remains incompletely defined. Objective?:A systematic review was performed using the PubMed database of English-language literature on crowdsourced evaluation of surgical technical tasks up to April 2017. Methods?:Articles were reviewed, abstracted, and analyzed, and were assessed for quality using the Medical Education Research Study Quality Instrument (MERSQI). Articles were evaluated with eligibility criteria for inclusion. Study information, performance task, subjects, evaluative standards, crowdworker compensation, time to response, and correlation between crowd and expert or standard evaluations were abstracted and analyzed. Results?:Of 63 unique publications initially identified, 13 with MERSQI scores ranging from 10 to 13 (mean?=?11.85) were included in the review. Overall, crowd and expert evaluations demonstrated good to excellent correlation across a wide range of tasks (Pearson's coefficient 0.59-0.95, Cronbach's alpha 0.32-0.92), with 1 exception being a study involving medical students. There was a wide range of reported interrater variability among experts. Nonexpert evaluation was consistently quicker than expert evaluation (ranging from 4.8 to 150.9 times faster), and was more cost effective. Conclusions?:Crowdsourced feedback appears to be comparable to expert feedback and is cost effective and efficient. Further work is needed to increase consistency in expert evaluations, to explore sources of discrepant assessments between surgeons and crowds, and to identify optimal populations and novel applications for this technology.

SUBMITTER: Dai JC

PROVIDER: S-EPMC5734322 | biostudies-literature | 2017 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Crowdsourcing in Surgical Skills Acquisition: A Developing Technology in Surgical Education.

Dai Jessica C JC Lendvay Thomas S TS Sorensen Mathew D MD

Journal of graduate medical education 20171201 6

<h4>Background</h4>The application of crowdsourcing to surgical education is a recent phenomenon and adds to increasing demands on surgical residency training. The efficacy, range, and scope of this technology for surgical education remains incompletely defined.<h4>Objective</h4>A systematic review was performed using the PubMed database of English-language literature on crowdsourced evaluation of surgical technical tasks up to April 2017.<h4>Methods</h4>Articles were reviewed, abstracted, and a ...[more]

PMID: 29270257

Similar Datasets

Project description:ProblemDespite mounting evidence that incorporation of QI curricula into surgical trainee education improves morbidity and outcomes, surgery training programs lack standardized QI curricula and tools to measure QI knowledge. In the current study, we developed, implemented, and evaluated a quality improvement curriculum for surgical residents.InterventionSurgical trainees participated in a longitudinal, year-long (2019-2020) curriculum based on the Institute for Healthcare Improvement's online program. Online curriculum was supplemented with in person didactics and small group projects. Acquisition of skills was assessed pre- and post- course via self-report on a Likert scale as well as the Quality Improvement Knowledge Application Tool (QIKAT). Self-efficacy scores were assessed using the General Self-Efficacy Scale. 9 out of 18 total course participants completed the post course survey. This first course cohort was analyzed as a pilot for future work.ContextThe project was developed and deployed among surgical residents during their research/lab year. Teams of surgical residents were partnered with a faculty project mentor, as well as non-physician teammates for project work.ImpactParticipation in the QI course significantly increased skills related to studying the process (p = 0.0463), making changes in a system (p = 0.0167), identifying whether a change leads to an improvement (p = 0.0039), using small cycles of change (p = 0.0000), identifying best practices and comparing them to local practices (p = 0.0020), using PDSA model as a systematic framework for trial and learning (p = 0.0004), identifying how data is linked to specific processes (p = 0.0488), and building the next improvement cycle upon success or failure (p = 0.0316). There was also a significant improvement in aim (p = 0.037) and change (p = 0.029) responses to one QIKAT vignette.Lessons learnedWe describe the effectiveness of a pilot longitudinal, multi component QI course based on the IHI online curriculum in improving surgical trainee knowledge and use of key QI skills.

Project description:ImportanceVideo learning prior to surgery is common practice for trainees and surgeons, and immersive virtual reality (IVR) simulators are of increasing interest for surgical training. The training effectiveness of IVR compared with video training in complex skill acquisition should be studied.ObjectivesTo evaluate whether IVR improves learning effectiveness for surgical trainees and to validate a VR rating scale through correlation to real-world performance.Design, setting, and participantsThis block randomized, intervention-controlled clinical trial included senior (ie, postgraduate year 4 and 5) orthopedic surgery residents from multiple institutions in Canada during a single training course. An intention-to-treat analysis was performed. Data were collected from January 30 to February 1, 2020.InterventionAn IVR training platform providing a case-based module for reverse shoulder arthroplasty (RSA) for advanced rotator cuff tear arthropathy. Participants were permitted to repeat the module indefinitely.Main outcomes and measuresThe primary outcome measure was a validated performance metric for both the intervention and control groups (Objective Structured Assessment of Technical Skills [OSATS]). Secondary measures included transfer of training (ToT), transfer effectiveness ratio (TER), and cost-effectiveness (CER) ratios of IVR training compared with control. Additional secondary measures included IVR performance metrics measured on a novel rating scale compared with real-world performance.ResultsA total of 18 senior surgical residents participated; 9 (50%) were randomized to the IVR group and 9 (50%) to the control group. Participant demographic characteristics were not different for age (mean [SD] age: IVR group, 31.1 [2.8] years; control group, 31.0 [2.7] years), gender (IVR group, 8 [89%] men; control group, 6 [67%] men), surgical experience (mean [SD] experience with RSA: IVR group, 3.3 [0.9]; control group, 3.2 [0.4]), or prior simulator use (had experience: IVR group 6 [67%]; control group, 4 [44%]). The IVR group completed training 387% faster considering a single repetition (mean [SD] time for IVR group: 4.1 [2.5] minutes; mean [SD] time for control group: 16.1 [2.6] minutes; difference, 12.0 minutes; 95% CI, 8.8-14.0 minutes; P < .001). The IVR group had significantly better mean (SD) OSATS scores than the control group (15.9 [2.5] vs 9.4 [3.2]; difference, 6.9; 95% CI, 3.3-9.7; P < .001). The IVR group also demonstrated higher mean (SD) verbal questioning scores (4.1 [1.0] vs 2.2 [1.7]; difference, 1.9; 95% CI, 0.1-3.3; P = .03). The IVR score (ie, Precision Score) had a strong correlation to real-world OSATS scores (r = 0.74) and final implant position (r = 0.73). The ToT was 59.4%, based on the OSATS score. The TER was 0.79, and the system was 34 times more cost-effective than control, based on CER.Conclusions and relevanceIn this study, surgical training with IVR demonstrated superior learning efficiency, knowledge, and skill transfer. The TER of 0.79 substituted for 47.4 minutes of operating room time when IVR was used for 60 minutes.Trial registrationClinicalTrials.gov Identifier: NCT04404010.

Project description:BackgroundCurrent global health course is most set as elective course taught in traditional teacher-taught model with low credit and short term. Innovate teaching models are required. Crowdsourcing characterized by high flexibility and strong application-orientation holds its potential to enhance global health education. We applied crowdsourcing to global health teaching for undergraduates, aiming to develop and evaluate a new teaching model for global health education.MethodsCrowdsourcing was implemented into traditional course-based teaching via introducing five COVID-19 related global health debates. Undergraduate students majoring in preventative medicine and nursing grouped in teams of 5-8, were asked to resolve these debates in reference to main content of the course and with manner they thought most effective to deliver the messages. Students' experience and teaching effect, were evaluated by questionnaires and teachers' ratings, respectively. McNemar's test was used to compare the difference in students' experience before and after the course, and regression models were used to explore the influencing factors of the teaching effect.ResultsA total of 172 undergraduates were included, of which 122 (71%) were females. Students' evaluation of the new teaching model improved after the course, but were polarized. Students' self-reported teaching effect averaged 67.53 ± 16.8 and the teachers' rating score averaged 90.84 ± 4.9. Students majoring in preventive medicine, participated in student union, spent more time on revision, and had positive feedback on the new teaching model tended to perform better.ConclusionWe innovatively implemented crowdsourcing into global health teaching, and found this new teaching model was positively received by undergraduate students with improved teaching effects. More studies are needed to optimize the implementation of crowdsourcing alike new methods into global health education, to enrich global health teaching models.

Dataset Information

Crowdsourcing in Surgical Skills Acquisition: A Developing Technology in Surgical Education.

Publications

Crowdsourcing in Surgical Skills Acquisition: A Developing Technology in Surgical Education.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets