Dataset Information

Face, content, and construct validation of a low-cost, non-biologic, sinus surgery task trainer and knowledge-based curriculum.

ABSTRACT: The purpose of this study was to evaluate face and content validity of a low-cost, low-technology, non-biologic endoscopic sinus surgery (ESS) task trainer and knowledge-based curriculum followed by construct validation of the task trainer.A sinus surgery task trainer and curriculum were developed. Attending otolaryngologists were surveyed regarding the utility of the task trainer and curriculum. A cross-sectional construct validation study was performed including medical students, residents, and attending otolaryngologists. Nine tasks were performed on the task trainer and graded using a global rating scale (GRS). Predictors of task trainer performance were evaluated, and spatial performance was measured. Regression analyses were performed to assess main associations.All attending physicians (n = 7) agreed that the task trainer accelerates the learning curve and incorporates essential ESS techniques and that the knowledge-based curriculum describes anatomical and technical knowledge germane to ESS. Twelve medical students, 9 otolaryngology residents, and 5 attending otolaryngologists completed task trainer testing. GRS score varied by level of training after adjusting for potential confounders (slope = 2.63; p = 0.001). There was evidence of an association between a history of video gaming (slope = 1.33; p = 0.077), sports experience (slope = 2.08; p = 0.033), and sinus surgery simulation (slope = 2.72; p = 0.023) with GRS score, although not statistically significant.This study demonstrated validity of a knowledge-based sinus surgery curriculum and low-cost, sinus task trainer supporting use in early training. Participants with prior video gaming, sports participation, and sinus surgery simulation experience perform better at baseline on the task trainer.

SUBMITTER: Harbison RA

PROVIDER: S-EPMC5386817 | biostudies-literature | 2017 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Face, content, and construct validation of a low-cost, non-biologic, sinus surgery task trainer and knowledge-based curriculum.

Harbison Richard A RA Johnson Kaalan E KE Miller Craig C Sardesai Maya G MG Davis Greg E GE

International forum of allergy & rhinology 20161116 4

<h4>Background</h4>The purpose of this study was to evaluate face and content validity of a low-cost, low-technology, non-biologic endoscopic sinus surgery (ESS) task trainer and knowledge-based curriculum followed by construct validation of the task trainer.<h4>Methods</h4>A sinus surgery task trainer and curriculum were developed. Attending otolaryngologists were surveyed regarding the utility of the task trainer and curriculum. A cross-sectional construct validation study was performed includ ...[more]

PMID: 27865063

Similar Datasets

Project description:PurposeWe evaluate the face, content, and construct validity of a portable hip arthroscopy module in a regional orthopaedic unit.MethodsParticipants were recruited from a regional orthopaedic centre, and categorized into novice (0 arthroscopies), intermediate (1-29 arthroscopies), and expert (>50 arthroscopies) groups based on reported experience in arthroscopy. Face and content validity was evaluated by feedback from users immediately following completion of modules. Objective measurements, including time taken and subjective measurements consisting of simulation software metrics including, cam lesion locations attempts, scope strikes on bone, healthy bone burred, and cam lesion burred. Scores achieved by experts were recorded, and the median score was set at the level at which proficiency was demonstrated. Participant feedback on perceived educational use was collected following completion.ResultsIn total, 20 participant results were included for analysis. Good face and content validity was expressed by participants with previous arthroscopic experience. Number of scope strikes within the simulator-derived metrics accurately discerned between levels of experience. Novices had a mean of 5 strikes per attempt (SD ±5), intermediates a mean of 5.8 strikes (SD ± 4.1). There was a significant difference between expert and novice groups (P = .01), and expert and intermediate groups (P = .002). No significant difference between overall performance scores achieved by participants in expert, intermediate, and novice groups (62% ±19 vs 55% ±22 vs 50% ±23, P = .15). This demonstrates incomplete construct validity of the simulator software-derived metrics.ConclusionsThis hip arthroscopy simulator demonstrated acceptable face and content validity, with incomplete construct validity of simulator software metrics. Participants reported high levels of satisfaction with the module, highlighting that the addition of haptic feedback would be beneficial to improve procedural steps. Incorporation of tactile feedback to the modulator components would likely enable the software to accurately delineate between levels of experience.Clinical relevanceThis study demonstrates good face and content validity. The addition of haptic feedback in a hip arthroscopy simulator may improve learning.

Project description:Resuscitative hysterotomy is a daunting and rarely performed procedure in the emergency department (ED). Given the paucity of clinical exposure to this intervention, resuscitative hysterotomy is an ideal opportunity for simulation-mediated deliberate practice. The authors propose a novel training program using a homegrown, realistic, simulation device as a means to practice resuscitative hysterotomy. Two high-fidelity, tissue-based task-trainer models were constructed and tested on a convenience sample of 14 emergency medicine (EM) residents. The simulated human placenta, bladder, amniotic sac, and uterus were constructed through the use of porcine skin, porcine stomach, transparent plastic bag, Foley tubing, and squid mantle, all secured with nylon sutures. A Gaumard S500 Articulating Newborn was inserted in the simulated uterus, and the entire model was placed into a Gaumard S500 Childbirth Simulator. Each model required less than 1 h for assembly. Emergent hysterotomy was first demonstrated by an EM faculty facilitator, followed by hands-on deliberate practice. Formal feedback on the learners' self-reported confidence and satisfaction levels was solicited at the end of the workshop through a survey previously cited for use with a low-fidelity resuscitative hysterotomy. Quantitative evaluation of the simulated training session was extracted through a 5-item questionnaire using a 5-point Likert-type scale (i.e., from 1, strongly disagree, to 5, strongly agree). Item scores were added for a cumulative total score, with a possible maximum score of 25 and minimum score of 5. Responses were overwhelmingly positive [24.13 (±?1.36)]. Qualitative feedback was extracted from the survey through open-ended questions; these responses highlighted learners' appreciation for hands-on practice and the development of a novel, tissue-based simulation task trainer. All participants recommended the training session be available to future learners. Resuscitative hysterotomy is a high-stakes, low-frequency procedure that demands provider practice and confidence. Our hybrid, tissue-based hysterotomy model represents a feasible opportunity for training. The model is cost conscious, easily reproducible, and portable and allows for ample deliberate practice.

Project description:BackgroundFor difficult or rare procedures, simulation offers an opportunity to provide education and training. In developing an adequate model to utilize in simulation, 3D printing has emerged as a useful technology to provide detailed, accessible, and high-fidelity models. Nasal osteotomy is an essential step in many rhinoplasty surgeries, yet it can be challenging to perform and difficult to receive adequate exposure to this nuanced portion of the procedure. As it currently stands, there are limited opportunities to practice nasal osteotomy due to the reliance on cadaveric bones, which are expensive, difficult to obtain, and require appropriate facilities and personnel. While previous designs have been developed, these models leave room for improvement in printing efficiency, cost, and material performance. This manuscript aims to describe the methodology for the design of an updated nasal osteotomy training model derived from anatomic data and optimized for printability, usability, and fidelity. Additionally, an analysis of multiple commercially available 3D printing materials and technologies was conducted to determine which offered superior equivalency to bone.MethodsThis model was updated from a first-generation model previously described to include a more usable base and form, reduce irrelevant structures, and optimize geometry for 3D printing, while maintaining the nasal bones with added stabilizers essential for function and fidelity. For the material comparison, this updated model was printed in five materials: Ultimaker Polylactic Acid, 3D Printlife ALGA, 3DXTECH SimuBone, FibreTuff, and FormLabs Durable V2. Facial plastic surgeons tested the models in a blinded, randomized fashion and completed surveys assessing tactile feedback, audio feedback, material limitation, and overall value.ResultsA model optimizing printability while maintaining quality in the area of interest was developed. In the material comparison, SimuBone emerged as the top choice amongst the evaluating physicians in an experience-based subjective comparison to human bone during a simulated osteotomy procedure using the updated model.ConclusionThe updated midface model that was user-centered, low-cost, and printable was designed. In material testing, Simubone was rated above other materials to have a more realistic feel.

Project description:BackgroundTraining programs such as the fundamentals of laparoscopic surgery (FLS) that are based on simulation are being currently used in several western countries. FLS allows skill acquisition and evaluation of competency in laparoscopic surgery. On the practical side, evaluation is determined by the MISTELS metrics (MISTELS is the acronym for the McGill inanimate system for training and evaluation of laparoscopic skills). This training program may be modified so that it can be implemented in countries with limited resources using a low-cost trainer box. Would the use of a low-cost trainer box alter the reliability of the MISTELS score?Objective of studyThe aim of the study was to evaluate the reliability of a modified MISTELS using a low-cost trainer box.MethodsIt was a prospective study carried out at Habib Thameur hospital in Tunis (Tunisia), between April 2016 and August 2016. The study involved residents from different surgical specialties in the departments of general surgery and paediatric surgery of the hospital during 2015 and 2016. This study assessed the reliability of a modified MISTELS system (Only three tasks were performed out of the five tasks used in the original MISTELS system). Evaluation was based on Cronbach's alpha and intraclass correlation coefficients (ICC). A low-cost trainer box was designed and constructed. The residents included in the study performed three series of three tasks using this trainer box. The first series was scored by two trained raters to evaluate inter-rater reliability. The two-other series were successively performed to evaluate test-retest reliability.ResultsThe internal consistency, assessed by Cronbach's alpha, was at 0.929 which is an acceptable score. As for inter-rater and test-retest reliabilities that were assessed by ICCs, they yielded excellent scores that were at 1 and 0.95 (95% CI, 0.891-0.978) respectively.ConclusionsThe reliability of a modified MISTELS is not altered by the use of a low-cost trainer box. The score of the modified MISTELS is a reliable score for evaluating technical skills of surgical residents using a low-cost trainer box.

Dataset Information

Face, content, and construct validation of a low-cost, non-biologic, sinus surgery task trainer and knowledge-based curriculum.

Publications

Face, content, and construct validation of a low-cost, non-biologic, sinus surgery task trainer and knowledge-based curriculum.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets