Simulation-based education with mastery learning improves residents' lumbar puncture skills.
Ontology highlight
ABSTRACT: Objective
To evaluate the effect of simulation-based mastery learning (SBML) on internal medicine residents' lumbar puncture (LP) skills, assess neurology residents' acquired LP skills from traditional clinical education, and compare the results of SBML to traditional clinical education.Methods
This study was a pretest-posttest design with a comparison group. Fifty-eight postgraduate year (PGY) 1 internal medicine residents received an SBML intervention in LP. Residents completed a baseline skill assessment (pretest) using a 21-item LP checklist. After a 3-hour session featuring deliberate practice and feedback, residents completed a posttest and were expected to meet or exceed a minimum passing score (MPS) set by an expert panel. Simulator-trained residents' pretest and posttest scores were compared to assess the impact of the intervention. Thirty-six PGY2, 3, and 4 neurology residents from 3 medical centers completed the same simulated LP assessment without SBML. SBML posttest scores were compared to neurology residents' baseline scores.Results
PGY1 internal medicine residents improved from a mean of 46.3% to 95.7% after SBML (p < 0.001) and all met the MPS at final posttest. The performance of traditionally trained neurology residents was significantly lower than simulator-trained residents (mean 65.4%, p < 0.001) and only 6% met the MPS.Conclusions
Residents who completed SBML showed significant improvement in LP procedural skills. Few neurology residents were competent to perform a simulated LP despite clinical experience with the procedure.
SUBMITTER: Barsuk JH
PROVIDER: S-EPMC3390539 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BACKGROUND: Paracentesis is a commonly performed bedside procedure that has the potential for serious complications. Therefore, simulation-based education for paracentesis is valuable for clinicians. OBJECTIVE: To assess internal medicine residents' procedural skills before and after simulation-based mastery learning on a paracentesis simulator. METHODS: A team with expertise in simulation and procedural skills developed and created a high fidelity, ultrasound-compatible paracentesis simulator. Fifty-eight first-year internal medicine residents completed a mastery learning-based intervention using the paracentesis simulator. Residents underwent baseline skill assessment (pretest) using a 25-item checklist. Residents completed a posttest after a 3-hour education session featuring a demonstration of the procedure, deliberate practice, ultrasound training, and feedback. All residents were expected to meet or exceed a minimum passing score (MPS) at posttest, the key feature of mastery learning. We compared pretest and posttest checklist scores to evaluate the effect of the educational intervention. Residents rated the training sessions. RESULTS: Residents' paracentesis skills improved from an average pretest score of 33.0% (SD = 15.2%) to 92.7% (SD = 5.4%) at posttest (P < .001). After the training intervention, all residents met or exceeded the MPS. The training sessions and realism of the simulation were rated highly by learners. CONCLUSION: This study demonstrates the ability of a paracentesis simulator to significantly improve procedural competence.
| S-EPMC3312528 | biostudies-other
Project description:BACKGROUND: Internal medicine residents must be competent in advanced cardiac life support (ACLS) for board certification. OBJECTIVE: To use a medical simulator to assess postgraduate year 2 (PGY-2) residents' baseline proficiency in ACLS scenarios and evaluate the impact of an educational intervention grounded in deliberate practice on skill development to mastery standards. DESIGN: Pretest-posttest design without control group. After baseline evaluation, residents received 4, 2-hour ACLS education sessions using a medical simulator. Residents were then retested. Residents who did not achieve a research-derived minimum passing score (MPS) on each ACLS problem had more deliberate practice and were retested until the MPS was reached. PARTICIPANTS: Forty-one PGY-2 internal medicine residents in a university-affiliated program. MEASUREMENTS: Observational checklists based on American Heart Association (AHA) guidelines with interrater and internal consistency reliability estimates; deliberate practice time needed for residents to achieve minimum competency standards; demographics; United States Medical Licensing Examination Step 1 and Step 2 scores; and resident ratings of program quality and utility. RESULTS: Performance improved significantly after simulator training. All residents met or exceeded the mastery competency standard. The amount of practice time needed to reach the MPS was a powerful (negative) predictor of posttest performance. The education program was rated highly. CONCLUSIONS: A curriculum featuring deliberate practice dramatically increased the skills of residents in ACLS scenarios. Residents needed different amounts of training time to achieve minimum competency standards. Residents enjoy training, evaluation, and feedback in a simulated clinical environment. This mastery learning program and other competency-based efforts illustrate outcome-based medical education that is now prominent in accreditation reform of residency education.
| S-EPMC1828088 | biostudies-other
Project description: Not available
| S-EPMC7280157 | biostudies-literature
Project description:BackgroundLumbar puncture (LP) is a commonly performed medical procedure in a wide range of indications. Virtual reality (VR) provides a stimulating, safe and efficient learning environment. We report the design and the evaluation of a three dimensions (3D) video for LP training.MethodsWe recorded a stereoscopic 180-degrees 3D video from two LPs performed in clinical settings in Fernand Widal Lariboisière University Hospital, Paris, France. The video was administered to third-year medical students as well as to a residents and attendings group during LP simulation-based training sessions.ResultsOn 168 participants (108 novice third-year medical students, and 60 residents and attendings with prior LP experience), satisfaction after video exposure was high (rated 4.7 ± 0.6 on a 5-point scale). No significant discomfort was reported (comfort score graded 4.5 ± 0.8 on 5). LP-naive students displayed higher satisfaction and perceived benefit than users with prior LP experience (overall, P < 0.05). Trainees evaluated favorably the 3D feature and supported the development of similar tutorials for other medical procedures (respectively, 3.9 ± 1.1 and 4.4 ± 0.9 on 5).ConclusionWe report our experience with a 3D video for LP training. VR support could increase knowledge retention and skill acquisition in association to LP simulation training.
| S-EPMC8981937 | biostudies-literature
Project description:IntroductionTube thoracostomy is a relatively infrequent, high-risk procedure that is a required competency for emergency medicine residents. Simulation-based mastery learning is the gold standard for procedure training and has been used to successfully train residents in high-risk procedures.MethodsWe developed a simulation-based mastery learning course for tube thoracostomy for PGY 2 emergency medicine residents. The course included (1) precourse work, (2) baseline assessment using a modified version of the TUBE-iCOMPT checklist, (3) anatomy/radiology review, (4) deliberate practice to master individual aspects of the procedure, and (5) final assessment. If a minimum passing score was not achieved, additional coaching and deliberate practice occurred until the learner was able to achieve a minimum passing score.ResultsAfter piloting the course with a cohort of seven PGY 2 emergency medicine residents, we successfully trained 24 additional PGY 2 residents in the subsequent two classes. Combining all three cohorts (N = 31), there was a statistically significant increase in learners' modified TUBE-iCOMPT scores (pretest M = 61.2, SD = 10.0; posttest M = 75.5, SD = 2.9; p < .001). Learners' confidence in their ability to correctly place a chest tube increased, rated on a 10-point Likert scale (1 = not very confident, 10 = very confident; precourse M = 5.6, SD = 1.8; postcourse M = 8.3, SD = 1.1; p < .001).DiscussionThis simulation-based course was well received by learners. Our assessment demonstrated that learners improved directly observed procedural skills in simulation and confidence in tube thoracostomy placement.
| S-EPMC9314465 | biostudies-literature
Project description:ObjectiveInserting peripheral venous catheters (PVCs) has been identified as a core competency for medical students. Because the performance - even of hygienic standards - of both students and novice physicians is frequently inadequate, medical faculties must focus on competence-based learning objectives and deliberate practice, features that are combined in mastery learning. Our aim was to determine the competency of students in inserting PVCs before and after an educational intervention.DesignThis study comprised a skills assessment with pre- and post-tests of a group of third-year students who received a simulation-based intervention. A newly established curriculum involved one hour of practice at inserting PVCs on simulators. Students were required to pass a test (total 21 points, pass mark 20 points) developed on the concept of mastery learning. An unannounced follow-up test was performed one week (8 days) after the intervention.SettingThe simulation center of the medical faculty in Muenster.ParticipantsThird-year students who received the intervention.ResultsOne hundred and nine complete data sets were obtained from 133 students (82.5%). Most students (97.2%) passed the test after the intervention (mean score increase from 15.56 to 20.50, P<0.001). There was a significant decrease in students' performance after one week (8 days): only 74.5% of participants passed this retest (mean score reduction from 20.50 to 20.06, P<0.001).ConclusionMastery learning is an effective form of teaching practical skills to medical students, allowing a thorough preparation for the challenges of daily clinical practice.
| S-EPMC5003138 | biostudies-literature
Project description:BackgroundUltrasound is an essential diagnostic examination used in several medical specialties. However, the quality of ultrasound examinations is dependent on mastery of certain skills, which may be difficult and costly to attain in the clinical setting. This study aimed to explore mastery learning for trainees practicing general abdominal ultrasound using a virtual reality simulator and to evaluate the associated cost per student achieving the mastery learning level.MethodsTrainees were instructed to train on a virtual reality ultrasound simulator until the attainment of a mastery learning level was established in a previous study. Automated simulator scores were used to track performances during each round of training, and these scores were recorded to determine learning curves. Finally, the costs of the training were evaluated using a micro-costing procedure.ResultsTwenty-one out of the 24 trainees managed to attain the predefined mastery level two times consecutively. The trainees completed their training with a median of 2h38min (range: 1h20min-4h30min) using a median of 7 attempts (range: 3-11 attempts) at the simulator test. The cost of training one trainee to the mastery level was estimated to be USD 638.ConclusionComplete trainees can obtain mastery learning levels in general abdominal ultrasound examinations within 3 hours of training in the simulated setting and at an average cost of USD 638 per trainee. Future studies are needed to explore how the cost of simulation-based training is best balanced against the costs of clinical training.
| S-EPMC10699015 | biostudies-literature
Project description:BackgroundLow levels of success in performing lumbar puncture have been observed among paediatric trainees. This study assessed the efficacy of simulation-based education with frequency building and precision teaching for training lumbar puncture to behavioural fluency.MethodsThe intervention group was assessed at baseline, at the final training trial, in the presence of distraction, and a minimum of one month after the cessation of the intervention in order to ascertain whether behavioural fluency in lumbar puncture was obtained. Subsequently, the performance of this intervention group (10 paediatric senior house officers) was compared to the performance of a comparator group of 10 more senior colleagues (paediatric registrars) who had not received the intervention. Retrospective chart audit was utilised to examine performance in the clinical setting.ResultsIntervention group participants required a mean of 5 trials to achieve fluency. Performance accuracy was significantly higher in the intervention group than the comparator group. Learning was retained at follow-up and persisted during distraction. Retrospective chart audit revealed no significant difference between the performance of the intervention group and a comparator group, comprised of more senior physicians, in the clinical setting, although the interpretation of these analyses are limited by a low number of lumbar punctures performed in the clinical setting.ConclusionsThe programme of simulation-based education with frequency building and precision teaching delivered produced behavioural fluency in lumbar puncture among paediatric trainees. Following the intervention, the performance of these participants was equivalent to, or greater than, that of senior paediatricians. This study supports the need for further research exploring the effectiveness of simulation-based education with precision teaching to train procedural skills to fluency, and the consideration of how best to explore the impact of these on patient outcomes.
| S-EPMC6511218 | biostudies-literature
Project description:Background: Caring for patients requiring mechanical ventilation is complex, and residents may lack adequate skill for managing these patients. Simulation-based mastery learning (SBML) is an educational model that trains clinicians to a high standard and can reduce complications. The mastery learning model has not been applied to ventilator management. Objective: The purpose of this study was to determine whether SBML, as compared with traditional training, is an effective strategy for teaching residents the skills necessary to manage patients requiring mechanical ventilation. Methods: We developed an SBML curriculum and a 47-item skills checklist to test ventilator management for patients with normal, restricted, and obstructed lung physiology. A minimum passing standard (MPS) on the checklist was set using the Mastery Angoff method. Residents rotating through the medical intensive care unit in Academic Year 2017-2018 were assigned to SBML or traditional training based on their medical intensive care unit team. The SBML group was pretested on a ventilator simulator using the skills checklist. They then received a 1.5-hour session (45 min didactic and 45 min deliberate practice on the simulator with feedback). At rotation completion, they were posttested on the simulator using the checklist until the MPS was met. Both SBML-trained and traditionally trained groups received teaching during daily bedside rounds and twice weekly didactic lectures. At rotation completion, traditionally trained residents were tested using the same skills checklist on the simulator. We compared pretest and posttest performance among SBML-trained residents and end of the rotation test performances between the SBML-trained and traditionally trained residents. Results: The MPS was set at 87% on the checklist. Fifty-seven residents were assigned to the SBML-trained group and 49 were assigned to the traditionally trained group. Mean checklist scores for SBML-trained residents improved from 51.4% (standard deviation [SD] = 17.5%) at pretest to 86.1% (SD = 7.6%) at initial posttest and 92.5% (SD = 3.7%) at final (mastery) posttest (both P < 0.001). Forty-two percent of residents required more than one attempt at the posttest to meet or exceed the MPS. At rotation completion, the traditionally trained residents had a mean test score of 60.9% (SD = 13.3%). Conclusion: SBML is an effective strategy to train residents on mechanical ventilator management. An SBML curriculum may augment traditional training methods to further equip residents to safely manage ventilated patients.
| S-EPMC8043263 | biostudies-literature
Project description:BackgroundNeonatal tele-resuscitation uses real-time, audio-video telemedicine to connect neonatologists with community hospital care teams during advanced neonatal resuscitations. While telemedicine continues to expand, best practices for training fellows in tele-resuscitation are not known.ObjectiveWe aimed to develop a neonatal tele-resuscitation curriculum using a simulation-based mastery learning model that provides neonatal-perinatal medicine (NPM) fellows with the knowledge, skills, and behaviors needed to lead tele-resuscitations.MethodsUsing technology-enhanced simulation education and a mastery learning model, we developed a longitudinal pilot tele-resuscitation curriculum. From 07/2018 to 03/2021, NPM fellows participated in the curriculum, which included individualized telemedicine learning, observing and leading simulated tele-resuscitations, and finally, performing clinical (non-simulated) tele-resuscitations. A performance assessment tool was developed to assess competency through eight questions mapped to the Accreditation Council for Graduate Medical Education (ACGME) core competencies, with responses on a 1 to 5 scale (1 = critical deficiencies; 5 = competence of an expert).ResultsFour NPM fellows participated in the curriculum, progressing through the curriculum at an individualized pace. Median scores on the three learning modules were 96-100%. Fellows participated in variable number of simulated tele-resuscitations based on when mastery was achieved (2-3 supervised simulations per fellow, 1-4 unsupervised simulations per fellow). In total, eighteen simulated tele-resuscitations (eight unsupervised, 10 supervised) and one clinical tele-resuscitation were conducted. Twenty-five performance assessments were completed. Assessment scores across the ACGME competencies were consistently high, with mean scores ranging from 4.2-4.6, with 4 equating to 'ready for unsupervised practice' and 5 equating to 'competence of an expert'.ConclusionsAs telemedicine use continues to expand, curricula that improve learners' comfort with and proficiency in tele-resuscitation are essential. A simulation-based mastery learning model may be one approach that affords learners gradual exposure to and mastery of complex tele-resuscitation skills and behaviors.
| S-EPMC8517198 | biostudies-literature