Dataset Information

Long-term retention assessment after simulation-based-training of pediatric procedural skills among adult emergency physicians: a multicenter observational study.

ABSTRACT:

Background

One of the primary goals of simulation-based education is to enable long-term retention of training gains. However, medical literature has poorly contributed to understanding the best timing for repetition of simulation sessions. There is heterogeneity in re-training recommendations.

Objectives

This study assessed, through simulation-based training in different groups, the long-term retention of rare pediatric technical procedures.

Methods

This multicenter observational study included 107 emergency physicians and residents. Eighty-eight were divided into four groups that were specifically trained for pediatric emergency procedures at different points in time between 2010 and 2015 (< 0.5 year prior for G1, between 0.5 and 2 years prior for G2, between 2 and 4 years prior for G3, and ≥ 4 years prior for G4). An untrained control group (C) included 19 emergency physicians. Participants were asked to manage an unconscious infant using a low-fidelity mannequin. Assessment was based on the performance at 6 specific tasks corresponding to airway (A) and ventilation (B) skills. The performance (scored on 100) was evaluated by the TAPAS scale (Team Average Performance Assessment Scale). Correlation between performance and clinical level of experience was studied.

Results

There was a significant difference in performance between groups (p < 0.0001). For G1, 89% of the expected tasks were completed but resulted in longer delays before initiating actions than for the other groups. There was no difference between G4 and C with less than half of the tasks performed (47 and 43% respectively, p = 0.57). There was no correlation between clinical level of experience and performance (p = 0.39).

Conclusion

Performance decreased at 6 months after specific training for pediatric emergency skills, with total loss at 4 years after training, irrespective of experience. Repetition of simulation sessions should be implemented frequently after training to improve long-term retention and the optimal rate of refresher courses requires further research.

SUBMITTER: Ansquer R

PROVIDER: S-EPMC6739955 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ObjectiveWhile short-term gains in performance of critical emergency procedures are demonstrated after simulation, long-term retention is relatively uncertain. Our objective was to determine whether simulation of critical emergency procedures promotes long-term retention of skills in nonsurgical physicians.MethodsWe searched multiple electronic databases using a peer-reviewed strategy. Eligible studies 1) were observational cohorts, quasi-experimental or randomized controlled trials; 2) assessed intubation, cricothyrotomy, pericardiocentesis, tube thoracostomy, or central line placement performance by nonsurgical physicians; 3) utilized any form of simulation; and 4) assessed skill performance immediately after and at ≥ 3 months after simulation. The primary outcome was skill performance at or above a preset performance benchmark at ≥ 3 months after simulation. Secondary outcomes included procedural skill performance at 3, 6, and ≥ 12 months after simulation.ResultsWe identified 1,712 citations, with 10 being eligible for inclusion. Methodologic quality was moderate with undefined primary outcomes; inadequate sample sizes; and use of nonstandardized, unvalidated tools. Three studies assessed performance to a specific performance benchmark. Two demonstrated maintenance of the minimum performance benchmark while two demonstrated significant skill decay. A significant decline in the mean performance scores from immediately after simulation to 3, 6, and ≥ 12 months after simulation was observed in four of four, three of four, and two of five studies, respectively. Scores remained significantly above baseline at 3, 6, and ≥ 12 months after simulation in three of four, three of four, and four of four studies, respectively.ConclusionThere were a limited number of studies examining the retention of critical skills after simulation training. While there was some evidence of skill retention after simulation, overall most studies demonstrated skill decline over time.

Project description:Background:In a setting in which learning of basic procedural skills commences upon graduation from medical school, and as a first step towards integration of simulation-based learning into the anesthesiology training program, a preparatory course for new anesthesia trainees was designed. Three educational strategies were sequentially combined (e-learning, simulation-based hands on workshops, and on-site observational learning), and performance was assessed in a stepwise approach on five procedural skills considered essential for early anesthetic management (peripheral intravenous cannulation, sterile hand wash and gowning, anesthesia workstation preparation, face-mask ventilation, and orotracheal intubation). The primary aim of this study was to determine if this preparatory training course at the onset of anesthesiology residency is useful to achieve a competent trainee performance in the clinical setting. Methods:This prospective study was carried out at a university-affiliated hospital in Buenos Aires, Argentina, from 2017 to 2019. The 24 participants, comprising three cohorts of 8 residents each, underwent a preparatory course at the onset of residency. Diverse, consecutive educational strategies, and assessments (three stages: 1, 2, 3) took place using task-specific tools (checklists) and global rating scales for five procedural skills. The primary outcome was achievement of competent scores (85%) in final assessments, and the secondary outcomes were performance improvement between assessment stages and compliance with predefined safety items. Results:Twenty trainees (83.3%) were found to be globally competent (both assessment tools for all procedures) during final assessments (stage 3). Statistically significant improvement was found for all procedural skills between baseline and after workshop assessment scores (stages 1-2), except for orotracheal intubation in checklists, and for all procedural skills between stages 2 and 3 except for sterile hand wash and gowning in checklists. Conclusions:In our single-center experience, the gap for competent trainee performance in essential early anesthetic management skills can be effectively covered by conducting an intensive, preparatory course using the combination of three educational strategies (e-learning, simulation-based hands on workshops, and observational learning) at the onset of residency. This course has allowed learning to be generated in a secure environment for both patients and trainees.

Project description:ObjectivesHospitalists are expected to be competent in performing bedside procedures, which are associated with significant morbidity and mortality. A national decline in procedures performed by hospitalists has prompted questions about their procedural competency. Additionally, though simulation-based mastery learning (SBML) has been shown to be effective among trainees whether this approach has enduring benefits for independent practitioners who already have experience is unknown. We aimed to assess the baseline procedural skill of hospitalists already credentialed to perform procedures. We hypothesised that simulation-based training of hospitalists would result in durable skill gains after several months.DesignProspective cohort study with pretraining and post-training measurements.SettingSingle, large, urban academic medical centre in the USA.ParticipantsTwenty-two out of 38 eligible participants defined as hospitalists working on teaching services where they would supervise trainees performing procedures.InterventionsOne-on-one, 60 min SBML of lumbar puncture (LP) and abdominal paracentesis (AP).Primary and secondary outcome measuresOur primary outcome was the percentage of hospitalists obtaining minimum passing scores (MPS) on LP and AP checklists; our secondary outcomes were average checklist scores and self-reported confidence.ResultsAt baseline, only 16% hospitalists met or exceeded the MPS for LP and 32% for AP. Immediately after SBML, 100% of hospitalists reached this threshold. Reassessment an average of 7 months later revealed that only 40% of hospitalists achieved the MPS. Confidence increased initially after training but declined over time.ConclusionsHospitalists may be performing invasive bedside procedures without demonstration of adequate skill. A single evidence-based training intervention was insufficient to sustain skills for the majority of hospitalists over a short period of time. More stringent practices for certifying hospitalists who perform risky procedures are warranted, as well as mechanisms to support skill maintenance, such as periodic simulation-based training and assessment.

Project description:BackgroundSkilled physician communication is a key component of patient experience. Large-scale studies of exposure to communication skills training and its impact on patient satisfaction have not been conducted.ObjectiveWe aimed to examine the impact of experiential relationship-centered physician communication skills training on patient satisfaction and physician experience.DesignThis was an observational study.SettingThe study was conducted at a large, multispecialty academic medical center.ParticipantsParticipants included 1537 attending physicians who participated in, and 1951 physicians who did not participate in, communication skills training between 1 August 2013 and 30 April 2014.InterventionAn 8-h block of interactive didactics, live or video skill demonstrations, and small group and large group skills practice sessions using a relationship-centered model.Main measuresHospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS), Clinician and Group Consumer Assessment of Healthcare Providers and Systems (CGCAHPS), Jefferson Scale of Empathy (JSE), Maslach Burnout Inventory (MBI), self-efficacy, and post course satisfaction.Key resultsFollowing the course, adjusted overall CGCAHPS scores for physician communication were higher for intervention physicians than for controls (92.09 vs. 91.09, p < 0.03). No significant interactions were noted between physician specialty or baseline CGCAHPS and improvement following the course. Significant improvement in the post-course HCAHPS Respect domain adjusted mean was seen in intervention versus control groups (91.08 vs. 88.79, p = 0.02) and smaller, non-statistically significant improvements were also seen for adjusted HCAHPS communication scores (83.95 vs. 82.73, p = 0.22). Physicians reported high course satisfaction and showed significant improvement in empathy (116.4 ± 12.7 vs. 124 ± 11.9, p < 0.001) and burnout, including all measures of emotional exhaustion, depersonalization, and personal accomplishment. Less depersonalization and greater personal accomplishment were sustained for at least 3 months.ConclusionsSystem-wide relationship-centered communication skills training improved patient satisfaction scores, improved physician empathy, self-efficacy, and reduced physician burnout. Further research is necessary to examine longer-term sustainability of such interventions.

Project description:ObjectivesProcedural competency is an essential prerequisite for the independent practice of emergency medicine. Multiple studies demonstrate that simulation-based procedural training (SBPT) is an effective method for acquiring and maintaining procedural competency and preferred over traditional paradigms ("see one, do one, teach one"). Although newer paradigms informing SBPT have emerged, educators often face circumstances that challenge and undermine their implementation. The goal of this paper is to identify and report on best practices and theory-supported solutions to some of these challenges as derived using a process of expert consensus building and reviews of the existing literature on SBPT.MethodsThe Society for Academic Emergency Medicine (SAEM) Simulation Academy SBPT Workgroup convened approximately 8 months prior to the 2019 SAEM Annual Meeting to perform a review of the literature and participate in a consensus-building process to identify solutions (in the form of best practices and educational theory) to these challenges faced by educators engaging in SBPT.Results and analysisThirteen distinct educational challenges to SBPT emerged from the expert group's primary literature reviews and consensus-building processes. Three domains emerged upon further analysis of the 13 challenges: learner, educator, and curriculum. Six challenges within the "learner" domain were selected for comprehensive discussion in this paper, as they were deemed representative of the most common and most significant threats to ideal SBPT. Each of the six challenges aligns with one of the following themes: 1) maximizing active learning, 2) maintaining learner engagement, 3) embracing learner diversity, 4) optimizing cognitive load, 5) promoting mindfulness and reflection, and 6) emphasizing deliberate practice for mastery learning. Over 20 "special treatments" for mitigating the impact of the 13 challenges were derived from the secondary literature search and consensus-building process prior to and during the preconference workshop; 11 of these that best address the six learner-centered challenges are explored, including implications for educators involved in SBPT.Conclusions/implications for educatorsWe propose multiple consensus-generated solutions (in the form of best practices and applied educational theory) that we believe are suitable and well aligned to overcome commonly encountered learner-centered challenges and threats to optimal SBPT.