Dataset Information

Cohort study of hospitalists' procedural skills: baseline competence and durability after simulation-based training.

ABSTRACT:

Objectives

Hospitalists are expected to be competent in performing bedside procedures, which are associated with significant morbidity and mortality. A national decline in procedures performed by hospitalists has prompted questions about their procedural competency. Additionally, though simulation-based mastery learning (SBML) has been shown to be effective among trainees whether this approach has enduring benefits for independent practitioners who already have experience is unknown. We aimed to assess the baseline procedural skill of hospitalists already credentialed to perform procedures. We hypothesised that simulation-based training of hospitalists would result in durable skill gains after several months.

Design

Prospective cohort study with pretraining and post-training measurements.

Setting

Single, large, urban academic medical centre in the USA.

Participants

Twenty-two out of 38 eligible participants defined as hospitalists working on teaching services where they would supervise trainees performing procedures.

Interventions

One-on-one, 60 min SBML of lumbar puncture (LP) and abdominal paracentesis (AP).

Primary and secondary outcome measures

Our primary outcome was the percentage of hospitalists obtaining minimum passing scores (MPS) on LP and AP checklists; our secondary outcomes were average checklist scores and self-reported confidence.

Results

At baseline, only 16% hospitalists met or exceeded the MPS for LP and 32% for AP. Immediately after SBML, 100% of hospitalists reached this threshold. Reassessment an average of 7 months later revealed that only 40% of hospitalists achieved the MPS. Confidence increased initially after training but declined over time.

Conclusions

Hospitalists may be performing invasive bedside procedures without demonstration of adequate skill. A single evidence-based training intervention was insufficient to sustain skills for the majority of hospitalists over a short period of time. More stringent practices for certifying hospitalists who perform risky procedures are warranted, as well as mechanisms to support skill maintenance, such as periodic simulation-based training and assessment.

SUBMITTER: Hale C

PROVIDER: S-EPMC8370503 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThe effectiveness of simulation-based training for skill acquisition is widely recognized. However, the impact of simulation-based procedural training (SBPT) on pre-clerkship medical students and the retention of procedural skills learned through this modality are rarely investigated.MethodsA prospective cohort study was conducted among pre-clerkship medical students. Learners underwent SBPT in venipuncture in the skills laboratory. Assessments were conducted at two main points: 1) immediate assessment following the training and 2) delayed assessment one year after training. Learner self-assessments, independent assessor assessments for procedural competency, and communication skills assessments were conducted in both instances. The students were assessed for their competency in performing venipuncture by an independent assessor immediately following the training in the simulated setting and one-year post-training in the clinical setting, using the Integrated Procedural Protocol Instrument (IPPI). The student's communication skills were assessed by standardized patients (SP) and actual patients in the simulated and clinical settings, respectively, using the Communication Assessment Tool (CAT).ResultsFifty-five pre-clerkship medical students were recruited for the study. A significant increase was observed in self-confidence [mean: 2.89 SD (Standard Deviation) (0.69)] and self-perceived competency [mean: 2.42 SD (0.57)] in performing venipuncture, which further improved at the delayed assessment conducted in the clinical setting (p < 0.001). Similarly, the IPPI ratings showed an improvement [immediate assessment: mean: 2.25 SD (1.62); delayed assessment: mean: 2.78 SD (0.53); p < 0.01] in venipuncture skills when assessed by an independent assessor blinded to the study design. A significant difference (p < 0.01) was also observed in doctor-patient communication when evaluated by SPs [mean: 2.49 SD (0.57)] and patients [mean: 3.76 SD (0.74)].ConclusionSimulation-based venipuncture training enabled students to perform the procedure with confidence and technical accuracy. Improved rating scores received at a one-year interval denote the impact of clinical training on skills acquisition. The durability of skills learned via SBPT needs to be further investigated.

Project description:ObjectiveWhile short-term gains in performance of critical emergency procedures are demonstrated after simulation, long-term retention is relatively uncertain. Our objective was to determine whether simulation of critical emergency procedures promotes long-term retention of skills in nonsurgical physicians.MethodsWe searched multiple electronic databases using a peer-reviewed strategy. Eligible studies 1) were observational cohorts, quasi-experimental or randomized controlled trials; 2) assessed intubation, cricothyrotomy, pericardiocentesis, tube thoracostomy, or central line placement performance by nonsurgical physicians; 3) utilized any form of simulation; and 4) assessed skill performance immediately after and at ≥ 3 months after simulation. The primary outcome was skill performance at or above a preset performance benchmark at ≥ 3 months after simulation. Secondary outcomes included procedural skill performance at 3, 6, and ≥ 12 months after simulation.ResultsWe identified 1,712 citations, with 10 being eligible for inclusion. Methodologic quality was moderate with undefined primary outcomes; inadequate sample sizes; and use of nonstandardized, unvalidated tools. Three studies assessed performance to a specific performance benchmark. Two demonstrated maintenance of the minimum performance benchmark while two demonstrated significant skill decay. A significant decline in the mean performance scores from immediately after simulation to 3, 6, and ≥ 12 months after simulation was observed in four of four, three of four, and two of five studies, respectively. Scores remained significantly above baseline at 3, 6, and ≥ 12 months after simulation in three of four, three of four, and four of four studies, respectively.ConclusionThere were a limited number of studies examining the retention of critical skills after simulation training. While there was some evidence of skill retention after simulation, overall most studies demonstrated skill decline over time.

Project description:Background:In a setting in which learning of basic procedural skills commences upon graduation from medical school, and as a first step towards integration of simulation-based learning into the anesthesiology training program, a preparatory course for new anesthesia trainees was designed. Three educational strategies were sequentially combined (e-learning, simulation-based hands on workshops, and on-site observational learning), and performance was assessed in a stepwise approach on five procedural skills considered essential for early anesthetic management (peripheral intravenous cannulation, sterile hand wash and gowning, anesthesia workstation preparation, face-mask ventilation, and orotracheal intubation). The primary aim of this study was to determine if this preparatory training course at the onset of anesthesiology residency is useful to achieve a competent trainee performance in the clinical setting. Methods:This prospective study was carried out at a university-affiliated hospital in Buenos Aires, Argentina, from 2017 to 2019. The 24 participants, comprising three cohorts of 8 residents each, underwent a preparatory course at the onset of residency. Diverse, consecutive educational strategies, and assessments (three stages: 1, 2, 3) took place using task-specific tools (checklists) and global rating scales for five procedural skills. The primary outcome was achievement of competent scores (85%) in final assessments, and the secondary outcomes were performance improvement between assessment stages and compliance with predefined safety items. Results:Twenty trainees (83.3%) were found to be globally competent (both assessment tools for all procedures) during final assessments (stage 3). Statistically significant improvement was found for all procedural skills between baseline and after workshop assessment scores (stages 1-2), except for orotracheal intubation in checklists, and for all procedural skills between stages 2 and 3 except for sterile hand wash and gowning in checklists. Conclusions:In our single-center experience, the gap for competent trainee performance in essential early anesthetic management skills can be effectively covered by conducting an intensive, preparatory course using the combination of three educational strategies (e-learning, simulation-based hands on workshops, and observational learning) at the onset of residency. This course has allowed learning to be generated in a secure environment for both patients and trainees.

Project description:BackgroundOne of the primary goals of simulation-based education is to enable long-term retention of training gains. However, medical literature has poorly contributed to understanding the best timing for repetition of simulation sessions. There is heterogeneity in re-training recommendations.ObjectivesThis study assessed, through simulation-based training in different groups, the long-term retention of rare pediatric technical procedures.MethodsThis multicenter observational study included 107 emergency physicians and residents. Eighty-eight were divided into four groups that were specifically trained for pediatric emergency procedures at different points in time between 2010 and 2015 (< 0.5 year prior for G1, between 0.5 and 2 years prior for G2, between 2 and 4 years prior for G3, and ≥ 4 years prior for G4). An untrained control group (C) included 19 emergency physicians. Participants were asked to manage an unconscious infant using a low-fidelity mannequin. Assessment was based on the performance at 6 specific tasks corresponding to airway (A) and ventilation (B) skills. The performance (scored on 100) was evaluated by the TAPAS scale (Team Average Performance Assessment Scale). Correlation between performance and clinical level of experience was studied.ResultsThere was a significant difference in performance between groups (p < 0.0001). For G1, 89% of the expected tasks were completed but resulted in longer delays before initiating actions than for the other groups. There was no difference between G4 and C with less than half of the tasks performed (47 and 43% respectively, p = 0.57). There was no correlation between clinical level of experience and performance (p = 0.39).ConclusionPerformance decreased at 6 months after specific training for pediatric emergency skills, with total loss at 4 years after training, irrespective of experience. Repetition of simulation sessions should be implemented frequently after training to improve long-term retention and the optimal rate of refresher courses requires further research.

Project description:BACKGROUND:Curricular constraints require being selective about the type of content trainees practice in their formal training. Teaching trainees procedural knowledge about "how" to perform steps of a skill along with conceptual knowledge about "why" each step is performed can support skill retention and transfer (i.e., the ability to adapt knowledge to novel problems). However, how best to organize how and why content for procedural skills training is unknown. OBJECTIVES:We examined the impact of different approaches to integrating why and how content on trainees' skill retention and transfer of simulation-based lumbar puncture (LP). DESIGN AND PARTICIPANTS:We randomized medical students (N?=?66) to practice LP for 1 h using one of three videos. One video presented only the how content for LP (Procedural Only). Two other videos presented how and why content (e.g., anatomy) in two ways: Integrated in Sequence, with why content followed by how content, or Integrated for Causation, with how and why content integrated throughout. MAIN MEASURES:Pairs of blinded raters scored participants' retention and transfer LP performances on a global rating scale (GRS), and written tests assessed participants' procedural and conceptual knowledge. KEY RESULTS:Simple mediation regression analyses showed that participants receiving an integrated instructional video performed significantly better on transfer through their intervention's positive impact on conceptual knowledge (all p?<?0.01). Further, the Integrated for Causation group performed significantly better on transfer than the Integrated in Sequence group (p?<?0.01), again mediated by improved conceptual knowledge. We observed no mediation of participants' skill retention (all p?>?0.01). CONCLUSIONS:When teaching supports cognitive integration of how and why content, trainees are able to transfer learning to new problems because of their improved conceptual understanding. Instructional designs for procedural skills that integrate how and why content can help educators optimize what trainees learn from each repetition of practice.

Project description:OBJECTIVES: The current review examines the effectiveness of simulation-based medical education (SBME) for training health professionals in cardiac physical examination and examines the relative effectiveness of key instructional design features. METHODS: Data sources included a comprehensive, systematic search of MEDLINE, EMBASE, CINAHL, PsychINFO, ERIC, Web of Science, and Scopus through May 2011. Included studies investigated SBME to teach health profession learners cardiac physical examination skills using outcomes of knowledge or skill. We carried out duplicate assessment of study quality and data abstraction and pooled effect sizes using random effects. RESULTS: We identified 18 articles for inclusion. Thirteen compared SBME to no-intervention (either single group pre-post comparisons or SBME added to other instruction common to all learners, such as traditional bedside teaching), three compared SBME to other educational interventions, and two compared two SBME interventions. Meta-analysis of the 13 no-intervention comparison studies demonstrated that simulation-based instruction in cardiac auscultation was effective, with pooled effect sizes of 1.10 (95 % CI 0.49-1.72; p?<?0.001; I(2)?=?92.4 %) for knowledge outcomes and 0.87 (95 % CI 0.52-1.22; p?<?0.001; I(2) = 91.5 %) for skills. In sub-group analysis, hands-on practice with the simulator appeared to be an important teaching technique. Narrative review of the comparative effectiveness studies suggests that SBME may be of similar effectiveness to other active educational interventions, but more studies are required. LIMITATIONS: The quantity of published evidence and the relative lack of comparative effectiveness studies limit this review. CONCLUSIONS: SBME is an effective educational strategy for teaching cardiac auscultation. Future studies should focus on comparing key instructional design features and establishing SBME's relative effectiveness compared to other educational interventions.