Dataset Information

An enhanced approach to simulation-based mastery learning: optimising the educational impact of a novel, National Postgraduate Medical Boot Camp.

ABSTRACT:

Background

Simulation-based mastery learning (SBML) is an effective, evidence-based methodology for procedural skill acquisition, but its application may be limited by its resource intensive nature. To address this issue, an enhanced SBML programme has been developed by the addition of both pre-learning and peer learning components. These components allowed the enhanced programme to be scaled up and delivered to 106 postgraduate doctors participating in a national educational teaching programme.

Methods

The pre-learning component consisted of an online reading pack and videos. The peer learning component consisted of peer-assisted deliberate practice and peer observation of assessment and feedback within the SBML session. Anonymised pre- and post-course questionnaires were completed by learners who participated in the enhanced programme. A mixture of quantitative and qualitative data was obtained.

Results

Questionnaires were distributed to and completed by 50 learners. Both sections of the pre-learning component were highly rated on the basis of a seven-point Likert scale. The peer learning component was also favourably received following a Likert scale rating. Peer observation of the performance and assessment process was rated similarly by first and second learners. The thematic analysis of the reasons for which peer-assisted deliberate practice was considered useful showed that familiarisation with equipment, the rehearsal of the procedure itself, the exchange of experiences and sharing of useful tips were important. The thematic analysis of the reasons why peer observation during 'performance, assessment and feedback' was useful highlighted that an ability to compare a peer's performance to their own and learning from observing a peer's mistakes were particularly helpful.

Conclusion

The SBML programme described has been enhanced by the addition of pre-learning and peer learning components which are educationally valued and allow its application on a national scale.

SUBMITTER: Scahill EL

PROVIDER: S-EPMC8074238 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Background: Pulmonary and critical care medicine (PCCM) fellowship requires a high degree of medical knowledge and procedural competency. Gaps in fellowship readiness can result in significant trainee anxiety related to starting fellowship training.Objective: To improve fellowship readiness and alleviate anxiety for PCCM-bound trainees by improving confidence in procedural skills and cognitive domains.Methods: Medical educators within the American Thoracic Society developed a national resident boot camp (RBC) to provide an immersive, experiential training program for physicians entering PCCM fellowships. The RBC curriculum is a 2-day course designed to build procedural skills, medical knowledge, and clinical confidence through high-fidelity simulation and active learning methodology. Separate programs for adult and pediatric providers run concurrently to provide unique training objectives targeted to their learners' needs. Trainee assessments include multiple-choice pre- and post-RBC knowledge tests and confidence assessments, which are scored on a four-point Likert scale, for specific PCCM-related procedural and cognitive skills. Learners also evaluate course material and educator effectiveness, which guide modifications of future RBC programs and provide feedback for individual educators, respectively.Results: The American Thoracic Society RBC was implemented in 2014 and has grown annually to include 132 trainees and more than 100 faculty members. Mean knowledge test scores for participants in the 2019 RBC adult program increased from 55% (±14% SD) on the pretest to 72% (±11% SD; P < 0.001) after RBC completion. Similarly, mean pretest scores for pediatric course attendees increased from 54% (±13% SD) to 62% (±19% SD; P = 0.17). Specific content domains that improved by 10% or more between pre- and posttests included airway management, bronchoscopy, pulmonary function testing, and code management for adult course participants, and airway management, pulmonary function testing, and extracorporeal membrane oxygenation for pediatric course participants. Trainee confidence also significantly improved across all procedural and cognitive domains for adult trainees and in 10 of 11 domains for pediatric course attendees. Course content for the 2019 RBC was overwhelmingly rated as "on target" for the level of learner, with <4% of respondents indicating any specific session was "much too basic" or "much too advanced."Conclusion: RBC participation improved PCCM-bound trainee knowledge, procedural familiarity, and confidence. Refinement of the RBC curriculum over the past 7 years has been guided by educator and course evaluations, with the ongoing goal of meeting the evolving educational needs of rising PCCM trainees.

Project description:BackgroundAccurate data retrieval is an essential part of patient care in the intensive care unit (ICU). The electronic health record (EHR) is the primary method for data storage and data review. We previously reported that residents participating in EHR-based simulations have varied and nonstandard approaches to finding data in the ICU, with subsequent errors in recognizing patient safety issues. We hypothesized that a novel EHR simulation-based training exercise would decrease EHR use variability among intervention interns, irrespective of prior EHR experience.ObjectiveThis study aims to understand the impact of a novel, short, high-fidelity, simulation-based EHR learning activity on the intern data gathering workflow and satisfaction.MethodsA total of 72 internal medicine interns across the 2018 and 2019 academic years underwent a dedicated EHR training session as part of a week-long boot camp early in their training. We collected data on previous EHR and ICU experience for all subjects. Training consisted of 1 hour of guided review of a high-fidelity, simulated ICU patient chart focusing on best navigation practices for data retrieval. Specifically, the activity focused on using high- and low-yield data visualization screens determined by expert consensus. The intervention group interns then had 20 minutes to review a new simulated patient chart before the group review. EHR screen navigation was captured using screen recording software and compared with data from existing ICU residents performing the same task on the same medical charts (N=62). Learners were surveyed immediately and 6 months after the activity to assess satisfaction and preferred EHR screen use.ResultsParticipants found the activity useful and enjoyable immediately and after 6 months. Intervention interns used more individual screens than reference residents (18 vs 20; P=.008), but the total number of screens used was the same (35 vs 38; P=.30). Significantly more intervention interns used the 10 most common screens (73% vs 45%; P=.001). Intervention interns used high-yield screens more often and low-yield screens less often than the reference residents, which are persistent on self-report 6 months later.ConclusionsA short, high-fidelity, simulation-based learning activity focused on provider-specific data gathering was found to be enjoyable and to modify navigation patterns persistently. This suggests that workflow-specific simulation-based EHR training throughout training is of educational benefit to residents.

Project description:IntroductionCurrent instruments to evaluate the postgraduate medical educational environment lack theoretical frameworks and are relatively long, which may reduce response rates. We aimed to develop and validate a brief instrument that, based on a solid theoretical framework for educational environments, solicits resident feedback to screen the postgraduate medical educational environment quality.MethodsStepwise, we developed a screening instrument, using existing instruments to assess educational environment quality and adopting a theoretical framework that defines three educational environment domains: content, atmosphere and organization. First, items from relevant existing instruments were collected and, after deleting duplicates and items not specifically addressing educational environment, grouped into the three domains. In a Delphi procedure, the item list was reduced to a set of items considered most important and comprehensively covering the three domains. These items were triangulated against the results of semi-structured interviews with 26 residents from three teaching hospitals to achieve face validity. This draft version of the Scan of Postgraduate Educational Environment Domains (SPEED) was administered to residents in a general and university hospital and further reduced and validated based on the data collected.ResultsTwo hundred twenty-three residents completed the 43-item draft SPEED. We used half of the dataset for item reduction, and the other half for validating the resulting SPEED (15 items, 5 per domain). Internal consistencies were high. Correlations between domain scores in the draft and brief versions of SPEED were high (>0.85) and highly significant (p<0.001). Domain score variance of the draft instrument was explained for ≥80% by the items representing the domains in the final SPEED.ConclusionsThe SPEED comprehensively covers the three educational environment domains defined in the theoretical framework. Because of its validity and brevity, the SPEED is promising as useful and easily applicable tool to regularly screen educational environment quality in postgraduate medical education.

Project description:BackgroundThe coronavirus disease 2019 (COVID-19) pandemic has disrupted clinical practice, research and teaching. During peaks, virtual courses were implemented but these changes are poorly described, especially for oncology postgraduate students and faculty teachers.Patients and methodsWe administered two surveys from June 2021 to October 2021 to students and faculty teachers (250 and 80 responses, respectively) who registered at Gustave Roussy School of Cancer Sciences (Université Paris-Saclay) during 3 consecutive university years (October 2018 to October 2021), where a major shift to e-learning was associated with COVID-19 pandemic.ResultsMost students were female (53%), attending physicians (50%), aged 30-39 years (54%) and 2020-2021 (66.4%) was the main year of training. Most faculty teachers were male (58%), aged 40-50 years (44%) and had participated in training for at least 3 years (83%). More than half of the students received 100% virtual training [55% versus 45% face-to-face/mixed teaching modalities; online (84%) versus remote teaching (16%)]. Only 34% of students declared >80% 'active listening' and only 16% of teachers considered e-learning to be more suitable (compared with face-to-face) for postgraduate education. Virtual teaching decreased student-teacher interactions as compared with mixed/face-to-face (lessons were sufficiently interactive for 54% students if virtual only teaching versus for 71% if other teaching modalities; P = 0.009). Teachers stated that virtual learning did not lead to any improvements in terms of attendance (68%), interaction (74%) and quality of teaching (68%). However, most faculty (76%) acknowledged that partial e-learning training should be maintained outside the pandemic, if it represents ≤50% of the whole teaching (teachers: 79% versus student: 66%; P = 0.04).ConclusionsCOVID-19 accelerated the transition toward novel practices. Students and faculty teachers agreed on the need for future mixed (≤50% e-learning) teaching modalities. Adequate formation and the use of codified best newer virtual practices are required.