An enhanced approach to simulation-based mastery learning: optimising the educational impact of a novel, National Postgraduate Medical Boot Camp.
Ontology highlight
ABSTRACT: Background
Simulation-based mastery learning (SBML) is an effective, evidence-based methodology for procedural skill acquisition, but its application may be limited by its resource intensive nature. To address this issue, an enhanced SBML programme has been developed by the addition of both pre-learning and peer learning components. These components allowed the enhanced programme to be scaled up and delivered to 106 postgraduate doctors participating in a national educational teaching programme.Methods
The pre-learning component consisted of an online reading pack and videos. The peer learning component consisted of peer-assisted deliberate practice and peer observation of assessment and feedback within the SBML session. Anonymised pre- and post-course questionnaires were completed by learners who participated in the enhanced programme. A mixture of quantitative and qualitative data was obtained.Results
Questionnaires were distributed to and completed by 50 learners. Both sections of the pre-learning component were highly rated on the basis of a seven-point Likert scale. The peer learning component was also favourably received following a Likert scale rating. Peer observation of the performance and assessment process was rated similarly by first and second learners. The thematic analysis of the reasons for which peer-assisted deliberate practice was considered useful showed that familiarisation with equipment, the rehearsal of the procedure itself, the exchange of experiences and sharing of useful tips were important. The thematic analysis of the reasons why peer observation during 'performance, assessment and feedback' was useful highlighted that an ability to compare a peer's performance to their own and learning from observing a peer's mistakes were particularly helpful.Conclusion
The SBML programme described has been enhanced by the addition of pre-learning and peer learning components which are educationally valued and allow its application on a national scale.
SUBMITTER: Scahill EL
PROVIDER: S-EPMC8074238 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:The demand for advanced practice providers (APPs) is increasing across the United States to meet necessary provider staffing requirements including in intensive care settings. Currently, participation in formal postgraduate training programs, or residencies, for APPs is not required for clinical practice, such that most of the APPs immediately enter into the workforce following completion of their initial graduate-level training. Consequently, this results in a supervised training period until APPs develop the necessary competencies to practice more autonomously. Educational programs that support specialty competency development may facilitate the transition of APPs into clinical practice, allowing them to be credentialed to perform essential procedures as quickly as possible. The goal of this boot camp was to provide training for APPs in common critical care, high-risk procedures, and to provide leadership development for high-risk cases to expedite their orientation process. The following manuscript describes our experience with the development, implementation, and short-term evaluation of this training program.
| S-EPMC6454646 | biostudies-literature
Project description:Background: Pulmonary and critical care medicine (PCCM) fellowship requires a high degree of medical knowledge and procedural competency. Gaps in fellowship readiness can result in significant trainee anxiety related to starting fellowship training.Objective: To improve fellowship readiness and alleviate anxiety for PCCM-bound trainees by improving confidence in procedural skills and cognitive domains.Methods: Medical educators within the American Thoracic Society developed a national resident boot camp (RBC) to provide an immersive, experiential training program for physicians entering PCCM fellowships. The RBC curriculum is a 2-day course designed to build procedural skills, medical knowledge, and clinical confidence through high-fidelity simulation and active learning methodology. Separate programs for adult and pediatric providers run concurrently to provide unique training objectives targeted to their learners' needs. Trainee assessments include multiple-choice pre- and post-RBC knowledge tests and confidence assessments, which are scored on a four-point Likert scale, for specific PCCM-related procedural and cognitive skills. Learners also evaluate course material and educator effectiveness, which guide modifications of future RBC programs and provide feedback for individual educators, respectively.Results: The American Thoracic Society RBC was implemented in 2014 and has grown annually to include 132 trainees and more than 100 faculty members. Mean knowledge test scores for participants in the 2019 RBC adult program increased from 55% (±14% SD) on the pretest to 72% (±11% SD; P < 0.001) after RBC completion. Similarly, mean pretest scores for pediatric course attendees increased from 54% (±13% SD) to 62% (±19% SD; P = 0.17). Specific content domains that improved by 10% or more between pre- and posttests included airway management, bronchoscopy, pulmonary function testing, and code management for adult course participants, and airway management, pulmonary function testing, and extracorporeal membrane oxygenation for pediatric course participants. Trainee confidence also significantly improved across all procedural and cognitive domains for adult trainees and in 10 of 11 domains for pediatric course attendees. Course content for the 2019 RBC was overwhelmingly rated as "on target" for the level of learner, with <4% of respondents indicating any specific session was "much too basic" or "much too advanced."Conclusion: RBC participation improved PCCM-bound trainee knowledge, procedural familiarity, and confidence. Refinement of the RBC curriculum over the past 7 years has been guided by educator and course evaluations, with the ongoing goal of meeting the evolving educational needs of rising PCCM trainees.
| S-EPMC8043273 | biostudies-literature
Project description:Background:Traditional medical education strategies teach learners how to correctly perform procedures while neglecting to provide formal training on iatrogenic error management. Error management training (EMT) requires active exploration as well as explicit encouragement for learners to make and learn from errors during training. Simulation provides an excellent methodology to execute a curriculum on iatrogenic procedural complication management. We hypothesize that a standardized simulation-based EMT curriculum will improve learner's confidence, cognitive knowledge, and performance in iatrogenic injury management. Methods:This was a pilot, prospective, observational study performed in a simulation center using a curriculum developed to educate resident physicians on iatrogenic procedural complication management. Pre- and postintervention assessments included confidence surveys, cognitive questionnaires, and critical action checklists for six simulated procedure complications. Assessment data were analyzed using medians and interquartile ranges (IQRs), and the paired change scores were tested for median equality to zero via Wilcoxon signed rank tests with p < 0.05 considered statistically significant. Results:Eighteen residents participated in the study curriculum. The median (IQR) confidence increased significantly by a summed score of 12.5 (8.75-17.25; p < 0.001). Similarly, the median (IQR) knowledge significantly increased by 6 (3-8) points from the pre- to postintervention assessment (p < 0.001). For each of the simulation cases, the number of critical actions performed increased significantly (p < 0.001 to p = 0.002). Conclusion:We demonstrated significant improvement in the confidence, clinical knowledge, and performance of critical actions after the completion of this curriculum. This pilot study provides evidence that a structured EMT curriculum is an effective method to teach management of iatrogenic injuries.
| S-EPMC6457349 | biostudies-literature
Project description:BackgroundAccurate data retrieval is an essential part of patient care in the intensive care unit (ICU). The electronic health record (EHR) is the primary method for data storage and data review. We previously reported that residents participating in EHR-based simulations have varied and nonstandard approaches to finding data in the ICU, with subsequent errors in recognizing patient safety issues. We hypothesized that a novel EHR simulation-based training exercise would decrease EHR use variability among intervention interns, irrespective of prior EHR experience.ObjectiveThis study aims to understand the impact of a novel, short, high-fidelity, simulation-based EHR learning activity on the intern data gathering workflow and satisfaction.MethodsA total of 72 internal medicine interns across the 2018 and 2019 academic years underwent a dedicated EHR training session as part of a week-long boot camp early in their training. We collected data on previous EHR and ICU experience for all subjects. Training consisted of 1 hour of guided review of a high-fidelity, simulated ICU patient chart focusing on best navigation practices for data retrieval. Specifically, the activity focused on using high- and low-yield data visualization screens determined by expert consensus. The intervention group interns then had 20 minutes to review a new simulated patient chart before the group review. EHR screen navigation was captured using screen recording software and compared with data from existing ICU residents performing the same task on the same medical charts (N=62). Learners were surveyed immediately and 6 months after the activity to assess satisfaction and preferred EHR screen use.ResultsParticipants found the activity useful and enjoyable immediately and after 6 months. Intervention interns used more individual screens than reference residents (18 vs 20; P=.008), but the total number of screens used was the same (35 vs 38; P=.30). Significantly more intervention interns used the 10 most common screens (73% vs 45%; P=.001). Intervention interns used high-yield screens more often and low-yield screens less often than the reference residents, which are persistent on self-report 6 months later.ConclusionsA short, high-fidelity, simulation-based learning activity focused on provider-specific data gathering was found to be enjoyable and to modify navigation patterns persistently. This suggests that workflow-specific simulation-based EHR training throughout training is of educational benefit to residents.
| S-EPMC8081274 | biostudies-literature
Project description:BackgroundWe sought to determine if a structured educational program for neurology residents can lower door-to-needle (DTN) times at an academic institution.MethodsA neurology resident educational stroke boot camp was developed and implemented in April 2013. Using a prospective database of 170 consecutive acute ischemic stroke (AIS) patients treated with IV tissue plasminogen activator (tPA) in our emergency department (ED), we evaluated the effect of the intervention on DTN times. We compared DTN times and other process measures preintervention and postintervention. p Values < 0.05 were considered significant.ResultsThe proportion of AIS patients treated with tPA within 60 minutes of arrival to our ED tripled from 18.1% preintervention to 61.2% postintervention (p < 0.001) with concomitant reduction in DTN time (median 79 minutes vs 58 minutes, p < 0.001). The resident-delegated task (stroke code to tPA) was reduced (75 minutes vs 44 minutes, p < 0.001), while there was no difference in ED-delegated tasks (door to stroke code [7 minutes vs 6 minutes, p = 0.631], door to CT [18 minutes in both groups, p = 0.547]). There was an increase in stroke mimics treated (6.9% vs 18.4%, p = 0.031), which did not lead to an increase in adverse outcomes.ConclusionsDTN times were reduced after the implementation of a stroke boot camp and were driven primarily by efficient resident stroke code management. Educational programs should be developed for health care providers involved in acute stroke patient care to improve rapid access to IV tPA at academic institutions.
| S-EPMC5490385 | biostudies-literature
Project description:IntroductionCurrent instruments to evaluate the postgraduate medical educational environment lack theoretical frameworks and are relatively long, which may reduce response rates. We aimed to develop and validate a brief instrument that, based on a solid theoretical framework for educational environments, solicits resident feedback to screen the postgraduate medical educational environment quality.MethodsStepwise, we developed a screening instrument, using existing instruments to assess educational environment quality and adopting a theoretical framework that defines three educational environment domains: content, atmosphere and organization. First, items from relevant existing instruments were collected and, after deleting duplicates and items not specifically addressing educational environment, grouped into the three domains. In a Delphi procedure, the item list was reduced to a set of items considered most important and comprehensively covering the three domains. These items were triangulated against the results of semi-structured interviews with 26 residents from three teaching hospitals to achieve face validity. This draft version of the Scan of Postgraduate Educational Environment Domains (SPEED) was administered to residents in a general and university hospital and further reduced and validated based on the data collected.ResultsTwo hundred twenty-three residents completed the 43-item draft SPEED. We used half of the dataset for item reduction, and the other half for validating the resulting SPEED (15 items, 5 per domain). Internal consistencies were high. Correlations between domain scores in the draft and brief versions of SPEED were high (>0.85) and highly significant (p<0.001). Domain score variance of the draft instrument was explained for ?80% by the items representing the domains in the final SPEED.ConclusionsThe SPEED comprehensively covers the three educational environment domains defined in the theoretical framework. Because of its validity and brevity, the SPEED is promising as useful and easily applicable tool to regularly screen educational environment quality in postgraduate medical education.
| S-EPMC4587553 | biostudies-literature
Project description:Objectives:To assess the correlation between perception of the learning environment and the approach to learning adopted by anesthesiology residents throughout training in an academic institution in the United States. Methods:This is a cross-sectional study involving forty-one anesthesiology residents who completed electronic forms of the Revised Two-Factor Study Process Questionnaire to assess learning approaches, and the Dundee Ready Educational Environment Measure questionnaire to assess learning environment. Convenience sampling was used with the current anesthesiology residents. Learning approaches were analyzed with a multiple regression model for correlation between total score, domains, and training level. Analysis of variance was used to assess differences in perception of the learning environment based on training level. Multivariate logistic regression was used to assess the correlation between domains of learning the environment and approaches questionnaires. Cronbach ? was used to evaluate the internal consistency of responses within each domain of both questionnaires. Results:Forty-one residents completed the questionnaires. Cronbach ? varied between 0.604 and 0.76 among the domains in the Study Process Questionnaire and was greater than 0.60 for the Dundee questionnaire. There was a moderate correlation between total deep approach scores and the total subjective perception of teachers scores (R2= - 0.507, p <0.01). There was no significant association between specific domains of Dundee and study process questionnaires and resident year of training. Conclusions:The learning approaches adopted by anesthesiology residents and the perception of the educational environment are not correlated with years of training. The DREEM and R-SPQ-2F questionnaires should not be recommended for evaluation of anesthesiology residents.
| S-EPMC6773370 | biostudies-literature
Project description:IntroductionTransitioning from medical student to intern requires individuals to possess medical knowledge, clinical skills, and the ability to communicate with a wide variety of health care professional as well as patients and their families. New doctors may be expected to function within the health care team without having received explicit instruction in communication previously. The materials associated with this publication are intended to be used as resources for small-group education of graduating medical students entering into pediatric, family medicine, or emergency medicine residencies.MethodsFour pediatric cases serve as the focus points for discussion and role-play around calling consultants and discussing difficult news with families and patients. Brief didactics and detailed facilitator notes help prime learning and guide discussion. The included facilitator notes and slide sets are part of the comprehensive materials necessary to implement this 4-hour course at your own institution.ResultsThis curriculum has been used since 2012 with graduating medical students entering into pediatric, family medicine, and emergency medicine residencies at two institutions within the United States. Feedback has been overwhelmingly positive, and students have reported increased confidence in their ability to communicate with families and other health care providers.DiscussionThis publication is the second part of a two-part curriculum but may be used independently of the first part. Although the cases are based on pediatrics, the content regarding communication is universal to many medical specialties.
| S-EPMC6464432 | biostudies-literature
Project description:IntroductionThe transition for being a medical student to a full functioning intern is accompanied by considerable stress and sense of unpreparedness. Simulation based workshops were previously reported to be effective in improving the readiness of interns and residents to their daily needed skills but only few programs were implemented on a large scale.MethodsA nationally endorsed and mandated pre-internship simulation based workshop is reported. We hypothesized that this intervention will have a meaningful and sustained impact on trainees' perception of their readiness to internship with regard to patient safety and quality of care skills. Main outcome measure was the workshop's contribution to professional training in general and to critical skills and error prevention in particular, as perceived by participants.ResultsBetween 2004 and 2011, 85 workshops were conducted for a total of 4,172 trainees. Eight-hundred and six of the 2,700 participants approached by e-mail, returned feedback evaluation forms, which were analyzed. Eighty five percent of trainees perceived the workshop as an essential component of their professional training, and 87% agreed it should be mandatory. These ratings peaked during internship and were generally sustained 3 years following the workshop. Contribution to emergency care skills was especially highly ranked (83%).ConclusionImplementation of a mandatory, simulation-based, pre-internship workshop on a national scale made a significant perceived impact on interns and residents. The sustained impact should encourage adopting this approach to facilitate the student to doctor transition.
| S-EPMC4774927 | biostudies-literature
Project description:ObjectiveTo explore fourth-year medical students' experience with a virtual, near-peer facilitated pediatric boot camp through the lens of self-determination theory (SDT).MethodsWe developed a virtual pediatric boot camp elective for fourth-year medical students pursuing pediatric residency using Kern's six steps of curriculum development. The two-week virtual elective consisted of facilitated video conferences and small group discussions led by two senior pediatric residents. Semi-structured focus groups were conducted after elective completion. Using SDT as our conceptual framework, we explored participants' experience with the near-peer facilitation of the boot camp. Focus group recordings were transcribed and thematically analyzed using deductive coding for SDT, with inductive coding for themes outside the theory's scope. Saturation was reached after three focus groups. The codebook was iteratively revised through peer debriefing between coders and reviewed by other authors. Credibility was established through member checking.ResultsNinety-two percent of eligible medical students (n = 23/25) participated in the boot camp with attendance ranging from 18-21 students per session. Twelve students (52%) participated in three focus groups. Qualitative analysis identified five major themes. Four themes consistent with SDT emerged: competence, autonomy, relatedness to near-peers, and relatedness to specialty/institution. The learning environment, including the virtual setting, emerged as an additional, non-SDT-related theme.ConclusionsMedical students' experience with our virtual boot camp closely aligned with SDT. Near-peer relatedness emerged as a unique theme which could be further investigated in other aspects of medical student education. Future research could evaluate higher-level learning outcomes from near-peer educational opportunities.Supplementary informationThe online version contains supplementary material available at 10.1007/s40670-021-01466-w.
| S-EPMC8762435 | biostudies-literature