Dataset Information

Relationship Between "Simulated Patient Scenarios and Role-Playing" Method and OSCE Performance in Senior Anesthesiology Residents: A Correlation Assessment Study.

ABSTRACT:

Background

"Simulated-patient scenarios and role-playing" and OSCE are among the many non-traditional education methods with variable results in different clinical settings.

Objectives

This cross-sectional study was performed to assess the correlation between the results of these two methods in senior anesthesiology residents, with a special focus on four of the six ACGME core competencies.

Methods

During two years, senior anesthesiology residents were subject to "simulated patient scenario and role-playing" sessions. Two faculty members took the role of the patient and one of the relatives. An objective checklist with 15 items was prepared to be rated by other department faculty members. Meanwhile, an ordered pattern of OSCE was prepared to cover four core competencies that were more related to this academic process (from a total of six core competencies). The mean and standard deviation of the score of each of the 15 items in the checklist were calculated. The correlation between cumulative checklist scoring results and OSCE exam results was assessed. A P value of less than 0.05 was considered significant.

Results

A total of 40 senior anesthesiology residents, with 344 assessments by faculty members in 40 sessions, were enrolled in the study. The questionnaire's Cronbach's alpha reliability was 0.74. No statistically significant disparity was detected between the results of the two assessment methods, while the results of the two assessments had a significant correlation (two-tailed correlation coefficient = 0.886; P value < 0.001).

Conclusions

There was an objective relationship between the results of "simulated patient scenario and role-playing" strategies and the results of OSCE exams using an observer-based rating method. Thus, they could be used as surrogates in the assessment of core clinical competencies of senior anesthesiology residents.

SUBMITTER: Dabbagh A

PROVIDER: S-EPMC8207878 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BACKGROUND:Point-of-care ultrasound (POCUS) is an important clinical tool for a growing number of medical specialties. The current American College of Emergency Physicians (ACEP) Ultrasound Guidelines recommend that trainees perform 150-300 ultrasound scans as part of POCUS training. We sought to assess the relationship between ultrasound scan numbers and performance on an ultrasound-focused observed structured clinical examination (OSCE). METHODS:This was a cross-sectional cohort study in which the number of ultrasound scans residents had previously performed were obtained from a prospective database and compared with their total score on an ultrasound OSCE. Ultrasound fellowship trained emergency physicians administered a previously published OSCE that consisted of standardized questions testing image acquisition and interpretation, ultrasound machine mechanics, patient positioning, and troubleshooting. Residents were observed while performing core applications including aorta, biliary, cardiac, deep vein thrombosis, Focused Assessment with Sonography in Trauma (FAST), pelvic, and thoracic ultrasound imaging. RESULTS:Twenty-nine postgraduate year (PGY)-3 and PGY-4 emergency medicine (EM) residents participated in the OSCE. The median OSCE score was 354 [interquartile range (IQR) 343-361] out of a total possible score of 370. Trainees had previously performed a median of 341 [IQR 289-409] total scans. Residents with more than 300 ultrasound scans had a median OSCE score of 355 [IQR 351-360], which was slightly higher than the median OSCE score of 342 [IQR 326-361] in the group with less than 300 total scans (p?=?0.04). Overall, a LOWESS curve demonstrated a positive association between scan numbers and OSCE scores with graphical review of the data suggesting a plateau effect. CONCLUSION:The results of this small single residency program study suggest a pattern of improvement in OSCE performance as scan numbers increased, with the appearance of a plateau effect around 300 scans. Further investigation of this correlation in diverse practice environments and within individual ultrasound modalities will be necessary to create generalizable recommendations for scan requirements as part of overall POCUS proficiency assessment.

Project description:Substance use disorder (SUD) among anesthesiologists and other physicians poses serious risks to both physicians and patients. Formulation of policy and individual treatment plans is hampered by lack of data regarding the epidemiology and outcomes of physician SUD.To describe the incidence and outcomes of SUD among anesthesiology residents.Retrospective cohort study of physicians who began training in United States anesthesiology residency programs from July 1, 1975, to July 1, 2009, including 44,612 residents contributing 177,848 resident-years to analysis. Follow-up for incidence and relapse was to the end of training and December 31, 2010, respectively.Cases of SUD (including initial SUD episode and any relapse, vital status and cause of death, and professional consequences of SUD) ascertained through training records of the American Board of Anesthesiology, including information from the Disciplinary Action Notification Service of the Federation of State Medical Boards and cause of death information from the National Death Index.Of the residents, 384 had evidence of SUD during training, with an overall incidence of 2.16 (95% CI, 1.95-2.39) per 1000 resident-years (2.68 [95% CI, 2.41-2.98] men and 0.65 [95% CI, 0.44-0.93] women per 1000 resident-years). During the study period, an initial rate increase was followed by a period of lower rates in 1996-2002, but the highest incidence has occurred since 2003 (2.87 [95% CI, 2.42-3.39] per 1000 resident-years). The most common substance category was intravenous opioids, followed by alcohol, marijuana or cocaine, anesthetics/hypnotics, and oral opioids. Twenty-eight individuals (7.3%; 95% CI, 4.9%-10.4%) died during the training period; all deaths were related to SUD. The Kaplan-Meier estimate of the cumulative proportion of survivors experiencing at least 1 relapse by 30 years after the initial episode (based on a median follow-up of 8.9 years [interquartile range, 5.0-18.8 years]) was 43% (95% CI, 34%-51%). Rates of relapse and death did not depend on the category of substance used. Relapse rates did not change over the study period.Among anesthesiology residents entering primary training from 1975 to 2009, 0.86% had evidence of SUD during training. Risk of relapse over the follow-up period was high, indicating persistence of risk after training.

Project description:IntroductionThis activity is designed for midlevel and senior anesthesia trainees to experience the complexities of one-lung ventilation in pediatrics in a high-fidelity simulated environment. With the use of video-assisted thoracoscopic surgery (VATS) becoming increasingly common in pediatrics, we identified this area as an opportunity for the development of a dedicated educational simulation activity.MethodsOur simulated patient is a 3-year-old girl with empyema presenting for decortication via VATS who subsequently develops hypoxemia. The main challenges for the trainee include airway selection and insertion, lung isolation with fiber optic confirmation, and management of hypoxemia in the setting of one-lung ventilation. A pediatric medical simulator suitable for practicing resuscitation is required, and a tracheobronchial tree model is highly desirable. Basic knowledge of thoracic and pediatric anesthesia is required, but specific experience with pediatric lung isolation is not.ResultsLearners who experienced the content of this simulation expressed a strong sentiment of value. All pilot trainees were surveyed and indicated they either agree or strongly agree (4 or 5, respectively, on a 5-point Likert scale) that "This simulation enhanced my understanding of how to select lung isolation devices for pediatric patients" and "This simulation enhanced my understanding of how to manage hypoxia in context in one-lung ventilation." Comments were overall positive, including "I am better prepared to manage pediatric one lung ventilation cases."DiscussionAt the University of Iowa, this activity is part of a core curriculum of simulation training that resident physicians in anesthesiology experience during their training. It functions as a tool for education, evaluation, and self-identification of weaknesses in the learner's knowledge base as it relates to the perioperative management of pediatric one-lung ventilation, as well as for reinforcing material learned in the classroom and operating room. Numerous anesthesiology residents and faculty have pilot-tested this simulation, and necessary modifications have been made based on their feedback.