Dataset Information

A novel comprehensive in-training examination course can improve residency-wide scores.

ABSTRACT: INTRODUCTION: The annual American Board of Emergency Medicine (ABEM) in-training examination is a tool to assess resident progress and knowledge. We implemented a course at the New York-Presbyterian Emergency Medicine Residency Program to improve ABEM scores and evaluate its effect. Previously, the examination was not emphasized and resident performance was lower than expected. METHODS: As an adjunct to required weekly residency conferences, an intensive 14-week in-training examination preparation program was developed that included lectures, pre-tests, high-yield study sheets, and a remediation program. We compared each residents in-training examination score to the postgraduate year-matched national mean. Scores before and after course implementation were evaluated by repeat measures regression modeling. Residency performance was evaluated by comparing residency average to the national average each year and by tracking ABEM national written examination pass rates. RESULTS: Following the course's introduction, odds of a resident scoring higher than the national average increased by 3.9 (95% CI 1.9-7.3) and percentage of residents exceeding the national average increased by 37% (95% CI 23%-52%). In the time since the course was started the overall residency mean score has outperformed the national average and the first-time ABEM written examination board pass rate has been 100%. CONCLUSION: A multifaceted residency-wide examination curriculum focused around an intensive 14-week course was associated with marked improvement on the in-training examination.

SUBMITTER: Sharma R

PROVIDER: S-EPMC3444196 | biostudies-other | 2012 Sep

REPOSITORIES: biostudies-other

ACCESS DATA

Similar Datasets

Project description:IntroductionAudience response systems (ARS) are increasingly popular; however, their contribution to education is not completely clear. Our study found that scores from review quizzes delivered by an ARS correlate with in-training exam (ITE) scores and are viewed positively by residents. This information may be useful in identifying poor performers early so that targeted educational interventions can be made. The objective was to determine if scores on review quizzes delivered by an ARS correlate with ITE scores and to obtain participant feedback on use of the ARS for ITE preparation.MethodsThis was a prospective observational study of emergency medicine (EM) residents at six accredited EM residency programs. Subjects included residents who had taken previous ITEs. Subjects participated in bimonthly review sessions using an ARS. Twelve review quizzes were administered, each consisting of 10 multiple-choice questions. After the ITE, subjects completed an attitudinal survey consisting of six Likert-scale items and one "yes/no" item. We used a mixed linear model to analyze the data, accounting for prior 2012 ITE scores and nesting due to institution.ResultsAmong 192 participants, 135 (70.3%) completed the ITE in both 2012 and 2013; we analyzed their data for the first objective. Results from the mixed linear model indicate that the total mean score on the review quizzes was a significant [t(127) = 6.68; p < 0.001] predictor of the 2013 ITE after controlling for the 2012 ITE score. One hundred forty-six (76.0%) participants completed the attitudinal survey; 96% of respondents stated that they would like ARS to be used more often in resident education. Respondents felt the sessions aided in learning (mean 7.7/10), assisted in preparation for the ITE (mean 6.7/10), and helped identify content areas of weakness (mean 7.6/10).ConclusionOur results suggest that scores from review quizzes delivered by an audience response system correlate with in-training exam scores and is viewed positively by residents.

Project description:BackgroundStudy motivation and knowledge retention benefit from regular student self-assessments. Inclusion of certainty-based learning (CBL) in computer-assisted formative tests may further enhance this by enabling students to identify whether they are uninformed or misinformed regarding the topics tested, which may trigger future study actions including instructor consultation.MethodsUsing a cross-over study design involving two out of thirteen computer-assisted formative assessments (CAFAs) of a first-year cell biology course, we compared student-instructor interactions, student learning experiences and final exam scores between two (bio)medical science student cohorts who worked with different CBL-containing CAFAs.ResultsA total of 389 students participated in the study. After completion 159 (41%) filled in a questionnaire on their experience with CBL during supervised CAFAs. In the control group the median duration of student-instructor interactions was 90 s (range 60-140 s), and this increased with 20 s to 110 s (range 60-150 s) in the group working with a CBL-based CAFA. The number of interactions was similar in both groups (0.22 per student per hour, regardless of CBL inclusion). Forty percent of the students expected that CBL would positively influence their study behavior, and 23% also anticipated a positive effect on examination scores. Student examination scores, however, were not affected by CBL. Almost half of the students (43%) were in favor of CBL inclusion in future computer-assisted learning modules, whereas 33% did not see merit in including CBL in CAFAs.ConclusionsIncorporation of CBL in a single formative assessment led to a slight increase in student-instructor interaction times, but had effect neither on the number of student-instructor interactions nor on exam scores. CBL inclusion positively influenced student's appreciation of the coursework, presumably by helping students to evaluate their mastery level and identify misconceptions. A more extensive enrollment of CBL beyond an individual formative assessment, throughout a course or a curriculum, may possibly reveal positive effects on study efficacy.

Project description:The competence centre for Residency Training in Family Medicine Bavaria (CCRTB) was established to improve the quality of postgraduate medical education by offering training and mentoring programmes for residents, and by providing train-the-trainer and mentoring courses for supervisors. Beyond that, regional Residency Training Networks (RTN) on avoluntary basis were developed to facilitate structured and efficient clinical rotation programs. Primary aim was to investigate the burden of burnout and the development of professionalism among CCRTB-residencies within a cross-sectional study. Secondary aim was to evaluate differences between CCRTB-residents with and without participation in aregional RTN. Burnout was determined with the Maslach Burnout Inventory (MBI), comprising the scales emotional exhaustion, depersonalization, and personal accomplishment. Ambulatory professionalization was evaluated using the German Professional Scale (Pro-D), comprising the scales professionalism towards the patient, towards other professionals, towards society, and towards oneself. Statistical significance of group differences was calculated by nonparametric tests. Multivariable linear regression modelling was performed to estimate the independent impact of professionalization and RTN participation on burnout scores. 347 CRRTB residents in ambulatory postgraduate training were invited, 212 (61.1%) participated, and 197 (92.9%) were included in our analyses. Lower emotional exhaustion and depersonalization, and increased personal accomplishment was associated with increased professionalisation, which was significant for nearly all Pro-D scales (p ≤ 0.05). RTN residents showed higher professionalism towards the patient (p = 0.031), other professionals (p = 0.012), and towards the society (p = 0.007) than residents of unstructured programs, and higher levels of personal accomplishment (p < 0.05). Early and efficient professionalization might be akey to reduce burnout and to establish asatisfying career in family medicine. Train-the-trainer and mentoring concepts should be implemented regularly for the training of residents. Thus, increased engagement in medical didactics should be aprerequisite for accreditation as atraining practice for residents.

Dataset Information

A novel comprehensive in-training examination course can improve residency-wide scores.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets