Dataset Information

Impact of a structured review session on medical student psychiatry subject examination performance.

ABSTRACT: Introduction: The National Board of Medical Examiners (NBME) subject examinations are used as a standardized metric for performance in required clerkships for third-year medical students. While several medical schools have implemented a review session to help consolidate knowledge acquired during the clerkship, the effects of such an intervention are not yet well-established. An improvement in NBME psychiatry examination scores has previously been reported with a single end-of-clerkship review session, but this was limited by a small sample size and the fact that attendance at the review session was optional, leading to likely selection bias. Methods: A 1.5-hour structured review session was conducted for medical students in the last week of each 4-week psychiatry clerkship between September 2014 and July 2015. Students were required to attend unless excused due to scheduling conflicts. Scores on the NBME psychiatry subject exam were compared with those of students taking the examination in the corresponding time period in each of the previous two academic years. Results: 83 students took the exam during the experimental period, while 176 took the exam during the control period. Statistically significant improvements were found in mean score (p=0.03), mean for the two lowest scores in each group (p<0.0007), and percentage of students scoring 70 or less (p=0.03). Percentage of students achieving the maximum possible score (99) was higher in the experimental group, but did not reach significance (p=0.06). Conclusions: An end-of-clerkship review session led to increased mean scores on the NBME psychiatry subject examination, particularly for students at the lower end of the score range. Future research should investigate the impact of such an intervention in other specialties and other institutions.

SUBMITTER: Siddiqi SH

PROVIDER: S-EPMC4648197 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:This study aimed to investigate the impact of student e-learning on the development of clinical competencies. The study participants were 3rd year students (n = 43) at a private mid-sized medical school located in a South Korean suburb on a four-year medical program. Educational intervention was implemented to enhance student clinical performance. Students engaged in learning activities that intended to promote their self-directed learning abilities and clinical performances using e-learning resources. Intervention was conducted for the duration of six months during the 3rd year and its effectiveness was investigated by comparing student performances in OSCEs in a pre- and post- comparison format and also by comparing them with national scores. In addition, student perceptions of the impact of e-learning on their OSCE performances were assessed using a questionnaire, which included 36 items that elicited student perceptions of their experiences of e-learning and readiness for e-learning. Student OSCE scores improved significantly after educational intervention in all domains of clinical competencies assessed and for total scores (p < 0.001). Furthermore, students achieved higher OSCE scores than national average scores in the post-test, whereas they had performed lower than national average scores in the pre-test. Students showed neutral or slightly positive responses to the effectiveness of e-learning, and their perceptions of e-learning were not associated with their e-learning readiness scores. The study shows student OSCE performance improved significantly after educational intervention, which indicate the effectiveness of e-learning to support student learning of clinical performance. Despite significant improvements in student OSCE scores after e-learning, their perceptions of its effectiveness were neutral. Furthermore, student perceptions of e-learning were not associated with their readiness for it. Suggestions are made to help students use e-learning more effectively to enhance their clinical competencies.

Project description:BACKGROUND:Peer-assisted learning (PAL) refers to a learning activity whereby students of similar academic level teach and learn from one another. Groupe de perfectionnement des habiletés cliniques (Clinical Skills Improvement Group), a student organization at Université Laval, Canada, propelled PAL into the digital era by creating a collaborative virtual patient platform. Medical interviews can be completed in pairs (a student-patient and a student-doctor) through an interactive Web-based application, which generates a score (weighted for key questions) and automated feedback. OBJECTIVES:The aim of the study was to measure the pedagogical impact of the application on the score at medical interview stations at the summative preclerkship Objective Structured Clinical Examination (OSCE). METHODS:We measured the use of the application (cases completed, mean score) in the 2 months preceding the OSCE. We also accessed the results of medical interview stations at the preclerkship summative OSCE. We analyzed whether using the application was associated with higher scores and/or better passing grades (≥60%) at the OSCE. Finally, we produced an online form where students could comment on their appreciation of the application. RESULTS:Of the 206 students completing the preclerkship summative OSCE, 170 (82.5%) were registered users on the application, completing a total of 3133 cases (18 by active user in average, 7 minutes by case in average). The appreciation questionnaire was answered online by 45 students who mentioned appreciating the intuitive, easy-to-use, and interactive design, the diversity of cases, and the automated feedback. Using the application was associated with reduced reported stress, improved scores (P=.04), and improved passing rates (P=.11) at the preclerkship summative OSCE. CONCLUSIONS:This study suggests that PAL can go far beyond small-group teaching, showing students' potential to create helpful pedagogical tools for their peers.

Project description:BACKGROUND:Objective structured clinical examinations (OSCEs) are a useful method to evaluate medical students' performance in the clerkship years. OSCEs are designed to assess skills and knowledge in a standardized clinical setting and through use of a preset standard grading sheet, so that clinical knowledge can be evaluated at a high level and in a reproducible way. OBJECTIVE:This study aimed to present our OSCE assessment tool designed specifically for radiology clerkship medical students, which we called the objective structured radiology examination (OSRE), with the intent to advance the assessment of clerkship medical students by providing an objective, structured, reproducible, and low-cost method to evaluate medical students' radiology knowledge and the reproducibility of this assessment tool. METHODS:We designed 9 different OSRE cases for radiology clerkship classes with participating third- and fourth-year medical students. Each examination comprises 1 to 3 images, a clinical scenario, and structured questions, along with a standardized scoring sheet that allows for an objective and low-cost assessment. Each medical student completed 3 of 9 random examination cases during their rotation. To evaluate for reproducibility of our scoring sheet assessment tool, we used 5 examiners to grade the same students. Reproducibility for each case and consistency for each grader were assessed with a two-way mixed effects intraclass correlation coefficient (ICC). An ICC below 0.4 was deemed poor to fair, an ICC of 0.41 to 0.60 was moderate, an ICC of 0.6 to 0.8 was substantial, and an ICC greater than 0.8 was almost perfect. We also assessed the correlation of scores and the students' clinical experience with a linear regression model and compared mean grades between third- and fourth-year students. RESULTS:A total of 181 students (156 third- and 25 fourth-year students) were included in the study for a full academic year. Moreover, 6 of 9 cases demonstrated average ICCs more than 0.6 (substantial correlation), and the average ICCs ranged from 0.36 to 0.80 (P<.001 for all the cases). The average ICC for each grader was more than 0.60 (substantial correlation). The average grade among the third-year students was 11.9 (SD 4.9), compared with 12.8 (SD 5) among the fourth-year students (P=.005). There was no correlation between clinical experience and OSRE grade (-0.02; P=.48), adjusting for the medical school year. CONCLUSIONS:Our OSRE is a reproducible assessment tool with most of our OSRE cases showing substantial correlation, except for 3 cases. No expertise in radiology is needed to grade these examinations using our scoring sheet. There was no correlation between scores and the clinical experience of the medical students tested.

Project description:PurposeObjective structured clinical examinations (OSCE) evaluate clinical reasoning, communication skills, and interpersonal behavior during medical education. In France, clinical training has long relied on bedside clinical practice in academic hospitals. The need for a simulated teaching environment has recently emerged, due to the increasing number of students admitted to medical schools, and the necessity of objectively evaluating practical skills. This study aimed at investigating the relationships between OSCE grades and current evaluation modalities.MethodsThree-hundred seventy-nine 4th-year students of University-of-Paris Medical School participated to the first large-scale OSCE at this institution, consisting in three OSCE stations (OSCE#1-3). OSCE#1 and #2 focused on cardiovascular clinical skills and competence, whereas OSCE#3 focused on relational skills while providing explanations before planned cholecystectomy. We investigated correlations of OSCE grades with multiple choice (MCQ)-based written examinations and evaluations of clinical skills and behavior (during hospital traineeships); OSCE grade distribution; and the impact of integrating OSCE grades into the current evaluation in terms of student ranking.ResultsThe competence-oriented OSCE#1 and OSCE#2 grades correlated only with MCQ grades (r = 0.19, P<0.001) or traineeship skill grades (r = 0.17, P = 0.001), respectively, and not with traineeship behavior grades (P>0.75). Conversely, the behavior-oriented OSCE#3 grades correlated with traineeship skill and behavior grades (r = 0.19, P<0.001, and r = 0.12, P = 0.032), but not with MCQ grades (P = 0.09). The dispersion of OSCE grades was wider than for MCQ examinations (P<0.001). When OSCE grades were integrated to the final fourth-year grade with an incremental 10%, 20% or 40% coefficient, an increasing proportion of the 379 students had a ranking variation by ±50 ranks (P<0.001). This ranking change mainly affected students among the mid-50% of ranking.ConclusionThis large-scale French experience showed that OSCE designed to assess a combination of clinical competence and behavioral skills, increases the discriminatory capacity of current evaluations modalities in French medical schools.

Project description:IntroductionThere has been a move to a "flipped classroom" (FC) in medical education. The FC promotes active learning and utilizes independent preparation prior to in-class sessions. Few studies have evaluated the effectiveness of the FC approach in medical education, specifically via virtual learning. The purpose of this study evaluates student and faculty perceptions of the FC approach and relationships between student engagement and performance.MethodThe first-year medical student psychiatry curriculum was redesigned with an FC approach and subsequently altered by COVID-19 to a virtual learning environment. A mixed-method approach was used to examine both qualitative assessment and quantitative performance data. Students and facilitators were invited to participate in surveys regarding the curriculum changes. Student performance data was collected via quizzes and examinations. Engagement was evaluated by student participation in National Board of Medical Examiners-style multiple-choice questions delivered via Top Hat®. Correlational analyses were used to evaluate associations between engagement and performance. T-tests were used to compare student satisfaction across 2019 and 2020.ResultsPerformance on in-class questions was positively associated with class rank and performance (p < 0.005). More students were either satisfied or strongly satisfied (91.5%) in 2020 compared to 85.7% in 2019 (two-tailed t-test, p = 0.04). Most students (81.3%) preferred in-class questions to lectures. In 2020, 62.6% of student comments were positive regarding the psychiatry curriculum vs 33.3% in 2019. Over 61.5% of facilitators felt positive towards the changes.ConclusionOur results demonstrate a positive relationship between engagement and class performance. Students and facilitators positively perceived the approach, with students preferring in-class questions compared to lectures. Future research should evaluate overall performance on standardized tests, third-year clerkships, and number of students matching into psychiatry.Supplementary informationThe online version contains supplementary material available at 10.1007/s40670-021-01287-x.

Dataset Information

Impact of a structured review session on medical student psychiatry subject examination performance.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets