Dataset Information

How does preclinical laboratory training impact physical examination skills during the first clinical year? A retrospective analysis of routinely collected objective structured clinical examination scores among the first two matriculating classes of a reformed curriculum in one Polish medical school.

ABSTRACT:

Objective

As a result of a curriculum reform launched in 2012 at our institution, preclinical training was shortened to 2 years instead of the traditional 3 years, creating additional incentives to optimise teaching methods. In accordance with the new curriculum, a semester-long preclinical module of clinical skills (CS) laboratory training takes place in the second year of study, while an introductory clinical course (ie, brief introductory clerkships) is scheduled for the Fall semester of the third year. Objective structured clinical examinations (OSCEs) are carried out at the conclusion of both the preclinical module and the introductory clinical course. Our aim was to compare the scores at physical examination stations between the first and second matriculating classes of a newly reformed curriculum on preclinical second-year OSCEs and early clinical third-year OSCEs.

Design

Analysis of routinely collected data.

Setting

One Polish medical school.

Participants

Complete OSCE records for 462 second-year students and 445 third-year students.

Outcome measures

OSCE scores by matriculation year.

Results

In comparison to the first class of the newly reformed curriculum, significantly higher (ie, better) OSCE scores were observed for those students who matriculated in 2013, a year after implementing the reformed curriculum. This finding was consistent for both second-year and third-year cohorts. Additionally, the magnitude of the improvement in median third-year OSCE scores was proportional to the corresponding advancement in preceding second-year preclinical OSCE scores for each of two different sets of physical examination tasks. In contrast, no significant difference was noted between the academic years in the ability to interpret laboratory data or ECG - tasks which had not been included in the second-year preclinical training.

Conclusion

Our results suggest the importance of preclinical training in a CS laboratory to improve students' competence in physical examination at the completion of introductory clinical clerkships during the first clinical year.

SUBMITTER: Swierszcz J

PROVIDER: S-EPMC5588968 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:The Brandenburg Medical School "Theodor Fontane" (MHB) was founded in 2014 by municipal and non-profit institutions in Bernau, Brandenburg an der Havel and Neuruppin to train more physicians for the non-metropolitan region of Brandenburg. Since the 2015 summer term, 48 medical students have been enrolled each year, accepted through the university's own selection process in which the score on the German school-leaving exam (Abitur) and time spent on the waiting list play subordinate roles. Tuition fees can be partially financed through scholarship agreements with regional hospitals if the applicants commit themselves to medical specialist training (Facharztweiterbildung) at a particular hospital. The main places of study are Neuruppin and Brandenburg an der Havel; there is a decentralized study phase from the eighth to tenth semester of study. The Brandenburg Reformed Medical Curriculum (BMM) complies with the model clause contained in the German regulations governing the licensing of medical doctors (ÄAppO). The curriculum is based on problem-based learning (PBL) and focused on competencies and consists of integrated interdisciplinary modules that combine, from the very beginning, basic sciences with clinical and theoretical medical subjects. The focus on general practice is visible in the regularly held "Practical Days" (Praxistag) during which second-year students and above have the opportunity to observe at participating medical practices and familiarize themselves with primary care in Brandenburg. A special focus of BMM is on the acquisition and development of communication and interpersonal skills. These are imparted through a longitudinal curriculum referred to as "Teamwork, Reflection, Interaction, Communication" (TRIK). High value is placed on critical thinking and scientific scholarship and this is reflected in an eight-week academic placement in which the students independently write a research paper. Several different teaching formats ensure that, along with learning specific subjects, sustained personal development can also take place. BMM's decentralized study phase starting in the eighth semester represents a special part of the curriculum in which students complete their clinical training in small groups at selected cooperating hospitals in Brandenburg. This phase encompasses not only hospital placements and other local patient-centered courses, but also centralized instruction via video conferencing to assure that basic sciences and clinical theory continue to be covered. Knowledge- and performance-based semester assessments, in particular OSCEs, reinforce the practical aspects of the training. These replace the M1 state medical examination in the first study phase. The first medical students are now in their ninth semester as of April 2019, making it still too early for final evaluations. The curriculum, successfully implemented to date, already satisfies core requirements of the Master Plan 2020 for undergraduate medical education (Masterplan Medizinstudium 2020) with the curriculum's organization and structure, curricular content, assessment formats and student admission process. With its decentralized structure, BMM specifically addresses the social and health policy challenges facing rural regions of Brandenburg. This is the first curriculum that has taken on the improvement of healthcare in rural regions as its central aim.

Project description:Introduction: The aim of the Objective Structured Clinical Examination (OSCE) is a standardized and fair assessment of clinical skills. Observing second clinical year medical students during a summative OSCE assessing a General Practice clerkship, we noticed that information exchange with peers led to a progressively faster and overly focused management of simulations. Therefore, we established a Multiple Scenario-OSCE (MS-OSCE) where all students had to manage the same chief complaint at a station but it's underlying scenarios being randomly changed during students' rotation through their parcours. We wanted to ensure they fully explore differential diagnosis instead of managing their task influenced by shared information. We wanted to assess if a MS-OSCE violates the assumption of objectivity and fairness given that students are not tested with the same scenarios. Methods: We developed and piloted five OSCE stations (chest pain, abdominal pain, back pain, fatigue and acute cough) with two or three different underlying scenarios each. At each station these scenarios randomly changed from student to student. Performance was assessed with a checklist and global rating. The effect of scenarios and raters on students' grades was assessed calculating the intraclass correlation coefficient with a fixed effect two level linear model. Results: A total of 169 students and 23 raters participated in the MS-OSCE. The internal consistency over all stations was 0.65 by Cronbach's alpha. The difference of the mean grades between the scenarios of a given chief complaint ranged from 0.03 to 0.4 on a 1 to 5 grading scale. The effect of scenarios on the variance of the final grades at each station ranged from 4% to 9% and of raters from 20% to 50% when adjusted for students' skills. Conclusions: The effect of different scenarios on the grades was relevant but small compared to the effect of raters on grades. Improving rater training is more important to ensure objectivity and fairness of MS-OSCE than providing the same scenario to all students.

Project description:BACKGROUND:Objective structured clinical examinations (OSCEs) are a useful method to evaluate medical students' performance in the clerkship years. OSCEs are designed to assess skills and knowledge in a standardized clinical setting and through use of a preset standard grading sheet, so that clinical knowledge can be evaluated at a high level and in a reproducible way. OBJECTIVE:This study aimed to present our OSCE assessment tool designed specifically for radiology clerkship medical students, which we called the objective structured radiology examination (OSRE), with the intent to advance the assessment of clerkship medical students by providing an objective, structured, reproducible, and low-cost method to evaluate medical students' radiology knowledge and the reproducibility of this assessment tool. METHODS:We designed 9 different OSRE cases for radiology clerkship classes with participating third- and fourth-year medical students. Each examination comprises 1 to 3 images, a clinical scenario, and structured questions, along with a standardized scoring sheet that allows for an objective and low-cost assessment. Each medical student completed 3 of 9 random examination cases during their rotation. To evaluate for reproducibility of our scoring sheet assessment tool, we used 5 examiners to grade the same students. Reproducibility for each case and consistency for each grader were assessed with a two-way mixed effects intraclass correlation coefficient (ICC). An ICC below 0.4 was deemed poor to fair, an ICC of 0.41 to 0.60 was moderate, an ICC of 0.6 to 0.8 was substantial, and an ICC greater than 0.8 was almost perfect. We also assessed the correlation of scores and the students' clinical experience with a linear regression model and compared mean grades between third- and fourth-year students. RESULTS:A total of 181 students (156 third- and 25 fourth-year students) were included in the study for a full academic year. Moreover, 6 of 9 cases demonstrated average ICCs more than 0.6 (substantial correlation), and the average ICCs ranged from 0.36 to 0.80 (P<.001 for all the cases). The average ICC for each grader was more than 0.60 (substantial correlation). The average grade among the third-year students was 11.9 (SD 4.9), compared with 12.8 (SD 5) among the fourth-year students (P=.005). There was no correlation between clinical experience and OSRE grade (-0.02; P=.48), adjusting for the medical school year. CONCLUSIONS:Our OSRE is a reproducible assessment tool with most of our OSRE cases showing substantial correlation, except for 3 cases. No expertise in radiology is needed to grade these examinations using our scoring sheet. There was no correlation between scores and the clinical experience of the medical students tested.