Dataset Information

Effect of ethnicity on performance in a final objective structured clinical examination: qualitative and quantitative study.

ABSTRACT: To assess the effect of ethnicity on student performance in stations assessing communication skills within an objective structured clinical examination.Quantitative and qualitative study.A final UK clinical examination consisting of a two day objective structured clinical examination with 22 stations.82 students from ethnic minorities and 97 white students.Mean scores for stations (quantitative) and observations made using discourse analysis on selected communication stations (qualitative).Mean performance of students from ethnic minorities was significantly lower than that of white students for stations assessing communication skills on days 1 (67.0% (SD 6.8%) and 72.3% (7.6%); P=0.001) and 2 (65.2% (6.6%) and 69.5% (6.3%); P=0.003). No examples of overt discrimination were found in 309 video recordings. Transcriptions showed subtle differences in communication styles in some students from ethnic minorities who performed poorly. Examiners' assumptions about what is good communication may have contributed to differences in grading.There was no evidence of explicit discrimination between students from ethnic minorities and white students in the objective structured clinical examination. A small group of male students from ethnic minorities used particularly poorly rated communicative styles, and some subtle problems in assessing communication skills may have introduced bias. Tests need to reflect issues of diversity to ensure that students from ethnic minorities are not disadvantaged.

SUBMITTER: Wass V

PROVIDER: S-EPMC153100 | biostudies-literature | 2003 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Effect of ethnicity on performance in a final objective structured clinical examination: qualitative and quantitative study.

Wass Val V Roberts Celia C Hoogenboom Ron R Jones Roger R Van der Vleuten Cees C

BMJ (Clinical research ed.) 20030401 7393

<h4>Objective</h4>To assess the effect of ethnicity on student performance in stations assessing communication skills within an objective structured clinical examination.<h4>Design</h4>Quantitative and qualitative study.<h4>Setting</h4>A final UK clinical examination consisting of a two day objective structured clinical examination with 22 stations.<h4>Participants</h4>82 students from ethnic minorities and 97 white students.<h4>Main outcome measures</h4>Mean scores for stations (quantitative) a ...[more]

PMID: 12689978

Similar Datasets

Project description:This study aimed to investigate the impact of student e-learning on the development of clinical competencies. The study participants were 3rd year students (n = 43) at a private mid-sized medical school located in a South Korean suburb on a four-year medical program. Educational intervention was implemented to enhance student clinical performance. Students engaged in learning activities that intended to promote their self-directed learning abilities and clinical performances using e-learning resources. Intervention was conducted for the duration of six months during the 3rd year and its effectiveness was investigated by comparing student performances in OSCEs in a pre- and post- comparison format and also by comparing them with national scores. In addition, student perceptions of the impact of e-learning on their OSCE performances were assessed using a questionnaire, which included 36 items that elicited student perceptions of their experiences of e-learning and readiness for e-learning. Student OSCE scores improved significantly after educational intervention in all domains of clinical competencies assessed and for total scores (p < 0.001). Furthermore, students achieved higher OSCE scores than national average scores in the post-test, whereas they had performed lower than national average scores in the pre-test. Students showed neutral or slightly positive responses to the effectiveness of e-learning, and their perceptions of e-learning were not associated with their e-learning readiness scores. The study shows student OSCE performance improved significantly after educational intervention, which indicate the effectiveness of e-learning to support student learning of clinical performance. Despite significant improvements in student OSCE scores after e-learning, their perceptions of its effectiveness were neutral. Furthermore, student perceptions of e-learning were not associated with their readiness for it. Suggestions are made to help students use e-learning more effectively to enhance their clinical competencies.

Project description:BACKGROUND:Evaluation of the competence and practical skills of nursing students, using the objective structured clinical examination (OSCE), is an integral part of the nursing education program. However, their performance could be negatively influenced by a significant level of stress and anxiety prior to the test. The present study aimed to evaluate the effect of an anxiety coping program on the OSCE performance level of first-year nursing students in Shiraz, Iran. METHODS:The present quasi-experimental study was conducted among 76 nursing students; control group (n?=?35) and intervention group (n?=?41). To attain the study purpose, the intervention group received a pre-exam anxiety coping program that included relaxation and soothing techniques, diaphragmatic breathing training, and progressive muscle relaxation training accompanied by light instrumental music, while the control group received no intervention before the exam. Data collection instruments included a demographic characteristics form and State-Trait Anxiety Inventory (STAI) questionnaire. Demographic characteristics of the participants indicated an overall homogeneity within the study population. The STAI questionnaire was filled in before and after the OSCE and the results were compared with those of the control group. The data were analysed using SPSS software (version 22.0). P?<?0.05 was considered statistically significant. RESULTS:As a result of the anxiety coping program, a substantial reduction in the anxiety score (by 11.61?units) in the intervention group was observed. There was a significant difference in the pre- and post-exam anxiety scores between the control and intervention groups (P?<?0.001). The anxiety coping program improved the examination results of nursing students in the final exam compared to the midterm results (an increase of 0.9487?units, P?<?0.001). CONCLUSION:The anxiety coping program reduced the anxiety level among nursing students and improved their OSCE results. Our findings can be utilized to better evaluate clinical activities in different medical and paramedical groups. Moreover, educators can implement such coping programs prior to evaluations in order to effectively assess the knowledge, attitude, and performance of the students.

Project description:BACKGROUND:Peer-assisted learning (PAL) refers to a learning activity whereby students of similar academic level teach and learn from one another. Groupe de perfectionnement des habiletés cliniques (Clinical Skills Improvement Group), a student organization at Université Laval, Canada, propelled PAL into the digital era by creating a collaborative virtual patient platform. Medical interviews can be completed in pairs (a student-patient and a student-doctor) through an interactive Web-based application, which generates a score (weighted for key questions) and automated feedback. OBJECTIVES:The aim of the study was to measure the pedagogical impact of the application on the score at medical interview stations at the summative preclerkship Objective Structured Clinical Examination (OSCE). METHODS:We measured the use of the application (cases completed, mean score) in the 2 months preceding the OSCE. We also accessed the results of medical interview stations at the preclerkship summative OSCE. We analyzed whether using the application was associated with higher scores and/or better passing grades (≥60%) at the OSCE. Finally, we produced an online form where students could comment on their appreciation of the application. RESULTS:Of the 206 students completing the preclerkship summative OSCE, 170 (82.5%) were registered users on the application, completing a total of 3133 cases (18 by active user in average, 7 minutes by case in average). The appreciation questionnaire was answered online by 45 students who mentioned appreciating the intuitive, easy-to-use, and interactive design, the diversity of cases, and the automated feedback. Using the application was associated with reduced reported stress, improved scores (P=.04), and improved passing rates (P=.11) at the preclerkship summative OSCE. CONCLUSIONS:This study suggests that PAL can go far beyond small-group teaching, showing students' potential to create helpful pedagogical tools for their peers.

Project description:PurposeEnsuring that examiners in different parallel circuits of objective structured clinical examinations (OSCEs) judge to the same standard is critical to the chain of validity. Recent work suggests examiner-cohort (i.e., the particular group of examiners) could significantly alter outcomes for some candidates. Despite this, examiner-cohort effects are rarely examined since fully nested data (i.e., no crossover between the students judged by different examiner groups) limit comparisons. In this study, the authors aim to replicate and further develop a novel method called Video-based Examiner Score Comparison and Adjustment (VESCA), so it can be used to enhance quality assurance of distributed or national OSCEs.MethodIn 2019, 6 volunteer students were filmed on 12 stations in a summative OSCE. In addition to examining live student performances, examiners from 8 separate examiner-cohorts scored the pool of video performances. Examiners scored videos specific to their station. Video scores linked otherwise fully nested data, enabling comparisons by Many Facet Rasch Modeling. Authors compared and adjusted for examiner-cohort effects. They also compared examiners' scores when videos were embedded (interspersed between live students during the OSCE) or judged later via the Internet.ResultsHaving accounted for differences in students' ability, different examiner-cohort scores for the same ability of student ranged from 18.57 of 27 (68.8%) to 20.49 (75.9%), Cohen's d = 1.3. Score adjustment changed the pass/fail classification for up to 16% of students depending on the modeled cut score. Internet and embedded video scoring showed no difference in mean scores or variability. Examiners' accuracy did not deteriorate over the 3-week Internet scoring period.ConclusionsExaminer-cohorts produced a replicable, significant influence on OSCE scores that was unaccounted for by typical assessment psychometrics. VESCA offers a promising means to enhance validity and fairness in distributed OSCEs or national exams. Internet-based scoring may enhance VESCA's feasibility.

Project description:Introduction: The aim of the Objective Structured Clinical Examination (OSCE) is a standardized and fair assessment of clinical skills. Observing second clinical year medical students during a summative OSCE assessing a General Practice clerkship, we noticed that information exchange with peers led to a progressively faster and overly focused management of simulations. Therefore, we established a Multiple Scenario-OSCE (MS-OSCE) where all students had to manage the same chief complaint at a station but it's underlying scenarios being randomly changed during students' rotation through their parcours. We wanted to ensure they fully explore differential diagnosis instead of managing their task influenced by shared information. We wanted to assess if a MS-OSCE violates the assumption of objectivity and fairness given that students are not tested with the same scenarios. Methods: We developed and piloted five OSCE stations (chest pain, abdominal pain, back pain, fatigue and acute cough) with two or three different underlying scenarios each. At each station these scenarios randomly changed from student to student. Performance was assessed with a checklist and global rating. The effect of scenarios and raters on students' grades was assessed calculating the intraclass correlation coefficient with a fixed effect two level linear model. Results: A total of 169 students and 23 raters participated in the MS-OSCE. The internal consistency over all stations was 0.65 by Cronbach's alpha. The difference of the mean grades between the scenarios of a given chief complaint ranged from 0.03 to 0.4 on a 1 to 5 grading scale. The effect of scenarios on the variance of the final grades at each station ranged from 4% to 9% and of raters from 20% to 50% when adjusted for students' skills. Conclusions: The effect of different scenarios on the grades was relevant but small compared to the effect of raters on grades. Improving rater training is more important to ensure objectivity and fairness of MS-OSCE than providing the same scenario to all students.

Dataset Information

Effect of ethnicity on performance in a final objective structured clinical examination: qualitative and quantitative study.

Publications

Effect of ethnicity on performance in a final objective structured clinical examination: qualitative and quantitative study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets