Dataset Information

Medical student perceptions of assessment systems, subjectivity, and variability on introductory dermatology clerkships.

ABSTRACT:

Background

Elective introductory clerkships in dermatology serve a critical function in providing formative experiences to medical students interested in the field. Although dermatology clerkships play a pivotal role in students' career choices and residency preparation, the assessment systems used to evaluate students on these clerkships are widely different and likely affect student experiences.

Objective

This study aimed to explore the relationship between dermatology clerkship assessment systems and student experiences through interviews with students about their clerkship reflections and perceptions of assessment.

Methods

The authors contacted clerkship directors via the Association of Professors of Dermatology mailing list and invited them to provide a description of the assessment system at their institution. The authors, via contacted clerkship directors, then invited students who had completed an introductory dermatology clerkship in between 2018 and 2019 to provide a description of the assessment system at their institution and to participate in a qualitative interview about their experiences with assessment systems. The authors then iteratively synthesized interview transcripts using phenomenological analysis, in which a templated approach was used to achieve comprehensive thematic categorization.

Results

Prior to clerkship onset, students expressed a limited understanding of their clinical role and the assessment system. During the clerkship, students endorsed variable expectations across preceptors, limited feedback experiences, and pressures to perform for evaluators. After their clerkship, students continued to perceive assessment systems as nontransparent, subjective, and preordained.

Conclusion

Medical students perceived assessment systems on introductory dermatology clerkships to be unclear and arbitrary. Encouragingly, students also viewed these challenges in assessment as malleable, identifying several opportunities for educational reform in dermatology clerkships.

SUBMITTER: Yoon J

PROVIDER: S-EPMC8243165 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BACKGROUND:Objective structured clinical examinations (OSCEs) are a useful method to evaluate medical students' performance in the clerkship years. OSCEs are designed to assess skills and knowledge in a standardized clinical setting and through use of a preset standard grading sheet, so that clinical knowledge can be evaluated at a high level and in a reproducible way. OBJECTIVE:This study aimed to present our OSCE assessment tool designed specifically for radiology clerkship medical students, which we called the objective structured radiology examination (OSRE), with the intent to advance the assessment of clerkship medical students by providing an objective, structured, reproducible, and low-cost method to evaluate medical students' radiology knowledge and the reproducibility of this assessment tool. METHODS:We designed 9 different OSRE cases for radiology clerkship classes with participating third- and fourth-year medical students. Each examination comprises 1 to 3 images, a clinical scenario, and structured questions, along with a standardized scoring sheet that allows for an objective and low-cost assessment. Each medical student completed 3 of 9 random examination cases during their rotation. To evaluate for reproducibility of our scoring sheet assessment tool, we used 5 examiners to grade the same students. Reproducibility for each case and consistency for each grader were assessed with a two-way mixed effects intraclass correlation coefficient (ICC). An ICC below 0.4 was deemed poor to fair, an ICC of 0.41 to 0.60 was moderate, an ICC of 0.6 to 0.8 was substantial, and an ICC greater than 0.8 was almost perfect. We also assessed the correlation of scores and the students' clinical experience with a linear regression model and compared mean grades between third- and fourth-year students. RESULTS:A total of 181 students (156 third- and 25 fourth-year students) were included in the study for a full academic year. Moreover, 6 of 9 cases demonstrated average ICCs more than 0.6 (substantial correlation), and the average ICCs ranged from 0.36 to 0.80 (P<.001 for all the cases). The average ICC for each grader was more than 0.60 (substantial correlation). The average grade among the third-year students was 11.9 (SD 4.9), compared with 12.8 (SD 5) among the fourth-year students (P=.005). There was no correlation between clinical experience and OSRE grade (-0.02; P=.48), adjusting for the medical school year. CONCLUSIONS:Our OSRE is a reproducible assessment tool with most of our OSRE cases showing substantial correlation, except for 3 cases. No expertise in radiology is needed to grade these examinations using our scoring sheet. There was no correlation between scores and the clinical experience of the medical students tested.

Project description:ObjectivesThe mistreatment of medical students remains pervasive in medical education. Understanding the extent to which clinicians and students recognise mistreatment can assist in creating targeted interventions that reduce mistreatment. The objective of this study was to use clinical vignettes to assess perceptions of medical student mistreatment among medical students and clinical faculty at an Australian university.Design, setting and participantsThis cross-sectional study used a survey of medical students and clinical faculty in a Doctor of Medicine (MD) programme at Macquarie University in Sydney, Australia. Data were collected via an online survey between 13 July and 27 July 2020.Outcome measuresFourteen clinical vignettes were developed based on commonly reported themes of mistreatment. An additional control vignette was also included, and these 15 vignettes were distributed via email to all 169 MD students and 42 teaching faculty at this teaching site. Participants were asked to rate whether the vignettes portrayed mistreatment on a 5-point Likert scale (strongly disagree to strongly agree).ResultsRespondents included 83 MD students and 34 clinical faculty. On average, students perceived mistreatment in 9 of 14 vignettes and faculty in 8 of 14 vignettes. Faculty and student perceptions aligned in themes of sexual abuse, physical abuse and in the control vignette depicting a constructive teaching style. Perceptions differed significantly between faculty and students (p<0.05) for five vignettes across the themes of gender discrimination, requests of students to perform non-educational tasks, humiliation, specialty choice discrimination and requests to perform a task beyond the student's capacity.ConclusionAgreement on what constitutes appropriate behaviour is crucial to ensuring that a culture of mistreatment can be replaced with one of kindness, equity and respect. This study demonstrated the successful use of vignettes to compare perceptions of mistreatment, with faculty and student perceptions differing across a variety of themes.

Project description:BackgroundThere are growing numbers of refugees throughout the world. Refugee health is a relatively unstudied and rarely taught component of medical education. In response to this need, a Refugee Health Elective was begun. Medical student perceptions toward cultural aspects of medicine and refugee health before and after participation in the elective were measured.MethodsPreliminary questionnaires were given to all preclinical students at the academic year commencement with follow-up questionnaires at the refugee elective's conclusion. Both questionnaires examined students' comfort in interacting with patients and familiarity with refugee medical issues, alternative medical practices, and social hindrances to medical care. The preliminary answers served as a control and follow-up questionnaire data were separated into participant/non-participant categories. All preclinical medical students at two Midwestern medical schools were provided the opportunity to participate in the Refugee Health Elective and surveys. The 3 data groups were compared using unadjusted and adjusted analysis techniques with the Kruskall-Wallis, Bonferroni and ANCOVA adjustment. P-values < 0.05 were considered significant.Results408 and 403 students filled out the preliminary and follow-up questionnaires, respectfully, 42 of whom participated in the elective. Students considering themselves minorities or multilingual were more likely to participate. Elective participants were more likely to be able to recognize the medical/mental health issues common to refugees, to feel comfortable interacting with foreign-born patients, and to identify cultural differences in understanding medical/mental health conditions, after adjusting for minority or multilingual status.ConclusionAs medical schools integrate a more multicultural curriculum, a Refugee Health Elective for preclinical students can enhance awareness and promote change in attitude toward medical/mental health issues common to refugees. This elective format offers tangible and effective avenues for these topics to be addressed.

Project description:BackgroundThe use of mobile apps in health care is growing. Current and future practitioners must be equipped with the skills to navigate and utilize apps in patient care, yet few strategies exist for training health care professional students on the usage of apps.ObjectiveTo characterize first-year pharmacy student use of medical apps, evaluate first-year pharmacy student's perception of skills in finding, evaluating, and using medical apps before and after a focused learning experience, and assess student satisfaction and areas for improvement regarding the learning experience.MethodsStudents listened to a recorded, Web-based lecture on finding, evaluating, and using mobile apps in patient care. A 2-hour, interactive workshop was conducted during which students were led by an instructor through a discussion on strategies for finding and using apps in health care. The students practiced evaluating 6 different health care-related apps. Surveys were conducted before and after the focused learning experience to assess students' perceptions of medical apps and current use and perspectives on satisfaction with the learning experience and role of technology in health care.ResultsThis educational intervention is the first described formal, interactive method to educate student pharmacists on medical apps. With a 99% response rate, surveys conducted before and after the learning experience displayed perceived improvement in student skills related to finding (52/119, 44% before vs 114/120, 95% after), evaluating (18/119, 15% before vs 112/120, 93% after), and using medical apps in patient care (31/119, 26% before vs 108/120, 90% after) and the health sciences classroom (38/119, 32% before vs 104/120, 87% after). Students described satisfaction with the educational experience and agreed that it should be repeated in subsequent years (89/120, 74% agreed or strongly agreed). Most students surveyed possessed portable electronic devices (107/119, 90% mobile phone) and agreed with the concept of medical apps being an important part of the health care profession in the future (112/119, 94% before and 115/120, 96% after).ConclusionsStudent pharmacists recognize the key role technology plays in the future of health care. A medical apps workshop was successful in improving student pharmacists' perceptions of ability to find, evaluate, and use medical apps.