Dataset Information

Piloting an outcome-based programme evaluation tool in undergraduate medical education.

ABSTRACT: AIMS: Different approaches to performance-oriented allocation of resources according to teaching quality are currently being discussed within German medical schools. The implementation of these programmes is impeded by a lack of valid criteria to measure teaching quality. An assessment of teaching quality should include structural and procedural aspects but focus on learning outcome itself. The aim of this study was to implement a novel, outcome-based evaluation tool within the clinical phase of a medical curriculum and address differences between the novel tool and traditional evaluation methods. METHODS: Student self-assessments before and after completion of a teaching module were used to compute performance gains for specific learning objectives. Mean performance gains in each module were compared to student expectations before the module and data derived from a traditional evaluation tool using overall course ratings at the end of the module. RESULTS: A ranking of the 21 modules according to computed performance gains yielded entirely different results than module rankings based on overall course ratings. There was no significant correlation between performance gain and overall ratings. However, the latter were significantly correlated to student expectations before entering the module as well as structural and procedural parameters (Pearson's r 0.7-0.9). CONCLUSION: Performance gain computed from comparative self-assessments adds an important new dimension to course evaluation in medical education. In contrast to overall course ratings, the novel tool is less heavily confounded by construct-irrelevant factors. Thus, it appears to be more appropriate than overall course ratings in determining teaching quality and developing algorithms to guide performance-oriented resource allocation in medical education.

SUBMITTER: Raupach T

PROVIDER: S-EPMC3374140 | biostudies-other | 2012

REPOSITORIES: biostudies-other

ACCESS DATA

Publications

Piloting an outcome-based programme evaluation tool in undergraduate medical education.

Raupach Tobias T Schiekirka Sarah S Münscher Christian C Beißbarth Tim T Himmel Wolfgang W Burckhardt Gerhard G Pukrop Tobias T

GMS Zeitschrift fur medizinische Ausbildung 20120515 3

<h4>Aims</h4>Different approaches to performance-oriented allocation of resources according to teaching quality are currently being discussed within German medical schools. The implementation of these programmes is impeded by a lack of valid criteria to measure teaching quality. An assessment of teaching quality should include structural and procedural aspects but focus on learning outcome itself. The aim of this study was to implement a novel, outcome-based evaluation tool within the clinical p ...[more]

PMID: 22737199

Similar Datasets

Project description:BackgroundPhysicians are in a position of great influence to advocate for health equity. As such, it is important for physicians-in-training to develop the knowledge and skills necessary to fulfil this role. Although various undergraduate medical programs have implemented health advocacy training, they often lack experiential learning and physician involvement. These aspects are foundational to the Advocacy Mentorship Initiative (AMI) which utilizes cascading mentorship as a novel approach to advocacy training. Medical students develop advocacy competency as peer mentors to youth raised in at-risk environments, while also being mentored themselves by physician residents. We aim to determine whether there are specific advantages to utilizing cascading mentorship to facilitate the attainment of advocacy competencies in undergraduate medical education.MethodsMedical students participating in AMI between 2017 to 2020 completed pre- and post-exposure questionnaires. Questionnaires assessed confidence in advocacy-related skills and knowledge of youth advocacy concepts, as well as learning goals, skills gained, benefits of AMI and resident mentors, and impact on future career. Sign tests were utilized to analyze quantitative results, and content analysis was used for open-ended responses. A triangulation protocol was also utilized.ResultsFifty mentors participated, 24 (48%) of which completed both pre- and post-exposure questionnaires. Participants gained confidence in advocacy-related skills (p?<?0.05) such as working with vulnerable populations and advocating for medical and non-medical needs. They also reported significant improvements (p?<?0.01) in their understanding of social determinants of health and concepts related to children's health and development. Content analysis showed that participants built meaningful relationships with mentees in which they learned about social determinants of health, youth advocacy, and developed various advocacy-related skills. Participants greatly valued mentorship by residents, identifying benefits such as support and advice regarding relations with at-risk youth, and career mentorship. AMI impacted participants' career trajectories in terms of interest in working with youth, psychiatry, and advocacy.ConclusionsAMI offers a unique method of advocacy training through cascading mentorship that engages medical students both as mentors to at-risk youth and mentees to resident physicians. Through cascading mentorship, medical students advance in their advocacy-related skills and understanding of social determinants of health.

Project description:BackgroundSince June 2002, revised regulations in Germany have required "Emergency Medical Care" as an interdisciplinary subject, and state that emergency treatment should be of increasing importance within the curriculum. A survey of the current status of undergraduate medical education in emergency medical care establishes the basis for further committee work.MethodsUsing a standardized questionnaire, all medical faculties in Germany were asked to answer questions concerning the structure of their curriculum, representation of disciplines, instructors' qualifications, teaching and assessment methods, as well as evaluation procedures.ResultsData from 35 of the 38 medical schools in Germany were analysed. In 32 of 35 medical faculties, the local Department of Anaesthesiology is responsible for the teaching of emergency medical care; in two faculties, emergency medicine is taught mainly by the Department of Surgery and in another by Internal Medicine. Lectures, seminars and practical training units are scheduled in varying composition at 97% of the locations. Simulation technology is integrated at 60% (n = 21); problem-based learning at 29% (n = 10), e-learning at 3% (n = 1), and internship in ambulance service is mandatory at 11% (n = 4). In terms of assessment methods, multiple-choice exams (15 to 70 questions) are favoured (89%, n = 31), partially supplemented by open questions (31%, n = 11). Some faculties also perform single practical tests (43%, n = 15), objective structured clinical examination (OSCE; 29%, n = 10) or oral examinations (17%, n = 6).ConclusionEmergency Medical Care in undergraduate medical education in Germany has a practical orientation, but is very inconsistently structured. The innovative options of simulation technology or state-of-the-art assessment methods are not consistently utilized. Therefore, an exchange of experiences and concepts between faculties and disciplines should be promoted to guarantee a standard level of education in emergency medical care.

Project description:BACKGROUND:Telemedicine has grown exponentially in the United States over the past few decades, and contemporary trends in the health care environment are serving to fuel this growth into the future. Therefore, medical schools are learning to incorporate telemedicine competencies into the undergraduate medical education of future physicians so that they can more effectively leverage telemedicine technologies for improving the quality of care, increasing patient access, and reducing health care expense. This review articulates the efforts of allopathic-degree-granting medical schools in the United States to characterize and systematize the learnings that have been generated thus far in the domain of telemedicine training in undergraduate medical education. OBJECTIVE:The aim of this review was to collect and outline the current experiences and learnings that have been generated as medical schools have sought to implement telemedicine capacity-building into undergraduate medical education. METHODS:We performed a mixed-methods review, starting with a literature review via Scopus, tracking with Excel, and an email outreach effort utilizing telemedicine curriculum data gathered by the Liaison Committee on Medical Education. This outreach included 70 institutions and yielded 7 interviews, 4 peer-reviewed research papers, 6 online documents, and 3 completed survey responses. RESULTS:There is an emerging, rich international body of learning being generated in the field of telemedicine training in undergraduate medical education. The integration of telemedicine-based lessons, ethics case-studies, clinical rotations, and even teleassessments are being found to offer great value for medical schools and their students. Most medical students find such training to be a valuable component of their preclinical and clinical education for a variety of reasons, which include fostering greater familiarity with telemedicine and increased comfort with applying telemedical approaches in their future careers. CONCLUSIONS:These competencies are increasingly important in tackling the challenges facing health care in the 21st century, and further implementation of telemedicine curricula into undergraduate medical education is highly merited.

Dataset Information

Piloting an outcome-based programme evaluation tool in undergraduate medical education.

Publications

Piloting an outcome-based programme evaluation tool in undergraduate medical education.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure