Dataset Information

Feasibility of implementing a standardized multisource feedback program in the graduate medical education environment.

ABSTRACT: BACKGROUND: Multisource feedback (MSF) is emerging as a central assessment method for several medical education competencies. Planning and resource requirements for a successful implementation can be significant. Our goal is to examine barriers and challenges to a successful multisite MSF implementation, and identify the benefits of MSF as perceived by participants. METHODS: We analyzed the 2007-2008 field trial implementation of the Assessment of Professional Behaviors, an MSF program of the National Board of Medical Examiners, conducted with 8 residency and fellowship programs at 4 institutions. We use a multimethod analysis that draws on quantitative process indicators and qualitative participant experience data. Process indicators include program attrition, completion of implementation milestones, number of participants at each site, number of MSF surveys assigned and completed, and adherence to an experimental rater training protocol. Qualitative data include communications with each program and semistructured interviews conducted with key field trial staff to elicit their experiences with implementation. RESULTS: Several implementation challenges are identified, including communication gaps and difficulty scheduling implementation and training workshops. Participant interviews indicate several program changes that should enhance feasibility, including increasing communication and streamlining the training process. CONCLUSIONS: Multisource feedback is a complex educational intervention that has the potential to provide users with a better understanding of performance expectations in the graduate medical education environment. Standardization of the implementation processes and tools should reduce the burden on program administrators and participants. Further study is warranted to broaden our understanding of the resource requirements for a successful MSF implementation and to show how outcomes change as MSF gains broader acceptance.

SUBMITTER: Richmond M

PROVIDER: S-EPMC3244317 | biostudies-other | 2011 Dec

REPOSITORIES: biostudies-other

ACCESS DATA

Similar Datasets

Project description:BackgroundLittle is known about the level of burnout among program administrators (PAs) in medical education and its impact on the trainee environment.ObjectiveTo investigate variations in burnout levels over a 1-year period among a national cohort of PAs and examine any associations between perceived support and isolation.DesignA 1-year longitudinal study conducted to assess burnout levels among PAs across the USA. The Copenhagen Burnout Inventory (score range, 0-100) was used to measure burnout over one academic year (July 2017-June 2018). The generalized estimating equations model was used to measure changes in burnout levels from the start of the academic year. To explore the differences in burnout scores across question response levels, a one-way ANOVA test was utilized and reported as least squares means ± SD.ParticipantsIndividuals who self-identified as PAs in a graduate medical education training program. Among the 1084 persons nationwide who expressed interest, 904 (83%) completed the baseline survey; 29 of the 42 (69%) local administrators completed the survey. "Clients" defined as interns, residents/fellows, and medical students.Main measuresChange in burnout score using the validated tool. Hypothesis formulated prior to data collection.Key resultsAmong the 931 participants, the 3rd quarter (March 2018) marked the lowest average personal burnout score (change from the start of academic year, - 3.67; p < 0.001, 95% CI - 5.77 to - 1.58) and work-related burnout score (change, - 3.03; p < 0.001, 95% CI - 5.01 to - 1.06). Client-related burnout was the lowest in September 2017 (change, - 1.46; p = 0.491; 95% CI - 3.54 to 0.62). June 2018: those who strongly agreed to feeling isolated in their current position had an increased personal (69.1 ± 18.4 SD), work-related (72.5 ± 20.8 SD), and client-related (42.3 ± 23.7 SD) burnout score.ConclusionsPA burnout levels fluctuate over the academic year and are shown to increase as feelings of isolation grow.

Project description:ObjectivesOur program implemented East EMWars, a year-long, longitudinal game that added competition to our existing curricular content. We surveyed residents to investigate the impact of gamification in emergency medicine residency training. We hypothesized that residents would report higher levels of motivation, engagement, and challenge with gamification compared to traditional didactics. Furthermore, we hypothesized that residents would exhibit generally positive perceptions about gamification as a learning tool and that it would translate to improved performance on the annual in-training examination.MethodsThis was a single-center, prospective pre- and post-intervention survey study at a community-based emergency medicine residency program. Given the multiplicity of research questions and inherent nature of educational research, a mixed methods approach was utilized. We utilized nonparametric testing for quantitative data with paired responses pre- and post-intervention. We solicited comments on the post-intervention that were categorized under thematic approach and presented in complete and unedited form in the results.ResultsEighteen (100%) of eligible residents in our program participated in both surveys. There were statistically significant increases in reported levels of motivation, engagement, and challenge with gamification compared to traditional didactic methods. Residents also reported overwhelmingly positive general perceptions about gamification and its broader generalizability and applicability. We did not reach statistical significance in determining if in-training exam scores were associated with our gamification initiative.ConclusionsThis study was a first-of-its-kind look into a longitudinal game in an emergency medicine residency program. Although our results are encouraging, medical educators need further research to determine if this increase in motivation, engagement, and challenge will be associated with an increase in examination scores or, more importantly, healthcare outcomes. Theory-based, broader-scale, prospective studies are needed to further explore and help establish these associations and outcomes.

Project description:BACKGROUND: Little is known about the factors that influence applicants' decisions to select a graduate medical education training program. Programs may improve their recruitment by better understanding that process. METHODS: Following the Match for the years 2008 though 2010, an electronic survey was sent to 664 applicants to 15 Duke University graduate medical education programs. Those individuals were ranked high enough to match to Duke University but chose to match at another institution. We used quantitative and qualitative analyses to explore factors influencing candidates' decisions and to identify program and institutional improvements to better attract top candidates. RESULTS: Response rate was 63% (417/664). The quantitative analysis identified factors that were "very important" to applicants (current resident satisfaction, relationship between faculty and residents, collegiality of current residents, quantity and quality of faculty content/mentoring, faculty teaching expertise, diversity of patients and types of procedures, and location), and those that were "not important" to applicants (child care or education opportunities for children, salary, United States Medical Licensing Examination requirements, part-time training options, favorable environment for minorities or women). There were statistically significant differences among specialties. Qualitative analysis identified 3 themes as most influential in their choice: location, program relationships, and the interview experience. CONCLUSION: The collection of 3 years of data across specialties identified factors that are important to applicants' choice of a training program. Some factors can be addressed quickly and with little effort, such as the format of the interview day. Others require programs and institutions to revisit their mission, priorities, and training culture to improve relationships between residents and faculty. Programs may wish to be more tactical in selecting the residents and faculty who meet with applicants and be more focused in planning how the interview time is used.

Dataset Information

Feasibility of implementing a standardized multisource feedback program in the graduate medical education environment.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets