Dataset Information

Is National Resident Matching Program Rank Predictive of Resident Performance or Post-graduation Achievement? 10 Years at One Emergency Medicine Residency.

ABSTRACT:

Introduction

Each year residency programs expend considerable effort ranking applicants for the National Residency Matching Program (NRMP). We explored the relationship between residents' NRMP rank list position as generated at our institution and their performance in residency and post-graduation to determine whether such efforts are justified.

Methods

Faculty who were present for the 10 consecutive study years at an allopathic emergency medicine residency retrospectively evaluated residents on their overall performance, medical knowledge, and interpersonal skills. Residency graduates were surveyed regarding their current position, hours of clinical practice, academic, teaching and leadership roles, and publications. We compared match position to performance using graphical techniques as the primary form of analysis.

Results

Ten faculty evaluated the 107 residents who graduated from the program during these 10 years by class year. Eighty-four residents responded to the survey. In general, we found little correlation between NRMP rank and faculty rank of resident performance. There was also little correlation between position in the NRMP rank list and the probability of having an academic career, publishing research, or having a teaching or leadership role.

Conclusion

We found that the position on our NRMP rank list was of little value in predicting which residents would do best in residency or take on academic or leadership roles once graduated. Residencies should evaluate the processes they use to generate their rank list to determine whether the ranking process is sufficiently predictive to warrant the effort expended.

SUBMITTER: Wall J

PROVIDER: S-EPMC6625696 | biostudies-literature | 2019 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Is National Resident Matching Program Rank Predictive of Resident Performance or Post-graduation Achievement? 10 Years at One Emergency Medicine Residency.

Wall Jessica J Votey Scott R SR Solomon Thomas T Schriger David L DL

The western journal of emergency medicine 20190613 4

<h4>Introduction</h4>Each year residency programs expend considerable effort ranking applicants for the National Residency Matching Program (NRMP). We explored the relationship between residents' NRMP rank list position as generated at our institution and their performance in residency and post-graduation to determine whether such efforts are justified.<h4>Methods</h4>Faculty who were present for the 10 consecutive study years at an allopathic emergency medicine residency retrospectively evaluat ...[more]

PMID: 31316704

Similar Datasets

Project description:ImportanceAlthough implicit bias in medical training has long been suspected, it has been difficult to study using objective measures, and the influence of sex and gender in the evaluation of medical trainees is unknown. The emergency medicine (EM) milestones provide a standardized framework for longitudinal resident assessment, allowing for analysis of resident performance across all years and programs at a scope and level of detail never previously possible.ObjectiveTo compare faculty-observed training milestone attainment of male vs female residency training.Design, setting, and participantsThis multicenter, longitudinal, retrospective cohort study took place at 8 community and academic EM training programs across the United States from July 1, 2013, to July 1, 2015, using a real-time, mobile-based, direct-observation evaluation tool. The study examined 33 456 direct-observation subcompetency evaluations of 359 EM residents by 285 faculty members.Main outcomes and measuresMilestone attainment for male and female EM residents as observed by male and female faculty throughout residency and analyzed using multilevel mixed-effects linear regression modeling.ResultsA total of 33 456 direct-observation evaluations were collected from 359 EM residents (237 men [66.0%] and 122 women [34.0%]) by 285 faculty members (194 men [68.1%] and 91 women [31.9%]) during the study period. Female and male residents achieved similar milestone levels during the first year of residency. However, the rate of milestone attainment was 12.7% (0.07 levels per year) higher for male residents through all of residency (95% CI, 0.04-0.09). By graduation, men scored approximately 0.15 milestone levels higher than women, which is equivalent to 3 to 4 months of additional training, given that the average resident gains approximately 0.52 levels per year using our model (95% CI, 0.49-0.54). No statistically significant differences in scores were found based on faculty evaluator gender (effect size difference, 0.02 milestone levels; 95% CI for males, -0.09 to 0.11) or evaluator-evaluatee gender pairing (effect size difference, -0.02 milestone levels; 95% CI for interaction, -0.05 to 0.01).Conclusions and relevanceAlthough male and female residents receive similar evaluations at the beginning of residency, the rate of milestone attainment throughout training was higher for male than female residents across all EM subcompetencies, leading to a gender gap in evaluations that continues until graduation. Faculty should be cognizant of possible gender bias when evaluating medical trainees.

Project description:IntroductionMedical professionalism is a core competency for emergency medicine (EM) trainees; but defining professionalism remains challenging, leading to difficulties creating objectives and performing assessment. Because professionalism is dynamic, culture-specific, and often taught by modeling, an exploration of trainees' perceptions can highlight their educational baseline and elucidate the importance they place on general conventional professionalism domains. To this end, our objective was to assess the relative value EM residents place on traditional components of professionalism.MethodsWe performed a cross-sectional, multi-institutional survey of incoming and graduating EM residents at four programs. The survey was developed using the American Board of Internal Medicine's "Project Professionalism" and the Accreditation Council of Graduate Medical Education definition of professionalism competency. We identified 27 attributes within seven domains: clinical excellence, humanism, accountability, altruism, duty and service, honor and integrity, and respect for others. Residents were asked to rate each attribute on a 10-point scale. We analyzed data to assess variance across attributes as well as differences between residents at different training levels or different institutions.ResultsOf the 114 residents eligible, 100 (88%) completed the survey. The relative value assigned to different professional attributes varied considerably, with those in the altruism domain valued significantly lower and those in the "respect for others" and "honor and integrity" valued significantly higher (p<0.001). Significant differences were found between interns and seniors for five attributes primarily in the "duty and service" domain (p<0.05). Among different residencies, significant differences were found with attributes within the "altruism" and "duty and service" domains (p<0.05).ConclusionResidents perceive differences in the relative importance of traditionally defined professional attributes and this may be useful to educators. Explanations for these differences are hypothesized, as are the potential implications for professionalism education. Because teaching professional behavior is taught most effectively via behavior modeling, faculty awareness of resident values and faculty development to address potential gaps may improve professionalism education.

Project description:BackgroundEmergency Medicine (EM) is a rapidly developing specialty in Africa with several emergency medicine residency-training programs (EMRPs) established across the continent over the past decade. Despite rapid proliferation of the specialty, little is known about emergency care curriculum structure and content. We provide an overview of Africa's EMRPs.MethodsThis was a descriptive cross-sectional survey conducted of EMRPs in Africa between January 2017 and December 2017. Data were prospectively collected using a structured survey that was developed and administered through online data capture software, REDCap (Version 7.2.2, Vanderbilt, Nashville, TN, USA). Survey questions focused on curriculum structure and design, including clinical rotations, didactics, research, and evaluation. Data are summarized with descriptive statistics.ResultsThe survey was sent to the leadership of 15 EMRPs in 12 different African countries and 11 (73%) responded. Five (46%) of the responding programs were started by local non-EM trained faculty, two (18%) were started by international partners, and the remainder by a combination of local non-EM faculty and international partners. Overall, Seven (64%) of the countries offer a 4-year EMRP. In General, 40% of curriculums are influenced the contents developed by African Federation for Emergency Medicine. All programs offer resident led-didactics, with a median of 12?h (Interquartile range 9-6?h) per month. All EMRPs have a mandatory research requirement. All EMRPs offer clinical rotations in the ED, Paediatrics, and Obstetrics and Gynaecology, while only 2 programs offer rotations in radiology and neonatal intensive care units. Only 46% of EMRPs have in-ED clinical supervision by specialist.ConclusionThe EMRPs in Africa were started by non-EM trained local faculty alone or collaboration with international partners. The curriculum offers most exposure to ED, and less exposure in radiology and neonatal intensive care. Residents are highly involved in leading didactics and less than half of the programs have in-ED specialist supervision of patient care.

Dataset Information

Is National Resident Matching Program Rank Predictive of Resident Performance or Post-graduation Achievement? 10 Years at One Emergency Medicine Residency.

Introduction

Methods

Results

Conclusion

Publications

Is National Resident Matching Program Rank Predictive of Resident Performance or Post-graduation Achievement? 10 Years at One Emergency Medicine Residency.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets