Dataset Information

Benchmark Performance of Emergency Medicine Residents in Pediatric Resuscitation: Are We Optimizing Pediatric Education for Emergency Medicine Trainees?

ABSTRACT:

Background

The majority of children in the United States seek emergency care at community-based general emergency departments (GEDs); however, the quality of GED pediatric emergency care varies widely. This may be explained by a number of factors, including residency training environments and postgraduate knowledge decay. Emergency medicine (EM) residents train in academic pediatric EDs, but didactic and clinical experience vary widely between programs, and little is known about the pediatric skills of these EM residents. This study aimed to assess the performance of senior EM residents in treating simulated pediatric patients at the end of their training.

Methods

This was a prospective, cross-sectional, simulation-based cohort study assessing the simulated performance of senior EM resident physicians from two Massachusetts programs leading medical teams caring for three critically ill patients. Sessions were video recorded and scored separately by three reviewers using a previously published simulation assessment tool. Self-efficacy surveys were completed prior to each session. The primary outcome was a median total performance score (TPS), calculated by the mean of individualized domain scores (IDS) for each case. Each IDS was calculated as a percentage of items performed on a checklist-based instrument.

Results

A total of 18 EM resident physicians participated (PGY-3 = 8, PGY-4 = 10). Median TPS for the cohort was 61% (IQR = 56%-70%). Median IDSs by case were as follows: sepsis 67% (IQR = 50%-67%), seizure 67% (IQR = 50%-83%), and cardiac arrest 67% (IQR = 43%-70%). The overall cohort self-efficacy for pediatric EM (PEM) was 64% (IQR = 60%-70%).

Conclusions

This study has begun the process of benchmarking clinical performance of graduating EM resident physicians. Overall, the EM resident cohort in this study performed similar to prior GED teams. Self-efficacy related to PEM correlated well with performance, with the exception of knowledge relative to intravenous fluid and vasopressor administration in pediatric septic shock. A significant area of discrepancy and missed checklist items were those related to cardiopulmonary resuscitation and basic life support maneuvers.

SUBMITTER: Schoppel KA

PROVIDER: S-EPMC8052997 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThe majority of children seeking care in emergency departments are seen by general emergency medicine (EM) residency program graduates. Throughout training, EM residents manage fewer critically ill pediatric patients compared to adults, and the exposure to children with illness and injury requiring emergent assessment and management is often limited and sporadic across training sites. This report describes the creation of a robust set of simulation cases for EM trainees incorporating topics identified during a previous modified Delphi study to improve their pediatric acute care knowledge and skills.MethodsAll 30 pediatric EM topics and 19/26 procedures previously identified as "must be taught by simulation" to EM residents were mapped to 15 simulation case topics. Twenty-seven authors from 16 institutions created cases and supporting materials. Each case was iteratively implemented during a peer review process at two to five sites with EM residents. Feedback from learners and facilitators was collected via electronic surveys and used to revise each case before the next implementation.ResultsThirty-five institutions participated in the peer review process. Fifty-one facilitators and 281 participants (90% EM residents) completed surveys. Most facilitators (98%) agreed or strongly agreed with the statement "This simulation case is relevant to the field of emergency medicine." A majority of facilitators and participants agreed or strongly agreed with the statements "The simulation case was realistic" (98% of facilitators, 94% of participants) and "This simulation case was effective in teaching resuscitation skills" (92% of facilitators, 98% of participants). Most participants reported confidence in knowledge and skills addressed in the learning objectives after participation.ConclusionsFacilitators and EM residents found cases from a novel simulation-based curriculum covering critical pediatric EM topics relevant, realistic, and effective. This curriculum can help provide a standardized, uniform experience for EM residents who will care for critically ill pediatric patients in their communities.

Project description:ObjectiveSimulation stands to serve an important role in modern competency-based programs of assessment in postgraduate medical education. Our objective was to compare the performance of individual emergency medicine (EM) residents in a simulation-based resuscitation objective structured clinical examination (OSCE) using the Queen's Simulation Assessment Tool (QSAT), with portfolio assessment of clinical encounters using a modified in-training evaluation report (ITER) to understand in greater detail the inferences that may be drawn from a simulation-based OSCE assessment.MethodsA prospective observational study was employed to explore the use of a multicenter simulation-based OSCE for evaluation of resuscitation competence. EM residents from five Canadian academic sites participated in the OSCE. Video-recorded performances were scored by blinded raters using the scenario-specific QSATs with domain-specific anchored scores (primary assessment, diagnostic actions, therapeutic actions, communication) and a global assessment score (GAS). Residents' portfolios were evaluated using a modified ITER subdivided by CanMEDS roles (medical expert, communicator, collaborator, leader, health advocate, scholar, and professional) and a GAS. Correlational and regression analyses were performed comparing components of each of the assessment methods.ResultsPortfolio review and ITER scoring was performed for 79 residents participating in the simulation-based OSCE. There was a significant positive correlation between total OSCE and ITER scores (r = 0.341). The strongest correlations were found between ITER medical expert score and each of the OSCE GAS (r = 0.420), communication (r = 0.443), and therapeutic action (r = 0.484) domains. ITER medical expert was a significant predictor of OSCE total (p = 0.002). OSCE therapeutic action was a significant predictor of ITER total (p = 0.02).ConclusionsSimulation-based resuscitation OSCEs and portfolio assessment captured by ITERs appear to measure differing aspects of competence, with weak to moderate correlation between those measures of conceptually similar constructs. In a program of competency-based assessment of EM residents, a simulation-based OSCE using the QSAT shows promise as a tool for assessing medical expert and communicator roles.

Project description:ObjectivesThe objective was to examine emergency medicine (EM) residents' perceptions of gender as it intersects with resuscitation team dynamics and the experience of acquiring resuscitation leadership skills.MethodsThis was an exploratory, qualitative study using grounded theory and a purposive sample of postgraduate year (PGY) 2-4 EM residents who function as resuscitation team leaders in two urban EM programs. One-on-one interviews were conducted by a single experienced researcher. Audiotaped interviews were transcribed and deidentified by two research assistants. A research team composed of a PhD educational researcher, a research nurse, an MPH research assistant, and an EM resident reviewed the transcripts and coded and analyzed data using MAXQDA v12. Themes and coding schema were discussed until consensus was reached. We used member checking to assess the accuracy of our report and to confirm that the interpretations were fair and representative.ResultsTheme saturation was reached after interviewing 16 participants: 10 males and 6 females. The three major themes related to gender that emerged included leadership style, gender inequality, and relationship building. Both male and female residents reported that a directive style was more effective when functioning in the resuscitation leadership role. Female residents more often expressed discomfort with a directive style of leadership, preferring a more communicative and collaborative style. Both female and male residents identified several challenges as disproportionately affecting female residents, including negotiating interactions with nurses more and "earning the respect" of the team members.ConclusionsResidents acknowledged that additional challenges exist for female residents in becoming resuscitation team leaders. Increasing awareness in residency program leadership is key to affecting change to ensure all residents are trained in a similar manner, while also addressing gender-specific needs of residents where appropriate. We present suggestions for addressing these barriers and incorporating discussion of leadership styles into residency training.

Project description:ObjectivesMost children seeking emergency care are evaluated in general emergency departments (EDs). The cumulative pediatric clinical experiences of emergency medicine (EM) residents are largely unknown. This study examined EM resident pediatric clinical experience through the lens of the Accreditation Council for Graduate Medical Education requirements and the Model of the Clinical Practice of Emergency Medicine.MethodsRetrospective, observational study of the cumulative clinical experience of two classes of EM residents from a 4-year training program at two pediatric EDs of a quaternary care pediatric center. A database of resident patient encounters was generated from the electronic medical record. Experiences classified included: diagnosis categories per the Model of the Clinical Practice of Emergency Medicine, procedures, and resuscitations. Results were stratified by age, acuity, and disposition.ResultsTwenty-five EM residents evaluated 17,642 patients (median = 723). Most patients (73.5%) were emergent acuity (Emergency Severity Index triage level 2 or 3 or non-intensive care admission); 2% were critical. Residents participated in 598 (median = 22) medical resuscitations and 483 (median = 19) trauma resuscitations. Minor procedures (e.g., laceration repair) were commonly performed; critical procedures (e.g., intubation) were rare. Exposure to neonates was infrequent and pediatric deaths were rare. Abdominal pain (5.7%), asthma exacerbation (4.6%), and fever (3.8%) were the most common diagnoses.ConclusionsEmergency medicine residents encountered a wide array of pediatric diagnoses throughout training and performed a substantial number of common pediatric procedures. Exposure to critical acuity and procedures, neonatal pathology, and certain pediatric-specific diagnoses, such as congenital heart disease, was limited despite training in a large, quaternary care children's hospital. Curriculum development and collaboration should focus on these areas.

Project description:BackgroundPediatric emergency physicians complete either a pediatric or emergency residency before fellowship training. Fewer emergency graduates are pursuing a pediatric emergency fellowship during the past decade, and the reasons for this decrease are unclear.ObjectivesThe purpose of this study was to explore emergency residents' incentives and barriers to pursuing a fellowship in pediatric emergency medicine (PEM).MethodsThis was a cross-sectional survey-based study. In 2016, we emailed the study survey to all Emergency Medicine Residents' Association (EMRA) members. Survey questions included respondents' interest in a PEM fellowship and perceived incentives and barriers to PEM.ResultsOf 6620 EMRA members in 2016, 322 (5.0%) responded to the survey. Respondents were 59.6% male, with a mean age of 30.6 years. A total of 105 respondents (32.6%) were in their first year of emergency medicine residency, 92 (28.6%) were in their second year, 77 (23.9%) were in their third year, and 48 (14.9%) were in their fourth or fifth year. A total of 102 (31.8%) respondents planned to pursue fellowship training, whereas 120 (37.4%) were undecided. A total of 140 (43.8%) respondents reported considering a PEM fellowship at some point. Among these respondents, the most common incentives for PEM fellowship were (1) a desire to improve pediatric care in community emergency departments (86, 26.7%), (2) to develop an academic focus (54, 16.8%), and (3) because a mentor encouraged a PEM fellowship (40, 12.4%). A perceived lack of financial benefit (142, 44.1%) and length of PEM fellowship training (89, 27.6%) were the most commonly reported barriers.ConclusionIn a cross-sectional survey of EMRA members, almost half of the respondents considered a PEM fellowship. PEM leaders who want to promote emergency medicine to pediatric emergency residents will need to leverage the incentives and mitigate the perceived barriers to a PEM fellowship to increase the number of emergency residency applicants.