Dataset Information

Development of a Rigorously Designed Procedural Checklist for Assessment of Emergency Medicine Resident Performance of Temporary Transvenous Cardiac Pacing.

ABSTRACT:

Objectives

Temporary transvenous cardiac pacing (TVP) is a potentially lifesaving intervention included in the list of essential core procedures for emergency medicine (EM) training; however, opportunities to perform TVP during residency cannot be guaranteed. EM graduates report feeling subjectively underprepared for this procedure, but objective performance data are lacking. Checklist-based simulated assessment is an increasing focus of competency-based medical education, particularly for invasive procedures like TVP. The objectives of this paper were as follows: first, to enlist a multidisciplinary team of experts to create an assessment tool for TVP using best practices in checklist development; second, to determine the reliability of checklist scoring; and third, to assess EM residents' baseline ability to perform TVP using a dedicated task trainer.

Methods

This study was conducted at a single 4-year EM residency. A panel of emergency physicians and cardiologists designed a TVP checklist using a modified Delphi approach. After consensus was achieved on a final checklist, EM residents were assessed using a dedicated TVP task trainer. Inter-rater reliability was determined using Cohen's kappa coefficient. Resident performance was determined by number of correctly performed checklist items.

Results

The expert panel achieved consensus on a 30-item checklist after three rounds of revisions. The Cohen's kappa coefficient for the overall checklist score was 0.87, with individual checklist items ranging from 0.63 to 1.00. In total, 58 residents were assessed with a mean score of 13.5 of 30 checklist items. Scores increased with each year of training.

Conclusions

This study details the rigorous development of a TVP checklist designed by a multidisciplinary team of experts. Checklist scores demonstrated strong inter-rater reliability. The overall poor performance of this cohort suggests the current approach to TVP training does not provide sufficient preparation for EM residents. Competency-based techniques, such as simulation-based mastery learning, should be explored.

SUBMITTER: Klein MR

PROVIDER: S-EPMC8171784 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundMechanical ventilation (MV) is a life-saving technology that restores or assists breathing. Like any treatment, MV has side effects. In some patients it can cause diaphragmatic atrophy, injury, and dysfunction (ventilator-induced diaphragmatic dysfunction, VIDD). Accumulating evidence suggests that VIDD makes weaning from MV difficult, which involves increased morbidity and mortality.Methods and analysisThis paper describes the protocol of a randomized, controlled, open-label, multicenter trial that is designed to investigate the safety and effectiveness of a novel therapy, temporary transvenous diaphragm pacing (TTVDP), to improve weaning from MV in up to 88 mechanically ventilated adult patients who have failed at least two spontaneous breathing trials over at least 7 days. Patients will be randomized (1:1) to TTVDP (treatment) or standard of care (control) groups. The primary efficacy endpoint is time to successful extubation with no reintubation within 48 h. Secondary endpoints include maximal inspiratory pressure and ultrasound-measured changes in diaphragm thickness and diaphragm thickening fraction over time. In addition, observational data will be collected and analyzed, including 30-day mortality and time to discharge from the intensive care unit and from the hospital. The hypothesis to be tested postulates that more TTVDP patients than control patients will be successfully weaned from MV within the 30 days following randomization.DiscussionThis study is the first large-scale clinical trial of a novel technology (TTVDP) aimed at accelerating difficult weaning from MV. The technology tested provides the first therapy directed specifically at VIDD, an important cause of delayed weaning from MV. Its results will help delineate the place of this therapeutic approach in clinical practice and help design future studies aimed at defining the indications and benefits of TTVDP.Trial registrationClinicalTrials.gov, NCT03096639 . Registered on 30 March 2017.

Project description:ObjectivesEmergency department thoracotomy (EDT) is a rare and challenging procedure. Emergency medicine (EM) residents have limited opportunities to perform the procedure in clinical or educational settings. Standardized, reliable, validated checklists do not exist to evaluate procedural competency. The objectives of this project were twofold: 1) to develop a checklist containing the critical actions for performing an EDT that can be used for future procedural skills training and 2) to evaluate the reliability and validity of the checklist for performing EDT.MethodsAfter a literature review, a preliminary 22-item checklist was developed and disseminated to experts in EM and trauma surgery. A modified Delphi method was used to revise the checklist. To assess usability of the checklist, EM and trauma surgery faculty and residents were evaluated performing an EDT while inter-rater reliability was calculated with Cohen's kappa. A Student's t-test was used to compare the performance of participants who had or had not performed a thoracotomy in clinical practice. Item-total correlation was calculated for each checklist item to determine discriminatory ability.ResultsA final 22-item checklist was developed for EDT. The overall inter-rater reliability was strong (κ = 0.84) with individual item agreement ranging from moderate to strong (κ = 0.61 to 1.00). Experts (attending physicians and senior residents) performed well on the checklist, achieving an average score of 80% on the checklist. Participants who had performed EDT in clinical practice performed significantly better than those that had not, achieving an average of 80.7% items completed versus 52.3% (p < 0.05). Seventeen of 22 items had an item-total correlation greater than 0.2.ConclusionsA final 22-item consensus-based checklist was developed for the EDT. Overall inter-rater reliability was strong. This checklist can be used in future studies to serve as a foundation for curriculum development around this important procedure.

Project description:IntroductionMedical professionalism is a core competency for emergency medicine (EM) trainees; but defining professionalism remains challenging, leading to difficulties creating objectives and performing assessment. Because professionalism is dynamic, culture-specific, and often taught by modeling, an exploration of trainees' perceptions can highlight their educational baseline and elucidate the importance they place on general conventional professionalism domains. To this end, our objective was to assess the relative value EM residents place on traditional components of professionalism.MethodsWe performed a cross-sectional, multi-institutional survey of incoming and graduating EM residents at four programs. The survey was developed using the American Board of Internal Medicine's "Project Professionalism" and the Accreditation Council of Graduate Medical Education definition of professionalism competency. We identified 27 attributes within seven domains: clinical excellence, humanism, accountability, altruism, duty and service, honor and integrity, and respect for others. Residents were asked to rate each attribute on a 10-point scale. We analyzed data to assess variance across attributes as well as differences between residents at different training levels or different institutions.ResultsOf the 114 residents eligible, 100 (88%) completed the survey. The relative value assigned to different professional attributes varied considerably, with those in the altruism domain valued significantly lower and those in the "respect for others" and "honor and integrity" valued significantly higher (p<0.001). Significant differences were found between interns and seniors for five attributes primarily in the "duty and service" domain (p<0.05). Among different residencies, significant differences were found with attributes within the "altruism" and "duty and service" domains (p<0.05).ConclusionResidents perceive differences in the relative importance of traditionally defined professional attributes and this may be useful to educators. Explanations for these differences are hypothesized, as are the potential implications for professionalism education. Because teaching professional behavior is taught most effectively via behavior modeling, faculty awareness of resident values and faculty development to address potential gaps may improve professionalism education.

Project description:The patient's Cr (creatinine), BUN (blood urea nitrogen), HBG (hemoglobin), VT (ventricular tachycardia), pacing frequency, puncture point, emergency to permanent pacing time, pacing current (mA), pacing threshold current (mA), and admission diagnosis data were collected. The data were subjected to frequency statistics, curve regression analysis, PLS regression analysis, adjustment analysis, chi-square test, ridge regression analysis, discriminant analysis, negative binomial regression analysis, Poisson regression analysis, and stepwise regression analysis. Some findings include the following: (1) Cr has a significant positive effect on HBG, and BUN has a significant negative effect on HBG. (2) VT has a negative correlation with age and a positive correlation with CK-MB and CK (creatinine kinase). (3) Myocarditis has a negative correlation with age and a significant positive correlation with CTnI (cardiac troponin I). (4) AST (aspartate transaminase) and ALT (alanine aminotransferase) have a significant positive impact on DDI (D-dimer), while CTnI has a significant negative impact on DDI. MYO (myoglobin) has no impact relationship to DDI. (5) ALT has a significant positive relationship with APTT (partial thromboplastin time). (6) Alb (albumin) and TBIL (total bilirubin) have a significant positive effect on PLT (platelet) count, while pro-BNP (B-type natriuretic peptide) and MYO have a significant negative effect on PLT. (7) CK has a significant positive effect on INR (international normalized ratio). (8) The relationship between sinus node dysfunction and VT significantly affect the pacing frequency (beats/minute). For third-degree atrioventricular block, different samples of sinus node dysfunction showed significant differences. (9) There is a significant positive correlation between pacing current (mA) and pacing threshold current (mA). (10) There was a significant positive correlation between perceived voltage (mV) and the time from emergency to permanent pacing. Admission diagnosis has a significant positive impact on the time from emergency to permanent pacing. The change (increase) in time from emergency to permanent pacing was 1.137-fold when an additional condition was diagnosed on admission.

Project description:BackgroundPediatric emergency medicine (PEM) physicians receive training in critical procedures, but these procedures are rare in practice. The literature on maintenance of procedural skills focuses on ways to practice (e.g., via simulation) and pays little attention to motivation's role. Understanding what motivates PEM physicians to maintain procedural skills can inform the design of supportive policies and interventions. Our study explores how PEM physicians conceptualize maintenance of procedural skills, what motivates them to maintain procedural skills, and barriers to procedural skill maintenance.MethodsThis was a qualitative study of 12 PEM faculty guided by the self-determination theory (SDT) of motivation. SDT describes a typology that distinguishes extrinsic and intrinsic motivation, with intrinsic motivation based on autonomy, competence, and relatedness. Interviews were transcribed and coded using constant-comparative technique, and interviews continued until thematic sufficiency was achieved.ResultsParticipants had difficulty defining procedural skill maintenance by specific criteria and expressed ambivalence about external standards for competence, noting the need to account for individual and local practice factors. Three themes characterizing participants' motivation for procedural skills maintenance included: (1) desire to provide optimal patient care and fear of unsuccessful performance (competence), (2) procedural competence as part of the identity of a PEM physician who teaches and performs procedures (competence and relatedness), and (3) desire for accessibility and choice of options in maintaining procedural skills (autonomy). Participants identified lack of opportunities, time, and support as barriers to motivation and skills maintenance.ConclusionSDT concepts were integral to understanding faculty motivation, and this highlights the need for prioritizing faculty autonomy, competence, and relatedness in designing supports for procedural skill maintenance. Our findings regarding the difficulty in defining maintenance of skills emphasize the need for further discussion and study of this topic.