Dataset Information

Psychometric properties of a novel knowledge assessment tool of mechanical ventilation for emergency medicine residents in the northeastern United States.

ABSTRACT:

Purpose

Prior descriptions of the psychometric properties of validated knowledge assessment tools designed to determine Emergency medicine (EM) residents understanding of physiologic and clinical concepts related to mechanical ventilation are lacking. In this setting, we have performed this study to describe the psychometric and performance properties of a novel knowledge assessment tool that measures EM residents' knowledge of topics in mechanical ventilation.

Methods

Results from a multicenter, prospective, survey study involving 219 EM residents from 8 academic hospitals in northeastern United States were analyzed to quantify reliability, item difficulty, and item discrimination of each of the 9 questions included in the knowledge assessment tool for 3 weeks, beginning in January 2013.

Results

The response rate for residents completing the knowledge assessment tool was 68.6% (214 out of 312 EM residents). Reliability was assessed by both Cronbach's alpha coefficient (0.6293) and the Spearman-Brown coefficient (0.6437). Item difficulty ranged from 0.39 to 0.96, with a mean item difficulty of 0.75 for all 9 questions. Uncorrected item discrimination values ranged from 0.111 to 0.556. Corrected item-total correlations were determined by removing the question being assessed from analysis, resulting in a range of item discrimination from 0.139 to 0.498.

Conclusion

Reliability, item difficulty and item discrimination were within satisfactory ranges in this study, demonstrating acceptable psychometric properties of this knowledge assessment tool. This assessment indicates that this knowledge assessment tool is sufficiently rigorous for use in future research studies or for assessment of EM residents for evaluative purposes.

SUBMITTER: Richards JB

PROVIDER: S-EPMC4789563 | biostudies-literature | 2016

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Psychometric properties of a novel knowledge assessment tool of mechanical ventilation for emergency medicine residents in the northeastern United States.

Richards Jeremy B JB Strout Tania D TD Seigel Todd A TA Wilcox Susan R SR

Journal of educational evaluation for health professions 20160216

<h4>Purpose</h4>Prior descriptions of the psychometric properties of validated knowledge assessment tools designed to determine Emergency medicine (EM) residents understanding of physiologic and clinical concepts related to mechanical ventilation are lacking. In this setting, we have performed this study to describe the psychometric and performance properties of a novel knowledge assessment tool that measures EM residents' knowledge of topics in mechanical ventilation.<h4>Methods</h4>Results fro ...[more]

PMID: 26924540

Similar Datasets

Project description:BackgroundThe majority of children seeking care in emergency departments are seen by general emergency medicine (EM) residency program graduates. Throughout training, EM residents manage fewer critically ill pediatric patients compared to adults, and the exposure to children with illness and injury requiring emergent assessment and management is often limited and sporadic across training sites. This report describes the creation of a robust set of simulation cases for EM trainees incorporating topics identified during a previous modified Delphi study to improve their pediatric acute care knowledge and skills.MethodsAll 30 pediatric EM topics and 19/26 procedures previously identified as "must be taught by simulation" to EM residents were mapped to 15 simulation case topics. Twenty-seven authors from 16 institutions created cases and supporting materials. Each case was iteratively implemented during a peer review process at two to five sites with EM residents. Feedback from learners and facilitators was collected via electronic surveys and used to revise each case before the next implementation.ResultsThirty-five institutions participated in the peer review process. Fifty-one facilitators and 281 participants (90% EM residents) completed surveys. Most facilitators (98%) agreed or strongly agreed with the statement "This simulation case is relevant to the field of emergency medicine." A majority of facilitators and participants agreed or strongly agreed with the statements "The simulation case was realistic" (98% of facilitators, 94% of participants) and "This simulation case was effective in teaching resuscitation skills" (92% of facilitators, 98% of participants). Most participants reported confidence in knowledge and skills addressed in the learning objectives after participation.ConclusionsFacilitators and EM residents found cases from a novel simulation-based curriculum covering critical pediatric EM topics relevant, realistic, and effective. This curriculum can help provide a standardized, uniform experience for EM residents who will care for critically ill pediatric patients in their communities.

Project description:IntroductionDue to hospital crowding, mechanically ventilated patients are increasingly spending hours boarding in emergency departments (ED) before intensive care unit (ICU) admission. This study aims to evaluate the association between time ventilated in the ED and in-hospital mortality, duration of mechanical ventilation, ICU and hospital length of stay (LOS).MethodsThis was a multi-center, prospective, observational study of patients ventilated in the ED, conducted at three academic Level I Trauma Centers from July 2011 to March 2013. All consecutive adult patients on invasive mechanical ventilation were eligible for enrollment. We performed a Cox regression to assess for a mortality effect for mechanically ventilated patients with each hour of increasing LOS in the ED and multivariable regression analyses to assess for independently significant contributors to in-hospital mortality. Our primary outcome was in-hospital mortality, with secondary outcomes of ventilator days, ICU LOS and hospital LOS. We further commented on use of lung protective ventilation and frequency of ventilator changes made in this cohort.ResultsWe enrolled 535 patients, of whom 525 met all inclusion criteria. Altered mental status without respiratory pathology was the most common reason for intubation, followed by trauma and respiratory failure. Using iterated Cox regression, a mortality effect occurred at ED time of mechanical ventilation > 7 hours, and the longer ED stay was also associated with a longer total duration of intubation. However, adjusted multivariable regression analysis demonstrated only older age and admission to the neurosciences ICU as independently associated with increased mortality. Of interest, only 23.8% of patients ventilated in the ED for over seven hours had changes made to their ventilator.ConclusionIn a prospective observational study of patients mechanically ventilated in the ED, there was a significant mortality benefit to expedited transfer of patients into an appropriate ICU setting.

Project description:BackgroundUnderstanding respiratory physiology and mechanical ventilation is a challenge for healthcare workers, particularly, medical residents. A team of French-speaking experts developed an innovative MOOC incorporating interactive simulation-based videos and serious games aiming at improving knowledge and skills in mechanical ventilation. Our objective was to evaluate the long-term knowledge retention regarding key concepts presented in this MOOC.MethodsFrench residents registered for the MOOC 2020's winter session were invited to participate in a two-step study. The first step consisted in evaluating students' pre-course knowledge of respiratory physiology and mechanical ventilation fusing a 20 five-item multiple choice questions test with a total score ranging from 0 to 100. For the second step, the same students answered the same test (after shuffling the questions) six months after the completion of the course. We assessed the impact of this MOOC on the students' knowledge retention by comparing pre-course and post-course scores.ResultOf the 102 residents who agreed to participate in the study, 80 completed the course and their mean ± SD pre-course score was 76.0 ± 8.0. Fifty-one respondents also completed the second and their post-course score was significantly higher than the baseline one (83.1 ± 7.3 vs. 77.5 ± 7.6, p < 0.001). Scores of the first and second rounds did not differ upon comparing respondents' background specialty or number of years of residency. For the vast majority of individual questions (96%), the success rate was higher at the post-course than at the pre-course assessment.ConclusionAn innovative MOOC incorporating simulation-based videos was effective in teaching medical residents basic mechanical ventilation knowledge and skills, especially in the field of respiratory physiology and ventilatory modes. We observed effective long-term knowledge retention with a higher score at the post-course assessment six months after the completion of the course compared with the pre-course score.

Dataset Information

Psychometric properties of a novel knowledge assessment tool of mechanical ventilation for emergency medicine residents in the northeastern United States.

Purpose

Methods

Results

Conclusion

Publications

Psychometric properties of a novel knowledge assessment tool of mechanical ventilation for emergency medicine residents in the northeastern United States.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets