Dataset Information

An Event-based Approach to Measurement: Facilitating Observational Measurement in Highly Variable Clinical Settings.

ABSTRACT: Background:Translational research in medical education requires the ability to rigorously measure learner performance in actual clinical settings; however, current measurement systems cannot accommodate the variability inherent in many patient care environments. This is especially problematic in emergency medicine, where patients represent a wide spectrum of severity for a single clinical presentation. Our objective is to describe and implement EBAM, an event-based approach to measurement that can be applied to actual emergency medicine clinical events. Methods:We used a four-step event-based approach to create an emergency department trauma resuscitation patient care measure. We applied the measure to a database of 360 actual trauma resuscitations recorded in a Level I trauma center using trained raters. A subset (n = 50) of videos was independently rated in duplicate to determine inter-rater reliability. Descriptive analyses were performed to describe characteristics of resuscitation events and Cohen's kappa was used to calculate reliability. Results:The methodology created a metric containing both universal items that are applied to all trauma resuscitation events and conditional items that only apply in certain situations. For clinical trauma events, injury severity scores ranged from 1 to 75 with a mean (±SD) of 21 (±15) and included both blunt (254/360; 74%) and penetrating (86/360; 25%) traumatic injuries, demonstrating the diverse nature of the clinical encounters. The mean (±SD) Cohen's kappa for patient care items was 0.7 (±0.3). Conclusion:We present an event-based approach to performance assessment that may address a major gap in translational education research. Our work centered on assessment of patient care behaviors during trauma resuscitation. More work is needed to evaluate this approach across a diverse array of clinical events.

SUBMITTER: Fernandez R

PROVIDER: S-EPMC7163198 | biostudies-literature | 2020 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

An Event-based Approach to Measurement: Facilitating Observational Measurement in Highly Variable Clinical Settings.

Fernandez Rosemarie R Rosenman Elizabeth D ED Brolliar Sarah S Chipman Anne K AK Kalynych Colleen C Vrablik Marie C MC Keebler Joseph R JR Lazzara Elizabeth H EH

AEM education and training 20191031 2

<h4>Background</h4>Translational research in medical education requires the ability to rigorously measure learner performance in actual clinical settings; however, current measurement systems cannot accommodate the variability inherent in many patient care environments. This is especially problematic in emergency medicine, where patients represent a wide spectrum of severity for a single clinical presentation. Our objective is to describe and implement EBAM, an event-based approach to measureme ...[more]

PMID: 32313861

Similar Datasets

Project description:BackgroundMedication events in clinical settings are significant threats to patient safety. Analyzing and learning from the medication event reports is an important way to prevent the recurrence of these events. Currently, the analysis of medication event reports is ineffective and requires heavy workloads for clinicians. An automated pipeline is proposed to help clinicians deal with the accumulated reports, extract valuable information and generate feedback from the reports. Thus, the strategy of medication event prevention can be further developed based on the lessons learned.MethodsIn order to build the automated pipeline, four classic machine learning classifiers (i.e., support vector machine, Naïve Bayes, random forest, and multi-layer perceptron) were compared to identify the event originating stages, event types, and event causes from the medication event reports. The precision, recall and F-1 measure were calculated to assess the performance of the classifiers. Further, a strategy to measure the similarity of medication event reports in our pipeline was established and evaluated by human subjects through a questionnaire.ResultsWe developed three classifiers to identify the medication event originating stages, event types and causes, respectively. For the event originating stages, a support vector machine classifier obtains the best performance with an F-1 measure of 0.792. For the event types, a support vector machine classifier exhibits the best performance with an F-1 measure of 0.758. And for the event causes, a random forest classifier reaches an F-1 measure of 0.925. The questionnaire results show that the similarity measurement is consistent with the domain experts in the task of identifying similar reports.ConclusionWe developed and evaluated an automated pipeline that could identify three attributes from the medication event reports and calculate the similarity scores between the reports based on the attributes. The pipeline is expected to improve the efficiency of analyzing the medication event reports and to learn from the reports in a timely manner.

Project description:BackgroundMaximal oxygen consumption (VO2max) is one of the most predictive biometrics for cardiovascular health and overall mortality. However, VO2max is rarely measured in large-scale research studies or routine clinical care because of the high cost, participant burden, and requirement for specialized equipment and staff.ObjectiveTo overcome the limitations of clinical VO2max measurement, we aim to develop a digital VO2max estimation protocol that can be self-administered remotely using only the sensors within a smartphone. We also aim to validate this measure within a broadly representative population across a spectrum of smartphone devices.MethodsTwo smartphone-based VO2max estimation protocols were developed: a 12-minute run test (12-MRT) based on distance measured by GPS and a 3-minute step test (3-MST) based on heart rate recovery measured by a camera. In a 101-person cohort, balanced across age deciles and sex, participants completed a gold standard treadmill-based VO2max measurement, two silver standard clinical protocols, and the smartphone-based 12-MRT and 3-MST protocols in the clinic and at home. In a separate 120-participant cohort, the video-based heart rate measurement underlying the 3-MST was measured for accuracy in individuals across the spectrum skin tones while using 8 different smartphones ranging in cost from US $99 to US $999.ResultsWhen compared with gold standard VO2max testing, Lin concordance was pc=0.66 for 12-MRT and pc=0.61 for 3-MST. However, in remote settings, the 12-MRT was significantly less concordant with the gold standard (pc=0.25) compared with the 3-MST (pc=0.61), although both had high test-retest reliability (12-MRT intraclass correlation coefficient=0.88; 3-MST intraclass correlation coefficient=0.86). On the basis of the finding that 3-MST concordance was generalizable to remote settings whereas 12-MRT was not, the video-based heart rate measure within the 3-MST was selected for further investigation. Heart rate measurements in any of the combinations of the six Fitzpatrick skin tones and 8 smartphones resulted in a concordance of pc≥0.81. Performance did not correlate with device cost, with all phones selling under US $200 performing better than pc>0.92.ConclusionsThese findings demonstrate the importance of validating mobile health measures in the real world across a diverse cohort and spectrum of hardware. The 3-MST protocol, termed as heart snapshot, measured VO2max with similar accuracy to supervised in-clinic tests such as the Tecumseh (pc=0.94) protocol, while also generalizing to remote and unsupervised measurements. Heart snapshot measurements demonstrated fidelity across demographic variation in age and sex, across diverse skin pigmentation, and between various iOS and Android phone configurations. This software is freely available for all validation data and analysis code.

Project description:Mucormycosis is an increasingly common, life-threatening fungal infection caused by fungi belonging to the subphylum Mucormycotina, order Mucorales. The major risk factors for mucormycosis include uncontrolled diabetes mellitus, treatment with corticosteroids, organ or bone marrow transplantation, neutropenia, trauma and burns, malignant hematological disorders, and deferoxamine-therapy in patients receiving hemodialysis. Amphotericin B (AmB) remains the only antifungal agent approved for the treatment of invasive mucormycosis. Because fungi belonging to the mucorales order are relatively resistant to AmB, high doses are required, which frequently causes nephrotoxicity and other adverse effects. In the absence of surgical removal of the infected focus (such as excision of the eye in patients with rhinocerebral mucormycosis), antifungal therapy alone is rarely curative. Even when surgical debridement is combined with high-dose AmB, the mortality associated with mucor¬mycosis is >50%. In patients with prolonged neutropenia or disseminated disease, mortality is 90-100%. Rhizopus oryzae is by far the most common organism isolated from patients with mucormycosis, and is responsible for approximately 70% of all cases of mucormycosis. Recent epidemiological data collected from transplant centers have demonstrated a striking increase in the number of reported cases of mucormycosis. Furthermore, mucormycosis outbreaks are also known to follow natural disasters as was the case following the tsunami that devastated Indonesia in 2004 and the tornadoes that destroyed Joplin, Missouri in June 2011. Hence, there exists a large impetus to identify particular virulence factors and biomarkers associated with mucormycosis, which would lead to a rational approach to develop new antifungals and vaccines to prevent deaths specifically due to mucormycosis. In order to better understand the complex nature of the host pathogen interaction during mucormycosis, we performed dual species RNA-seq on 5 different Mucorales strains during in vitro infection of endothelial or epithelial cells.

Dataset Information

An Event-based Approach to Measurement: Facilitating Observational Measurement in Highly Variable Clinical Settings.

Publications

An Event-based Approach to Measurement: Facilitating Observational Measurement in Highly Variable Clinical Settings.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets