Impact of integrated graphical display on expert and novice diagnostic performance in critical care.
Ontology highlight
ABSTRACT: Objective
To determine the impact of a graphical information display on diagnosing circulatory shock.Materials and methods
This was an experimental study comparing integrated and conventional information displays. Participants were intensivists or critical care fellows (experts) and first-year medical residents (novices).Results
The integrated display was associated with higher performance (87% vs 82%; P < .001), less time (2.9 vs 3.5 min; P = .008), and more accurate etiology (67% vs 54%; P = .048) compared to the conventional display. When stratified by experience, novice physicians using the integrated display had higher performance (86% vs 69%; P < .001), less time (2.9 vs 3.7 min; P = .03), and more accurate etiology (65% vs 42%; P = .02); expert physicians using the integrated display had nonsignificantly improved performance (87% vs 82%; P = .09), time (2.9 vs 3.3; P = .28), and etiology (69% vs 67%; P = .81).Discussion
The integrated display appeared to support efficient information processing, which resulted in more rapid and accurate circulatory shock diagnosis. Evidence more strongly supported a difference for novices, suggesting that graphical displays may help reduce expert-novice performance gaps.
SUBMITTER: Reese TJ
PROVIDER: S-EPMC7481028 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:The aspiration of biology education is to give students tools to apply knowledge learned in the classroom to everyday life. Genetic modification is a real-world biological concept that relies on an in-depth understanding of the molecular behavior of DNA and proteins. This study investigated undergraduate biology students' conceptions of genetically modified organisms (GMOs) when probed with real-world, molecular and cellular, and essentialist cues, and how those conceptions compared across biology expertise. We developed a novel written assessment tool and administered it to 120 non-biology majors, 154 entering biology majors, 120 advanced biology majors (ABM), and nine biology faculty. Results indicated that undergraduate biology majors rarely included molecular and cellular rationales in their initial explanations of GMOs. Despite ABM demonstrating that they have much of the biology knowledge necessary to understand genetic modification, they did not appear to apply this knowledge to explaining GMOs. Further, this study showed that all undergraduate student populations exhibited evidence of essentialist thinking while explaining GMOs, regardless of their level of biology training. Finally, our results suggest an association between scientifically accurate ideas and the application of molecular and cellular rationales, as well as an association between misconceptions and essentialist rationales.
| S-EPMC5589432 | biostudies-literature
Project description:Our social skills are critically determined by our ability to understand and appropriately respond to actions performed by others. However despite its obvious importance, the mechanisms enabling action understanding in humans have remained largely unclear. A popular but controversial belief is that parts of the motor system contribute to our ability to understand observed actions. Here, using a novel behavioral paradigm, we investigated this belief by examining a causal relation between action production, and a component of action understanding--outcome prediction, the ability of a person to predict the outcome of observed actions. We asked dart experts to watch novice dart throwers and predict the outcome of their throws. We modulated the feedbacks provided to them, caused a specific improvement in the expert's ability to predict watched actions while controlling the other experimental factors, and exhibited that a change (improvement) in their outcome prediction ability results in a progressive and proportional deterioration in the expert's own darts performance. This causal relationship supports involvement of the motor system in outcome prediction by humans of actions observed in others.
| S-EPMC4227030 | biostudies-literature
Project description:ObjectivesInferior vena cava collapsibility (cIVC) measured by point-of-care ultrasound (POCUS) has been proposed as a noninvasive means of assessing fluid responsiveness. We aimed to prospectively evaluate the performance of a 25% cIVC cutoff value to detect fluid responsiveness among spontaneously breathing intensive care unit (ICU) patients when assessed with POCUS by novice versus expert physician sonologists.MethodsProspective observational study of spontaneously breathing ICU patients. Fluid responsiveness was defined as a >10% increase in cardiac index following a 500 mL fluid bolus, measured by bioreactance. Novice sonologist measured cIVC with POCUS. Their measurements were later compared to an expert physician sonologist who independently reviewed the POCUS images and assessed cIVCs.ResultsOf the 85 participants, 44 (52%) were fluid responders. A 25% cIVC cutoff value performed better when assessed by expert sonologists than novice physician sonologists (receiver-operator characteristic curve, ROC = 0.82 [0.74-0.88] vs ROC = 0.69 [0.60-0.77]).ConclusionsA 25% cIVC cutoff value measured by POCUS detects fluid responsiveness. However, the experience of the physician sonologist affects test performance and should be considered when interpreting and clinically using cIVC to direct intravenous fluid resuscitation.
| S-EPMC7153972 | biostudies-literature
Project description:Background:It is widely reported that facilitation can aid implementation of evidence-based practices. Although scholars agree that facilitators need a diverse range of skills, only a few retrospective studies have identified some of these. During the test of a facilitation strategy within the context of a VA initiative to implement evidence-based care delivery models, we documented the skills an expert external facilitator transferred to two initially novice internal regional facilitators. Ours is the first study to explore facilitation skills as they are being applied and transferred. Methods:Facilitators applied the strategy at eight primary care clinics that lacked implementation capacity in two VA networks. We conducted monthly debriefing interviews over a 30-month period and documented these in detailed notes. External facilitator interviews focused specifically on training and mentoring internal facilitators and the skills that she transferred. We also conducted, recorded, and transcribed two qualitative interviews with each facilitator and queried them about training content and process. We conducted a content analysis of the data, using deductive and inductive methods, to identify skills the external facilitator helped internal facilitators learn. We also explored the complexity of facilitation skills and grouped them into overarching skillsets. Results:The external facilitator helped internal facilitators learn 22 complex skills; with few exceptions, these skills were not unique but overlapped with one another. We clustered 21 of these into 5 groups of overarching skillsets: (1) building relationships and creating a supportive environment, (2) changing the system of care and the structure and processes that support it, (3) transferring knowledge and skills and creating infrastructure support for ongoing learning, (4) planning and leading change efforts, and (5) assessing people, processes, and outcomes and creating infrastructure for program monitoring. Conclusions:This study documented a broad range of implementation facilitation skills that are complex and overlapping. Findings suggest that studies and initiatives planning or applying facilitation as an implementation strategy should ensure that facilitators have or have the opportunity to learn the skills they need. Because facilitation skills are complex, the use of didactic methods alone may not be sufficient for transferring skills; future work should explore other methods and techniques.
| S-EPMC7427882 | biostudies-literature
Project description:Active-learning strategies can improve science, technology, engineering, and mathematics (STEM) undergraduates' abilities to learn fundamental concepts and skills. However, the results instructors achieve vary substantially. One explanation for this is that instructors commonly implement active learning differently than intended. An important factor affecting how instructors implement active learning is knowledge of teaching and learning. We aimed to discover knowledge that is important to effective active learning in large undergraduate courses. We developed a lesson-analysis instrument to elicit teacher knowledge, drawing on the theoretical construct of teacher noticing. We compared the knowledge used by expert (n = 14) and novice (n = 29) active-learning instructors as they analyzed lessons. Experts and novices differed in what they noticed, with experts more commonly considering how instructors hold students accountable, topic-specific student difficulties, whether the instructor elicited and responded to student thinking, and opportunities students had to generate their own ideas and work. Experts were also better able to support their lesson analyses with reasoning. This work provides foundational knowledge for the future design of preparation and support for instructors adopting active learning. Improving teacher knowledge will improve the implementation of active learning, which will be necessary to widely realize the potential benefits of active learning in undergraduate STEM.
| S-EPMC6007764 | biostudies-literature
Project description:Limitations of graphical displays as well as human perception make the presentation and analysis of multidimensional data challenging. Graphical display of information on paper or by current projectors is perforce limited to two dimensions; the encoding of information from other dimensions must be overloaded into the two physical dimensions. A number of alternative means of encoding this information have been implemented, such as offsetting data points at an angle (e.g., three-dimensional projections onto a two-dimensional surface) or generating derived parameters that are combinations of other variables (e.g., principal components). Here, we explore the use of color to encode additional dimensions of data. PolyChromatic Plots are standard dot plots, where the color of each event is defined by the values of one, two, or three of the measurements for that event. The measurements for these parameters are mapped onto an intensity value for each primary color (red, green, or blue) based on different functions. In addition, differential weighting of the priority with which overlapping events are displayed can be defined by these same measurements. PolyChromatic Plots can encode up to five independent dimensions of data in a single display. By altering the color mapping function and the priority function, very different displays that highlight or de-emphasize populations of events can be generated. As for standard black-and-white dot plots, frequency information can be significantly biased by this display; care must be taken to ensure appropriate interpretation of the displays. PolyChromatic Plots are a powerful display type that enables rapid data exploration. By virtue of encoding as many as five dimensions of data independently, an enormous amount of information can be gleaned from the displays. In many ways, the display performs somewhat like an unsupervised cluster algorithm, by highlighting events of similar distributions in multivariate space.
| S-EPMC2583940 | biostudies-literature
Project description:INTRODUCTION:Patients admitted to a critical care medicine (CCM) environment, including an intensive care unit (ICU), are susceptible to harm and significant resource utilisation. Therefore, a strategy to optimise provider performance is required. Performance scorecards are used by institutions for the purposes of driving quality improvement. There is no widely accepted or standardised scorecard that has been used for overall CCM performance. We aim to improve quality of care, patient safety and patient/family experience in CCM practice through the utilisation of a standardised, repeatable and multidimensional performance scorecard, designed to provide a continuous review of ICU physician and nurse practice, as well as departmental metrics. METHODS AND ANALYSIS:This will be a mixed-methods, controlled before and after study to assess the impact of a CCM-specific quality scorecard. Scorecard metrics were developed through expert consensus and existing literature. The study will include 19 attending CCM physicians and approximately 300 CCM nurses. Patient data for scorecard compilation are collected daily from bedside flow sheets. Preintervention baseline data will be collected for 6 months for each participant. After this, each participant will receive their scorecard measures. Following a 3-month washout period, postintervention data will be collected for 6 months. The primary outcome will be change in performance metrics following the provision of scorecard feedback to subjects. A cost analysis will also be performed, with the purpose of comparing total ICU costs prior to implementation of the scorecard with total ICU costs following implementation of the scorecard. The qualitative portion will include interviews with participants following the intervention phase. Interviews will be analysed in order to identify recurrent themes and subthemes, for the purposes of driving scorecard improvement. ETHICS AND DISSEMINATION:This protocol has been approved by the local research ethics board. Publication of results is anticipated in 2019. If this intervention is found to improve patient- and unit-directed outcomes, with evidence of cost-effectiveness, it would support the utilisation of such a scorecard as a quality standard in CCM.
| S-EPMC5781100 | biostudies-literature
Project description:Student engagement in the analysis of primary scientific literature increases critical thinking, scientific literacy, data evaluation, and science process skills. However, little is known about the process by which expertise in reading scientific articles develops. For this reason, we decided to compare how faculty experts and student novices engage with a research article. We performed think-aloud interviews of biology faculty and undergraduates as they read through a scientific article. We analyzed these interviews using qualitative methods. We grounded data interpretation in cognitive load theory and the ICAP (interactive, constructive, active, and passive) framework. Our results revealed that faculty have more complex schemas than students and that they reduce cognitive load through two main mechanisms: summarizing and note-taking. Faculty also engage with articles at a higher cognitive level, described as constructive by the ICAP framework, when compared with students. More complex schemas, effectively lowering cognitive load, and deeper engagement with the text may help explain why faculty encounter fewer comprehension difficulties than students in our study. Finally, faculty analyze and evaluate data more often than students when reading the text. Findings include a discussion of successful pedagogical approaches for instructors wishing to enhance undergraduates' comprehension and analysis of research articles.
| S-EPMC6829068 | biostudies-literature
Project description:The goal of this study was to examine the ability of emergency physicians who are not experts in emergency ultrasound (US) to perform lung ultrasonography and to identify B-lines. The hypothesis was that novice sonographers are able to perform lung US and identify B-lines after a brief intervention. In addition, the authors examined the diagnostic accuracy of B-lines in undifferentiated dyspneic patients for the diagnosis of acute heart failure syndrome (AHFS), using an eight-lung-zone technique as well as an abbreviated two-lung-zone technique.This was a prospective, cross-sectional study of patients who presented to the emergency department (ED) with acute dyspnea from May 2009 to June 2010. Emergency medicine (EM) resident physicians, who received a 30-minute training course in thoracic US examinations, performed lung ultrasonography on patients presenting to the ED with undifferentiated dyspnea. They attempted to identify the presence or absence of sonographic B-lines in eight lung fields based on their bedside US examinations. An emergency US expert blinded to the diagnosis and patient presentation, as well as to the residents' interpretations of presence of B-lines, served as the criterion standard. A secondary outcome determined the accuracy of B-lines, using both an eight-lung-zone and a two-lung-zone technique, for predicting pulmonary edema from AHFS in patients presenting with undifferentiated dyspnea. Two expert reviewers who were blinded to the US results determined the clinical diagnosis of AHFS.A cohort of 66 EM resident physicians performed lung US on 380 patients with a range of 1 to 28 examinations, a mean of 5.8 examinations, and a median of three examinations performed per resident. Compared to expert interpretation, lung US to detect B-lines by inexperienced sonographers achieved the following test characteristics: sensitivity 85%, specificity 84%, positive likelihood ratio (+LR) 5.2, negative likelihood ratio (-LR) 0.2, positive predictive value (PPV) 64%, and negative predictive value (NPV) 94%. Regarding the secondary outcome, the final diagnosis was AHFS in 35% of patients (134 of 380). For novice sonographers, one positive lung zone (i.e., anything positive) had a sensitivity of 87%, a specificity of 49%, a +LR of 1.7, a -LR of 0.3, a PPV of 50%, and an NPV of 88% for predicting AHFS. When all eight lung zones were determined positive (i.e., totally positive) by novice sonographers, the sensitivity was 19%, specificity was 97%, +LR was 5.7, -LR was 0.8, PPV was 76%, and NPV was 68% for predicting AHFS. The areas under the curve for novice and expert sonographers were 0.77 (95% CI = 0.72 to 0.82) and 0.76 (95% CI = 0.71 to 0.82), respectively.Novice sonographers can identify sonographic B-lines with similar accuracy compared to an expert sonographer. Lung US has fair predictive value for pulmonary edema from acute heart failure in the hands of both novice and expert sonographers.
| S-EPMC5225273 | biostudies-literature
Project description:Examining the effects of exogenous exposures on complex metabolic processes poses the unique challenge of identifying interactions among a large number of metabolites. Recent progress in the quantification of the metabolome through mass spectrometry (MS) and nuclear magnetic resonance (NMR) has given rise to high-dimensional biomedical data of specific metabolites that can be leveraged to study their effects in humans. These metabolic interactions can be evaluated using probabilistic graphical models (PGMs), which define conditional dependence and independence between components within and between heterogeneous biomedical datasets. This method allows for the detection and recovery of valuable but latent information that cannot be easily detected by other currently existing methods. Here, we develop a PGM method, referred to as an "Integrated Gaussian Graphical Model (IGGM)", to incorporate exposure concentrations of seven trace elements-arsenic (As), lead (Pb), mercury (Hg), cadmium (Cd), zinc (Zn), selenium (Se) and copper (Cu-into metabolic networks. We first conducted a simulation study demonstrating that the integration of trace elements into metabolomics data can improve the accuracy of detecting latent interactions of metabolites impacted by exposure in the network. We tested parameters such as sample size and the number of neighboring metabolites of a chosen trace element for their impact on the accuracy of detecting metabolite interactions. We then applied this method to measurements of cord blood plasma metabolites and placental trace elements collected from newborns in the New Hampshire Birth Cohort Study (NHBCS). We found that our approach can identify latent interactions among metabolites that are related to trace element concentrations. Application to similarly structured data may contribute to our understanding of the complex interplay between exposure-related metabolic interactions that are important for human health.
| S-EPMC6817396 | biostudies-literature