Dataset Information

Impact of integrated graphical display on expert and novice diagnostic performance in critical care.

ABSTRACT:

Objective

To determine the impact of a graphical information display on diagnosing circulatory shock.

Materials and methods

This was an experimental study comparing integrated and conventional information displays. Participants were intensivists or critical care fellows (experts) and first-year medical residents (novices).

Results

The integrated display was associated with higher performance (87% vs 82%; P < .001), less time (2.9 vs 3.5 min; P = .008), and more accurate etiology (67% vs 54%; P = .048) compared to the conventional display. When stratified by experience, novice physicians using the integrated display had higher performance (86% vs 69%; P < .001), less time (2.9 vs 3.7 min; P = .03), and more accurate etiology (65% vs 42%; P = .02); expert physicians using the integrated display had nonsignificantly improved performance (87% vs 82%; P = .09), time (2.9 vs 3.3; P = .28), and etiology (69% vs 67%; P = .81).

Discussion

The integrated display appeared to support efficient information processing, which resulted in more rapid and accurate circulatory shock diagnosis. Evidence more strongly supported a difference for novices, suggesting that graphical displays may help reduce expert-novice performance gaps.

SUBMITTER: Reese TJ

PROVIDER: S-EPMC7481028 | biostudies-literature | 2020 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Impact of integrated graphical display on expert and novice diagnostic performance in critical care.

Reese Thomas J TJ Del Fiol Guilherme G Tonna Joseph E JE Kawamoto Kensaku K Segall Noa N Weir Charlene C Macpherson Brekk C BC Kukhareva Polina P Wright Melanie C MC

Journal of the American Medical Informatics Association : JAMIA 20200801 8

<h4>Objective</h4>To determine the impact of a graphical information display on diagnosing circulatory shock.<h4>Materials and methods</h4>This was an experimental study comparing integrated and conventional information displays. Participants were intensivists or critical care fellows (experts) and first-year medical residents (novices).<h4>Results</h4>The integrated display was associated with higher performance (87% vs 82%; P < .001), less time (2.9 vs 3.5 min; P = .008), and more accurate eti ...[more]

PMID: 32548627

Similar Datasets

Project description:IntroductionPoint-of-care ultrasound (POCUS) has become an important diagnostic tool in acute care medicine; however, little is known about the biomechanical differences between novice and expert practitioners.MethodsA low-cost ($50 CAD) gyroscope and accelerometer integrated sensor was assembled and affixed to an ultrasound probe. Seventeen participants, nine novices and eight experts, were recruited to perform three abdominal and four cardiac scans on a standardized patient. Participant demographics, time per scan, average acceleration, average angular velocity, decay in acceleration and angular velocity over time, and frequency of probe movements were analyzed. Video capture with blinded video review was scored.ResultsOn video review, experts had higher image optimization and acquisition scores for both abdominal and cardiac scans. Experts had shorter scan times for abdominal (7 s vs. 26 s, p = 0.003) and cardiac (11 s vs. 26 s, p < 0.001) scans. There was no difference in average acceleration (g) between novices and experts performing abdominal (1.02 vs. 1.01, p = 0.50) and cardiac (1.01 vs. 1.01, p = 0.45) scans. Experts had lower angular velocity (°/s) for abdominal scans (10.00 vs. 18.73, p < 0.001) and cardiac scans (15.61 vs. 20.33, p = 0.02) There was a greater decay in acceleration over time for experts performing cardiac scans compared to novices (-0.194 vs. -0.050, p = 0.03) but not for abdominal scans or when measuring angular velocity. The frequency of movements (Hz) was higher for novices compared to experts for abdominal (16.68 vs. 13.79, p < 0.001) and cardiac (17.60 vs. 13.63, p = 0.002) scans.DiscussionThis study supports the feasibility of a low-cost gyroscope and accelerometer integrated sensor to quantify the biomechanics of POCUS. It may also support the concept of "window shopping" as a method by which experts obtain abdominal and cardiac views, where sliding is used to find an acoustic window, then smaller rocking and tilting probe movements are used to refine the image.

Project description:BackgroundWhile expert optometrists tend to rely on a deep understanding of the disease and intuitive pattern recognition, those with less experience may depend more on extensive data, comparisons, and external guidance. Understanding these variations is important for developing artificial intelligence (AI) systems that can effectively support optometrists with varying degrees of experience and minimize decision inconsistencies.ObjectiveThe main objective of this study is to identify and analyze the variations in diagnostic decision-making approaches between novice and expert optometrists. By understanding these variations, we aim to provide guidelines for the development of AI systems that can support optometrists with varying levels of expertise. These guidelines will assist in developing AI systems for glaucoma diagnosis, ultimately enhancing the diagnostic accuracy of optometrists and minimizing inconsistencies in their decisions.MethodsWe conducted in-depth interviews with 14 optometrists using within-subject design, including both novices and experts, focusing on their approaches to glaucoma diagnosis. The responses were coded and analyzed using a mixed method approach incorporating both qualitative and quantitative analysis. Statistical tests such as Mann-Whitney U and chi-square tests were used to find significance in intergroup variations. These findings were further supported by themes extracted through qualitative analysis, which helped to identify decision-making patterns and understand variations in their approaches.ResultsBoth groups showed lower concordance rates with clinical diagnosis, with experts showing almost double (7/35, 20%) concordance rates with limited data in comparison to novices (7/69, 10%), highlighting the impact of experience and data availability on clinical judgment; this rate increased to nearly 40% for both groups (experts: 5/12, 42% and novices: 8/21, 42%) when they had access to complete historical data of the patient. We also found statistically significant intergroup differences between the first visits and subsequent visits with a P value of less than .05 on the Mann-Whitney U test in many assessments. Furthermore, approaches to the exam assessment and decision differed significantly: experts emphasized comprehensive risk assessments and progression analysis, demonstrating cognitive efficiency and intuitive decision-making, while novices relied more on structured, analytical methods and external references. Additionally, significant variations in patient follow-up times were observed, with a P value of <.001 on the chi-square test, showing a stronger influence of experience on follow-up time decisions.ConclusionsThe study highlights significant variations in the decision-making process of novice and expert optometrists in glaucoma diagnosis, with experience playing a key role in accuracy, approach, and management. These findings demonstrate the critical need for AI systems tailored to varying levels of expertise. They also provide insights for the future design of AI systems aimed at enhancing the diagnostic accuracy of optometrists and consistency across different expertise levels, ultimately improving patient outcomes in optometric practice.

Project description:Personalization of ICU nutrition is essential to future of critical care. Recommendations from American/European guidelines and practice suggestions incorporating recent literature are presented. Low-dose enteral nutrition (EN) or parenteral nutrition (PN) can be started within 48 h of admission. While EN is preferred route of delivery, new data highlight PN can be given safely without increased risk; thus, when early EN is not feasible, provision of isocaloric PN is effective and results in similar outcomes. Indirect calorimetry (IC) measurement of energy expenditure (EE) is recommended by both European/American guidelines after stabilization post-ICU admission. Below-measured EE (~ 70%) targets should be used during early phase and increased to match EE later in stay. Low-dose protein delivery can be used early (~ D1-2) (< 0.8 g/kg/d) and progressed to ≥ 1.2 g/kg/d as patients stabilize, with consideration of avoiding higher protein in unstable patients and in acute kidney injury not on CRRT. Intermittent-feeding schedules hold promise for further research. Clinicians must be aware of delivered energy/protein and what percentage of targets delivered nutrition represents. Computerized nutrition monitoring systems/platforms have become widely available. In patients at risk of micronutrient/vitamin losses (i.e., CRRT), evaluation of micronutrient levels should be considered post-ICU days 5-7 with repletion of deficiencies where indicated. In future, we hope use of muscle monitors such as ultrasound, CT scan, and/or BIA will be utilized to assess nutrition risk and monitor response to nutrition. Use of specialized anabolic nutrients such as HMB, creatine, and leucine to improve strength/muscle mass is promising in other populations and deserves future study. In post-ICU setting, continued use of IC measurement and other muscle measures should be considered to guide nutrition. Research on using rehabilitation interventions such as cardiopulmonary exercise testing (CPET) to guide post-ICU exercise/rehabilitation prescription and using anabolic agents such as testosterone/oxandrolone to promote post-ICU recovery is needed.

Project description:BackgroundIt is widely reported that facilitation can aid implementation of evidence-based practices. Although scholars agree that facilitators need a diverse range of skills, only a few retrospective studies have identified some of these. During the test of a facilitation strategy within the context of a VA initiative to implement evidence-based care delivery models, we documented the skills an expert external facilitator transferred to two initially novice internal regional facilitators. Ours is the first study to explore facilitation skills as they are being applied and transferred.MethodsFacilitators applied the strategy at eight primary care clinics that lacked implementation capacity in two VA networks. We conducted monthly debriefing interviews over a 30-month period and documented these in detailed notes. External facilitator interviews focused specifically on training and mentoring internal facilitators and the skills that she transferred. We also conducted, recorded, and transcribed two qualitative interviews with each facilitator and queried them about training content and process. We conducted a content analysis of the data, using deductive and inductive methods, to identify skills the external facilitator helped internal facilitators learn. We also explored the complexity of facilitation skills and grouped them into overarching skillsets.ResultsThe external facilitator helped internal facilitators learn 22 complex skills; with few exceptions, these skills were not unique but overlapped with one another. We clustered 21 of these into 5 groups of overarching skillsets: (1) building relationships and creating a supportive environment, (2) changing the system of care and the structure and processes that support it, (3) transferring knowledge and skills and creating infrastructure support for ongoing learning, (4) planning and leading change efforts, and (5) assessing people, processes, and outcomes and creating infrastructure for program monitoring.ConclusionsThis study documented a broad range of implementation facilitation skills that are complex and overlapping. Findings suggest that studies and initiatives planning or applying facilitation as an implementation strategy should ensure that facilitators have or have the opportunity to learn the skills they need. Because facilitation skills are complex, the use of didactic methods alone may not be sufficient for transferring skills; future work should explore other methods and techniques.

Dataset Information

Impact of integrated graphical display on expert and novice diagnostic performance in critical care.

Objective

Materials and methods

Results

Discussion

Publications

Impact of integrated graphical display on expert and novice diagnostic performance in critical care.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets