Dataset Information

The impact of a diagnostic decision support system on the consultation: perceptions of GPs and patients.

ABSTRACT:

Background

Clinical decision support systems (DSS) aimed at supporting diagnosis are not widely used. This is mainly due to usability issues and lack of integration into clinical work and the electronic health record (EHR). In this study we examined the usability and acceptability of a diagnostic DSS prototype integrated with the EHR and in comparison with the EHR alone.

Methods

Thirty-four General Practitioners (GPs) consulted with 6 standardised patients (SPs) using only their EHR system (baseline session); on another day, they consulted with 6 different but matched for difficulty SPs, using the EHR with the integrated DSS prototype (DSS session). GPs were interviewed twice (at the end of each session), and completed the Post-Study System Usability Questionnaire at the end of the DSS session. The SPs completed the Consultation Satisfaction Questionnaire after each consultation.

Results

The majority of GPs (74%) found the DSS useful: it helped them consider more diagnoses and ask more targeted questions. They considered three user interface features to be the most useful: (1) integration with the EHR; (2) suggested diagnoses to consider at the start of the consultation and; (3) the checklist of symptoms and signs in relation to each suggested diagnosis. There were also criticisms: half of the GPs felt that the DSS changed their consultation style, by requiring them to code symptoms and signs while interacting with the patient. SPs sometimes commented that GPs were looking at their computer more than at them; this comment was made more often in the DSS session (15%) than in the baseline session (3%). Nevertheless, SP ratings on the satisfaction questionnaire did not differ between the two sessions.

Conclusions

To use the DSS effectively, GPs would need to adapt their consultation style, so that they code more information during rather than at the end of the consultation. This presents a potential barrier to adoption. Training GPs to use the system in a patient-centred way, as well as improvement of the DSS interface itself, could facilitate coding. To enhance patient acceptability, patients should be informed about the potential of the DSS to improve diagnostic accuracy.

SUBMITTER: Porat T

PROVIDER: S-EPMC5457602 | biostudies-literature | 2017 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The impact of a diagnostic decision support system on the consultation: perceptions of GPs and patients.

Porat Talya T Delaney Brendan B Kostopoulou Olga O

BMC medical informatics and decision making 20170602 1

<h4>Background</h4>Clinical decision support systems (DSS) aimed at supporting diagnosis are not widely used. This is mainly due to usability issues and lack of integration into clinical work and the electronic health record (EHR). In this study we examined the usability and acceptability of a diagnostic DSS prototype integrated with the EHR and in comparison with the EHR alone.<h4>Methods</h4>Thirty-four General Practitioners (GPs) consulted with 6 standardised patients (SPs) using only their E ...[more]

PMID: 28576145

Similar Datasets

Project description:BackgroundContinuously growing medical knowledge and the increasing amount of data make it difficult for medical professionals to keep track of all new information and to place it in the context of existing information. A variety of digital technologies and artificial intelligence-based methods are currently available as persuasive tools to empower physicians in clinical decision-making and improve health care quality. A novel diagnostic decision support system (DDSS) prototype developed by Ada Health GmbH with a focus on traceability, transparency, and usability will be examined more closely in this study.ObjectiveThe aim of this study is to test the feasibility and functionality of a novel DDSS prototype, exploring its potential and performance in identifying the underlying cause of acute dyspnea in patients at the University Hospital Basel.MethodsA prospective, observational feasibility study was conducted at the emergency department (ED) and internal medicine ward of the University Hospital Basel, Switzerland. A convenience sample of 20 adult patients admitted to the ED with dyspnea as the chief complaint and a high probability of inpatient admission was selected. A study physician followed the patients admitted to the ED throughout the hospitalization without interfering with the routine clinical work. Routinely collected health-related personal data from these patients were entered into the DDSS prototype. The DDSS prototype's resulting disease probability list was compared with the gold-standard main diagnosis provided by the treating physician.ResultsThe DDSS presented information with high clarity and had a user-friendly, novel, and transparent interface. The DDSS prototype was not perfectly suited for the ED as case entry was time-consuming (1.5-2 hours per case). It provided accurate decision support in the clinical inpatient setting (average of cases in which the correct diagnosis was the first diagnosis listed: 6/20, 30%, SD 2.10%; average of cases in which the correct diagnosis was listed as one of the top 3: 11/20, 55%, SD 2.39%; average of cases in which the correct diagnosis was listed as one of the top 5: 14/20, 70%, SD 2.26%) in patients with dyspnea as the main presenting complaint.ConclusionsThe study of the feasibility and functionality of the tool was successful, with some limitations. Used in the right place, the DDSS has the potential to support physicians in their decision-making process by showing new pathways and unintentionally ignored diagnoses. The DDSS prototype had some limitations regarding the process of data input, diagnostic accuracy, and completeness of the integrated medical knowledge. The results of this study provide a basis for the tool's further development. In addition, future studies should be conducted with the aim to overcome the current limitations of the tool and study design.Trial registrationClinicalTrials.gov NCT04827342; https://clinicaltrials.gov/ct2/show/NCT04827342.

Project description:BackgroundDiagnostic errors pose significant health risks and contribute to patient mortality. With the growing accessibility of electronic health records, machine learning models offer a promising avenue for enhancing diagnosis quality. Current research has primarily focused on a limited set of diseases with ample training data, neglecting diagnostic scenarios with limited data availability.ObjectiveThis study aims to develop an information retrieval (IR)-based framework that accommodates data sparsity to facilitate broader diagnostic decision support.MethodsWe introduced an IR-based diagnostic decision support framework called CliniqIR. It uses clinical text records, the Unified Medical Language System Metathesaurus, and 33 million PubMed abstracts to classify a broad spectrum of diagnoses independent of training data availability. CliniqIR is designed to be compatible with any IR framework. Therefore, we implemented it using both dense and sparse retrieval approaches. We compared CliniqIR's performance to that of pretrained clinical transformer models such as Clinical Bidirectional Encoder Representations from Transformers (ClinicalBERT) in supervised and zero-shot settings. Subsequently, we combined the strength of supervised fine-tuned ClinicalBERT and CliniqIR to build an ensemble framework that delivers state-of-the-art diagnostic predictions.ResultsOn a complex diagnosis data set (DC3) without any training data, CliniqIR models returned the correct diagnosis within their top 3 predictions. On the Medical Information Mart for Intensive Care III data set, CliniqIR models surpassed ClinicalBERT in predicting diagnoses with <5 training samples by an average difference in mean reciprocal rank of 0.10. In a zero-shot setting where models received no disease-specific training, CliniqIR still outperformed the pretrained transformer models with a greater mean reciprocal rank of at least 0.10. Furthermore, in most conditions, our ensemble framework surpassed the performance of its individual components, demonstrating its enhanced ability to make precise diagnostic predictions.ConclusionsOur experiments highlight the importance of IR in leveraging unstructured knowledge resources to identify infrequently encountered diagnoses. In addition, our ensemble framework benefits from combining the complementary strengths of the supervised and retrieval-based models to diagnose a broad spectrum of diseases.

Project description:In advanced dementia, feeding problems are nearly universal, and families face difficult decisions about feeding options. Initial interviews for a randomized trial were used to describe surrogates' perceptions of feeding options, and to determine whether a decision aid on feeding options in advanced dementia would improve knowledge, reduce expectation of benefit from tube feeding, and reduce conflict over treatment choices for persons with advanced dementia.Semistructured interview with prestudy and poststudy design for surrogates in the intervention group.Twenty-four skilled nursing facilities across North Carolina participating in a cluster randomized trial.Two hundred and fifty-five surrogate decision makers for nursing home residents with advanced dementia and feeding problems, in control (n = 129) and intervention (n = 126) groups.For intervention surrogates only, an audiovisual-print decision aid provided information on dementia, feeding problems in dementia, advantages and disadvantages of feeding tubes or assisted oral feeding options, and the role of surrogates in making these decisions.The interview included open-ended items asking surrogates to report advantages and disadvantages of tube feeding and assisted oral feeding. Knowledge of feeding options was measured with 19 true/false items and items measuring expectation of benefit from tube feeding. Surrogates reported which of these two feeding options they preferred for the person with dementia, and how confident they were in this choice; their level of conflict about the choice was measured using the decisional conflict scale.Before the decision aid, surrogates described advantages and disadvantages of assisted oral feeding and tube feeding in practical, ethical, and medical terms. After review of the decision aid, intervention surrogates had improved knowledge scores (15.5 vs 16.8; P < .001), decreased expectation of benefits from tube feeding (2.73 vs 2.32; P = .001), and reduced decisional conflict (2.24 vs 1.91; P < .001). Surrogates preferred assisted oral feeding initially and reported more certainty about this choice after the decision aid.A structured decision aid can be used to improve decision making about feeding options in dementia care.

Project description:BackgroundThe increasing affordability of DNA sequencing has allowed it to be widely deployed in pathology laboratories. However, this has exposed many issues with the analysis and reporting of variants for clinical diagnostic use. Implementing a high-throughput sequencing (NGS) clinical reporting system requires a diverse combination of capabilities, statistical methods to identify variants, global variant databases, a validated bioinformatics pipeline, an auditable laboratory workflow, reproducible clinical assays and quality control monitoring throughout. These capabilities must be packaged in software that integrates the disparate components into a useable system.ResultsTo meet these needs, we developed a web-based application, PathOS, which takes variant data from a patient sample through to a clinical report. PathOS has been used operationally in the Peter MacCallum Cancer Centre for two years for the analysis, curation and reporting of genetic tests for cancer patients, as well as the curation of large-scale research studies. PathOS has also been deployed in cloud environments allowing multiple institutions to use separate, secure and customisable instances of the system. Increasingly, the bottleneck of variant curation is limiting the adoption of clinical sequencing for molecular diagnostics. PathOS is focused on providing clinical variant curators and pathology laboratories with a decision support system needed for personalised medicine. While the genesis of PathOS has been within cancer molecular diagnostics, the system is applicable to NGS clinical reporting generally.ConclusionsThe widespread availability of genomic sequencers has highlighted the limited availability of software to support clinical decision-making in molecular pathology. PathOS is a system that has been developed and refined in a hospital laboratory context to meet the needs of clinical diagnostics. The software is available as a set of Docker images and source code at https://github.com/PapenfussLab/PathOS .

Project description:PURPOSE:Patients with a history of radiocontrast media (RCM) hypersensitivity can be overlooked, resulting in repeated reactions. Therefore, a consultation support system for RCM hypersensitivity has been in operation at Seoul National University Bundang Hospital since December 2011. We analyzed the effect of this system on physicians' practice. METHODS:A retrospective study was conducted on patients with previous RCM reactions (December 1, 2010 to November 30, 2012). The control period was December 2010 to November 2011, and the intervention period was December 2011 to November 2012. The primary outcome was the composite outcome of premedication and consultation. Premedication was defined as preventive medication prescribed by the physician who ordered RCM-enhanced computed tomography (CT) at the same time. The secondary outcome was the recurrence rate after using the consultation support system. RESULTS:A total of 189 clinicians prescribed 913 CT scans during the control period and 225 clinicians performed 1,153 examinations during the intervention period. The odds ratio (OR) of achieving the composite outcome increased significantly after use of the consultation support system (OR, 1.54; 95% confidence interval [CI], 1.15-2.05). Clinicians in both medical (OR, 1.48; 95% CI, 1.06-2.07) and surgical (OR, 2.07; 95% CI, 1.24-3.46) departments showed significant changes in their behavior, whereas those in the emergency department did not (OR, 1.07; 95% CI, 0.41-2.78). Professors (OR, 1.47; 95% CI, 1.06-2.04) and trainees (OR, 1.97, 95% CI, 1.22-3.18) showed significant changes in their behavior toward patients with previous RCM reactions. The behavior of 86 clinicians who ordered CT scans during both the control and intervention periods was unchanged. CONCLUSIONS:The consultation support system for those with previous RCM hypersensitivity reactions changed physicians' practice patterns and decreased recurrent RCM hypersensitivity reactions as well.

Dataset Information

The impact of a diagnostic decision support system on the consultation: perceptions of GPs and patients.

Background

Methods

Results

Conclusions

Publications

The impact of a diagnostic decision support system on the consultation: perceptions of GPs and patients.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets