Dataset Information

Automatic identification of recent high impact clinical articles in PubMed to support clinical decision making using time-agnostic features.

ABSTRACT:

Objectives

Finding recent clinical studies that warrant changes in clinical practice ("high impact" clinical studies) in a timely manner is very challenging. We investigated a machine learning approach to find recent studies with high clinical impact to support clinical decision making and literature surveillance.

Methods

To identify recent studies, we developed our classification model using time-agnostic features that are available as soon as an article is indexed in PubMed®, such as journal impact factor, author count, and study sample size. Using a gold standard of 541 high impact treatment studies referenced in 11 disease management guidelines, we tested the following null hypotheses: (1) the high impact classifier with time-agnostic features (HI-TA) performs equivalently to PubMed's Best Match sort and a MeSH-based Naïve Bayes classifier; and (2) HI-TA performs equivalently to the high impact classifier with both time-agnostic and time-sensitive features (HI-TS) enabled in a previous study. The primary outcome for both hypotheses was mean top 20 precision.

Results

The differences in mean top 20 precision between HI-TA and three baselines (PubMed's Best Match, a MeSH-based Naïve Bayes classifier, and HI-TS) were not statistically significant (12% vs. 3%, p = 0.101; 12% vs. 11%, p = 0.720; 12% vs. 25%, p = 0.094, respectively). Recall of HI-TA was low (7%).

Conclusion

HI-TA had equivalent performance to state-of-the-art approaches that depend on time-sensitive features. With the advantage of relying only on time-agnostic features, the proposed approach can be used as an adjunct to help clinicians identify recent high impact clinical studies to support clinical decision-making. However, low recall limits the use of HI-TA for literature surveillance.

SUBMITTER: Bian J

PROVIDER: S-EPMC6342626 | biostudies-literature | 2019 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Automatic identification of recent high impact clinical articles in PubMed to support clinical decision making using time-agnostic features.

Bian Jiantao J Abdelrahman Samir S Shi Jianlin J Del Fiol Guilherme G

Journal of biomedical informatics 20181122

<h4>Objectives</h4>Finding recent clinical studies that warrant changes in clinical practice ("high impact" clinical studies) in a timely manner is very challenging. We investigated a machine learning approach to find recent studies with high clinical impact to support clinical decision making and literature surveillance.<h4>Methods</h4>To identify recent studies, we developed our classification model using time-agnostic features that are available as soon as an article is indexed in PubMed®, su ...[more]

PMID: 30468912

Similar Datasets

Project description:BackgroundElectronic medical records are widely used in family practices across Canada and can improve health outcomes. However, recent reports indicate that physicians using electronic medical records work longer and have less direct patient contact which may contribute to burnout. Therefore, new and innovative digital tools are essential to reduce physician workloads and improve patient-physician interaction to address physician burnout. The objective of this study was to assess the efficiency and accuracy of clinical decision-making when using a new preventive care point-of-care clinical decision support system (CDSS). An estimate of the potential annual time savings was also determined. This study also assessed physician reported perceived usefulness and ease of use of the CDSS.MethodsQuantitative and qualitative data were collected during this study. Each participant evaluated two simulated patient charts and identified which preventive care metrics were due. The participants recorded their decisions and the time required to assess each chart. Participants then completed a Technology Acceptance Model survey regarding the perceived usefulness and ease of use of the CDSS, which included qualitative feedback. The amount of time saved was determined and participants' clinical decision-making accuracy was scored against current Canadian preventive care guidelines. The number of preventive care specific visits completed per year was determined using clinic billing data.ResultsThe preventive care CDSS saved an average of 195.7 s of chart review time (249.5 s vs 445.2 s; P < 0.001). A total of 1520 preventive visits were performed at Primrose and Bruyère Family Medicine Centres. Extrapolated across the organization, implementation of the new tool could save 82.6 h per year. Decision-making accuracy was not affected by the new tool (78.4% vs 80.9%, P > 0.05). Participants rated the perceived ease of use and usefulness to be very high.ConclusionsNew digital tools may reduce providers' workload without impacting clinical decision-making accuracy. Participants indicated that the preventive care CDSS was useful and easy to use. Further software development and clinical studies are required to further improve and characterize the effect this new CDSS has when implemented in clinical practice.

Project description:Involvement of many variables, uncertainty in treatment response, and inter-patient heterogeneity challenge objective decision-making in dynamic treatment regime (DTR) in oncology. Advanced machine learning analytics in conjunction with information-rich dense multi-omics data have the ability to overcome such challenges. We have developed a comprehensive artificial intelligence (AI)-based optimal decision-making framework for assisting oncologists in DTR. In this work, we demonstrate the proposed framework to Knowledge Based Response-Adaptive Radiotherapy (KBR-ART) applications by developing an interactive software tool entitled Adaptive Radiotherapy Clinical Decision Support (ARCliDS). ARCliDS is composed of two main components: Artifcial RT Environment (ARTE) and Optimal Decision Maker (ODM). ARTE is designed as a Markov decision process and modeled via supervised learning. Given a patient's pre- and during-treatment information, ARTE can estimate treatment outcomes for a selected daily dosage value (radiation fraction size). ODM is formulated using reinforcement learning and is trained on ARTE. ODM can recommend optimal daily dosage adjustments to maximize the tumor local control probability and minimize the side effects. Graph Neural Networks (GNN) are applied to exploit the inter-feature relationships for improved modeling performance and a novel double GNN architecture is designed to avoid nonphysical treatment response. Datasets of size 117 and 292 were available from two clinical trials on adaptive RT in non-small cell lung cancer (NSCLC) patients and adaptive stereotactic body RT (SBRT) in hepatocellular carcinoma (HCC) patients, respectively. For training and validation, dense data with 297 features were available for 67 NSCLC patients and 110 features for 71 HCC patients. To increase the sample size for ODM training, we applied Generative Adversarial Networks to generate 10,000 synthetic patients. The ODM was trained on the synthetic patients and validated on the original dataset. We found that, Double GNN architecture was able to correct the nonphysical dose-response trend and improve ARCliDS recommendation. The average root mean squared difference (RMSD) between ARCliDS recommendation and reported clinical decisions using double GNNs were 0.61 [0.03] Gy/frac (mean [sem]) for adaptive RT in NSCLC patients and 2.96 [0.42] Gy/frac for adaptive SBRT HCC compared to the single GNN's RMSDs of 0.97 [0.12] Gy/frac and 4.75 [0.16] Gy/frac, respectively. Overall, For NSCLC and HCC, ARCliDS with double GNNs was able to reproduce 36% and 50% of the good clinical decisions (local control and no side effects) and improve 74% and 30% of the bad clinical decisions, respectively. In conclusion, ARCliDS is the first web-based software dedicated to assist KBR-ART with multi-omics data. ARCliDS can learn from the reported clinical decisions and facilitate AI-assisted clinical decision-making for improving the outcomes in DTR.

Project description:BackgroundIn prehospital emergency care, providers face significant challenges in making informed decisions due to factors such as limited cognitive support, high-stress environments, and lack of experience with certain patient conditions. Effective Clinical Decision Support Systems (CDSS) have great potential to alleviate these challenges. However, such systems have not yet been widely adopted in real-world practice and have been found to cause workflow disruptions and usability issues. Therefore, it is critical to investigate how to design CDSS that meet the needs of prehospital providers while accounting for the unique characteristics of prehospital workflows.MethodsWe conducted semi-structured interviews with 20 prehospital providers recruited from four Emergency Medical Services (EMS) agencies in an urban area in the northeastern U.S. The interviews focused on the decision-making challenges faced by prehospital providers, their technological needs for decision support, and key considerations for the design and implementation of a CDSS that can seamlessly integrate into prehospital care workflows. The data were analyzed using content analysis to identify common themes.ResultsOur qualitative study identified several challenges in prehospital decision-making, including limited access to diagnostic tools, insufficient experience with certain critical patient conditions, and a lack of cognitive support. Participants highlighted several desired features to make CDSS more effective in the dynamic, hands-busy, and cognitively demanding prehospital context, such as automatic prompts for possible patient conditions and treatment options, alerts for critical patient safety events, AI-powered medication identification, and easy retrieval of protocols using hands-free methods (e.g., voice commands). Key considerations for successful CDSS adoption included balancing the frequency and urgency of alerts to reduce alarm fatigue and workflow disruptions, facilitating real-time data collection and documentation to enable decision generation, and ensuring trust and accountability while preventing over-reliance when using CDSS.ConclusionThis study provides empirical insights into the challenges and user needs in prehospital decision-making and offers practical and system design implications for addressing these issues.

Project description:BackgroundLung cancer treatment decisions are typically made among clinical experts in a multidisciplinary tumour board (MTB) based on clinical data and guidelines. The rise of artificial intelligence and cultural shifts towards patient autonomy are changing the nature of clinical decision-making towards personalized treatments. This can be supported by clinical decision support systems (CDSSs) that generate personalized treatment information as a basis for shared decision-making (SDM). Little is known about lung cancer patients' treatment decisions and the potential for SDM supported by CDSSs. The aim of this study is to understand to what extent SDM is done in current practice and what clinicians need to improve it.ObjectiveTo explore (1) the extent to which patient preferences are taken into consideration in non-small-cell lung cancer (NSCLC) treatment decisions; (2) clinician perspectives on using CDSSs to support SDM.DesignMixed methods study consisting of a retrospective cohort study on patient deviation from MTB advice and reasons for deviation, qualitative interviews with lung cancer specialists and observations of MTB discussions and patient consultations.Setting and participantsNSCLC patients (N = 257) treated at a single radiotherapy clinic and nine lung cancer specialists from six Dutch clinics.ResultsWe found a 10.9% (n = 28) deviation rate from MTB advice; 50% (n = 14) were due to patient preference, of which 85.7% (n = 12) chose a less intensive treatment than MTB advice. Current MTB recommendations are based on clinician experience, guidelines and patients' performance status. Most specialists (n = 7) were receptive towards CDSSs but cited barriers, such as lack of trust, lack of validation studies and time. CDSSs were considered valuable during MTB discussions rather than in consultations.ConclusionLung cancer decisions are heavily influenced by clinical guidelines and experience, yet many patients prefer less intensive treatments. CDSSs can support SDM by presenting the harms and benefits of different treatment options rather than giving single treatment advice. External validation of CDSSs should be prioritized.Patient or public contributionThis study did not involve patients or the public explicitly; however, the study design was informed by prior interviews with volunteers of a cancer patient advocacy group. The study objectives and data collection were supported by Dutch health care insurer CZ for a project titled 'My Best Treatment' that improves patient-centeredness and the lung cancer patient pathway in the Netherlands.

Dataset Information

Automatic identification of recent high impact clinical articles in PubMed to support clinical decision making using time-agnostic features.

Objectives

Methods

Results

Conclusion

Publications

Automatic identification of recent high impact clinical articles in PubMed to support clinical decision making using time-agnostic features.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets