Dataset Information

A mathematical model for interpretable clinical decision support with applications in gynecology.

ABSTRACT:

Background

Over time, methods for the development of clinical decision support (CDS) systems have evolved from interpretable and easy-to-use scoring systems to very complex and non-interpretable mathematical models. In order to accomplish effective decision support, CDS systems should provide information on how the model arrives at a certain decision. To address the issue of incompatibility between performance, interpretability and applicability of CDS systems, this paper proposes an innovative model structure, automatically leading to interpretable and easily applicable models. The resulting models can be used to guide clinicians when deciding upon the appropriate treatment, estimating patient-specific risks and to improve communication with patients.

Methods and findings

We propose the interval coded scoring (ICS) system, which imposes that the effect of each variable on the estimated risk is constant within consecutive intervals. The number and position of the intervals are automatically obtained by solving an optimization problem, which additionally performs variable selection. The resulting model can be visualised by means of appealing scoring tables and color bars. ICS models can be used within software packages, in smartphone applications, or on paper, which is particularly useful for bedside medicine and home-monitoring. The ICS approach is illustrated on two gynecological problems: diagnosis of malignancy of ovarian tumors using a dataset containing 3,511 patients, and prediction of first trimester viability of pregnancies using a dataset of 1,435 women. Comparison of the performance of the ICS approach with a range of prediction models proposed in the literature illustrates the ability of ICS to combine optimal performance with the interpretability of simple scoring systems.

Conclusions

The ICS approach can improve patient-clinician communication and will provide additional insights in the importance and influence of available variables. Future challenges include extensions of the proposed methodology towards automated detection of interaction effects, multi-class decision support systems, prognosis and high-dimensional data.

SUBMITTER: Van Belle VM

PROVIDER: S-EPMC3315538 | biostudies-literature | 2012

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A mathematical model for interpretable clinical decision support with applications in gynecology.

Van Belle Vanya M C A VM Van Calster Ben B Timmerman Dirk D Bourne Tom T Bottomley Cecilia C Valentin Lil L Neven Patrick P Van Huffel Sabine S Suykens Johan A K JA Boyd Stephen S

PloS one 20120329 3

<h4>Background</h4>Over time, methods for the development of clinical decision support (CDS) systems have evolved from interpretable and easy-to-use scoring systems to very complex and non-interpretable mathematical models. In order to accomplish effective decision support, CDS systems should provide information on how the model arrives at a certain decision. To address the issue of incompatibility between performance, interpretability and applicability of CDS systems, this paper proposes an inn ...[more]

PMID: 22479598

Similar Datasets

Project description:PURPOSE:Precision oncology is hindered by the lack of decision support for determining the functional and therapeutic significance of genomic alterations in tumors and relevant clinically available options. To bridge this knowledge gap, we established a Precision Oncology Decision Support (PODS) team that provides annotations at the alteration-level and subsequently determined if clinical decision-making was influenced. METHODS:Genomic alterations were annotated to determine actionability based on a variant's known or potential functional and/or therapeutic significance. The medical records of a subset of patients annotated in 2015 were manually reviewed to assess trial enrollment. A web-based survey was implemented to capture the reasons why genotype-matched therapies were not pursued. RESULTS:PODS processed 1,669 requests for annotation of 4,084 alterations (2,254 unique) across 49 tumor types for 1,197 patients. 2,444 annotations for 669 patients included an actionable variant call: 32.5% actionable, 9.4% potentially, 29.7% unknown, 28.4% non-actionable. 66% of patients had at least one actionable/potentially actionable alteration. 20.6% (110/535) patients annotated enrolled on a genotype-matched trial. Trial enrolment was significantly higher for patients with actionable/potentially actionable alterations (92/333, 27.6%) than those with unknown (16/136, 11.8%) and non-actionable (2/66, 3%) alterations (p=0.00004). Actionable alterations in PTEN, PIK3CA, and ERBB2 most frequently led to enrollment on genotype-matched trials. Clinicians cited a variety of reasons why patients with actionable alterations did not enroll on trials. CONCLUSION:Over half of alterations annotated were of unknown significance or non-actionable. Physicians were more likely to enroll a patient on a genotype-matched trial when an annotation supported actionability. Future studies are needed to demonstrate the impact of decision support on trial enrollment and oncologic outcomes.

Project description:BackgroundLimited consideration of clinical decision support (CDS) design best practices, such as a user-centered design, is often cited as a key barrier to CDS adoption and effectiveness. The application of CDS best practices is resource intensive; thus, institutions often rely on commercially available CDS tools that are created to meet the generalized needs of many institutions and are not user centered. Beyond resource availability, insufficient guidance on how to address key aspects of implementation, such as contextual factors, may also limit the application of CDS best practices. An implementation science (IS) framework could provide needed guidance and increase the reproducibility of CDS implementations.ObjectiveThis study aims to compare the effectiveness of an enhanced CDS tool informed by CDS best practices and an IS framework with a generic, commercially available CDS tool.MethodsWe conducted an explanatory sequential mixed methods study. An IS-enhanced and commercial CDS alert were compared in a cluster randomized trial across 28 primary care clinics. Both alerts aimed to improve beta-blocker prescribing for heart failure. The enhanced alert was informed by CDS best practices and the Practical, Robust, Implementation, and Sustainability Model (PRISM) IS framework, whereas the commercial alert followed vendor-supplied specifications. Following PRISM, the enhanced alert was informed by iterative, multilevel stakeholder input and the dynamic interactions of the internal and external environment. Outcomes aligned with PRISM's evaluation measures, including patient reach, clinician adoption, and changes in prescribing behavior. Clinicians exposed to each alert were interviewed to identify design features that might influence adoption. The interviews were analyzed using a thematic approach.ResultsBetween March 15 and August 23, 2019, the enhanced alert fired for 61 patients (106 alerts, 87 clinicians) and the commercial alert fired for 26 patients (59 alerts, 31 clinicians). The adoption and effectiveness of the enhanced alert were significantly higher than those of the commercial alert (62% vs 29% alerts adopted, P<.001; 14% vs 0% changed prescribing, P=.006). Of the 21 clinicians interviewed, most stated that they preferred the enhanced alert.ConclusionsThe results of this study suggest that applying CDS best practices with an IS framework to create CDS tools improves implementation success compared with a commercially available tool.Trial registrationClinicalTrials.gov NCT04028557; http://clinicaltrials.gov/ct2/show/NCT04028557.

Dataset Information

A mathematical model for interpretable clinical decision support with applications in gynecology.

Background

Methods and findings

Conclusions

Publications

A mathematical model for interpretable clinical decision support with applications in gynecology.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets