Dataset Information

A framework for making predictive models useful in practice.

ABSTRACT:

Objective

To analyze the impact of factors in healthcare delivery on the net benefit of triggering an Advanced Care Planning (ACP) workflow based on predictions of 12-month mortality.

Materials and methods

We built a predictive model of 12-month mortality using electronic health record data and evaluated the impact of healthcare delivery factors on the net benefit of triggering an ACP workflow based on the models' predictions. Factors included nonclinical reasons that make ACP inappropriate: limited capacity for ACP, inability to follow up due to patient discharge, and availability of an outpatient workflow to follow up on missed cases. We also quantified the relative benefits of increasing capacity for inpatient ACP versus outpatient ACP.

Results

Work capacity constraints and discharge timing can significantly reduce the net benefit of triggering the ACP workflow based on a model's predictions. However, the reduction can be mitigated by creating an outpatient ACP workflow. Given limited resources to either add capacity for inpatient ACP versus developing outpatient ACP capability, the latter is likely to provide more benefit to patient care.

Discussion

The benefit of using a predictive model for identifying patients for interventions is highly dependent on the capacity to execute the workflow triggered by the model. We provide a framework for quantifying the impact of healthcare delivery factors and work capacity constraints on achieved benefit.

Conclusion

An analysis of the sensitivity of the net benefit realized by a predictive model triggered clinical workflow to various healthcare delivery factors is necessary for making predictive models useful in practice.

SUBMITTER: Jung K

PROVIDER: S-EPMC8200271 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundSolitary pulmonary nodule (SPN) is a common finding in routine clinical practice when performing chest imaging tests. The vast majority of these nodules are benign, and only a small proportion are malignant. The application of predictive models of nodule malignancy in routine clinical practice would help to achieve better diagnostic management of SPN. The present systematic review was carried out with the purpose of critically assessing studies aimed at developing predictive models of solitary pulmonary nodule (SPN) malignancy from SPN incidentally detected in routine clinical practice.MethodsWe performed a search of available scientific literature until October 2020 in Pubmed, SCOPUS and Cochrane Central databases. The inclusion criteria were observational studies carried out in low-risk population from 35 years old onwards aimed at constructing predictive models of malignancy of pulmonary solitary nodule detected incidentally in routine clinical practice. Studies had to be published in peer-reviewed journals, either in Spanish, Portuguese or English. Exclusion criteria were non-human studies, or predictive models based in high-risk populations, or models based on computational approaches. Exclusion criteria were non-human studies, or predictive models based in high-risk populations, or models based on computational approaches (such as radiomics). We used The Transparent Reporting of a multivariable Prediction model for Individual Prognosis Or Diagnosis (TRIPOD) statement, to describe the type of predictive model included in each study, and The Prediction model Risk Of Bias ASsessment Tool (PROBAST) to evaluate the quality of the selected articles.ResultsA total of 186 references were retrieved, and after applying the exclusion/inclusion criteria, 15 articles remained for the final review. All studies analysed clinical and radiological variables. The most frequent independent predictors of SPN malignancy were, in order of frequency, age, diameter, spiculated edge, calcification and smoking history. Variables such as race, SPN growth rate, emphysema, fibrosis, apical scarring and exposure to asbestos, uranium and radon were not analysed by the majority of the studies. All studies were classified as high risk of bias due to inadequate study designs, selection bias, insufficient population follow-up and lack of external validation, compromising their applicability for clinical practice.ConclusionsThe studies included have been shown to have methodological weaknesses compromising the clinical applicability of the evaluated SPN malignancy predictive models and their potential influence on clinical decision-making for the SPN diagnostic management.Systematic review registrationPROSPERO CRD42020161559.