Dataset Information

Added Value of Intraoperative Data for Predicting Postoperative Complications: The MySurgeryRisk PostOp Extension.

ABSTRACT:

Background

Models that predict postoperative complications often ignore important intraoperative events and physiological changes. This study tested the hypothesis that accuracy, discrimination, and precision in predicting postoperative complications would improve when using both preoperative and intraoperative data input data compared with preoperative data alone.

Methods

This retrospective cohort analysis included 43,943 adults undergoing 52,529 inpatient surgeries at a single institution during a 5-y period. Random forest machine learning models in the validated MySurgeryRisk platform made patient-level predictions for seven postoperative complications and mortality occurring during hospital admission using electronic health record data and patient neighborhood characteristics. For each outcome, one model trained with preoperative data alone; one model trained with both preoperative and intraoperative data. Models were compared by accuracy, discrimination (expressed as area under the receiver operating characteristic curve), precision (expressed as area under the precision-recall curve), and reclassification indices.

Results

Machine learning models incorporating both preoperative and intraoperative data had greater accuracy, discrimination, and precision than models using preoperative data alone for predicting all seven postoperative complications (intensive care unit length of stay >48 h, mechanical ventilation >48 h, neurologic complications including delirium, cardiovascular complications, acute kidney injury, venous thromboembolism, and wound complications), and in-hospital mortality (accuracy: 88% versus 77%; area under the receiver operating characteristic curve: 0.93 versus 0.87; area under the precision-recall curve: 0.21 versus 0.15). Overall reclassification improvement was 2.4%-10.0% for complications and 11.2% for in-hospital mortality.

Conclusions

Incorporating both preoperative and intraoperative data significantly increased the accuracy, discrimination, and precision of machine learning models predicting postoperative complications and mortality.

SUBMITTER: Datta S

PROVIDER: S-EPMC7755426 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundCompared with historic ventilation strategies, modern lung-protective ventilation includes lower tidal volumes (VT), lower driving pressures, and application of positive end-expiratory pressure (PEEP). The contributions of each component to an overall intraoperative protective ventilation strategy aimed at reducing postoperative pulmonary complications have neither been adequately resolved, nor comprehensively evaluated within an adult cardiac surgical population. The authors hypothesized that a bundled intraoperative protective ventilation strategy was independently associated with decreased odds of pulmonary complications after cardiac surgery.MethodsIn this observational cohort study, the authors reviewed nonemergent cardiac surgical procedures using cardiopulmonary bypass at a tertiary care academic medical center from 2006 to 2017. The authors tested associations between bundled or component intraoperative protective ventilation strategies (VT below 8 ml/kg ideal body weight, modified driving pressure [peak inspiratory pressure - PEEP] below 16 cm H2O, and PEEP greater than or equal to 5 cm H2O) and postoperative outcomes, adjusting for previously identified risk factors. The primary outcome was a composite pulmonary complication; secondary outcomes included individual pulmonary complications, postoperative mortality, as well as durations of mechanical ventilation, intensive care unit stay, and hospital stay.ResultsAmong 4,694 cases reviewed, 513 (10.9%) experienced pulmonary complications. After adjustment, an intraoperative lung-protective ventilation bundle was associated with decreased pulmonary complications (adjusted odds ratio, 0.56; 95% CI, 0.42-0.75). Via a sensitivity analysis, modified driving pressure below 16 cm H2O was independently associated with decreased pulmonary complications (adjusted odds ratio, 0.51; 95% CI, 0.39-0.66), but VT below 8 ml/kg and PEEP greater than or equal to 5 cm H2O were not.ConclusionsThe authors identified an intraoperative lung-protective ventilation bundle as independently associated with pulmonary complications after cardiac surgery. The findings offer insight into components of protective ventilation associated with adverse outcomes and may serve as targets for future prospective interventional studies investigating the impact of specific protective ventilation strategies on postoperative outcomes after cardiac surgery.

Project description:Introduction: The role of intraoperative ventilation strategies in subjects undergoing surgery is still contested. This meta-analysis study was performed to assess the relationship between the low tidal volumes strategy and conventional mechanical ventilation in subjects undergoing surgery. Methods: A systematic literature search up to December 2020 was performed in OVID, Embase, Cochrane Library, PubMed, and Google scholar, and 28 studies including 11,846 subjects undergoing surgery at baseline and reporting a total of 2,638 receiving the low tidal volumes strategy and 3,632 receiving conventional mechanical ventilation, were found recording relationships between low tidal volumes strategy and conventional mechanical ventilation in subjects undergoing surgery. Odds ratio (OR) or mean difference (MD) with 95% confidence intervals (CIs) were calculated between the low tidal volumes strategy vs. conventional mechanical ventilation using dichotomous and continuous methods with a random or fixed-effect model. Results: The low tidal volumes strategy during surgery was significantly related to a lower rate of postoperative pulmonary complications (OR, 0.60; 95% CI, 0.44-0.83, p < 0.001), aspiration pneumonitis (OR, 0.63; 95% CI, 0.46-0.86, p < 0.001), and pleural effusion (OR, 0.72; 95% CI, 0.56-0.92, p < 0.001) compared to conventional mechanical ventilation. However, the low tidal volumes strategy during surgery was not significantly correlated with length of hospital stay (MD, -0.48; 95% CI, -0.99-0.02, p = 0.06), short-term mortality (OR, 0.88; 95% CI, 0.70-1.10, p = 0.25), atelectasis (OR, 0.76; 95% CI, 0.57-1.01, p = 0.06), acute respiratory distress (OR, 1.06; 95% CI, 0.67-1.66, p = 0.81), pneumothorax (OR, 1.37; 95% CI, 0.88-2.15, p = 0.17), pulmonary edema (OR, 0.70; 95% CI, 0.38-1.26, p = 0.23), and pulmonary embolism (OR, 0.65; 95% CI, 0.26-1.60, p = 0.35) compared to conventional mechanical ventilation. Conclusions: The low tidal volumes strategy during surgery may have an independent relationship with lower postoperative pulmonary complications, aspiration pneumonitis, and pleural effusion compared to conventional mechanical ventilation. This relationship encouraged us to recommend the low tidal volumes strategy during surgery to avoid any possible complications.

Project description:Background"Lung-protective ventilation" describes a ventilation strategy involving low tidal volumes (VTs) and/or low driving pressure/plateau pressure and has been associated with improved outcomes after mechanical ventilation. We evaluated the association between intraoperative ventilation parameters (including positive end-expiratory pressure [PEEP], driving pressure, and VT) and 3 postoperative outcomes: (1) PaO2/fractional inspired oxygen tension (FIO2), (2) postoperative pulmonary complications, and (3) 30-day mortality.MethodsWe retrospectively analyzed adult patients who underwent major noncardiac surgery and remained intubated postoperatively from 2006 to 2015 at a single US center. Using multivariable regressions, we studied associations between intraoperative ventilator settings and lowest postoperative PaO2/FIO2 while intubated, pulmonary complications identified from discharge diagnoses, and in-hospital 30-day mortality.ResultsAmong a cohort of 2096 cases, the median PEEP was 5 cm H2O (interquartile range = 4-6), median delivered VT was 520 mL (interquartile range = 460-580), and median driving pressure was 15 cm H2O (13-19). After multivariable adjustment, intraoperative median PEEP (linear regression estimate [B] = -6.04; 95% CI, -8.22 to -3.87; P < .001), median FIO2 (B = -0.30; 95% CI, -0.50 to -0.10; P = .003), and hours with driving pressure >16 cm H2O (B = -5.40; 95% CI, -7.2 to -4.2; P < .001) were associated with decreased postoperative PaO2/FIO2. Higher postoperative PaO2/FIO2 ratios were associated with a decreased risk of pulmonary complications (adjusted odds ratio for each 100 mm Hg = 0.495; 95% CI, 0.331-0.740; P = .001, model C-statistic of 0.852) and mortality (adjusted odds ratio = 0.495; 95% CI, 0.366-0.606; P < .001, model C-statistic of 0.820). Intraoperative time with VT >500 mL was also associated with an increased likelihood of developing a postoperative pulmonary complication (adjusted odds ratio = 1.06/hour; 95% CI, 1.00-1.20; P = .042).ConclusionsIn patients requiring postoperative intubation after noncardiac surgery, increased median FIO2, increased median PEEP, and increased time duration with elevated driving pressure predict lower postoperative PaO2/FIO2. Intraoperative duration of VT >500 mL was independently associated with increased postoperative pulmonary complications. Lower postoperative PaO2/FIO2 ratios were independently associated with pulmonary complications and mortality. Our findings suggest that postoperative PaO2/FIO2 may be a potential target for future prospective trials investigating the impact of specific ventilation strategies for reducing ventilator-induced pulmonary injury.

Project description:ImportancePostoperative complications can significantly impact perioperative care management and planning.ObjectivesTo assess machine learning (ML) models for predicting postoperative complications using independent and combined preoperative and intraoperative data and their clinically meaningful model-agnostic interpretations.Design, setting, and participantsThis retrospective cohort study assessed 111 888 operations performed on adults at a single academic medical center from June 1, 2012, to August 31, 2016, with a mean duration of follow-up based on the length of postoperative hospital stay less than 7 days. Data analysis was performed from February 1 to September 31, 2020.Main outcomes and measuresOutcomes included 5 postoperative complications: acute kidney injury (AKI), delirium, deep vein thrombosis (DVT), pulmonary embolism (PE), and pneumonia. Patient and clinical characteristics available preoperatively, intraoperatively, and a combination of both were used as inputs for 5 candidate ML models: logistic regression, support vector machine, random forest, gradient boosting tree (GBT), and deep neural network (DNN). Model performance was compared using the area under the receiver operating characteristic curve (AUROC). Model interpretations were generated using Shapley Additive Explanations by transforming model features into clinical variables and representing them as patient-specific visualizations.ResultsA total of 111 888 patients (mean [SD] age, 54.4 [16.8] years; 56 915 [50.9%] female; 82 533 [73.8%] White) were included in this study. The best-performing model for each complication combined the preoperative and intraoperative data with the following AUROCs: pneumonia (GBT), 0.905 (95% CI, 0.903-0.907); AKI (GBT), 0.848 (95% CI, 0.846-0.851); DVT (GBT), 0.881 (95% CI, 0.878-0.884); PE (DNN), 0.831 (95% CI, 0.824-0.839); and delirium (GBT), 0.762 (95% CI, 0.759-0.765). Performance of models that used only preoperative data or only intraoperative data was marginally lower than that of models that used combined data. When adding variables with missing data as input, AUROCs increased from 0.588 to 0.905 for pneumonia, 0.579 to 0.848 for AKI, 0.574 to 0.881 for DVT, 0.5 to 0.831 for PE, and 0.6 to 0.762 for delirium. The Shapley Additive Explanations analysis generated model-agnostic interpretation that illustrated significant clinical contributors associated with risks of postoperative complications.Conclusions and relevanceThe ML models for predicting postoperative complications with model-agnostic interpretation offer opportunities for integrating risk predictions for clinical decision support. Such real-time clinical decision support can mitigate patient risks and help in anticipatory management for perioperative contingency planning.