Dataset Information

Machine learning to predict transplant outcomes: helpful or hype? A national cohort study.

ABSTRACT: An increasing number of studies claim machine learning (ML) predicts transplant outcomes more accurately. However, these claims were possibly confounded by other factors, namely, supplying new variables to ML models. To better understand the prospects of ML in transplantation, we compared ML to conventional regression in a "common" analytic task: predicting kidney transplant outcomes using national registry data. We studied 133 431 adult deceased-donor kidney transplant recipients between 2005 and 2017. Transplant centers were randomly divided into 70% training set (190 centers/97 787 recipients) and 30% validation set (82 centers/35 644 recipients). Using the training set, we performed regression and ML procedures [gradient boosting (GB) and random forests (RF)] to predict delayed graft function, one-year acute rejection, death-censored graft failure C, all-cause graft failure, and death. Their performances were compared on the validation set using -statistics. In predicting rejection, regression (C = _0.601 0.611_0.621 ) actually outperformed GB (C = _0.581 0.591_0.601 ) and RF (C = _0.569 0.579_0.589 ). For all other outcomes, the C-statistics were nearly identical across methods (delayed graft function, 0.717-0.723; death-censored graft failure, 0.637-0.642; all-cause graft failure, 0.633-0.635; and death, 0.705-0.708). Given its shortcomings in model interpretability and hypothesis testing, ML is advantageous only when it clearly outperforms conventional regression; in the case of transplant outcomes prediction, ML seems more hype than helpful.

SUBMITTER: Bae S

PROVIDER: S-EPMC8269970 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundPancreatic cancer is the third leading cause of cancer-related deaths, and although pancreatectomy is currently the only curative treatment, it is associated with significant morbidity.ObjectiveThe objective of this study was to evaluate the utility of wearable telemonitoring technologies to predict treatment outcomes using patient activity metrics and machine learning.MethodsIn this prospective, single-center, single-cohort study, patients scheduled for pancreatectomy were provided with a wearable telemonitoring device to be worn prior to surgery. Patient clinical data were collected and all patients were evaluated using the American College of Surgeons National Surgical Quality Improvement Program surgical risk calculator (ACS-NSQIP SRC). Machine learning models were developed to predict whether patients would have a textbook outcome and compared with the ACS-NSQIP SRC using area under the receiver operating characteristic (AUROC) curves.ResultsBetween February 2019 and February 2020, 48 patients completed the study. Patient activity metrics were collected over an average of 27.8 days before surgery. Patients took an average of 4162.1 (SD 4052.6) steps per day and had an average heart rate of 75.6 (SD 14.8) beats per minute. Twenty-eight (58%) patients had a textbook outcome after pancreatectomy. The group of 20 (42%) patients who did not have a textbook outcome included 14 patients with severe complications and 11 patients requiring readmission. The ACS-NSQIP SRC had an AUROC curve of 0.6333 to predict failure to achieve a textbook outcome, while our model combining patient clinical characteristics and patient activity data achieved the highest performance with an AUROC curve of 0.7875.ConclusionsMachine learning models outperformed ACS-NSQIP SRC estimates in predicting textbook outcomes after pancreatectomy. The highest performance was observed when machine learning models incorporated patient clinical characteristics and activity metrics.

Project description:BackgroundSingle-cell transcriptomic studies have greatly improved organ-specific insights into macrophage polarization states are essential for the initiation and resolution of inflammation in all tissues; however, such insights are yet to translate into therapies that can predictably alter macrophage fate.MethodUsing machine learning algorithms on human macrophages, here we reveal the continuum of polarization states that is shared across diverse contexts. A path, comprised of 338 genes accurately identified both physiologic and pathologic spectra of "reactivity" and "tolerance", and remained relevant across tissues, organs, species, and immune cells (>12,500 diverse datasets).FindingsThis 338-gene signature identified macrophage polarization states at single-cell resolution, in physiology and across diverse human diseases, and in murine pre-clinical disease models. The signature consistently outperformed conventional signatures in the degree of transcriptome-proteome overlap, and in detecting disease states; it also prognosticated outcomes across diverse acute and chronic diseases, e.g., sepsis, liver fibrosis, aging, and cancers. Crowd-sourced genetic and pharmacologic studies confirmed that model-rationalized interventions trigger predictable macrophage fates.InterpretationThese findings provide a formal and universally relevant definition of macrophage states and a predictive framework (http://hegemon.ucsd.edu/SMaRT) for the scientific community to develop macrophage-targeted precision diagnostics and therapeutics.FundingThis work was supported by the National Institutes for Health (NIH) grant R01-AI155696 (to P.G, D.S and S.D). Other sources of support include: R01-GM138385 (to D.S), R01-AI141630 (to P.G), R01-DK107585 (to S.D), and UG3TR003355 (to D.S, S.D, and P.G). D.S was also supported by two Padres Pedal the Cause awards (Padres Pedal the Cause/RADY #PTC2017 and San Diego NCI Cancer Centers Council (C3) #PTC2017). S.S, G.D.K, and D.D were supported through The American Association of Immunologists (AAI) Intersect Fellowship Program for Computational Scientists and Immunologists. We also acknowledge support from the Padres Pedal the Cause #PTC2021 and the Torey Coast Foundation, La Jolla (P.G and D.S). D.S, P.G, and S.D were also supported by the Leona M. and Harry B. Helmsley Charitable Trust.

Project description:BackgroundMetabolic syndrome (MetS), a major contributor to cardiovascular disease and diabetes, is considered to be among the most common public health problems worldwide.ObjectiveWe aimed to identify and rank the most important nutritional and nonnutritional factors contributing to the development of MetS using a data-mining method.MethodsThis prospective study was performed on 3048 adults (aged ≥20 years) who participated in the fifth follow-up examination of the Tehran Lipid and Glucose Study, who were followed for 3 years. MetS was defined according to the modified definition of the National Cholesterol Education Program/Adult Treatment Panel III. The importance of variables was obtained by the training set using the random forest model for determining factors with the greatest contribution to developing MetS.ResultsAmong the 3048 participants, 701 (22.9%) developed MetS during the study period. The mean age of the participants was 44.3 years (SD 11.8). The total incidence rate of MetS was 229.9 (95% CI 278.6-322.9) per 1000 person-years and the mean follow-up time was 40.5 months (SD 7.3). The incidence of MetS was significantly (P<.001) higher in men than in women (27% vs 20%). Those affected by MetS were older, married, had diabetes, with lower levels of education, and had a higher BMI (P<.001). The percentage of hospitalized patients was higher among those with MetS than among healthy people, although this difference was only statistically significant in women (P=.02). Based on the variable importance and multiple logistic regression analyses, the most important determinants of MetS were identified as history of diabetes (odds ratio [OR] 6.3, 95% CI 3.9-10.2, P<.001), BMI (OR 1.2, 95% CI 1.0-1.2, P<.001), age (OR 1.0, 95% CI 1.0-1.03, P<.001), female gender (OR 0.5, 95% CI 0.38-0.63, P<.001), and dietary monounsaturated fatty acid (OR 0.97, 95% CI 0.94-0.99, P=.04).ConclusionsBased on our findings, the incidence rate of MetS was significantly higher in men than in women in Tehran. The most important determinants of MetS were history of diabetes, high BMI, older age, male gender, and low dietary monounsaturated fatty acid intake.

Dataset Information

Machine learning to predict transplant outcomes: helpful or hype? A national cohort study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets