Dataset Information

Deep Reinforcement Learning and Simulation as a Path Toward Precision Medicine.

ABSTRACT: Traditionally, precision medicine involves classifying patients to identify subpopulations that respond favorably to specific therapeutics. We pose precision medicine as a dynamic feedback control problem, where treatment administered to a patient is guided by measurements taken during the course of treatment. We consider sepsis, a life-threatening condition in which dysregulation of the immune system causes tissue damage. We leverage an existing simulation of the innate immune response to infection and apply deep reinforcement learning (DRL) to discover an adaptive personalized treatment policy that specifies effective multicytokine therapy to simulated sepsis patients based on systemic measurements. The learned policy achieves a dramatic reduction in mortality rate over a set of 500 simulated patients relative to standalone antibiotic therapy. Advantages of our approach are threefold: (1) the use of simulation allows exploring therapeutic strategies beyond clinical practice and available data, (2) advances in DRL accommodate learning complex therapeutic strategies for complex biological systems, and (3) optimized treatments respond to a patient's individual disease progression over time, therefore, capturing both differences across patients and the inherent randomness of disease progression within a single patient. We hope that this work motivates both considering adaptive personalized multicytokine mediation therapy for sepsis and exploiting simulation with DRL for precision medicine more broadly.

SUBMITTER: Petersen BK

PROVIDER: S-EPMC6590719 | biostudies-literature | 2019 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Deep Reinforcement Learning and Simulation as a Path Toward Precision Medicine.

Petersen Brenden K BK Yang Jiachen J Grathwohl Will S WS Cockrell Chase C Santiago Claudio C An Gary G Faissol Daniel M DM

Journal of computational biology : a journal of computational molecular cell biology 20190125 6

<b>Traditionally, precision medicine involves classifying patients to identify subpopulations that respond favorably to specific therapeutics. We pose precision medicine as a dynamic feedback control problem, where treatment administered to a patient is guided by measurements taken during the course of treatment. We consider sepsis, a life-threatening condition in which dysregulation of the immune system causes tissue damage. We leverage an existing simulation of the innate immune response to in ...[more]

PMID: 30681362

Similar Datasets

Project description:Neuroinflammation commences decades before Alzheimer's disease (AD) clinical onset and represents one of the earliest pathomechanistic alterations throughout the AD continuum. Large-scale genome-wide association studies point out several genetic variants-TREM2, CD33, PILRA, CR1, MS4A, CLU, ABCA7, EPHA1, and HLA-DRB5-HLA-DRB1-potentially linked to neuroinflammation. Most of these genes are involved in proinflammatory intracellular signaling, cytokines/interleukins/cell turnover, synaptic activity, lipid metabolism, and vesicle trafficking. Proteomic studies indicate that a plethora of interconnected aberrant molecular pathways, set off and perpetuated by TNF-α, TGF-β, IL-1β, and the receptor protein TREM2, are involved in neuroinflammation. Microglia and astrocytes are key cellular drivers and regulators of neuroinflammation. Under physiological conditions, they are important for neurotransmission and synaptic homeostasis. In AD, there is a turning point throughout its pathophysiological evolution where glial cells sustain an overexpressed inflammatory response that synergizes with amyloid-β and tau accumulation, and drives synaptotoxicity and neurodegeneration in a self-reinforcing manner. Despite a strong therapeutic rationale, previous clinical trials investigating compounds with anti-inflammatory properties, including non-steroidal anti-inflammatory drugs (NSAIDs), did not achieve primary efficacy endpoints. It is conceivable that study design issues, including the lack of diagnostic accuracy and biomarkers for target population identification and proof of mechanism, may partially explain the negative outcomes. However, a recent meta-analysis indicates a potential biological effect of NSAIDs. In this regard, candidate fluid biomarkers of neuroinflammation are under analytical/clinical validation, i.e., TREM2, IL-1β, MCP-1, IL-6, TNF-α receptor complexes, TGF-β, and YKL-40. PET radio-ligands are investigated to accomplish in vivo and longitudinal regional exploration of neuroinflammation. Biomarkers tracking different molecular pathways (body fluid matrixes) along with brain neuroinflammatory endophenotypes (neuroimaging markers), can untangle temporal-spatial dynamics between neuroinflammation and other AD pathophysiological mechanisms. Robust biomarker-drug codevelopment pipelines are expected to enrich large-scale clinical trials testing new-generation compounds active, directly or indirectly, on neuroinflammatory targets and displaying putative disease-modifying effects: novel NSAIDs, AL002 (anti-TREM2 antibody), anti-Aβ protofibrils (BAN2401), and AL003 (anti-CD33 antibody). As a next step, taking advantage of breakthrough and multimodal techniques coupled with a systems biology approach is the path to pursue for developing individualized therapeutic strategies targeting neuroinflammation under the framework of precision medicine.

Dataset Information

Deep Reinforcement Learning and Simulation as a Path Toward Precision Medicine.

Publications

Deep Reinforcement Learning and Simulation as a Path Toward Precision Medicine.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets