Dataset Information

Pleione: A tool for statistical and multi-objective calibration of Rule-based models.

ABSTRACT: Mathematical models based on Ordinary Differential Equations (ODEs) are frequently used to describe and simulate biological systems. Nevertheless, such models are often difficult to understand. Unlike ODE models, Rule-Based Models (RBMs) utilise formal language to describe reactions as a cumulative number of statements that are easier to understand and correct. They are also gaining popularity because of their conciseness and simulation flexibility. However, RBMs generally lack tools to perform further analysis that requires simulation. This situation arises because exact and approximate simulations are computationally intensive. Translating RBMs into ODEs is commonly used to reduce simulation time, but this technique may be prohibitive due to combinatorial explosion. Here, we present the software called Pleione to calibrate RBMs. Parameter calibration is essential given the incomplete experimental determination of reaction rates and the goal of using models to reproduce experimental data. The software distributes stochastic simulations and calculations and incorporates equivalence tests to determine the fitness of RBMs compared with data. The primary features of Pleione were thoroughly tested on a model of gene regulation in Escherichia coli. Pleione yielded satisfactory results regarding calculation time and error reduction for multiple simulators, models, parameter search strategies, and computing infrastructures.

SUBMITTER: Santibanez R

PROVIDER: S-EPMC6805871 | biostudies-literature | 2019 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Pleione: A tool for statistical and multi-objective calibration of Rule-based models.

Santibáñez Rodrigo R Garrido Daniel D Martin Alberto J M AJM

Scientific reports 20191022 1

Mathematical models based on Ordinary Differential Equations (ODEs) are frequently used to describe and simulate biological systems. Nevertheless, such models are often difficult to understand. Unlike ODE models, Rule-Based Models (RBMs) utilise formal language to describe reactions as a cumulative number of statements that are easier to understand and correct. They are also gaining popularity because of their conciseness and simulation flexibility. However, RBMs generally lack tools to perform ...[more]

PMID: 31641245

Similar Datasets

Project description:Computational agent-based simulation (ABS) is increasingly used to complement laboratory techniques in advancing our understanding of biological systems. Calibration, the identification of parameter values that align simulation with biological behaviours, becomes challenging as increasingly complex biological domains are simulated. Complex domains cannot be characterized by single metrics alone, rendering simulation calibration a fundamentally multi-metric optimization problem that typical calibration techniques cannot handle. Yet calibration is an essential activity in simulation-based science; the baseline calibration forms a control for subsequent experimentation and hence is fundamental in the interpretation of results. Here, we develop and showcase a method, built around multi-objective optimization, for calibrating ABSs against complex target behaviours requiring several metrics (termed objectives) to characterize. Multi-objective calibration (MOC) delivers those sets of parameter values representing optimal trade-offs in simulation performance against each metric, in the form of a Pareto front. We use MOC to calibrate a well-understood immunological simulation against both established a priori and previously unestablished target behaviours. Furthermore, we show that simulation-borne conclusions are broadly, but not entirely, robust to adopting baseline parameter values from different extremes of the Pareto front, highlighting the importance of MOC's identification of numerous calibration solutions. We devise a method for detecting overfitting in a multi-objective context, not previously possible, used to save computational effort by terminating MOC when no improved solutions will be found. MOC can significantly impact biological simulation, adding rigour to and speeding up an otherwise time-consuming calibration process and highlighting inappropriate biological capture by simulations that cannot be well calibrated. As such, it produces more accurate simulations that generate more informative biological predictions.

Project description:Background Improved methods for sampling outdoor-biting mosquitoes are urgently needed to improve surveillance of vector-borne diseases. Such tools could potentially replace the human landing catch (HLC), which, despite being the most direct option for measuring human exposures, raises significant ethical and logistical concerns. Several alternatives are under development, but detailed evaluation still requires common frameworks for calibration relative to HLC. The aim of this study was to develop and validate a statistical framework for predicting human-biting rates from different exposure-free alternatives. Methods We obtained mosquito abundance data (Anopheles arabiensis, Anopheles funestus and Culex spp.) from a year-long Tanzanian study comparing six outdoor traps [Suna Trap (SUN), BG Sentinel (BGS), M-Trap (MTR), M-Trap + CDC (MTRC), Ifakara Tent Trap-C (ITT-C) and Mosquito Magnet-X Trap (MMX)] and HLC. Generalised linear models were developed within a Bayesian framework to investigate associations between the traps and HLC, taking intra- and inter-specific density dependence into account. The best model was used to create a calibration tool for predicting HLC-equivalents. Results For An. arabiensis, SUN catches had the strongest correlation with HLC (R2 = 19.4), followed by BGS (R2 = 17.2) and MTRC (R2 = 13.1) catches. The least correlated catch was MMX (R2 = 2.5). For An. funestus, BGS had the strongest correlation with the HLC (R2 = 53.4), followed by MTRC (R2 = 37.4) and MTR (R2 = 37.4). For Culex mosquitoes, the traps most highly correlated with the HLC were MTR (R2 = 45.4) and MTRC (R2 = 44.2). Density dependence, both between and within species, influenced the performance of only BGS traps. An interactive Shiny App calibration tool was developed for this and similar applications. Conclusion We successfully developed a calibration tool to assess the performance of different traps for assessing outdoor-biting risk, and established a valuable framework for estimating human exposures based on the trap catches. The performance of candidate traps varied between mosquito taxa; thus, there was no single optimum. Although all the traps tested underestimated the HLC-derived exposures, it was possible to mathematically define their representativeness of the true biting risk, with or without density dependence. The results of this study emphasise the need to aim for a consistent and representative sampling approach, as opposed to simply seeking traps that catch the most mosquitoes. Graphical Abstract Supplementary Information The online version contains supplementary material available at 10.1186/s13071-022-05403-7.

Project description:The advent of two-photon microscopy now reveals unprecedented, detailed spatio-temporal data on cellular motility and interactions in vivo. Understanding cellular motility patterns is key to gaining insight into the development and possible manipulation of the immune response. Computational simulation has become an established technique for understanding immune processes and evaluating hypotheses in the context of experimental data, and there is clear scope to integrate microscopy-informed motility dynamics. However, determining which motility model best reflects in vivo motility is non-trivial: 3D motility is an intricate process requiring several metrics to characterize. This complicates model selection and parameterization, which must be performed against several metrics simultaneously. Here we evaluate Brownian motion, Lévy walk and several correlated random walks (CRWs) against the motility dynamics of neutrophils and lymph node T cells under inflammatory conditions by simultaneously considering cellular translational and turn speeds, and meandering indices. Heterogeneous cells exhibiting a continuum of inherent translational speeds and directionalities comprise both datasets, a feature significantly improving capture of in vivo motility when simulated as a CRW. Furthermore, translational and turn speeds are inversely correlated, and the corresponding CRW simulation again improves capture of our in vivo data, albeit to a lesser extent. In contrast, Brownian motion poorly reflects our data. Lévy walk is competitive in capturing some aspects of neutrophil motility, but T cell directional persistence only, therein highlighting the importance of evaluating models against several motility metrics simultaneously. This we achieve through novel application of multi-objective optimization, wherein each model is independently implemented and then parameterized to identify optimal trade-offs in performance against each metric. The resultant Pareto fronts of optimal solutions are directly contrasted to identify models best capturing in vivo dynamics, a technique that can aid model selection more generally. Our technique robustly determines our cell populations' motility strategies, and paves the way for simulations that incorporate accurate immune cell motility dynamics.

Dataset Information

Pleione: A tool for statistical and multi-objective calibration of Rule-based models.

Publications

Pleione: A tool for statistical and multi-objective calibration of Rule-based models.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets