Dataset Information

Statistical Framework for Uncertainty Quantification in Computational Molecular Modeling.

ABSTRACT: As computational modeling, simulation, and predictions are becoming integral parts of biomedical pipelines, it behooves us to emphasize the reliability of the computational protocol. For any reported quantity of interest (QOI), one must also compute and report a measure of the uncertainty or error associated with the QOI. This is especially important in molecular modeling, since in most practical applications the inputs to the computational protocol are often noisy, incomplete, or low-resolution. Unfortunately, currently available modeling tools do not account for uncertainties and their effect on the final QOIs with sufficient rigor. We have developed a statistical framework that expresses the uncertainty of the QOI as the probability that the reported value deviates from the true value by more than some user-defined threshold. First, we provide a theoretical approach where this probability can be bounded using Azuma-Hoeffding like inequalities. Second, we approximate this probability empirically by sampling the space of uncertainties of the input and provide applications of our framework to bound uncertainties of several QOIs commonly used in molecular modeling. Finally, we also present several visualization techniques to effectively and quantitavely visualize the uncertainties: in the input, final QOIs, and also intermediate states.

SUBMITTER: Rasheed M

PROVIDER: S-EPMC5710766 | biostudies-literature | 2016 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Statistical Framework for Uncertainty Quantification in Computational Molecular Modeling.

Rasheed Muhibur M Clement Nathan N Bhowmick Abhishek A Bajaj Chandrajit C

ACM-BCB ... ... : the ... ACM Conference on Bioinformatics, Computational Biology and Biomedicine. ACM Conference on Bioinformatics, Computational Biology and Biomedicine 20161001

As computational modeling, simulation, and predictions are becoming integral parts of biomedical pipelines, it behooves us to emphasize the reliability of the computational protocol. For any reported quantity of interest (QOI), one must also compute and report a measure of the uncertainty or error associated with the QOI. This is especially important in molecular modeling, since in most practical applications the inputs to the computational protocol are often noisy, incomplete, or low-resolution ...[more]

PMID: 29202129

Similar Datasets

Project description:Computational models of the human head are promising tools for estimating the impact-induced response of the brain, and thus play an important role in the prediction of traumatic brain injury. The basic constituents of these models (i.e., model geometry, material properties, and boundary conditions) are often associated with significant uncertainty and variability. As a result, uncertainty quantification (UQ), which involves quantification of the effect of this uncertainty and variability on the simulated response, becomes critical to ensure reliability of model predictions. Modern biofidelic head model simulations are associated with very high computational cost and high-dimensional inputs and outputs, which limits the applicability of traditional UQ methods on these systems. In this study, a two-stage, data-driven manifold learning-based framework is proposed for UQ of computational head models. This framework is demonstrated on a 2D subject-specific head model, where the goal is to quantify uncertainty in the simulated strain fields (i.e., output), given variability in the material properties of different brain substructures (i.e., input). In the first stage, a data-driven method based on multi-dimensional Gaussian kernel-density estimation and diffusion maps is used to generate realizations of the input random vector directly from the available data. Computational simulations of a small number of realizations provide input-output pairs for training data-driven surrogate models in the second stage. The surrogate models employ nonlinear dimensionality reduction using Grassmannian diffusion maps, Gaussian process regression to create a low-cost mapping between the input random vector and the reduced solution space, and geometric harmonics models for mapping between the reduced space and the Grassmann manifold. It is demonstrated that the surrogate models provide highly accurate approximations of the computational model while significantly reducing the computational cost. Monte Carlo simulations of the surrogate models are used for uncertainty propagation. UQ of the strain fields highlights significant spatial variation in model uncertainty, and reveals key differences in uncertainty among commonly used strain-based brain injury predictor variables.

Project description:High-throughput experimentation has revolutionized data-driven experimental sciences and opened the door to the application of machine learning techniques. Nevertheless, the quality of any data analysis strongly depends on the quality of the data and specifically the degree to which random effects in the experimental data-generating process are quantified and accounted for. Accordingly calibration, i.e. the quantitative association between observed quantities and measurement responses, is a core element of many workflows in experimental sciences. Particularly in life sciences, univariate calibration, often involving non-linear saturation effects, must be performed to extract quantitative information from measured data. At the same time, the estimation of uncertainty is inseparably connected to quantitative experimentation. Adequate calibration models that describe not only the input/output relationship in a measurement system but also its inherent measurement noise are required. Due to its mathematical nature, statistically robust calibration modeling remains a challenge for many practitioners, at the same time being extremely beneficial for machine learning applications. In this work, we present a bottom-up conceptual and computational approach that solves many problems of understanding and implementing non-linear, empirical calibration modeling for quantification of analytes and process modeling. The methodology is first applied to the optical measurement of biomass concentrations in a high-throughput cultivation system, then to the quantification of glucose by an automated enzymatic assay. We implemented the conceptual framework in two Python packages, calibr8 and murefi, with which we demonstrate how to make uncertainty quantification for various calibration tasks more accessible. Our software packages enable more reproducible and automatable data analysis routines compared to commonly observed workflows in life sciences. Subsequently, we combine the previously established calibration models with a hierarchical Monod-like ordinary differential equation model of microbial growth to describe multiple replicates of Corynebacterium glutamicum batch cultures. Key process model parameters are learned by both maximum likelihood estimation and Bayesian inference, highlighting the flexibility of the statistical and computational framework.

Project description:Uncertainty analysis is the process of identifying limitations in scientific knowledge and evaluating their implications for scientific conclusions. In the context of microbial risk assessment, the uncertainty in the predicted microbial behavior can be an important component of the overall uncertainty. Conventional deterministic modeling approaches which provide point estimates of the pathogen's levels cannot quantify the uncertainty around the predictions. The objective of this study was to use Bayesian statistical modeling for describing uncertainty in predicted microbial thermal inactivation of Salmonella enterica Typhimurium DT104. A set of thermal inactivation data in broth with water activity adjusted to 0.75 at 9 different temperature conditions obtained from the ComBase database (www.combase.cc) was used. A log-linear microbial inactivation was used as a primary model while for secondary modeling, a linear relation between the logarithm of inactivation rate and temperature was assumed. For comparison, data were fitted with a two-step and a global Bayesian regression. Posterior distributions of model's parameters were used to predict Salmonella thermal inactivation. The combination of the joint posterior distributions of model's parameters allowed the prediction of cell density over time, total reduction time and inactivation rate as probability distributions at different time and temperature conditions. For example, for the time required to eliminate a Salmonella population of about 107 CFU/ml at 65°C, the model predicted a time distribution with a median of 0.40 min and 5th and 95th percentiles of 0.24 and 0.60 min, respectively. The validation of the model showed that it can describe successfully uncertainty in predicted thermal inactivation with most observed data being within the 95% prediction intervals of the model. The global regression approach resulted in less uncertain predictions compared to the two-step regression. The developed model could be used to quantify uncertainty in thermal inactivation in risk-based processing design as well as in risk assessment studies.

Dataset Information

Statistical Framework for Uncertainty Quantification in Computational Molecular Modeling.

Publications

Statistical Framework for Uncertainty Quantification in Computational Molecular Modeling.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets