Multivariate emulation of computer simulators: model selection and diagnostics with application to a humanitarian relief model.
Ontology highlight
ABSTRACT:
SUBMITTER: Overstall AM
PROVIDER: S-EPMC4991306 | biostudies-literature | 2016 Aug
REPOSITORIES: biostudies-literature
Publications
Multivariate emulation of computer simulators: model selection and diagnostics with application to a humanitarian relief model.
Overstall Antony M AM Woods David C DC
Journal of the Royal Statistical Society. Series C, Applied statistics 20160301 4
We present a common framework for Bayesian emulation methodologies for multivariate output simulators, or computer models, that employ either parametric linear models or non-parametric Gaussian processes. Novel diagnostics suitable for multivariate covariance separable emulators are developed and techniques to improve the adequacy of an emulator are discussed and implemented. A variety of emulators are compared for a humanitarian relief simulator, modelling aid missions to Sicily after a volcani ...[more]
Similar Datasets
Project description:Computer-based simulations may represent an innovative, flexible, and cost-efficient training approach that has been underutilised in pharmacy practice education. This may need to change, with increasing pressure on clinical placement availability, COVID-19 restrictions, and economic pressures to improve teaching efficiency. This systematic narrative review summarises various computer-based simulations described in the pharmacy practice education literature, identifies the currently available products, and highlights key characteristics. Five major databases were searched (Medline, CINAHL, ERIC, Education Source and Embase). Authors also manually reviewed the publication section of major pharmacy simulator websites and performed a citation analysis. We identified 49 studies describing 29 unique simulators, which met the inclusion criteria. Only eight of these simulators were found to be currently available. The characteristics of these eight simulators were examined through the lens of eight main criteria (feedback type, grading, user play mode, cost, operational requirement, community/hospital setting, scenario sharing option, and interaction elements). Although a number of systems have been developed and trialled, relatively few are available on the market, and each comes with benefits and drawbacks. Educators are encouraged to consider their own institutional, professional and curriculum needs, and determine which product best aligns with their teaching goals.
| S-EPMC9844304 | biostudies-literature
Project description:Prepositioning relief network is an effective strategy to mitigate the impact of natural disasters and public health emergencies, such as the COVID-19 pandemic. However, designing a proper network is challenging due to limited information and, more importantly, the correlated demand uncertainty that exists among affected areas. We consider a network design problem for humanitarian relief purposes, where demand correlations exist and demand information is limited, i.e., only the mean demand and covariance matrix are known. Note that the covariance matrix can explicitly capture the correlated demand among areas. We formulate this problem as a mixed-integer two-stage distributionally robust location-inventory model, which is generally NP-hard and computationally intractable. The model is further reformulated as a mixed-integer conic problem based on copositive cones, and it is tractable with positive semidefinite relaxation. To accelerate the problem-solving process, we design an interpretable branching-and-pricing heuristic with a warm start. Both semi-case study and simulation results demonstrate that explicitly modelling demand correlation can decrease unmet demand.
| S-EPMC10265446 | biostudies-literature
Project description:BackgroundAlthough nurses play an important role in humanitarian aid and disaster relief (HA/DR), little is known about the nursing activities that are performed in HA/DR. We aimed to clarify the nursing activities performed by Japanese nurses in HA/DR and to examine the factors associated with the frequency of nursing activities.MethodsA self-administered questionnaire survey was completed by 147 nurses with HA/DR experience. The survey extracted information on demographic characteristics, past experience (e.g., disaster medical training experience, HA/DR experience), circumstances surrounding their dispatched to HA/DR (e.g., team size, disaster type, post-disaster phase, mission term), and the frequency of nursing activities performed under HA/DR. The frequency of nursing activities was rated on a 5-point Likert scale. Evaluation of nursing activities was conducted based on the "nursing activity score", which represents the frequency of each nursing activity. Factors related to the nursing activity score were evaluated by multiple logistic regression analysis.ResultsNurses were involved in 27 nursing activities in HA/DR, 10 of which were performed frequently. On analysis, factors significantly associated with nursing activity score were nursing license as a registered nurse (OR 7.79, 95% CI 2.95-20.57), two or more experiences with disaster medical training (OR 2.90 95%, CI 1.12-7.49) and a post-disaster phase of three weeks or longer (OR 8.77, 95% CI 2.59-29.67).ConclusionsThese results will contribute to the design of evidence-based disaster medical training that improves the quality of nursing activities.
| S-EPMC4784935 | biostudies-literature
Project description:We develop a new genetic prediction method, smooth-threshold multivariate genetic prediction, using single nucleotide polymorphisms (SNPs) data in genome-wide association studies (GWASs). Our method consists of two stages. At the first stage, unlike the usual discontinuous SNP screening as used in the gene score method, our method continuously screens SNPs based on the output from standard univariate analysis for marginal association of each SNP. At the second stage, the predictive model is built by a generalized ridge regression simultaneously using the screened SNPs with SNP weight determined by the strength of marginal association. Continuous SNP screening by the smooth thresholding not only makes prediction stable but also leads to a closed form expression of generalized degrees of freedom (GDF). The GDF leads to the Stein's unbiased risk estimation (SURE), which enables data-dependent choice of optimal SNP screening cutoff without using cross-validation. Our method is very rapid because computationally expensive genome-wide scan is required only once in contrast to the penalized regression methods including lasso and elastic net. Simulation studies that mimic real GWAS data with quantitative and binary traits demonstrate that the proposed method outperforms the gene score method and genomic best linear unbiased prediction (GBLUP), and also shows comparable or sometimes improved performance with the lasso and elastic net being known to have good predictive ability but with heavy computational cost. Application to whole-genome sequencing (WGS) data from the Alzheimer's Disease Neuroimaging Initiative (ADNI) exhibits that the proposed method shows higher predictive power than the gene score and GBLUP methods.
| S-EPMC5849235 | biostudies-literature
Project description:Microorganisms play critical roles in human health and disease. They live in diverse communities in which they interact synergistically or antagonistically. Thus for estimating microbial associations with clinical covariates, such as treatment effects, joint (multivariate) statistical models are preferred. Multivariate models allow one to estimate and exploit complex interdependencies among multiple taxa, yielding more powerful tests of exposure or treatment effects than application of taxon-specific univariate analyses. Analysis of microbial count data also requires special attention because data commonly exhibit zero inflation, i.e., more zeros than expected from a standard count distribution. To meet these needs, we developed a Bayesian variable selection model for multivariate count data with excess zeros that incorporates information on the covariance structure of the outcomes (counts for multiple taxa), while estimating associations with the mean levels of these outcomes. Though there has been much work on zero-inflated models for longitudinal data, little attention has been given to high-dimensional multivariate zero-inflated data modeled via a general correlation structure. Through simulation, we compared performance of the proposed method to that of existing univariate approaches, for both the binary ("excess zero") and count parts of the model. When outcomes were correlated the proposed variable selection method maintained type I error while boosting the ability to identify true associations in the binary component of the model. For the count part of the model, in some scenarios the univariate method had higher power than the multivariate approach. This higher power was at a cost of a highly inflated false discovery rate not observed with the proposed multivariate method. We applied the approach to oral microbiome data from the Pediatric HIV/AIDS Cohort Oral Health Study and identified five (of 44) species associated with HIV infection.
| S-EPMC7308073 | biostudies-literature
Project description:It is often the case that researchers wish to simultaneously explore the behavior of and estimate overall risk for multiple, related diseases with varying rarity while accounting for potential spatial and/or temporal correlation. In this paper, we propose a flexible class of multivariate spatio-temporal mixture models to fill this role. Further, these models offer flexibility with the potential for model selection as well as the ability to accommodate lifestyle, socio-economic, and physical environmental variables with spatial, temporal, or both structures. Here, we explore the capability of this approach via a large scale simulation study and examine a motivating data example involving three cancers in South Carolina. The results which are focused on four model variants suggest that all models possess the ability to recover simulation ground truth and display improved model fit over two baseline Knorr-Held spatio-temporal interaction model variants in a real data application.
| S-EPMC5722237 | biostudies-literature
Project description:MotivationRelief is a family of machine learning algorithms that uses nearest-neighbors to select features whose association with an outcome may be due to epistasis or statistical interactions with other features in high-dimensional data. Relief-based estimators are non-parametric in the statistical sense that they do not have a parameterized model with an underlying probability distribution for the estimator, making it difficult to determine the statistical significance of Relief-based attribute estimates. Thus, a statistical inferential formalism is needed to avoid imposing arbitrary thresholds to select the most important features. We reconceptualize the Relief-based feature selection algorithm to create a new family of STatistical Inference Relief (STIR) estimators that retains the ability to identify interactions while incorporating sample variance of the nearest neighbor distances into the attribute importance estimation. This variance permits the calculation of statistical significance of features and adjustment for multiple testing of Relief-based scores. Specifically, we develop a pseudo t-test version of Relief-based algorithms for case-control data.ResultsWe demonstrate the statistical power and control of type I error of the STIR family of feature selection methods on a panel of simulated data that exhibits properties reflected in real gene expression data, including main effects and network interaction effects. We compare the performance of STIR when the adaptive radius method is used as the nearest neighbor constructor with STIR when the fixed-k nearest neighbor constructor is used. We apply STIR to real RNA-Seq data from a study of major depressive disorder and discuss STIR's straightforward extension to genome-wide association studies.Availability and implementationCode and data available at http://insilico.utulsa.edu/software/STIR.Supplementary informationSupplementary data are available at Bioinformatics online.
| S-EPMC6477983 | biostudies-literature
Project description:BackgroundGenotype-phenotype association has been one of the long-standing problems in bioinformatics. Identifying both the marginal and epistatic effects among genetic markers, such as Single Nucleotide Polymorphisms (SNPs), has been extensively integrated in Genome-Wide Association Studies (GWAS) to help derive "causal" genetic risk factors and their interactions, which play critical roles in life and disease systems. Identifying "synergistic" interactions with respect to the outcome of interest can help accurate phenotypic prediction and understand the underlying mechanism of system behavior. Many statistical measures for estimating synergistic interactions have been proposed in the literature for such a purpose. However, except for empirical performance, there is still no theoretical analysis on the power and limitation of these synergistic interaction measures.ResultsIn this paper, it is shown that the existing information-theoretic multivariate synergy depends on a small subset of the interaction parameters in the model, sometimes on only one interaction parameter. In addition, an adjusted version of multivariate synergy is proposed as a new measure to estimate the interactive effects, with experiments conducted over both simulated data sets and a real-world GWAS data set to show the effectiveness.ConclusionsWe provide rigorous theoretical analysis and empirical evidence on why the information-theoretic multivariate synergy helps with identifying genetic risk factors via synergistic interactions. We further establish the rigorous sample complexity analysis on detecting interactive effects, confirmed by both simulated and real-world data sets.
| S-EPMC5872388 | biostudies-literature
Project description:Despite extensive research efforts, reconstruction of gene regulatory networks (GRNs) from transcriptomics data remains a pressing challenge in systems biology. While non-linear approaches for reconstruction of GRNs show improved performance over simpler alternatives, we do not yet have understanding if joint modelling of multiple target genes may improve performance, even under linearity assumptions. To address this problem, we propose two novel approaches that cast the GRN reconstruction problem as a blend between regularized multivariate regression and graphical models that combine the L2,1-norm with classical regularization techniques. We used data and networks from the DREAM5 challenge to show that the proposed models provide consistently good performance in comparison to contenders whose performance varies with data sets from simulation and experiments from model unicellular organisms Escherichia coli and Saccharomyces cerevisiae. Since the models' formulation facilitates the prediction of master regulators, we also used the resulting findings to identify master regulators over all data sets as well as their plasticity across different environments. Our results demonstrate that the identified master regulators are in line with experimental evidence from the model bacterium E. coli. Together, our study demonstrates that simultaneous modelling of several target genes results in improved inference of GRNs and can be used as an alternative in different applications.
| S-EPMC10414675 | biostudies-literature
Project description:Predictive regression models can be created with many different modelling approaches. Choices need to be made for data set splitting, cross-validation methods, specific regression parameters and best model criteria, as they all affect the accuracy and efficiency of the produced predictive models, and therefore, raising model reproducibility and comparison issues. Cheminformatics and bioinformatics are extensively using predictive modelling and exhibit a need for standardization of these methodologies in order to assist model selection and speed up the process of predictive model development. A tool accessible to all users, irrespectively of their statistical knowledge, would be valuable if it tests several simple and complex regression models and validation schemes, produce unified reports, and offer the option to be integrated into more extensive studies. Additionally, such methodology should be implemented as a free programming package, in order to be continuously adapted and redistributed by others.We propose an integrated framework for creating multiple regression models, called RRegrs. The tool offers the option of ten simple and complex regression methods combined with repeated 10-fold and leave-one-out cross-validation. Methods include Multiple Linear regression, Generalized Linear Model with Stepwise Feature Selection, Partial Least Squares regression, Lasso regression, and Support Vector Machines Recursive Feature Elimination. The new framework is an automated fully validated procedure which produces standardized reports to quickly oversee the impact of choices in modelling algorithms and assess the model and cross-validation results. The methodology was implemented as an open source R package, available at https://www.github.com/enanomapper/RRegrs, by reusing and extending on the caret package.The universality of the new methodology is demonstrated using five standard data sets from different scientific fields. Its efficiency in cheminformatics and QSAR modelling is shown with three use cases: proteomics data for surface-modified gold nanoparticles, nano-metal oxides descriptor data, and molecular descriptors for acute aquatic toxicity data. The results show that for all data sets RRegrs reports models with equal or better performance for both training and test sets than those reported in the original publications. Its good performance as well as its adaptability in terms of parameter optimization could make RRegrs a popular framework to assist the initial exploration of predictive models, and with that, the design of more comprehensive in silico screening applications.Graphical abstractRRegrs is a computer-aided model selection framework for R multiple regression models; this is a fully validated procedure with application to QSAR modelling.
| S-EPMC4570700 | biostudies-literature