Multivariate emulation of computer simulators: model selection and diagnostics with application to a humanitarian relief model.
Ontology highlight
ABSTRACT:
SUBMITTER: Overstall AM
PROVIDER: S-EPMC4991306 | biostudies-literature | 2016 Aug
REPOSITORIES: biostudies-literature
Publications
Multivariate emulation of computer simulators: model selection and diagnostics with application to a humanitarian relief model.
Overstall Antony M AM Woods David C DC
Journal of the Royal Statistical Society. Series C, Applied statistics 20160301 4
We present a common framework for Bayesian emulation methodologies for multivariate output simulators, or computer models, that employ either parametric linear models or non-parametric Gaussian processes. Novel diagnostics suitable for multivariate covariance separable emulators are developed and techniques to improve the adequacy of an emulator are discussed and implemented. A variety of emulators are compared for a humanitarian relief simulator, modelling aid missions to Sicily after a volcani ...[more]
Similar Datasets
Project description:BackgroundAlthough nurses play an important role in humanitarian aid and disaster relief (HA/DR), little is known about the nursing activities that are performed in HA/DR. We aimed to clarify the nursing activities performed by Japanese nurses in HA/DR and to examine the factors associated with the frequency of nursing activities.MethodsA self-administered questionnaire survey was completed by 147 nurses with HA/DR experience. The survey extracted information on demographic characteristics, past experience (e.g., disaster medical training experience, HA/DR experience), circumstances surrounding their dispatched to HA/DR (e.g., team size, disaster type, post-disaster phase, mission term), and the frequency of nursing activities performed under HA/DR. The frequency of nursing activities was rated on a 5-point Likert scale. Evaluation of nursing activities was conducted based on the "nursing activity score", which represents the frequency of each nursing activity. Factors related to the nursing activity score were evaluated by multiple logistic regression analysis.ResultsNurses were involved in 27 nursing activities in HA/DR, 10 of which were performed frequently. On analysis, factors significantly associated with nursing activity score were nursing license as a registered nurse (OR 7.79, 95% CI 2.95-20.57), two or more experiences with disaster medical training (OR 2.90 95%, CI 1.12-7.49) and a post-disaster phase of three weeks or longer (OR 8.77, 95% CI 2.59-29.67).ConclusionsThese results will contribute to the design of evidence-based disaster medical training that improves the quality of nursing activities.
| S-EPMC4784935 | biostudies-literature
Project description:We develop a new genetic prediction method, smooth-threshold multivariate genetic prediction, using single nucleotide polymorphisms (SNPs) data in genome-wide association studies (GWASs). Our method consists of two stages. At the first stage, unlike the usual discontinuous SNP screening as used in the gene score method, our method continuously screens SNPs based on the output from standard univariate analysis for marginal association of each SNP. At the second stage, the predictive model is built by a generalized ridge regression simultaneously using the screened SNPs with SNP weight determined by the strength of marginal association. Continuous SNP screening by the smooth thresholding not only makes prediction stable but also leads to a closed form expression of generalized degrees of freedom (GDF). The GDF leads to the Stein's unbiased risk estimation (SURE), which enables data-dependent choice of optimal SNP screening cutoff without using cross-validation. Our method is very rapid because computationally expensive genome-wide scan is required only once in contrast to the penalized regression methods including lasso and elastic net. Simulation studies that mimic real GWAS data with quantitative and binary traits demonstrate that the proposed method outperforms the gene score method and genomic best linear unbiased prediction (GBLUP), and also shows comparable or sometimes improved performance with the lasso and elastic net being known to have good predictive ability but with heavy computational cost. Application to whole-genome sequencing (WGS) data from the Alzheimer's Disease Neuroimaging Initiative (ADNI) exhibits that the proposed method shows higher predictive power than the gene score and GBLUP methods.
| S-EPMC5849235 | biostudies-literature
Project description:Microorganisms play critical roles in human health and disease. They live in diverse communities in which they interact synergistically or antagonistically. Thus for estimating microbial associations with clinical covariates, such as treatment effects, joint (multivariate) statistical models are preferred. Multivariate models allow one to estimate and exploit complex interdependencies among multiple taxa, yielding more powerful tests of exposure or treatment effects than application of taxon-specific univariate analyses. Analysis of microbial count data also requires special attention because data commonly exhibit zero inflation, i.e., more zeros than expected from a standard count distribution. To meet these needs, we developed a Bayesian variable selection model for multivariate count data with excess zeros that incorporates information on the covariance structure of the outcomes (counts for multiple taxa), while estimating associations with the mean levels of these outcomes. Though there has been much work on zero-inflated models for longitudinal data, little attention has been given to high-dimensional multivariate zero-inflated data modeled via a general correlation structure. Through simulation, we compared performance of the proposed method to that of existing univariate approaches, for both the binary ("excess zero") and count parts of the model. When outcomes were correlated the proposed variable selection method maintained type I error while boosting the ability to identify true associations in the binary component of the model. For the count part of the model, in some scenarios the univariate method had higher power than the multivariate approach. This higher power was at a cost of a highly inflated false discovery rate not observed with the proposed multivariate method. We applied the approach to oral microbiome data from the Pediatric HIV/AIDS Cohort Oral Health Study and identified five (of 44) species associated with HIV infection.
| S-EPMC7308073 | biostudies-literature
Project description:It is often the case that researchers wish to simultaneously explore the behavior of and estimate overall risk for multiple, related diseases with varying rarity while accounting for potential spatial and/or temporal correlation. In this paper, we propose a flexible class of multivariate spatio-temporal mixture models to fill this role. Further, these models offer flexibility with the potential for model selection as well as the ability to accommodate lifestyle, socio-economic, and physical environmental variables with spatial, temporal, or both structures. Here, we explore the capability of this approach via a large scale simulation study and examine a motivating data example involving three cancers in South Carolina. The results which are focused on four model variants suggest that all models possess the ability to recover simulation ground truth and display improved model fit over two baseline Knorr-Held spatio-temporal interaction model variants in a real data application.
| S-EPMC5722237 | biostudies-literature
Project description:MotivationRelief is a family of machine learning algorithms that uses nearest-neighbors to select features whose association with an outcome may be due to epistasis or statistical interactions with other features in high-dimensional data. Relief-based estimators are non-parametric in the statistical sense that they do not have a parameterized model with an underlying probability distribution for the estimator, making it difficult to determine the statistical significance of Relief-based attribute estimates. Thus, a statistical inferential formalism is needed to avoid imposing arbitrary thresholds to select the most important features. We reconceptualize the Relief-based feature selection algorithm to create a new family of STatistical Inference Relief (STIR) estimators that retains the ability to identify interactions while incorporating sample variance of the nearest neighbor distances into the attribute importance estimation. This variance permits the calculation of statistical significance of features and adjustment for multiple testing of Relief-based scores. Specifically, we develop a pseudo t-test version of Relief-based algorithms for case-control data.ResultsWe demonstrate the statistical power and control of type I error of the STIR family of feature selection methods on a panel of simulated data that exhibits properties reflected in real gene expression data, including main effects and network interaction effects. We compare the performance of STIR when the adaptive radius method is used as the nearest neighbor constructor with STIR when the fixed-k nearest neighbor constructor is used. We apply STIR to real RNA-Seq data from a study of major depressive disorder and discuss STIR's straightforward extension to genome-wide association studies.Availability and implementationCode and data available at http://insilico.utulsa.edu/software/STIR.Supplementary informationSupplementary data are available at Bioinformatics online.
| S-EPMC6477983 | biostudies-literature
Project description:Genotype-phenotype association has been one of the long-standing problems in bioinformatics. Identifying both the marginal and epistatic effects among genetic markers, such as Single Nucleotide Polymorphisms (SNPs), has been extensively integrated in Genome-Wide Association Studies (GWAS) to help derive "causal" genetic risk factors and their interactions, which play critical roles in life and disease systems. Identifying "synergistic" interactions with respect to the outcome of interest can help accurate phenotypic prediction and understand the underlying mechanism of system behavior. Many statistical measures for estimating synergistic interactions have been proposed in the literature for such a purpose. However, except for empirical performance, there is still no theoretical analysis on the power and limitation of these synergistic interaction measures.In this paper, it is shown that the existing information-theoretic multivariate synergy depends on a small subset of the interaction parameters in the model, sometimes on only one interaction parameter. In addition, an adjusted version of multivariate synergy is proposed as a new measure to estimate the interactive effects, with experiments conducted over both simulated data sets and a real-world GWAS data set to show the effectiveness.We provide rigorous theoretical analysis and empirical evidence on why the information-theoretic multivariate synergy helps with identifying genetic risk factors via synergistic interactions. We further establish the rigorous sample complexity analysis on detecting interactive effects, confirmed by both simulated and real-world data sets.
| S-EPMC5872388 | biostudies-literature
Project description:Predictive regression models can be created with many different modelling approaches. Choices need to be made for data set splitting, cross-validation methods, specific regression parameters and best model criteria, as they all affect the accuracy and efficiency of the produced predictive models, and therefore, raising model reproducibility and comparison issues. Cheminformatics and bioinformatics are extensively using predictive modelling and exhibit a need for standardization of these methodologies in order to assist model selection and speed up the process of predictive model development. A tool accessible to all users, irrespectively of their statistical knowledge, would be valuable if it tests several simple and complex regression models and validation schemes, produce unified reports, and offer the option to be integrated into more extensive studies. Additionally, such methodology should be implemented as a free programming package, in order to be continuously adapted and redistributed by others.We propose an integrated framework for creating multiple regression models, called RRegrs. The tool offers the option of ten simple and complex regression methods combined with repeated 10-fold and leave-one-out cross-validation. Methods include Multiple Linear regression, Generalized Linear Model with Stepwise Feature Selection, Partial Least Squares regression, Lasso regression, and Support Vector Machines Recursive Feature Elimination. The new framework is an automated fully validated procedure which produces standardized reports to quickly oversee the impact of choices in modelling algorithms and assess the model and cross-validation results. The methodology was implemented as an open source R package, available at https://www.github.com/enanomapper/RRegrs, by reusing and extending on the caret package.The universality of the new methodology is demonstrated using five standard data sets from different scientific fields. Its efficiency in cheminformatics and QSAR modelling is shown with three use cases: proteomics data for surface-modified gold nanoparticles, nano-metal oxides descriptor data, and molecular descriptors for acute aquatic toxicity data. The results show that for all data sets RRegrs reports models with equal or better performance for both training and test sets than those reported in the original publications. Its good performance as well as its adaptability in terms of parameter optimization could make RRegrs a popular framework to assist the initial exploration of predictive models, and with that, the design of more comprehensive in silico screening applications.Graphical abstractRRegrs is a computer-aided model selection framework for R multiple regression models; this is a fully validated procedure with application to QSAR modelling.
| S-EPMC4570700 | biostudies-literature
Project description:Humanitarian social enterprises (HSEs) are facing mounting pressure to incorporate social innovation into their practice. This study thus identifies how HSEs leverage organizational capabilities toward developing social innovation. Specifically, it considers how resource scarcity and operating circumstances affect the capabilities used by HSEs for developing social innovation, using a longitudinal case study approach with qualitative data from 12 hunger-relief HSEs operating in the United States. Based on 59 interviews with 31 managers and directors and related documents, several propositions are posited. The findings suggest that resource availability (i.e., scarcity vs. abundance) leads some HSEs to focus on developing social innovation using their collaborative capabilities, while others leverage their absorptive capacity. Further, HSEs adjust their approach to developing social innovation based on whether they are operating in ordinary circumstances (i.e., before the COVID pandemic) or extraordinary ones (i.e., during the COVID pandemic). Interestingly, the findings suggest that the organizational capabilities used by HSEs are adjusted as these enterprises become more familiar with extraordinary operating circumstances. For example, at the onset of the COVID-19 pandemic, resource-scarce HSEs focused on parallel bricolage to develop social innovation. Subsequently, they focused on selective bricolage. The findings offer novel insights by relating the social innovation of social enterprises to crisis management.Supplementary informationThe online version contains supplementary material available at 10.1007/s10551-021-05014-9.
| S-EPMC8747850 | biostudies-literature
Project description:The analysis of multiple outcomes is becoming increasingly common in modern biomedical studies. It is well-known that joint statistical models for multiple outcomes are more flexible and more powerful than fitting a separate model for each outcome; they yield more powerful tests of exposure or treatment effects by taking into account the dependence among outcomes and pooling evidence across outcomes. It is, however, unlikely that all outcomes are related to the same subset of covariates. Therefore, there is interest in identifying exposures or treatments associated with particular outcomes, which we term outcome-specific variable selection. In this work, we propose a variable selection approach for multivariate normal responses that incorporates not only information on the mean model, but also information on the variance-covariance structure of the outcomes. The approach effectively leverages evidence from all correlated outcomes to estimate the effect of a particular covariate on a given outcome. To implement this strategy, we develop a Bayesian method that builds a multivariate prior for the variable selection indicators based on the variance-covariance of the outcomes. We show via simulation that the proposed variable selection strategy can boost power to detect subtle effects without increasing the probability of false discoveries. We apply the approach to the Normative Aging Study (NAS) epigenetic data and identify a subset of five genes in the asthma pathway for which gene-specific DNA methylations are associated with exposures to either black carbon, a marker of traffic pollution, or sulfate, a marker of particles generated by power plants.
| S-EPMC5217755 | biostudies-literature
Project description:BackgroundThe residency match process for competitive specialties hinders programs' ability to holistically review applications.ObjectiveA computer simulation model of the residency application process was created to test the hypotheses that (1) it is advantageous to medical students to apply to the maximum number of programs under the current system, and (2) including a medical student's residency program preferences at the beginning of the application process improves the efficiency of the system for applicants and programs as quantified by the number of interview invitations received.MethodsThe study was conducted in 2016 using 2014 Otolaryngology Match data. A computer model was created to perform simulations for multiple scenarios to test the hypotheses. Students were assigned scores representing easy and hard metrics and program preferences, simulating a mixture of individual student preference and general program popularity.ResultsWe modeled a system of 99 otolaryngology residency programs with 292 residency spots and 460 student applicants. While it was individually advantageous for an applicant to apply to the maximum number of programs, this led to a poor result for the majority of students when all applicants undertook the strategy. The number of interview invitations improved for most applicants when preference was revealed.ConclusionsOffering applicants an option to provide program preference improves the practical number of interview invitations. This enables programs to review applicants holistically-instead of using single parameters such as United States Medical Licensing Examination scores-which facilitates a selection of applicants who will be successful in residency.
| S-EPMC6375320 | biostudies-literature