Generalized Empirical Bayes Modeling via Frequentist Goodness of Fit.
Ontology highlight
ABSTRACT:
SUBMITTER: Mukhopadhyay S
PROVIDER: S-EPMC6040203 | biostudies-literature | 2018 Jul
REPOSITORIES: biostudies-literature
Publications
Generalized Empirical Bayes Modeling via Frequentist Goodness of Fit.
Mukhopadhyay Subhadeep S Fletcher Douglas D
Scientific reports 20180702 1
The two key issues of modern Bayesian statistics are: (i) establishing principled approach for distilling statistical prior that is consistent with the given data from an initial believable scientific prior; and (ii) development of a consolidated Bayes-frequentist data analysis workflow that is more effective than either of the two separately. In this paper, we propose the idea of "Bayes via goodness-of-fit" as a framework for exploring these fundamental questions, in a way that is general enoug ...[more]
Similar Datasets
Project description:Seasonal influenza epidemics cause consistent, considerable, widespread loss annually in terms of economic burden, morbidity, and mortality. With access to accurate and reliable forecasts of a current or upcoming influenza epidemic's behavior, policy makers can design and implement more effective countermeasures. This past year, the Centers for Disease Control and Prevention hosted the "Predict the Influenza Season Challenge", with the task of predicting key epidemiological measures for the 2013-2014 U.S. influenza season with the help of digital surveillance data. We developed a framework for in-season forecasts of epidemics using a semiparametric Empirical Bayes framework, and applied it to predict the weekly percentage of outpatient doctors visits for influenza-like illness, and the season onset, duration, peak time, and peak height, with and without using Google Flu Trends data. Previous work on epidemic modeling has focused on developing mechanistic models of disease behavior and applying time series tools to explain historical data. However, tailoring these models to certain types of surveillance data can be challenging, and overly complex models with many parameters can compromise forecasting ability. Our approach instead produces possibilities for the epidemic curve of the season of interest using modified versions of data from previous seasons, allowing for reasonable variations in the timing, pace, and intensity of the seasonal epidemics, as well as noise in observations. Since the framework does not make strict domain-specific assumptions, it can easily be applied to some other diseases with seasonal epidemics. This method produces a complete posterior distribution over epidemic curves, rather than, for example, solely point predictions of forecasting targets. We report prospective influenza-like-illness forecasts made for the 2013-2014 U.S. influenza season, and compare the framework's cross-validated prediction error on historical data to that of a variety of simpler baseline predictors.
| S-EPMC4552841 | biostudies-literature
Project description:Meta-analysis is a very useful tool to combine information from different sources. Fixed effect and random effect models are widely used in meta-analysis. Despite their popularity, they may give us misleading results if the models don't fit the data but are blindly used. Therefore, like any statistical analysis, checking the model fitting is an important step. However, in practice, the goodness-of-fit in meta-analysis is rarely discussed. In this paper, we propose some tests to check the goodness-of-fit for the fixed and random effect models with assumption of normal distributions in meta-analysis. Through simulation study, we show that the proposed tests control type I error rate very well. To demonstrate the usefulness of the proposed tests, we also apply them to some real data sets. Our study shows that the proposed tests are useful tools in checking the goodness-of-fit of the normal models used in meta-analysis.
| S-EPMC4655309 | biostudies-other
Project description:Motivation: Computational inference methods that make use of graphical models to extract regulatory networks from gene expression data can have difficulty reconstructing dense regions of a network, a consequence of both computational complexity and unreliable parameter estimation when sample size is small. As a result, identification of hub genes is of special difficulty for these methods.Methods: We present a new algorithm, Empirical Light Mutual Min (ELMM), for large network reconstruction that has properties well suited for dense graph recovery. ELMM reconstructs the undirected graph of a regulatory network using empirical Bayes conditional independence testing with a heuristic relaxation of independence constraints in dense areas of the graph. This relaxation allows only one gene of a pair with a putative relation to be aware of the network connection, an approach that is aimed at easing multiple testing problems associated with recovering densely connected structures.Results: Using in silico data, we show that ELMM has better performance than commonly used network inference algorithms including PC Algorithm, GeneNet, and ARACNE. We also apply ELMM to reconstruct a network among 5,400 genes expressed in human lung airway epithelium of healthy nonsmokers, healthy smokers, and smokers with pulmonary diseases assayed using microarrays. The analysis identifies dense subnetworks that are consistent with known regulatory relationships in the lung airway and also suggests novel hub regulatory relationships among a number of genes that play roles in oxidative stress, wound response, and secretion.
2024-06-05 | GSE32030 | GEO
Project description:Air pollution is a matter of concern among the public, especially for those living in urban and industrial areas. Markov chain modeling is often used to model the underlying dynamics of air pollution, which involves describing the transition probability of going from one air pollution state to another. Thus, estimating the transition probability matrix for the data of the air pollution index (API) is an essential process in the modeling. However, one may observe many zero probabilities in the transition probability matrix, especially when faced with a small sample, interpreting the results with respect to the climate condition less realistic. This study proposes a robust empirical Bayes method, which incorporates a method of smoothing the zero frequencies in the count matrix, contributing to an improved estimation of the transition probability matrix. The robustness of the empirical Bayesian estimation is investigated based on Bayes risk. The transition probability matrices estimated based on the robust empirical Bayes method for the hourly API data collected from seven monitoring stations in Malaysia for the period 2012 to 2014 are used for determining the air pollution characteristics such as the mean residence time, the steady-state probability and the mean recurrence time. Furthermore, the proposed method has been evaluated by Monte Carlo simulations. Results suggest that it is quite effective in producing non-zero transition probability estimates, and superior to the maximum likelihood method in terms of minimizing the mean squared error for individual and entire transition probabilities. Therefore, the robust empirical Bayes method proves to be an improved approach to the estimation of the Markov chain. When applied to API data, it could provide important information on air pollution dynamics that may help guiding the development of proper strategies for managing the impact of air quality.Supplementary informationThe online version contains supplementary material available at 10.1007/s40201-020-00607-4.
| S-EPMC8172767 | biostudies-literature
Project description:This article proposes methodology for assessing goodness of fit in Bayesian hierarchical models. The methodology is based on comparing values of pivotal discrepancy measures (PDMs), computed using parameter values drawn from the posterior distribution, to known reference distributions. Because the resulting diagnostics can be calculated from standard output of Markov chain Monte Carlo algorithms, their computational costs are minimal. Several simulation studies are provided, each of which suggests that diagnostics based on PDMs have higher statistical power than comparable posterior-predictive diagnostic checks in detecting model departures. The proposed methodology is illustrated in a clinical application; an application to discrete data is described in supplementary material.
| S-EPMC3276744 | biostudies-literature
Project description:Linear mixed models (LMMs) are widely used for regression analysis of data that are assumed to be clustered or correlated. Assessing model fit is important for valid inference but to date no confirmatory tests are available to assess the adequacy of the fixed effects part of LMMs against general alternatives. We therefore propose a class of goodness-of-fit tests for the mean structure of LMMs. Our test statistic is a quadratic form of the difference between observed values and the values expected under the estimated model in cells defined by a partition of the covariate space. We show that this test statistic has an asymptotic chi-squared distribution when model parameters are estimated by maximum likelihood or by least squares and method of moments, and study its power under local alternatives both analytically and in simulations. Data on repeated measurements of thyroglobulin from individuals exposed to the accident at the Chernobyl power plant in 1986 are used to illustrate the proposed test.
| S-EPMC5426279 | biostudies-literature
Project description:We propose Lp distance-based goodness-of-fit (GOF) tests for uniform stochastic ordering with two continuous distributions F and G, both of which are unknown. Our tests are motivated by the fact that when F and G are uniformly stochastically ordered, the ordinal dominance curve R = FG-1 is star-shaped. We derive asymptotic distributions and prove that our testing procedure has a unique least favorable configuration of F and G for p ? [1,?]. We use simulation to assess finite-sample performance and demonstrate that a modified, one-sample version of our procedure (e.g., with G known) is more powerful than the one-sample GOF test suggested by Arcones and Samaniego (2000, Annals of Statistics). We also discuss sample size determination. We illustrate our methods using data from a pharmacology study evaluating the effects of administering caffeine to prematurely born infants.
| S-EPMC5771311 | biostudies-literature
Project description:Coarse structural nested mean models are tools to estimate treatment effects from longitudinal observational data with time-dependent confounding. There is, however, no guidance on how to specify the treatment effect model, and model misspecification can lead to bias. We derive a goodness-of-fit test based on modified overidentification restrictions tests for evaluating a treatment effect model, and show that our test statistic is doubly-robust in the sense that, with a correct treatment effect model, the test has the correct type-I error if either the treatment initiation model or a nuisance regression outcome model is correctly specified. In a simulation study we show that the test has correct type-I error and can detect model misspecification. We use the test to study how the timing of antiretroviral treatment initiation after HIV infection predicts the effect of one year of treatment in HIV-positive patients with acute and early infection.
| S-EPMC5152627 | biostudies-literature
Project description:The ordinal dominance curve (ODC) is a useful graphical tool to compare two population distributions. These distributions are said to satisfy uniform stochastic ordering (USO) if the ODC for them is star-shaped. A goodness-of-fit test for USO was recently proposed when both distributions are unknown. This test involves calculating the Lp distance between an empirical estimator of the ODC and its least star-shaped majorant. The least favorable configuration of the two distributions was established so that proper critical values could be determined; i.e., to control the probability of type I error for all star-shaped ODCs. However, the use of these critical values can lead to a conservative test and minimal power to detect certain non-star-shaped alternatives. Two new methods for determining data-dependent critical values are proposed. Simulation is used to show both methods can provide substantial increases in power while still controlling the size of the distance-based test. The methods are also applied to a data set involving premature infants. An R package that implements all tests is provided.
| S-EPMC7453724 | biostudies-literature
Project description:BackgroundAn important goal of whole-genome studies concerned with single nucleotide polymorphisms (SNPs) is the identification of SNPs associated with a covariate of interest such as the case-control status or the type of cancer. Since these studies often comprise the genotypes of hundreds of thousands of SNPs, methods are required that can cope with the corresponding multiple testing problem. For the analysis of gene expression data, approaches such as the empirical Bayes analysis of microarrays have been developed particularly for the detection of genes associated with the response. However, the empirical Bayes analysis of microarrays has only been suggested for binary responses when considering expression values, i.e. continuous predictors.ResultsIn this paper, we propose a modification of this empirical Bayes analysis that can be used to analyze high-dimensional categorical SNP data. This approach along with a generalized version of the original empirical Bayes method are available in the R package siggenes version 1.10.0 and later that can be downloaded from http://www.bioconductor.org.ConclusionAs applications to two subsets of the HapMap data show, the empirical Bayes analysis of microarrays cannot only be used to analyze continuous gene expression data, but also be applied to categorical SNP data, where the response is not restricted to be binary. In association studies in which typically several ten to a few hundred SNPs are considered, our approach can furthermore be employed to test interactions of SNPs. Moreover, the posterior probabilities resulting from the empirical Bayes analysis of (prespecified) interactions/genotypes can also be used to quantify the importance of these interactions.
| S-EPMC2335278 | biostudies-literature