Dataset Information

Fdrci: FDR confidence interval selection and adjustment for large-scale hypothesis testing.

ABSTRACT:

Motivation

Approaches that control error by applying a priori fixed discovery thresholds such as 0.05 limit the ability of investigators to identify and publish weak effects even when evidence suggests that such effects exist. However, current false discovery rate (FDR) estimation methods lack a principled approach for post hoc identification of discovery thresholds other than 0.05.

Results

We describe a flexible approach that hinges on the precision of a permutation-based FDR estimator. A series of discovery thresholds are proposed, and an FDR confidence interval selection and adjustment technique is used to identify intervals that do not cover one, implying that some discoveries are expected to be true. We report an application to a transcriptome-wide association study of the MAVERICC clinical trial involving patients with metastatic colorectal cancer. Several genes are identified whose predicted expression is associated with progression-free or overall survival.

Availability and implementation

Software is provided via the CRAN repository (https://cran.r-project.org/web/packages/fdrci/index.html).

Supplementary information

Supplementary data are available at Bioinformatics Advances online.

SUBMITTER: Millstein J

PROVIDER: S-EPMC9210923 | biostudies-literature | 2022

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

fdrci: FDR confidence interval selection and adjustment for large-scale hypothesis testing.

Millstein Joshua J Battaglin Francesca F Arai Hiroyuki H Zhang Wu W Jayachandran Priya P Soni Shivani S Parikh Aparna R AR Mancao Christoph C Lenz Heinz-Josef HJ

Bioinformatics advances 20220613 1

<h4>Motivation</h4>Approaches that control error by applying a priori fixed discovery thresholds such as 0.05 limit the ability of investigators to identify and publish weak effects even when evidence suggests that such effects exist. However, current false discovery rate (FDR) estimation methods lack a principled approach for <i>post hoc</i> identification of discovery thresholds other than 0.05.<h4>Results</h4>We describe a flexible approach that hinges on the precision of a permutation-based ...[more]

PMID: 35747247

Similar Datasets

Project description:Mediation hypothesis testing for a large number of mediators is challenging due to the composite structure of the null hypothesis, H 0 : α β = 0 ${H}_{0}:\alpha \beta =0$ ( α $\alpha $ : effect of the exposure on the mediator after adjusting for confounders; β $\beta $ : effect of the mediator on the outcome after adjusting for exposure and confounders). In this paper, we reviewed three classes of methods for large-scale one at a time mediation hypothesis testing. These methods are commonly used for continuous outcomes and continuous mediators assuming there is no exposure-mediator interaction so that the product α β $\alpha \beta $ has a causal interpretation as the indirect effect. The first class of methods ignores the impact of different structures under the composite null hypothesis, namely, (1) α = 0 , β ≠ 0 $\alpha =0,\beta \ne 0$ ; (2) α ≠ 0 , β = 0 $\alpha \ne 0,\beta =0$ ; and (3) α = β = 0 $\alpha =\beta =0$ . The second class of methods weights the reference distribution under each case of the null to form a mixture reference distribution. The third class constructs a composite test statistic using the three p values obtained under each case of the null so that the reference distribution of the composite statistic is approximately U ( 0 , 1 ) $U(0,1)$ . In addition to these existing methods, we developed the Sobel-comp method belonging to the second class, which uses a corrected mixture reference distribution for Sobel's test statistic. We performed extensive simulation studies to compare all six methods belonging to these three classes in terms of the false positive rates (FPRs) under the null hypothesis and the true positive rates under the alternative hypothesis. We found that the second class of methods which uses a mixture reference distribution could best maintain the FPRs at the nominal level under the null hypothesis and had the greatest true positive rates under the alternative hypothesis. We applied all methods to study the mediation mechanism of DNA methylation sites in the pathway from adult socioeconomic status to glycated hemoglobin level using data from the Multi-Ethnic Study of Atherosclerosis (MESA). We provide guidelines for choosing the optimal mediation hypothesis testing method in practice and develop an R package medScan available on the CRAN for implementing all the six methods.