Evaluating Alternative Correction Methods for Multiple Comparison in Functional Neuroimaging Research.
Ontology highlight
ABSTRACT:
SUBMITTER: Han H
PROVIDER: S-EPMC6721788 | biostudies-literature | 2019 Aug
REPOSITORIES: biostudies-literature
Publications
Evaluating Alternative Correction Methods for Multiple Comparison in Functional Neuroimaging Research.
Han Hyemin H Glenn Andrea L AL Dawson Kelsie J KJ
Brain sciences 20190812 8
A significant challenge for fMRI research is statistically controlling for false positives without omitting true effects. Although a number of traditional methods for multiple comparison correction exist, several alternative tools have been developed that do not rely on strict parametric assumptions, but instead implement alternative methods to correct for multiple comparisons. In this study, we evaluated three of these methods, Statistical non-Parametric Mapping (SnPM), 3DClustSim, and Threshol ...[more]
Similar Datasets
Project description:Population health researchers from different fields often address similar substantive questions but rely on different study designs, reflecting their home disciplines. This is especially true in studies involving causal inference, for which semantic and substantive differences inhibit interdisciplinary dialogue and collaboration. In this paper, we group nonrandomized study designs into two categories: those that use confounder-control (such as regression adjustment or propensity score matching) and those that rely on an instrument (such as instrumental variables, regression discontinuity, or differences-in-differences approaches). Using the Shadish, Cook, and Campbell framework for evaluating threats to validity, we contrast the assumptions, strengths, and limitations of these two approaches and illustrate differences with examples from the literature on education and health. Across disciplines, all methods to test a hypothesized causal relationship involve unverifiable assumptions, and rarely is there clear justification for exclusive reliance on one method. Each method entails trade-offs between statistical power, internal validity, measurement quality, and generalizability. The choice between confounder-control and instrument-based methods should be guided by these tradeoffs and consideration of the most important limitations of previous work in the area. Our goals are to foster common understanding of the methods available for causal inference in population health research and the tradeoffs between them; to encourage researchers to objectively evaluate what can be learned from methods outside one's home discipline; and to facilitate the selection of methods that best answer the investigator's scientific questions.
| S-EPMC6926350 | biostudies-literature
Project description:Insect olfactory receptors (ORs) in the peripheral olfactory system play an important role detecting elements of information from the environment. At present, various approaches are used for deorphanizing of ORs in insect. In this study, we compared methods for functional analysis of ORs in vitro and in vivo taking the candidate pheromone receptor OR13 of Helicoverpa assulta (HassOR13) as the object of our experiments. We found that the natural system was more sensitive than those utilizing transgenic Drosophila. The two-electrode voltage-clamp recording is more suitable for functional screening of large numbers of ORs, while the in vivo transgenic Drosophila system could prove more accurate to further validate the function of a specific OR. We also found that, among the different solvents used to dissolve pheromones and odorants, hexane offered good reproducibility and high sensitivity. Finally, the function of ORs was indirectly confirmed in transgenic Drosophila, showing that odor-activation of ORs-expressing olfactory receptor neurons (ORNs) can mediate behavioral choices. In summary, our results compare advantages and drawbacks of different approaches, thus helping in the choice of the method most suitable, in each specific situation, for deorphanizing insect ORs.
| S-EPMC5025650 | biostudies-literature
Project description:Recent research in neuroimaging has focused on assessing associations between genetic variants that are measured on a genomewide scale and brain imaging phenotypes. A large number of works in the area apply massively univariate analyses on a genomewide basis to find single nucleotide polymorphisms that influence brain structure. In this paper, we propose using various dimensionality reduction methods on both brain structural MRI scans and genomic data, motivated by the Alzheimer's Disease Neuroimaging Initiative (ADNI) study. We also consider a new multiple testing adjustment method and compare it with two existing false discovery rate (FDR) adjustment methods. The simulation results suggest an increase in power for the proposed method. The real-data analysis suggests that the proposed procedure is able to find associations between genetic variants and brain volume differences that offer potentially new biological insights.
| S-EPMC4263222 | biostudies-literature
Project description:The estimation of multiple sequence alignments of protein sequences is a basic step in many bioinformatics pipelines, including protein structure prediction, protein family identification, and phylogeny estimation. Statistical coestimation of alignments and trees under stochastic models of sequence evolution has long been considered the most rigorous technique for estimating alignments and trees, but little is known about the accuracy of such methods on biological benchmarks. We report the results of an extensive study evaluating the most popular protein alignment methods as well as the statistical coestimation method BAli-Phy on 1192 protein data sets from established benchmarks as well as on 120 simulated data sets. Our study (which used more than 230 CPU years for the BAli-Phy analyses alone) shows that BAli-Phy has better precision and recall (with respect to the true alignments) than the other alignment methods on the simulated data sets but has consistently lower recall on the biological benchmarks (with respect to the reference alignments) than many of the other methods. In other words, we find that BAli-Phy systematically underaligns when operating on biological sequence data but shows no sign of this on simulated data. There are several potential causes for this change in performance, including model misspecification, errors in the reference alignments, and conflicts between structural alignment and evolutionary alignments, and future research is needed to determine the most likely explanation. We conclude with a discussion of the potential ramifications for each of these possibilities. [BAli-Phy; homology; multiple sequence alignment; protein sequences; structural alignment.].
| S-EPMC6472439 | biostudies-literature
Project description:BACKGROUND:Sex differences in brain structure and clinical course of substance use disorders underscores the need to include women in structural brain imaging studies. The NIH has supported the need for research to address sex differences. We evaluated female enrollment in substance abuse structural brain imaging research and the methods used to study sex differences in substance effects. METHODS:Structural brain imaging studies published through 2016 (n=230) were evaluated for number of participants by sex and substance use status and methods used to evaluate sex differences. Temporal trends in the numbers of participants by sex and substance use status were analyzed. We evaluated how often sex effects were appropriately analyzed and the proportion of studies that found sex by substance interactions on volumetric measures. RESULTS:Female enrollment increased over time, but remained significantly lower than male enrollment (p=0.01), with the greatest bias for alcohol and opiate studies. 79% of studies included both sexes; however, 74% did not evaluate sex effects or used an analytic approach that precluded detection of sex by substance use interactions. 85% of studies that stratified by sex reported different substance effects on brain volumes. Only 33% of studies examining two-way interactions found significant interactions, highlighting that many studies were underpowered to detect interactions. CONCLUSIONS:Although female participation in substance use studies of brain morphometry has increased, sex disparity persists. Studying adequate numbers of both sexes and employing correct analytic approaches is critical for understanding sex differences in brain morphometric changes in substance abuse.
| S-EPMC5581940 | biostudies-literature
Project description:Genome comparison is now a crucial step for genome annotation and identification of regulatory motifs. Genome comparison aims for instance at finding genomic regions either specific to or in one-to-one correspondence between individuals/strains/species. It serves e.g. to pre-annotate a new genome by automatically transferring annotations from a known one. However, efficiency, flexibility and objectives of current methods do not suit the whole spectrum of applications, genome sizes and organizations. Innovative approaches are still needed. Hence, we propose an alternative way of comparing multiple genomes based on segmentation by similarity. In this framework, rather than being formulated as a complex optimization problem, genome comparison is seen as a segmentation question for which a single optimal solution can be found in almost linear time. We apply our method to analyse three strains of a virulent pathogenic bacteria, Ehrlichia ruminantium, and identify 92 new genes. We also find out that a substantial number of genes thought to be strain specific have potential orthologs in the other strains. Our solution is implemented in an efficient program, qod, equipped with a user-friendly interface, and enables the automatic transfer of annotations between compared genomes or contigs (Video in Supplementary Data). Because it somehow disregards the relative order of genomic blocks, qod can handle unfinished genomes, which due to the difficulty of sequencing completion may become an interesting characteristic for the future. Availabilty: http://www.atgc-montpellier.fr/qod.
| S-EPMC3159434 | biostudies-literature
Project description:Studies of the neural basis of human pain processing present many challenges because of the subjective and variable nature of pain, and the inaccessibility of the central nervous system. Neuroimaging methods, such as functional magnetic resonance imaging (fMRI), have provided the ability to investigate these neural processes, and yet commonly used analysis methods may not be optimally adapted for studies of pain. Here we present a comparison of model-driven and data-driven analysis methods, specifically for the study of human pain processing. Methods are tested using data from healthy control participants in two previous studies, with separate data sets spanning the brain, and the brainstem and spinal cord. Data are analyzed by fitting time-series responses to predicted BOLD responses in order to identify significantly responding regions (model-driven), as well as with connectivity analyses (data-driven) based on temporal correlations between responses in spatially separated regions, and with connectivity analyses based on structural equation modeling, allowing for multiple source regions to explain the signal variations in each target region. The results are assessed in terms of the amount of signal variance that can be explained in each region, and in terms of the regions and connections that are identified as having BOLD responses of interest. The characteristics of BOLD responses in identified regions are also investigated. The results demonstrate that data-driven approaches are more effective than model-driven approaches for fMRI studies of pain.
| S-EPMC7735591 | biostudies-literature
Project description:Markov models and master equations are a powerful means of modeling dynamic processes like protein conformational changes. However, these models are often difficult to understand because of the enormous number of components and connections between them. Therefore, a variety of methods have been developed to facilitate understanding by coarse-graining these complex models. Here, we employ Bayesian model comparison to determine which of these coarse-graining methods provides the models that are most faithful to the original set of states. We find that the Bayesian agglomerative clustering engine and the hierarchical Nyström expansion graph (HNEG) typically provide the best performance. Surprisingly, the original Perron cluster cluster analysis (PCCA) method often provides the next best results, outperforming the newer PCCA+ method and the most probable paths algorithm. We also show that the differences between the models are qualitatively significant, rather than being minor shifts in the boundaries between states. The performance of the methods correlates well with the entropy of the resulting coarse-grainings, suggesting that finding states with more similar populations (i.e., avoiding low population states that may just be noise) gives better results.
| S-EPMC3724791 | biostudies-other
Project description:Biological subtypes in Alzheimer's disease, originally identified on neuropathological data, have been translated to in vivo biomarkers such as structural magnetic resonance imaging and positron emission tomography, to disentangle the heterogeneity within Alzheimer's disease. Although there is methodological variability across studies, comparable characteristics of subtypes are reported at the group level. In this study, we investigated whether group-level similarities translate to individual-level agreement across subtyping methods, in a head-to-head context. We compared five previously published subtyping methods. Firstly, we validated the subtyping methods in 89 amyloid-beta positive Alzheimer's disease dementia patients (reference group: 70 amyloid-beta negative healthy individuals) using structural magnetic resonance imaging. Secondly, we extended and applied the subtyping methods to 53 amyloid-beta positive prodromal Alzheimer's disease and 30 amyloid-beta positive Alzheimer's disease dementia patients (reference group: 200 amyloid-beta negative healthy individuals) using structural magnetic resonance imaging and tau positron emission tomography. Subtyping methods were implemented as outlined in each original study. Group-level and individual-level comparisons across methods were performed. Each individual subtyping method was replicated, and the proof-of-concept was established. At the group level, all methods captured subtypes with similar patterns of demographic and clinical characteristics, and with similar cortical thinning and tau positron emission tomography uptake patterns. However, at the individual level, large disagreements were found in subtype assignments. Although characteristics of subtypes are comparable at the group level, there is a large disagreement at the individual level across subtyping methods. Therefore, there is an urgent need for consensus and harmonization across subtyping methods. We call for the establishment of an open benchmarking framework to overcome this problem.
| S-EPMC7713995 | biostudies-literature
Project description:BackgroundWhole blood is frequently utilized in genome-wide association studies of DNA methylation patterns in relation to environmental exposures or clinical outcomes. These associations can be confounded by cellular heterogeneity. Algorithms have been developed to measure or adjust for this heterogeneity, and some have been compared in the literature. However, with new methods available, it is unknown whether the findings will be consistent, if not which method(s) perform better.ResultsMethods: We compared eight cell-type correction methods including the method in the minfi R package, the method by Houseman et al., the Removing unwanted variation (RUV) approach, the methods in FaST-LMM-EWASher, ReFACTor, RefFreeEWAS, and RefFreeCellMix R programs, along with one approach utilizing surrogate variables (SVAs). We first evaluated the association of DNA methylation at each CpG across the whole genome with prenatal arsenic exposure levels and with cancer status, adjusted for estimated cell-type information obtained from different methods. We then compared CpGs showing statistical significance from different approaches. For the methods implemented in minfi and proposed by Houseman et al., we utilized homogeneous data with composition of some blood cells available and compared them with the estimated cell compositions. Finally, for methods not explicitly estimating cell compositions, we evaluated their performance using simulated DNA methylation data with a set of latent variables representing "cell types".ResultsResults from the SVA-based method overall showed the highest agreement with all other methods except for FaST-LMM-EWASher. Using homogeneous data, minfi provided better estimations on cell types compared to the originally proposed method by Houseman et al. Further simulation studies on methods free of reference data revealed that SVA provided good sensitivities and specificities, RefFreeCellMix in general produced high sensitivities but specificities tended to be low when confounding is present, and FaST-LMM-EWASher gave the lowest sensitivity but highest specificity.ConclusionsResults from real data and simulations indicated that SVA is recommended when the focus is on the identification of informative CpGs. When appropriate reference data are available, the method implemented in the minfi package is recommended. However, if no such reference data are available or if the focus is not on estimating cell proportions, the SVA method is suggested.
| S-EPMC5391562 | biostudies-literature