Evaluating Alternative Correction Methods for Multiple Comparison in Functional Neuroimaging Research.
Ontology highlight
ABSTRACT:
SUBMITTER: Han H
PROVIDER: S-EPMC6721788 | biostudies-literature | 2019 Aug
REPOSITORIES: biostudies-literature
Publications
Evaluating Alternative Correction Methods for Multiple Comparison in Functional Neuroimaging Research.
Han Hyemin H Glenn Andrea L AL Dawson Kelsie J KJ
Brain sciences 20190812 8
A significant challenge for fMRI research is statistically controlling for false positives without omitting true effects. Although a number of traditional methods for multiple comparison correction exist, several alternative tools have been developed that do not rely on strict parametric assumptions, but instead implement alternative methods to correct for multiple comparisons. In this study, we evaluated three of these methods, Statistical non-Parametric Mapping (SnPM), 3DClustSim, and Threshol ...[more]
Similar Datasets
Project description:Population health researchers from different fields often address similar substantive questions but rely on different study designs, reflecting their home disciplines. This is especially true in studies involving causal inference, for which semantic and substantive differences inhibit interdisciplinary dialogue and collaboration. In this paper, we group nonrandomized study designs into two categories: those that use confounder-control (such as regression adjustment or propensity score matching) and those that rely on an instrument (such as instrumental variables, regression discontinuity, or differences-in-differences approaches). Using the Shadish, Cook, and Campbell framework for evaluating threats to validity, we contrast the assumptions, strengths, and limitations of these two approaches and illustrate differences with examples from the literature on education and health. Across disciplines, all methods to test a hypothesized causal relationship involve unverifiable assumptions, and rarely is there clear justification for exclusive reliance on one method. Each method entails trade-offs between statistical power, internal validity, measurement quality, and generalizability. The choice between confounder-control and instrument-based methods should be guided by these tradeoffs and consideration of the most important limitations of previous work in the area. Our goals are to foster common understanding of the methods available for causal inference in population health research and the tradeoffs between them; to encourage researchers to objectively evaluate what can be learned from methods outside one's home discipline; and to facilitate the selection of methods that best answer the investigator's scientific questions.
| S-EPMC6926350 | biostudies-literature
Project description:Insect olfactory receptors (ORs) in the peripheral olfactory system play an important role detecting elements of information from the environment. At present, various approaches are used for deorphanizing of ORs in insect. In this study, we compared methods for functional analysis of ORs in vitro and in vivo taking the candidate pheromone receptor OR13 of Helicoverpa assulta (HassOR13) as the object of our experiments. We found that the natural system was more sensitive than those utilizing transgenic Drosophila. The two-electrode voltage-clamp recording is more suitable for functional screening of large numbers of ORs, while the in vivo transgenic Drosophila system could prove more accurate to further validate the function of a specific OR. We also found that, among the different solvents used to dissolve pheromones and odorants, hexane offered good reproducibility and high sensitivity. Finally, the function of ORs was indirectly confirmed in transgenic Drosophila, showing that odor-activation of ORs-expressing olfactory receptor neurons (ORNs) can mediate behavioral choices. In summary, our results compare advantages and drawbacks of different approaches, thus helping in the choice of the method most suitable, in each specific situation, for deorphanizing insect ORs.
| S-EPMC5025650 | biostudies-literature
Project description:Recent research in neuroimaging has focused on assessing associations between genetic variants that are measured on a genomewide scale and brain imaging phenotypes. A large number of works in the area apply massively univariate analyses on a genomewide basis to find single nucleotide polymorphisms that influence brain structure. In this paper, we propose using various dimensionality reduction methods on both brain structural MRI scans and genomic data, motivated by the Alzheimer's Disease Neuroimaging Initiative (ADNI) study. We also consider a new multiple testing adjustment method and compare it with two existing false discovery rate (FDR) adjustment methods. The simulation results suggest an increase in power for the proposed method. The real-data analysis suggests that the proposed procedure is able to find associations between genetic variants and brain volume differences that offer potentially new biological insights.
| S-EPMC4263222 | biostudies-literature
Project description:The estimation of multiple sequence alignments of protein sequences is a basic step in many bioinformatics pipelines, including protein structure prediction, protein family identification, and phylogeny estimation. Statistical coestimation of alignments and trees under stochastic models of sequence evolution has long been considered the most rigorous technique for estimating alignments and trees, but little is known about the accuracy of such methods on biological benchmarks. We report the results of an extensive study evaluating the most popular protein alignment methods as well as the statistical coestimation method BAli-Phy on 1192 protein data sets from established benchmarks as well as on 120 simulated data sets. Our study (which used more than 230 CPU years for the BAli-Phy analyses alone) shows that BAli-Phy has better precision and recall (with respect to the true alignments) than the other alignment methods on the simulated data sets but has consistently lower recall on the biological benchmarks (with respect to the reference alignments) than many of the other methods. In other words, we find that BAli-Phy systematically underaligns when operating on biological sequence data but shows no sign of this on simulated data. There are several potential causes for this change in performance, including model misspecification, errors in the reference alignments, and conflicts between structural alignment and evolutionary alignments, and future research is needed to determine the most likely explanation. We conclude with a discussion of the potential ramifications for each of these possibilities. [BAli-Phy; homology; multiple sequence alignment; protein sequences; structural alignment.].
| S-EPMC6472439 | biostudies-literature
Project description:BackgroundSex differences in brain structure and clinical course of substance use disorders underscores the need to include women in structural brain imaging studies. The NIH has supported the need for research to address sex differences. We evaluated female enrollment in substance abuse structural brain imaging research and the methods used to study sex differences in substance effects.MethodsStructural brain imaging studies published through 2016 (n=230) were evaluated for number of participants by sex and substance use status and methods used to evaluate sex differences. Temporal trends in the numbers of participants by sex and substance use status were analyzed. We evaluated how often sex effects were appropriately analyzed and the proportion of studies that found sex by substance interactions on volumetric measures.ResultsFemale enrollment increased over time, but remained significantly lower than male enrollment (p=0.01), with the greatest bias for alcohol and opiate studies. 79% of studies included both sexes; however, 74% did not evaluate sex effects or used an analytic approach that precluded detection of sex by substance use interactions. 85% of studies that stratified by sex reported different substance effects on brain volumes. Only 33% of studies examining two-way interactions found significant interactions, highlighting that many studies were underpowered to detect interactions.ConclusionsAlthough female participation in substance use studies of brain morphometry has increased, sex disparity persists. Studying adequate numbers of both sexes and employing correct analytic approaches is critical for understanding sex differences in brain morphometric changes in substance abuse.
| S-EPMC5581940 | biostudies-literature
Project description:Genome comparison is now a crucial step for genome annotation and identification of regulatory motifs. Genome comparison aims for instance at finding genomic regions either specific to or in one-to-one correspondence between individuals/strains/species. It serves e.g. to pre-annotate a new genome by automatically transferring annotations from a known one. However, efficiency, flexibility and objectives of current methods do not suit the whole spectrum of applications, genome sizes and organizations. Innovative approaches are still needed. Hence, we propose an alternative way of comparing multiple genomes based on segmentation by similarity. In this framework, rather than being formulated as a complex optimization problem, genome comparison is seen as a segmentation question for which a single optimal solution can be found in almost linear time. We apply our method to analyse three strains of a virulent pathogenic bacteria, Ehrlichia ruminantium, and identify 92 new genes. We also find out that a substantial number of genes thought to be strain specific have potential orthologs in the other strains. Our solution is implemented in an efficient program, qod, equipped with a user-friendly interface, and enables the automatic transfer of annotations between compared genomes or contigs (Video in Supplementary Data). Because it somehow disregards the relative order of genomic blocks, qod can handle unfinished genomes, which due to the difficulty of sequencing completion may become an interesting characteristic for the future. Availabilty: http://www.atgc-montpellier.fr/qod.
| S-EPMC3159434 | biostudies-literature
Project description:Studies of the neural basis of human pain processing present many challenges because of the subjective and variable nature of pain, and the inaccessibility of the central nervous system. Neuroimaging methods, such as functional magnetic resonance imaging (fMRI), have provided the ability to investigate these neural processes, and yet commonly used analysis methods may not be optimally adapted for studies of pain. Here we present a comparison of model-driven and data-driven analysis methods, specifically for the study of human pain processing. Methods are tested using data from healthy control participants in two previous studies, with separate data sets spanning the brain, and the brainstem and spinal cord. Data are analyzed by fitting time-series responses to predicted BOLD responses in order to identify significantly responding regions (model-driven), as well as with connectivity analyses (data-driven) based on temporal correlations between responses in spatially separated regions, and with connectivity analyses based on structural equation modeling, allowing for multiple source regions to explain the signal variations in each target region. The results are assessed in terms of the amount of signal variance that can be explained in each region, and in terms of the regions and connections that are identified as having BOLD responses of interest. The characteristics of BOLD responses in identified regions are also investigated. The results demonstrate that data-driven approaches are more effective than model-driven approaches for fMRI studies of pain.
| S-EPMC7735591 | biostudies-literature
Project description:Although sex differences in psychiatric disorders abound, few neuropsychopharmacology (NPP) studies consider sex as a biological variable (SABV). We conducted a scoping review of this literature in humans by systematically searching PubMed to identify peer-reviewed journal articles published before March 2020 that (1) studied FDA-approved medications used to treat psychiatric disorders (or related symptoms) and (2) adequately evaluated sex differences using in vivo neuroimaging methodologies. Of the 251 NPP studies that included both sexes and considered SABV in analyses, 80% used methodologies that eliminated the effect of sex (e.g., by including sex as a covariate to control for its effect). Only 20% (50 studies) adequately evaluated sex differences either by testing for an interaction involving sex or by stratifying analyses by sex. Of these 50 studies, 72% found statistically significant sex differences in at least one outcome. Sex differences in neural and behavioral outcomes were studied more often in drugs indicated for conditions with known sex differences. Likewise, the majority of studies conducted in those drug classes noted sex differences: antidepressants (13 of 16), antipsychotics (10 of 12), sedative-hypnotics (6 of 10), and stimulants (6 of 10). In contrast, only two studies of mood stabilizers evaluated SABV, with one noting a sex difference. By mapping this literature, we bring into sharp relief how few studies adequately evaluate sex differences in NPP studies. Currently, all NIH-funded studies are required to consider SABV. We urge scientific journals, peer reviewers, and regulatory agencies to require researchers to consider SABV in their research. Continuing to ignore SABV in NPP research has ramifications both in terms of rigor and reproducibility of research, potentially leading to costly consequences and unrealized benefits.
| S-EPMC8674314 | biostudies-literature
Project description:Eyeblinks and other large artifacts can create two major problems in event-related potential (ERP) research, namely confounds and increased noise. Here, we developed a method for assessing the effectiveness of artifact correction and rejection methods at minimizing these two problems. We then used this method to assess a common artifact minimization approach, in which independent component analysis (ICA) is used to correct ocular artifacts, and artifact rejection is used to reject trials with extreme values resulting from other sources (e.g., movement artifacts). This approach was applied to data from five common ERP components (P3b, N400, N170, mismatch negativity, and error-related negativity). Four common scoring methods (mean amplitude, peak amplitude, peak latency, and 50% area latency) were examined for each component. We found that eyeblinks differed systematically across experimental conditions for several of the components. We also found that artifact correction was reasonably effective at minimizing these confounds, although it did not usually eliminate them completely. In addition, we found that the rejection of trials with extreme voltage values was effective at reducing noise, with the benefits of eliminating these trials outweighing the reduced number of trials available for averaging. For researchers who are analyzing similar ERP components and participant populations, this combination of artifact correction and rejection approaches should minimize artifact-related confounds and lead to improved data quality. Researchers who are analyzing other components or participant populations can use the method developed in this study to determine which artifact minimization approaches are effective in their data.
| S-EPMC10516012 | biostudies-literature
Project description:In recent years, a series of scaling correction (SC) methods have been developed in the Yang laboratory to reduce and eliminate the delocalization error, which is an intrinsic and systematic error existing in conventional density functional approximations (DFAs) within density functional theory (DFT). On the basis of extensive numerical results, the SC methods have been demonstrated to be capable of reducing the delocalization error effectively and producing accurate descriptions for many critical and challenging problems, including the fundamental gap, photoemission spectroscopy, charge transfer excitations, and polarizability. In the development of SC methods, the SC methods were mainly implemented in the QM4D package that was developed in the Yang laboratory for research development. The heavy dependency on the QM4D package hinders the SC methods from access by researchers for broad applications. In this work, we developed a reliable and efficient implementation, LibSC, for the global scaling correction (GSC) method and the localized orbital scaling correction (LOSC) method. LibSC will serve as a lightweight and open-source library that can be easily accessed by the quantum chemistry community. The implementation of LibSC is carefully modularized to provide the essential functionalities for conducting calculations of the SC methods. In addition, LibSC provides simple and consistent interfaces to support multiple popular programing languages, including C, C++, and Python. In addition to the development of the library, we also integrated LibSC with two popular and open-source quantum chemistry packages, the Psi4 package and the PySCF package, which provides immediate access for general users to perform calculations with SC methods.
| S-EPMC9372917 | biostudies-literature