Brain-wide inferiority and equivalence tests in fMRI group analyses: Selected applications.
Ontology highlight
ABSTRACT:
SUBMITTER: Gerchen MF
PROVIDER: S-EPMC8596945 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:In recent years, there has been significant criticism of functional magnetic resonance imaging (fMRI) studies with small sample sizes. The argument is that such studies have low statistical power, as well as reduced likelihood for statistically significant results to be true effects. The prevalence of these studies has led to a situation where a large number of published results are not replicable and likely false. Despite this growing body of evidence, small sample fMRI studies continue to be regularly performed; likely due to the high cost of scanning. In this report we investigate the use of a moderated t-statistic for performing group-level fMRI analysis to help alleviate problems related to small sample sizes. The proposed approach, implemented in the popular R-package LIMMA (linear models for microarray data), has found wide usage in the genomics literature for dealing with similar issues. Utilizing task-based fMRI data from the Human Connectome Project (HCP), we compare the performance of the moderated t-statistic with the standard t-statistic, as well as the pseudo t-statistic commonly used in non-parametric fMRI analysis. We find that the moderated t-test significantly outperforms both alternative approaches for studies with sample sizes less than 40 subjects. Further, we find that the results were consistent both when using voxel-based and cluster-based thresholding. We also introduce an R-package, LIMMI (linear models for medical images), that provides a quick and convenient way to apply the method to fMRI data.
| S-EPMC8295929 | biostudies-literature
Project description:We consider the non-inferiority (or equivalence) test of the odds ratio (OR) in a crossover study with binary outcomes to evaluate the treatment effects of two drugs. To solve this problem, Lui and Chang (2011) proposed both an asymptotic method and a conditional method based on a random effects logit model. Kenward and Jones (1987) proposed a likelihood ratio test (LRTM ) based on a log linear model. These existing methods are all subject to model misspecification. In this paper, we propose a likelihood ratio test (LRT) and a score test that are independent of model specification. Monte Carlo simulation studies show that, in scenarios considered in this paper, both the LRT and the score test have higher power than the asymptotic and conditional methods for the non-inferiority test; the LRT, score, and asymptotic methods have similar power, and they all have higher power than the conditional method for the equivalence test. When data can be well described by a log linear model, the LRTM has the highest power among all the five methods (LRTM , LRT, score, asymptotic, and conditional) for both non-inferiority and equivalence tests. However, in scenarios for which a log linear model does not describe the data well, the LRTM has the lowest power for the non-inferiority test and has inflated type I error rates for the equivalence test. We provide an example from a clinical trial that illustrates our methods. Copyright © 2016 John Wiley & Sons, Ltd.
| S-EPMC4961621 | biostudies-literature
Project description:Brain function in "resting" state has been extensively studied with functional magnetic resonance imaging (FMRI). However, drawing valid inferences, particularly for group comparisons, is fraught with pitfalls. Differing levels of brain-wide correlations can confound group comparisons. Global signal regression (GSReg) attempts to reduce this confound and is commonly used, even though it differentially biases correlations over brain regions, potentially leading to false group differences. We propose to use average brain-wide correlations as a measure of global correlation (GCOR), and examine the circumstances under which it can be used to identify or correct for differences in global fluctuations. In the process, we show the bias induced by GSReg to be a function only of the data's covariance matrix, and use simulations to compare corrections with GCOR as covariate to GSReg under various scenarios. We find that unlike GSReg, GCOR is a conservative approach that can reduce global variations, while avoiding the introduction of false significant differences, as GSReg can. However, as with GSReg, one cannot escape the interaction effect between the grouping variable and GCOR covariate on effect size. While GCOR is a complementary measure for resting state-FMRI applicable to legacy data, it is a lesser substitute for proper level-I denoising. We also assess the applicability of GCOR to empirical data with motion-based subject grouping and compare group differences to those using GSReg. We find that, while GCOR reduced correlation differences between high and low movers, it is doubtful that motion was the sole driver behind the differences in the first place.
| S-EPMC3749702 | biostudies-literature
Project description:Blood oxygen level-dependent functional MRI (fMRI) constitutes a powerful neuroimaging technology to map brain-wide functions in response to specific sensory or cognitive tasks. However, fMRI mapping of the vestibular system, which is pivotal for our sense of balance, poses significant challenges. Physical constraints limit a subject's ability to perform motion- and balance-related tasks inside the scanner, and current stimulation techniques within the scanner are nonspecific to delineate complex vestibular nucleus (VN) pathways. Using fMRI, we examined brain-wide neural activity patterns elicited by optogenetically stimulating excitatory neurons of a major vestibular nucleus, the ipsilateral medial VN (MVN). We demonstrated robust optogenetically evoked fMRI activations bilaterally at sensorimotor cortices and their associated thalamic nuclei (auditory, visual, somatosensory, and motor), high-order cortices (cingulate, retrosplenial, temporal association, and parietal), and hippocampal formations (dentate gyrus, entorhinal cortex, and subiculum). We then examined the modulatory effects of the vestibular system on sensory processing using auditory and visual stimulation in combination with optogenetic excitation of the MVN. We found enhanced responses to sound in the auditory cortex, thalamus, and inferior colliculus ipsilateral to the stimulated MVN. In the visual pathway, we observed enhanced responses to visual stimuli in the ipsilateral visual cortex, thalamus, and contralateral superior colliculus. Taken together, our imaging findings reveal multiple brain-wide central vestibular pathways. We demonstrate large-scale modulatory effects of the vestibular system on sensory processing.
| S-EPMC6525493 | biostudies-literature
Project description:Resting-state functional magnetic resonance imaging (rs-fMRI) and other technologies have been offering evidence and insights showing that altered brain functional networks are associated with neurological illnesses such as Alzheimer's disease. Exploring brain networks of clinical populations compared to those of controls would be a key inquiry to reveal underlying neurological processes related to such illnesses. For such a purpose, group-level inference is a necessary first step in order to establish whether there are any genuinely disrupted brain subnetworks. Such an analysis is also challenging due to the high dimensionality of the parameters in a network model and high noise levels in neuroimaging data. We are still in the early stage of method development as highlighted by Varoquaux and Craddock (2013) that "there is currently no unique solution, but a spectrum of related methods and analytical strategies" to learn and compare brain connectivity. In practice the important issue of how to choose several critical parameters in estimating a network, such as what association measure to use and what is the sparsity of the estimated network, has not been carefully addressed, largely because the answers are unknown yet. For example, even though the choice of tuning parameters in model estimation has been extensively discussed in the literature, as to be shown here, an optimal choice of a parameter for network estimation may not be optimal in the current context of hypothesis testing. Arbitrarily choosing or mis-specifying such parameters may lead to extremely low-powered tests. Here we develop highly adaptive tests to detect group differences in brain connectivity while accounting for unknown optimal choices of some tuning parameters. The proposed tests combine statistical evidence against a null hypothesis from multiple sources across a range of plausible tuning parameter values reflecting uncertainty with the unknown truth. These highly adaptive tests are not only easy to use, but also high-powered robustly across various scenarios. The usage and advantages of these novel tests are demonstrated on an Alzheimer's disease dataset and simulated data.
| S-EPMC4644249 | biostudies-literature
Project description:For either the equivalence trial or the non-inferiority trial with survivor outcomes from two treatment groups, the most popular testing procedure is the extension (e.g., Wellek, A log-rank test for equivalence of two survivor functions, Biometrics, 1993; 49: 877-881) of log-rank based test under proportional hazards model. We show that the actual type I error rate for the popular procedure of Wellek is higher than the intended nominal rate when survival responses from two treatment arms satisfy the proportional odds survival model. When the true model is proportional odds survival model, we show that the hypothesis of equivalence of two survival functions can be formulated as a statistical hypothesis involving only the survival odds ratio parameter. We further show that our new equivalence test, formulation, and related procedures are applicable even in the presence of additional covariates beyond treatment arms, and the associated equivalence test procedures have correct type I error rates under the proportional hazards model as well as the proportional odds survival model. These results show that use of our test will be a safer statistical practice for equivalence trials of survival responses than the commonly used log-rank based tests.
| S-EPMC5557049 | biostudies-other
Project description:Functional magnetic resonance imaging (fMRI) is widely used in clinical applications to highlight brain areas involved in specific cognitive processes. Brain impairments, such as tumors, suppress the fMRI activation of the anatomical areas they invade and, thus, brain-damaged functional networks present missing links/areas of activation. The identification of the missing circuitry components is of crucial importance to estimate the damage extent. The study of functional networks associated with clinical tasks but performed by healthy individuals becomes, therefore, of paramount concern. These "healthy" networks can, indeed, be used as control networks for clinical studies. In this work we investigate the functional architecture of 20 healthy individuals performing a language task designed for clinical purposes. We unveil a common architecture persistent across all subjects under study, that we call "core" network, which involves Broca's area, Wernicke's area, the premotor area, and the pre-supplementary motor area. We study the connectivity of this circuitry by using the k-core centrality measure, and we find that three of these areas belong to the most robust structure of the functional language network for the specific task under study. Our results provide useful insights on primarily important functional connections.
| S-EPMC7006870 | biostudies-literature
Project description:BackgroundNon-inferiority and equivalence trials require tailored methodology and therefore adequate conduct and reporting is an ambitious task. The aim of our review was to assess whether the criteria recommended by the CONSORT extension were followed.MethodsWe searched the Medline database and the Cochrane Central Register for reports of randomised non-inferiority and equivalence trials published in English language. We excluded reports on bioequivalence studies, reports targeting on other than the main results of a trial, and articles of which the full-text version was not available. In total, we identified 209 reports (167 non-inferiority, 42 equivalence trials) and assessed the reporting and methodological quality using abstracted items of the CONSORT extension.ResultsHalf of the articles did not report on the method of randomisation and only a third of the trials were reported to use blinding. The non-inferiority or equivalence margin was defined in most reports (94%), but was justified only for a quarter of the trials. Sample size calculation was reported for a proportion of 90%, but the margin was taken into account in only 78% of the trials reported. Both intention-to-treat and per-protocol analysis were presented in less than half of the reports. When reporting the results, a confidence interval was given for 85% trials. A proportion of 21% of the reports presented a conclusion that was wrong or incomprehensible. Overall, we found a substantial lack of quality in reporting and conduct. The need to improve also applied to aspects generally recommended for randomised trials. The quality was partly better in high-impact journals as compared to others.ConclusionsThere are still important deficiencies in the reporting on the methodological approach as well as on results and interpretation even in high-impact journals. It seems to take more than guidelines to improve conduct and reporting of non-inferiority and equivalence trials.
| S-EPMC3554513 | biostudies-literature
Project description:Adaptive interventions (AIs) are increasingly popular in the behavioral sciences. An AI is a sequence of decision rules that specify for whom and under what conditions different intervention options should be offered, in order to address the changing needs of individuals as they progress over time. The sequential, multiple assignment, randomized trial (SMART) is a novel trial design that was developed to aid in empirically constructing effective AIs. The sequential randomizations in a SMART often yield multiple AIs that are embedded in the trial by design. Many SMARTs are motivated by scientific questions pertaining to the comparison of such embedded AIs. Existing data analytic methods and sample size planning resources for SMARTs are suitable only for superiority testing, namely for testing whether one embedded AI yields better primary outcomes on average than another. This calls for noninferiority/equivalence testing methods, because AIs are often motivated by the need to deliver support/care in a less costly or less burdensome manner, while still yielding benefits that are equivalent or noninferior to those produced by a more costly/burdensome standard of care. Here, we develop data-analytic methods and sample-size formulas for SMARTs testing the noninferiority or equivalence of one AI over another. Sample size and power considerations are discussed with supporting simulations, and online resources for sample size planning are provided. A simulated data analysis shows how to test noninferiority and equivalence hypotheses with SMART data. For illustration, we use an example from a SMART in the area of health psychology aiming to develop an AI for promoting weight loss among overweight/obese adults. (PsycINFO Database Record (c) 2020 APA, all rights reserved).
| S-EPMC7061067 | biostudies-literature
Project description:Children use numbers every day and typically receive formal mathematical training from an early age, as it is a main subject in school curricula. Despite an increase in children neuroimaging studies, a comprehensive neuropsychological model of mathematical functions in children is lacking. Using quantitative meta-analyses of functional magnetic resonance imaging (fMRI) studies, we identify concordant brain areas across articles that adhere to a set of selection criteria (e.g., whole-brain analysis, coordinate reports) and report brain activity to tasks that involve processing symbolic and non-symbolic numbers with and without formal mathematical operations, which we called respectively number tasks and calculation tasks. We present data on children 14 years and younger, who solved these tasks. Results show activity in parietal (e.g., inferior parietal lobule and precuneus) and frontal (e.g., superior and medial frontal gyri) cortices, core areas related to mental-arithmetic, as well as brain regions such as the insula and claustrum, which are not typically discussed as part of mathematical problem solving models. We propose a topographical atlas of mathematical processes in children, discuss findings within a developmental constructivist theoretical model, and suggest practical methodological considerations for future studies.
| S-EPMC6969084 | biostudies-literature