Importance of test-retest reliability for promoting fMRI based screening and interventions in major depressive disorder.
Ontology highlight
ABSTRACT:
SUBMITTER: Compere L
PROVIDER: S-EPMC8272717 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:In recent years, interest has been growing in dynamic characteristic of brain signals from resting-state functional magnetic resonance imaging (rs-fMRI). Synchrony and metastability, as neurodynamic indexes, are considered as one of methods for analyzing dynamic characteristics. Although much research has studied the analysis of neurodynamic indices, few have investigated its reliability. In this paper, the datasets from the Human Connectome Project have been used to explore the test-retest reliabilities of synchrony and metastability from multiple angles through intra-class correlation (ICC). The results showed that both of these indexes had fair test-retest reliability, but they are strongly affected by the field strength, the spatial resolution, and scanning interval, less affected by the temporal resolution. Denoising processing can help improve their ICC values. In addition, the reliability of neurodynamic indexes was affected by the node definition strategy, but these effects were not apparent. In particular, by comparing the test-retest reliability of different resting-state networks, we found that synchrony of different networks was basically stable, but the metastability varied considerably. Among these, DMN and LIM had a relatively higher test-retest reliability of metastability than other networks. This paper provides a methodological reference for exploring the brain dynamic neural activity by using synchrony and metastability in fMRI signals.
| S-EPMC8773904 | biostudies-literature
Project description:Functional connectivity analysis has become a powerful tool for probing the human brain function and its breakdown in neuropsychiatry disorders. So far, most studies adopted resting-state paradigm to examine functional connectivity networks in the brain, thanks to its low demand and high tolerance that are essential for clinical studies. However, the test-retest reliability of resting-state connectivity measures is moderate, potentially due to its low behavioral constraint. On the other hand, naturalistic neuroimaging paradigms, an emerging approach for cognitive neuroscience with high ecological validity, could potentially improve the reliability of functional connectivity measures. To test this hypothesis, we characterized the test-retest reliability of functional connectivity measures during a natural viewing condition, and benchmarked it against resting-state connectivity measures acquired within the same functional magnetic resonance imaging (fMRI) session. We found that the reliability of connectivity and graph theoretical measures of brain networks is significantly improved during natural viewing conditions over resting-state conditions, with an average increase of almost 50% across various connectivity measures. Not only sensory networks for audio-visual processing become more reliable, higher order brain networks, such as default mode and attention networks, but also appear to show higher reliability during natural viewing. Our results support the use of natural viewing paradigms in estimating functional connectivity of brain networks, and have important implications for clinical application of fMRI. Hum Brain Mapp 38:2226-2241, 2017. © 2017 Wiley Periodicals, Inc.
| S-EPMC6867176 | biostudies-literature
Project description:We examined the reliability of measures of fMRI, subjective, and cardiovascular reactions to standardized versions of a Stroop color-word task and a multisource interference task. A sample of 14 men and 12 women (30-49 years old) completed the tasks on two occasions, separated by a median of 88 days. The reliability of fMRI BOLD signal changes in brain areas engaged by the tasks was moderate, and aggregating fMRI BOLD signal changes across the tasks improved test-retest reliability metrics. These metrics included voxel-wise intraclass correlation coefficients (ICCs) and overlap ratio statistics. Task-aggregated ratings of subjective arousal, valence, and control, as well as cardiovascular reactions evoked by the tasks showed ICCs of 0.57 to 0.87 (ps < .001), indicating moderate-to-strong reliability. These findings support using these tasks as a battery for fMRI studies of cardiovascular reactivity.
| S-EPMC3376244 | biostudies-literature
Project description:Recent studies found low test-retest reliability in functional magnetic resonance imaging (fMRI), raising serious concerns among researchers, but these studies mostly focused on the reliability of individual fMRI features (e.g., individual connections in resting state connectivity maps). Meanwhile, neuroimaging researchers increasingly employ multivariate predictive models that aggregate information across a large number of features to predict outcomes of interest, but the test-retest reliability of predicted outcomes of these models has not previously been systematically studied. Here we apply 10 predictive modeling methods to resting state connectivity maps from the Human Connectome Project dataset to predict 61 outcome variables. Compared with mean reliability of individual resting state connections, we find mean reliability of the predicted outcomes of predictive models is substantially higher for all 10 modeling methods assessed. Moreover, improvement was consistently observed across all scanning and processing choices (i.e., scan lengths, censoring thresholds, volume- vs. surface-based processing). For the most reliable methods, the reliability of predicted outcomes was mostly, though not exclusively, in the "good" range (above 0.60). Finally, we identified three mechanisms that help to explain why predicted outcomes of predictive models have higher reliability than individual imaging features. We conclude that researchers can potentially achieve higher test-retest reliability by making greater use of predictive models.
| S-EPMC8599720 | biostudies-literature
Project description:To date, only one study has examined test-retest reliability of resting state fMRI (R-fMRI) in children, none in clinical developing groups. Here, we assessed short-term test-retest reliability in a sample of 46 children (11-17.9 years) with attention-deficit/hyperactivity disorder (ADHD) and 57 typically developing children (TDC). Our primary test-retest reliability measure was the intraclass correlation coefficient (ICC), quantified for a range of R-fMRI metrics. We aimed to (1) survey reliability within and across diagnostic groups, and (2) compare voxel-wise ICC between groups. We found moderate-to-high ICC across all children and within groups, with higher-order functional networks showing greater ICC. Nearly all R-fMRI metrics exhibited significantly higher ICC in TDC than in children with ADHD for one or more regions. In particular, posterior cingulate and ventral precuneus exhibited group differences in ICC across multiple measures. In the context of overall moderate-to-high test-retest reliability in children, regional differences in ICC related to diagnostic groups likely reflect the underlying pathophysiology for ADHD. Our currently limited understanding of the factors contributing to inter- and intra-subject variability in ADHD underscores the need for large initiatives aimed at examining their impact on test-retest reliability in both clinical and developing populations.
| S-EPMC6989828 | biostudies-literature
Project description:"Resting-state" or task-free fMRI can assess intrinsic connectivity network (ICN) integrity in health and disease, suggesting a potential for use of these methods as disease-monitoring biomarkers. Numerous analytical options are available, including model-driven ROI-based correlation analysis and model-free, independent component analysis (ICA). High test-retest reliability will be a necessary feature of a successful ICN biomarker, yet available reliability data remains limited. Here, we examined ICN fMRI test-retest reliability in 24 healthy older subjects scanned roughly one year apart. We focused on the salience network, a disease-relevant ICN not previously subjected to reliability analysis, as well as the default mode network. Most ICN analytical methods proved reliable (intraclass coefficients>0.4) and were further improved by wavelet analysis. Seed-based ROI correlation analysis showed high scan-wise reliability, whereas graph theoretical analysis and temporal concatenation group ICA proved most reliable at the individual unit-wise level (voxels, ROIs). Including global signal regression in ROI-based correlation analyses reduced reliability. Our study provides a direct comparison between the most commonly used ICN fMRI methods and potential guidelines for measuring intrinsic connectivity in aging control and patient populations over time.
| S-EPMC4226138 | biostudies-other
Project description:Neural correlates of decision making under risk are being increasingly utilized as biomarkers of risk for substance abuse and other psychiatric disorders, treatment outcomes, and brain development. This research relies on the basic assumption that fMRI measures of decision making represent stable, trait-like individual differences. However, reliability needs to be established for each individual construct. Here we assessed long-term test-retest reliability (TRR) of regional brain activations related to decision making under risk using the Balloon Analogue Risk Taking task (BART) and identified regions with good TRRs and familial influences, an important prerequisite for the use of fMRI measures in genetic studies. A secondary goal was to examine the factors potentially affecting fMRI TRRs in one particular risk task, including the magnitude of neural activation, data analytical approaches, different methods of defining boundaries of a region, and participant motion. For the average BOLD response, reliabilities ranged across brain regions from poor to good (ICCs of 0 to 0.8, with a mean ICC of 0.17) and highest reliabilities were observed for parietal, occipital, and temporal regions. Among the regions that were of a priori theoretical importance due to their reported associations with decision making, the activation of left anterior insula and right caudate during the decision period showed the highest reliabilities (ICCs of 0.54 and 0.63, respectively). Among the regions with highest reliabilities, the right fusiform, right rostral anterior cingulate and left superior parietal regions also showed high familiality as indicated by intrapair monozygotic twin correlations (ranging from 0.66 to 0.69). Overall, regions identified by modeling the average BOLD response to a specific event type (rather than its modulation by a parametric regressor), regions including significantly activated vertices (compared to a whole parcel), and regions with greater magnitude of task-related activations showed greater reliabilities. Participant motion had a moderate negative effect on TRR. Regions activated during decision period rather than outcome period of risky decisions showed the greatest TRR and familiality. Regions with reliable activations can be utilized as neural markers of individual differences or endophenotypes in future clinical neuroscience and genetic studies of risk-taking.
| S-EPMC7846028 | biostudies-literature
Project description:Resting state functional magnetic resonance imaging (rs-fMRI) provides a powerful tool to examine large-scale neural networks in the human brain and their disturbances in neuropsychiatric disorders. Thanks to its low demand and high tolerance, resting state paradigms can be easily acquired from clinical population. However, due to the unconstrained nature, resting state paradigm is associated with excessive head movement and proneness to sleep. Consequently, the test-retest reliability of rs-fMRI measures is moderate at best, falling short of widespread use in the clinic. Here, we characterized the effect of sleep on the test-retest reliability of rs-fMRI. Using measures of heart rate variability (HRV) derived from simultaneous electrocardiogram (ECG) recording, we identified portions of fMRI data when subjects were more alert or sleepy, and examined their effects on the test-retest reliability of functional connectivity measures. When volumes of sleep were excluded, the reliability of rs-fMRI is significantly improved, and the improvement appears to be general across brain networks. The amount of improvement is robust with the removal of as much as 60% volumes of sleepiness. Therefore, test-retest reliability of rs-fMRI is affected by sleep and could be improved by excluding volumes of sleepiness as indexed by HRV. Our results suggest a novel and practical method to improve test-retest reliability of rs-fMRI measures.
| S-EPMC5420587 | biostudies-literature
Project description:Background: Major Depressive Disorder (MDD) is a moderately heritable disorder with a high lifetime prevalence. At present, laboratory blood tests to support MDD diagnosis are not available. Methods: We used a classifier approach on blood gene expression profiles of a unique set of non-medicated subjects (MDD patients and controls) to select genes of which expression is predictive for disease status. To reveal blood gene expression changes related to MDD disease, we applied a powerful ex vivo stimulus to the blood, i.e. incubation with lipopolysaccharide (LPS; 10 ng/ml blood). Results: Based on LPS-stimulated blood gene expression using whole-genome microarrays in 42 subjects (primary cohort; 21 MDD patients (mean age 42.3 years), 21 healthy controls (mean age 41.9 years)), we identified a set of genes (CAPRIN1, CLEC4A, KRT23, MLC1, PLSCR1, PROK2, ZBTB16) that serves as a molecular signature of MDD. These findings were validated for the primary cohort using an independent quantitative PCR method (P = 0.007). The difference between depressive patients and controls was confirmed (P = 0.019) in a replication cohort of 13 patients with MDD (mean age 42.8 years) and 14 controls (mean age 45.6 years). The MDD-signature score comprised of expression levels of 7 genes could discriminate depressive patients from controls with sensitivity of 76.9% and specificity of 71.8%. Conclusions: We show for the first time that molecular analysis of stimulated blood cells can be used as an endophenotype for MDD diagnosis, which is a milestone in establishing biomarkers for neuropsychiatric disorders with moderate heritability in general. Our results may provide a new entry point for following and predicting treatment outcome, as well as prediction of severity and recurrence of MDD. In total, 33 MDD patients and 34 healthy controls were analyzed using basal gene expression in whole blood, and gene expression from whole blood that was stimulated with LPS for 5-6 h, using microarrays. Patients were arbitrarily selected from all patients to serve as primary cohort (nMDD = 21 (MDD01-MDD21); nControls = 21 (Con01-Con21)), or replication cohort (nMDD = 12 (MDD22-MDD35); nControls = 13 (Con22-Con37)) using microarrays. This submission does not include Samples CON21_LPS or CON30_LPS.
2011-10-04 | E-GEOD-19738 | biostudies-arrayexpress
Project description:Visibility graphs provide a novel approach for analysing time-series data. Graph theoretical analysis of visibility graphs can provide new features for data mining applications in fMRI. However, visibility graphs features have not been used widely in the field of neuroscience. This is likely due to a lack of understanding of their robustness in the presence of noise (e.g., motion) and their test-retest reliability. In this study, we investigated visibility graph properties of fMRI data in the human connectome project (N = 1010) and tested their sensitivity to motion and test-retest reliability. We also characterised the strength of connectivity obtained using degree synchrony of visibility graphs. We found that strong correlation (r > 0.5) between visibility graph properties, such as the number of communities and average degrees, and motion in the fMRI data. The test-retest reliability (Intraclass correlation coefficient (ICC)) of graph theoretical features was high for the average degrees (0.74, 95% CI = [0.73, 0.75]), and moderate for clustering coefficient (0.43, 95% CI = [0.41, 0.44]) and average path length (0.41, 95% CI = [0.38, 0.44]). Functional connectivity between brain regions was measured by correlating the visibility graph degrees. However, the strength of correlation was found to be moderate to low (r < 0.35). These findings suggest that even small movement in fMRI data can strongly influence robustness and reliability of visibility graph features, thus, requiring robust motion correction strategies prior to data analysis. Further studies are necessary for better understanding of the potential application of visibility graph features in fMRI.
| S-EPMC11021232 | biostudies-literature