Test-Retest Reliability of Resting Brain Small-World Network Properties across Different Data Processing and Modeling Strategies.
Ontology highlight
ABSTRACT:
SUBMITTER: Wu Q
PROVIDER: S-EPMC10216465 | biostudies-literature | 2023 May
REPOSITORIES: biostudies-literature
Publications
Test-Retest Reliability of Resting Brain Small-World Network Properties across Different Data Processing and Modeling Strategies.
Wu Qianying Q Lei Hui H Mao Tianxin T Deng Yao Y Zhang Xiaocui X Jiang Yali Y Zhong Xue X Detre John A JA Liu Jianghong J Rao Hengyi H
Brain sciences 20230519 5
Resting-state functional magnetic resonance imaging (fMRI) with graph theoretical modeling has been increasingly applied for assessing whole brain network topological organization, yet its reproducibility remains controversial. In this study, we acquired three repeated resting-state fMRI scans from 16 healthy controls during a strictly controlled in-laboratory study and examined the test-retest reliability of seven global and three nodal brain network metrics using different data processing and ...[more]
Similar Datasets
Project description:Recent studies found low test-retest reliability in functional magnetic resonance imaging (fMRI), raising serious concerns among researchers, but these studies mostly focused on the reliability of individual fMRI features (e.g., individual connections in resting state connectivity maps). Meanwhile, neuroimaging researchers increasingly employ multivariate predictive models that aggregate information across a large number of features to predict outcomes of interest, but the test-retest reliability of predicted outcomes of these models has not previously been systematically studied. Here we apply 10 predictive modeling methods to resting state connectivity maps from the Human Connectome Project dataset to predict 61 outcome variables. Compared with mean reliability of individual resting state connections, we find mean reliability of the predicted outcomes of predictive models is substantially higher for all 10 modeling methods assessed. Moreover, improvement was consistently observed across all scanning and processing choices (i.e., scan lengths, censoring thresholds, volume- vs. surface-based processing). For the most reliable methods, the reliability of predicted outcomes was mostly, though not exclusively, in the "good" range (above 0.60). Finally, we identified three mechanisms that help to explain why predicted outcomes of predictive models have higher reliability than individual imaging features. We conclude that researchers can potentially achieve higher test-retest reliability by making greater use of predictive models.
| S-EPMC8599720 | biostudies-literature
Project description:Resting-state functional connectivity analysis has become a widely used method for the investigation of human brain connectivity and pathology. The measurement of neuronal activity by functional MRI, however, is impeded by various nuisance signals that reduce the stability of functional connectivity. Several methods exist to address this predicament, but little consensus has yet been reached on the most appropriate approach. Given the crucial importance of reliability for the development of clinical applications, we here investigated the effect of various confound removal approaches on the test-retest reliability of functional-connectivity estimates in two previously defined functional brain networks. Our results showed that gray matter masking improved the reliability of connectivity estimates, whereas denoising based on principal components analysis reduced it. We additionally observed that refraining from using any correction for global signals provided the best test-retest reliability, but failed to reproduce anti-correlations between what have been previously described as antagonistic networks. This suggests that improved reliability can come at the expense of potentially poorer biological validity. Consistent with this, we observed that reliability was proportional to the retained variance, which presumably included structured noise, such as reliable nuisance signals (for instance, noise induced by cardiac processes). We conclude that compromises are necessary between maximizing test-retest reliability and removing variance that may be attributable to non-neuronal sources.
| S-EPMC5322256 | biostudies-literature
Project description:Regression dynamic causal modeling (rDCM) is a novel and computationally highly efficient method for inferring effective connectivity at the whole-brain level. While face and construct validity of rDCM have already been demonstrated, here we assessed its test-retest reliability-a test-theoretical property of particular importance for clinical applications-together with group-level consistency of connection-specific estimates and consistency of whole-brain connectivity patterns over sessions. Using the Human Connectome Project dataset for eight different paradigms (tasks and rest) and two different parcellation schemes, we found that rDCM provided highly consistent connectivity estimates at the group level across sessions. Second, while test-retest reliability was limited when averaging over all connections (range of mean intraclass correlation coefficient 0.24-0.42 over tasks), reliability increased with connection strength, with stronger connections showing good to excellent test-retest reliability. Third, whole-brain connectivity patterns by rDCM allowed for identifying individual participants with high (and in some cases perfect) accuracy. Comparing the test-retest reliability of rDCM connectivity estimates with measures of functional connectivity, rDCM performed favorably-particularly when focusing on strong connections. Generally, for all methods and metrics, task-based connectivity estimates showed greater reliability than those from the resting state. Our results underscore the potential of rDCM for human connectomics and clinical applications.
| S-EPMC8959103 | biostudies-literature
Project description:The reliability of magnetoencephalography (MEG) resting-state functional connectivity in schizophrenia (SZ) is unknown as previous research has focused on healthy controls (HC). Here, we examined reliability in 26 participants (13-SZ, 13-HC). Eyes opened and eyes closed resting-state data were collected on 4 separate occasions during 2 visits, 1 week apart. For source modeling, we used minimum norm software to apply dynamic statistical parametric mapping. Source analyses compared the following functional connectivity metrics from each data run: coherence (coh), imaginary coherence (imcoh), pairwise phase consistency (ppc), phase-locking value (plv), phase lag index (pli), weighted phase lag index (wpli), and weighted phase lag index debiased (wpli2). Intraclass correlation coefficients (ICCs) were calculated for whole brain, network, and network pair averages. For reliability, ICCs above 0.75 = excellent, above 0.60 = good, above 0.40 = fair, and below 0.40 = poor reliability. We found the reliability of these metrics varied greatly depending on frequency band, network, network pair, and participant group examined. Broadband (1-58 Hz) whole brain averages in both HC and SZ showed excellent reliability for wpli2, and good to fair reliability for ppc, plv, and coh. Broadband network averages showed excellent to good reliability across 1 hour and 1 week for coh, imcoh, ppc, plv, wpli within default mode, cognitive control, and visual networks in HC, while the same metrics had excellent to fair reliability in SZ. Regional network pair averages showed good to fair reliability for coh, ppc, plv within default mode, cognitive control and visual network pairs in HC and SZ. In general, HC had higher reliability compared to SZ, and the default mode, cognitive control, and visual networks had higher reliability compared to somatosensory and auditory networks. Similar reliability levels occurred for both eyes opened and eyes closed resting-states for most metrics. The functional connectivity metrics of coh, ppc, and plv performed best across 1 hour and 1 week in HC and SZ. We also found that SZ had reduced coh, plv, and ppc in the dmn average and pair values indicating dysconnectivity in SZ. These findings encourage collecting both eyes opened and eyes closed resting-state MEG, while demonstrating that clinical populations may differ in reliability.
| S-EPMC7772354 | biostudies-literature
Project description:In recent years, interest has been growing in dynamic characteristic of brain signals from resting-state functional magnetic resonance imaging (rs-fMRI). Synchrony and metastability, as neurodynamic indexes, are considered as one of methods for analyzing dynamic characteristics. Although much research has studied the analysis of neurodynamic indices, few have investigated its reliability. In this paper, the datasets from the Human Connectome Project have been used to explore the test-retest reliabilities of synchrony and metastability from multiple angles through intra-class correlation (ICC). The results showed that both of these indexes had fair test-retest reliability, but they are strongly affected by the field strength, the spatial resolution, and scanning interval, less affected by the temporal resolution. Denoising processing can help improve their ICC values. In addition, the reliability of neurodynamic indexes was affected by the node definition strategy, but these effects were not apparent. In particular, by comparing the test-retest reliability of different resting-state networks, we found that synchrony of different networks was basically stable, but the metastability varied considerably. Among these, DMN and LIM had a relatively higher test-retest reliability of metastability than other networks. This paper provides a methodological reference for exploring the brain dynamic neural activity by using synchrony and metastability in fMRI signals.
| S-EPMC8773904 | biostudies-literature
Project description:Resting-state functional MRI (rs-fMRI) has emerged as a powerful tool for investigating brain functional connectivity (FC). Research in recent years has focused on assessing the reliability of FC across younger subjects within and between scan-sessions. Test-retest reliability in resting-state functional connectivity (RSFC) has not yet been examined in older adults. In this study, we investigated age-related differences in reliability and stability of RSFC across scans. In addition, we examined how global signal regression (GSR) affects RSFC reliability and stability. Three separate resting-state scans from 29 younger adults (18-35 yrs) and 26 older adults (55-85 yrs) were obtained from the International Consortium for Brain Mapping (ICBM) dataset made publically available as part of the 1000 Functional Connectomes project www.nitrc.org/projects/fcon_1000. 92 regions of interest (ROIs) with 5 cubic mm radius, derived from the default, cingulo-opercular, fronto-parietal and sensorimotor networks, were previously defined based on a recent study. Mean time series were extracted from each of the 92 ROIs from each scan and three matrices of z-transformed correlation coefficients were created for each subject, which were then used for evaluation of multi-scan reliability and stability. The young group showed higher reliability of RSFC than the old group with GSR (p-value = 0.028) and without GSR (p-value <0.001). Both groups showed a high degree of multi-scan stability of RSFC and no significant differences were found between groups. By comparing the test-retest reliability of RSFC with and without GSR across scans, we found significantly higher proportion of reliable connections in both groups without GSR, but decreased stability. Our results suggest that aging is associated with reduced reliability of RSFC which itself is highly stable within-subject across scans for both groups, and that GSR reduces the overall reliability but increases the stability in both age groups and could potentially alter group differences of RSFC.
| S-EPMC3515585 | biostudies-literature
Project description:Functional hubs with disproportionately extensive connectivities play a crucial role in global information integration in human brain networks. However, most resting-state functional magnetic resonance imaging (R-fMRI) studies have identified functional hubs by examining spontaneous fluctuations of the blood oxygen level-dependent signal within a typical low-frequency band (e.g., 0.01-0.08 Hz or 0.01-0.1 Hz). Little is known about how the spatial distributions of functional hubs depend on frequency bands of interest. Here, we used repeatedly measured R-fMRI data from 53 healthy young adults and a degree centrality analysis to identify voxelwise frequency-resolved functional hubs and further examined their test-retest reliability across two sessions. We showed that a wide-range frequency band (0.01-0.24 Hz) accessible with a typical sampling rate (fsample = 0.5 Hz) could be classified into three frequency bands with distinct patterns, namely, low-frequency (LF, 0.01-0.06 Hz), middle-frequency (MF, 0.06-0.16 Hz), and high-frequency (HF, 0.16-0.24 Hz) bands. The functional hubs were mainly located in the medial and lateral frontal and parietal cortices in the LF band, and in the medial prefrontal cortex, superior temporal gyrus, parahippocampal gyrus, amygdala, and several cerebellar regions in the MF and HF bands. These hub regions exhibited fair to good test-retest reliability, regardless of the frequency band. The presence of the three frequency bands was well replicated using an independent R-fMRI dataset from 45 healthy young adults. Our findings demonstrate reliable frequency-resolved functional connectivity hubs in three categories, thus providing insights into the frequency-specific connectome organization in healthy and disordered brains.
| S-EPMC9106786 | biostudies-literature
Project description:Recent research has demonstrated the feasibility of combining functional near-infrared spectroscopy (fNIRS) and graph theory approaches to explore the topological attributes of human brain networks. However, the test-retest (TRT) reliability of the application of graph metrics to these networks remains to be elucidated. Here, we used resting-state fNIRS and a graph-theoretical approach to systematically address TRT reliability as it applies to various features of human brain networks, including functional connectivity, global network metrics and regional nodal centrality metrics. Eighteen subjects participated in two resting-state fNIRS scan sessions held ?20 min apart. Functional brain networks were constructed for each subject by computing temporal correlations on three types of hemoglobin concentration information (HbO, HbR, and HbT). This was followed by a graph-theoretical analysis, and then an intraclass correlation coefficient (ICC) was further applied to quantify the TRT reliability of each network metric. We observed that a large proportion of resting-state functional connections (?90%) exhibited good reliability (0.6< ICC <0.74). For global and nodal measures, reliability was generally threshold-sensitive and varied among both network metrics and hemoglobin concentration signals. Specifically, the majority of global metrics exhibited fair to excellent reliability, with notably higher ICC values for the clustering coefficient (HbO: 0.76; HbR: 0.78; HbT: 0.53) and global efficiency (HbO: 0.76; HbR: 0.70; HbT: 0.78). Similarly, both nodal degree and efficiency measures also showed fair to excellent reliability across nodes (degree: 0.52?0.84; efficiency: 0.50?0.84); reliability was concordant across HbO, HbR and HbT and was significantly higher than that of nodal betweenness (0.28?0.68). Together, our results suggest that most graph-theoretical network metrics derived from fNIRS are TRT reliable and can be used effectively for brain network research. This study also provides important guidance on the choice of network metrics of interest for future applied research in developmental and clinical neuroscience.
| S-EPMC3767699 | biostudies-literature
Project description:Resting state functional magnetic resonance imaging (rs-fMRI) provides a powerful tool to examine large-scale neural networks in the human brain and their disturbances in neuropsychiatric disorders. Thanks to its low demand and high tolerance, resting state paradigms can be easily acquired from clinical population. However, due to the unconstrained nature, resting state paradigm is associated with excessive head movement and proneness to sleep. Consequently, the test-retest reliability of rs-fMRI measures is moderate at best, falling short of widespread use in the clinic. Here, we characterized the effect of sleep on the test-retest reliability of rs-fMRI. Using measures of heart rate variability (HRV) derived from simultaneous electrocardiogram (ECG) recording, we identified portions of fMRI data when subjects were more alert or sleepy, and examined their effects on the test-retest reliability of functional connectivity measures. When volumes of sleep were excluded, the reliability of rs-fMRI is significantly improved, and the improvement appears to be general across brain networks. The amount of improvement is robust with the removal of as much as 60% volumes of sleepiness. Therefore, test-retest reliability of rs-fMRI is affected by sleep and could be improved by excluding volumes of sleepiness as indexed by HRV. Our results suggest a novel and practical method to improve test-retest reliability of rs-fMRI measures.
| S-EPMC5420587 | biostudies-literature
Project description:Background: As resting-state functional connectivity (rsFC) research moves toward the study of individual differences, test-retest reliability is increasingly important to understand. Previous literature supports the test-retest reliability of rsFC derived with independent component analysis (ICA) and dual regression, yet the impact of dimensionality (i.e., the number of components to extract from group-ICA) remained obscure in the current context of large-scale data sets. Methods: To provide principled guidelines on this issue, ICA at dimensionalities varying from 25 to 350 was applied to the cortical surface with resting-state functional magnetic resonance imaging data from 1003 participants in the Human Connectome Project. The reliability of two rsFC measures, (within-component) coherence and (between-component) connectivity, was estimated. Results: Reliability and its change with dimensionality varied by network: the cognitive (frontoparietal, cingulo-opercular, dorsal attention, and default) networks were measured with the highest reliability, which improved with increased dimensionality until at least 150; the visual and somatomotor networks were measured with lower reliability, which benefited mildly from increased dimensionality; and the temporal pole/orbitofrontal cortex (TP/OFC) network was measured with the lowest reliability. Overall, ICA reliability was optimized at dimensionalities of 150 or above. Compared with two popular binary, nonoverlapping cortical atlases, ICA and dual regression resulted in higher reliability for the cognitive networks, lower reliability for the somatomotor network, and similar reliability for the visual and TP/OFC networks. Discussion: These findings highlight analytical decisions that maximize the reliability of rsFC measures and how they depend on one's networks of interest. Impact statement Independent component analysis (ICA) and dual regression is a popular approach to resting-state functional connectivity (rsFC) analysis. Yet there is little consensus around the optimal ICA dimensionality, i.e., how many brain components to extract from group-ICA. We proposed that rsFC test-retest reliability is an important criterion when choosing dimensionality. The present study compares rsFC reliability across various dimensionalities in the state-of-the-art Human Connectome Project data. We also compared reliability based on ICA versus two popular brain atlases. The findings are of interest to both researchers who study brain parcellation and those who use rsFC to examine brain-behavior relationship.
| S-EPMC8817714 | biostudies-literature