Test-retest reliability of functional connectivity networks during naturalistic fMRI paradigms.
Ontology highlight
ABSTRACT:
SUBMITTER: Wang J
PROVIDER: S-EPMC6867176 | biostudies-literature | 2017 Apr
REPOSITORIES: biostudies-literature
Publications
Test-retest reliability of functional connectivity networks during naturalistic fMRI paradigms.
Wang Jiahui J Ren Yudan Y Hu Xintao X Nguyen Vinh Thai VT Guo Lei L Han Junwei J Guo Christine Cong CC
Human brain mapping 20170117 4
Functional connectivity analysis has become a powerful tool for probing the human brain function and its breakdown in neuropsychiatry disorders. So far, most studies adopted resting-state paradigm to examine functional connectivity networks in the brain, thanks to its low demand and high tolerance that are essential for clinical studies. However, the test-retest reliability of resting-state connectivity measures is moderate, potentially due to its low behavioral constraint. On the other hand, na ...[more]
Similar Datasets
Project description:"Resting-state" or task-free fMRI can assess intrinsic connectivity network (ICN) integrity in health and disease, suggesting a potential for use of these methods as disease-monitoring biomarkers. Numerous analytical options are available, including model-driven ROI-based correlation analysis and model-free, independent component analysis (ICA). High test-retest reliability will be a necessary feature of a successful ICN biomarker, yet available reliability data remains limited. Here, we examined ICN fMRI test-retest reliability in 24 healthy older subjects scanned roughly one year apart. We focused on the salience network, a disease-relevant ICN not previously subjected to reliability analysis, as well as the default mode network. Most ICN analytical methods proved reliable (intraclass coefficients>0.4) and were further improved by wavelet analysis. Seed-based ROI correlation analysis showed high scan-wise reliability, whereas graph theoretical analysis and temporal concatenation group ICA proved most reliable at the individual unit-wise level (voxels, ROIs). Including global signal regression in ROI-based correlation analyses reduced reliability. Our study provides a direct comparison between the most commonly used ICN fMRI methods and potential guidelines for measuring intrinsic connectivity in aging control and patient populations over time.
| S-EPMC4226138 | biostudies-other
Project description:Resting functional MRI studies of the infant brain are increasingly becoming an important tool in developmental neuroscience. Whereas the test-retest reliability of functional connectivity (FC) measures derived from resting fMRI data have been characterized in the adult and child brain, similar assessments have not been conducted in infants. In this study, we examined the intra-session test-retest reliability of FC measures from 119 infant brain MRI scans from four neurodevelopmental studies. We investigated edge-level and subject-level reliability within one MRI session (between and within runs) measured by the Intraclass correlation coefficient (ICC). First, using an atlas-based approach, we examined whole-brain connectivity as well as connectivity within two common resting fMRI networks - the default mode network (DMN) and the sensorimotor network (SMN). Second, we examined the influence of run duration, study site, and scanning manufacturer (e.g., Philips and General Electric) on ICCs. Lastly, we tested spatial similarity using the Jaccard Index from networks derived from independent component analysis (ICA). Consistent with resting fMRI studies from adults, our findings indicated poor edge-level reliability (ICC = 0.14-0.18), but moderate-to-good subject-level intra-session reliability for whole-brain, DMN, and SMN connectivity (ICC = 0.40-0.78). We also found significant effects of run duration, site, and scanning manufacturer on reliability estimates. Some ICA-derived networks showed strong spatial reproducibility (e.g., DMN, SMN, and Visual Network), and were labelled based on their spatial similarity to analogous networks measured in adults. These networks were reproducibly found across different study sites. However, other ICA-networks (e.g. Executive Control Network) did not show strong spatial reproducibility, suggesting that the reliability and/or maturational course of functional connectivity may vary by network. In sum, our findings suggest that developmental scientists may be on safe ground examining the functional organization of some major neural networks (e.g. DMN and SMN), but judicious interpretation of functional connectivity is essential to its ongoing success.
| S-EPMC8335644 | biostudies-literature
Project description:The reliability of magnetoencephalography (MEG) resting-state functional connectivity in schizophrenia (SZ) is unknown as previous research has focused on healthy controls (HC). Here, we examined reliability in 26 participants (13-SZ, 13-HC). Eyes opened and eyes closed resting-state data were collected on 4 separate occasions during 2 visits, 1 week apart. For source modeling, we used minimum norm software to apply dynamic statistical parametric mapping. Source analyses compared the following functional connectivity metrics from each data run: coherence (coh), imaginary coherence (imcoh), pairwise phase consistency (ppc), phase-locking value (plv), phase lag index (pli), weighted phase lag index (wpli), and weighted phase lag index debiased (wpli2). Intraclass correlation coefficients (ICCs) were calculated for whole brain, network, and network pair averages. For reliability, ICCs above 0.75 = excellent, above 0.60 = good, above 0.40 = fair, and below 0.40 = poor reliability. We found the reliability of these metrics varied greatly depending on frequency band, network, network pair, and participant group examined. Broadband (1-58 Hz) whole brain averages in both HC and SZ showed excellent reliability for wpli2, and good to fair reliability for ppc, plv, and coh. Broadband network averages showed excellent to good reliability across 1 hour and 1 week for coh, imcoh, ppc, plv, wpli within default mode, cognitive control, and visual networks in HC, while the same metrics had excellent to fair reliability in SZ. Regional network pair averages showed good to fair reliability for coh, ppc, plv within default mode, cognitive control and visual network pairs in HC and SZ. In general, HC had higher reliability compared to SZ, and the default mode, cognitive control, and visual networks had higher reliability compared to somatosensory and auditory networks. Similar reliability levels occurred for both eyes opened and eyes closed resting-states for most metrics. The functional connectivity metrics of coh, ppc, and plv performed best across 1 hour and 1 week in HC and SZ. We also found that SZ had reduced coh, plv, and ppc in the dmn average and pair values indicating dysconnectivity in SZ. These findings encourage collecting both eyes opened and eyes closed resting-state MEG, while demonstrating that clinical populations may differ in reliability.
| S-EPMC7772354 | biostudies-literature
Project description:Functional connectivity (FC) has become a leading method for resting-state functional magnetic resonance imaging (rs-fMRI) analysis. However, the majority of the previous studies utilized pairwise, temporal synchronization-based FC. Recently, high-order FC (HOFC) methods were proposed with the idea of computing "correlation of correlations" to capture high-level, more complex associations among the brain regions. There are two types of HOFC. The first type is topographical profile similarity-based HOFC (tHOFC) and its variant, associated HOFC (aHOFC), for capturing different levels of HOFC. Instead of measuring the similarity of the original rs-fMRI signals with the traditional FC (low-order FC, or LOFC), tHOFC measures the similarity of LOFC profiles (i.e., a set of LOFC values between a region and all other regions) between each pair of brain regions. The second type is dynamics-based HOFC (dHOFC) which defines the quadruple relationship among every four brain regions by first calculating two pairwise dynamic LOFC "time series" and then measuring their temporal synchronization (i.e., temporal correlation of the LOFC fluctuations, not the BOLD fluctuations). Applications have shown the superiority of HOFC in both disease biomarker detection and individualized diagnosis than LOFC. However, no study has been carried out for the assessment of test-retest reliability of different HOFC metrics. In this paper, we systematically evaluate the reliability of the two types of HOFC methods using test-retest rs-fMRI data from 25 (12 females, age 24.48 ± 2.55 years) young healthy adults with seven repeated scans (with interval = 3-8 days). We found that all HOFC metrics have satisfactory reliability, specifically (1) fair-to-good for tHOFC and aHOFC, and (2) fair-to-moderate for dHOFC with relatively strong connectivity strength. We further give an in-depth analysis of the biological meanings of each HOFC metric and highlight their differences compared to the LOFC from the aspects of cross-level information exchanges, within-/between-network connectivity, and modulatory connectivity. In addition, how the dynamic analysis parameter (i.e., sliding window length) affects dHOFC reliability is also investigated. Our study reveals unique functional associations characterized by the HOFC metrics. Guidance and recommendations for future applications and clinical research using HOFC are provided. This study has made a further step toward unveiling more complex human brain connectome.
| S-EPMC5539178 | biostudies-other
Project description:IntroductionStructural MRI has long been used to characterize local morphological features of the human brain. Coordination patterns of the local morphological features among regions, however, are not well understood. Here, we constructed individual-level morphological brain networks and systematically examined their topological organization and long-term test-retest reliability under different analytical schemes of spatial smoothing, brain parcellation, and network type.MethodsThis study included 57 healthy participants and all participants completed two MRI scan sessions. Individual morphological brain networks were constructed by estimating interregional similarity in the distribution of regional gray matter volume in terms of the Kullback-Leibler divergence measure. Graph-based global and nodal network measures were then calculated, followed by the statistical comparison and intra-class correlation analysis.ResultsThe morphological brain networks were highly reproducible between sessions with significantly larger similarities for interhemispheric connections linking bilaterally homotopic regions. Further graph-based analyses revealed that the morphological brain networks exhibited nonrandom topological organization of small-worldness, high parallel efficiency and modular architecture regardless of the analytical choices of spatial smoothing, brain parcellation and network type. Moreover, several paralimbic and association regions were consistently revealed to be potential hubs. Nonetheless, the three studied factors particularly spatial smoothing significantly affected quantitative characterization of morphological brain networks. Further examination of long-term reliability revealed that all the examined network topological properties showed fair to excellent reliability irrespective of the analytical strategies, but performing spatial smoothing significantly improved reliability. Interestingly, nodal centralities were positively correlated with their reliabilities, and nodal degree and efficiency outperformed nodal betweenness with respect to reliability.ConclusionsOur findings support single-subject morphological network analysis as a meaningful and reliable method to characterize structural organization of the human brain; this method thus opens a new avenue toward understanding the substrate of intersubject variability in behavior and function and establishing morphological network biomarkers in brain disorders.
| S-EPMC4782249 | biostudies-literature
Project description:Neural correlates of decision making under risk are being increasingly utilized as biomarkers of risk for substance abuse and other psychiatric disorders, treatment outcomes, and brain development. This research relies on the basic assumption that fMRI measures of decision making represent stable, trait-like individual differences. However, reliability needs to be established for each individual construct. Here we assessed long-term test-retest reliability (TRR) of regional brain activations related to decision making under risk using the Balloon Analogue Risk Taking task (BART) and identified regions with good TRRs and familial influences, an important prerequisite for the use of fMRI measures in genetic studies. A secondary goal was to examine the factors potentially affecting fMRI TRRs in one particular risk task, including the magnitude of neural activation, data analytical approaches, different methods of defining boundaries of a region, and participant motion. For the average BOLD response, reliabilities ranged across brain regions from poor to good (ICCs of 0 to 0.8, with a mean ICC of 0.17) and highest reliabilities were observed for parietal, occipital, and temporal regions. Among the regions that were of a priori theoretical importance due to their reported associations with decision making, the activation of left anterior insula and right caudate during the decision period showed the highest reliabilities (ICCs of 0.54 and 0.63, respectively). Among the regions with highest reliabilities, the right fusiform, right rostral anterior cingulate and left superior parietal regions also showed high familiality as indicated by intrapair monozygotic twin correlations (ranging from 0.66 to 0.69). Overall, regions identified by modeling the average BOLD response to a specific event type (rather than its modulation by a parametric regressor), regions including significantly activated vertices (compared to a whole parcel), and regions with greater magnitude of task-related activations showed greater reliabilities. Participant motion had a moderate negative effect on TRR. Regions activated during decision period rather than outcome period of risky decisions showed the greatest TRR and familiality. Regions with reliable activations can be utilized as neural markers of individual differences or endophenotypes in future clinical neuroscience and genetic studies of risk-taking.
| S-EPMC7846028 | biostudies-literature
Project description:Resting-state functional MRI (rs-fMRI) has emerged as a powerful tool for investigating brain functional connectivity (FC). Research in recent years has focused on assessing the reliability of FC across younger subjects within and between scan-sessions. Test-retest reliability in resting-state functional connectivity (RSFC) has not yet been examined in older adults. In this study, we investigated age-related differences in reliability and stability of RSFC across scans. In addition, we examined how global signal regression (GSR) affects RSFC reliability and stability. Three separate resting-state scans from 29 younger adults (18-35 yrs) and 26 older adults (55-85 yrs) were obtained from the International Consortium for Brain Mapping (ICBM) dataset made publically available as part of the 1000 Functional Connectomes project www.nitrc.org/projects/fcon_1000. 92 regions of interest (ROIs) with 5 cubic mm radius, derived from the default, cingulo-opercular, fronto-parietal and sensorimotor networks, were previously defined based on a recent study. Mean time series were extracted from each of the 92 ROIs from each scan and three matrices of z-transformed correlation coefficients were created for each subject, which were then used for evaluation of multi-scan reliability and stability. The young group showed higher reliability of RSFC than the old group with GSR (p-value = 0.028) and without GSR (p-value <0.001). Both groups showed a high degree of multi-scan stability of RSFC and no significant differences were found between groups. By comparing the test-retest reliability of RSFC with and without GSR across scans, we found significantly higher proportion of reliable connections in both groups without GSR, but decreased stability. Our results suggest that aging is associated with reduced reliability of RSFC which itself is highly stable within-subject across scans for both groups, and that GSR reduces the overall reliability but increases the stability in both age groups and could potentially alter group differences of RSFC.
| S-EPMC3515585 | biostudies-literature
Project description:In recent years, interest has been growing in dynamic characteristic of brain signals from resting-state functional magnetic resonance imaging (rs-fMRI). Synchrony and metastability, as neurodynamic indexes, are considered as one of methods for analyzing dynamic characteristics. Although much research has studied the analysis of neurodynamic indices, few have investigated its reliability. In this paper, the datasets from the Human Connectome Project have been used to explore the test-retest reliabilities of synchrony and metastability from multiple angles through intra-class correlation (ICC). The results showed that both of these indexes had fair test-retest reliability, but they are strongly affected by the field strength, the spatial resolution, and scanning interval, less affected by the temporal resolution. Denoising processing can help improve their ICC values. In addition, the reliability of neurodynamic indexes was affected by the node definition strategy, but these effects were not apparent. In particular, by comparing the test-retest reliability of different resting-state networks, we found that synchrony of different networks was basically stable, but the metastability varied considerably. Among these, DMN and LIM had a relatively higher test-retest reliability of metastability than other networks. This paper provides a methodological reference for exploring the brain dynamic neural activity by using synchrony and metastability in fMRI signals.
| S-EPMC8773904 | biostudies-literature
Project description:While structural network analysis consolidated the hypothesis of cerebral small vessel disease (SVD) being a disconnection syndrome, little is known about functional changes on the level of brain networks. In patients with genetically defined SVD (CADASIL, n =?41) and sporadic SVD (n =?46), we independently tested the hypothesis that functional networks change with SVD burden and mediate the effect of disease burden on cognitive performance, in particular slowing of processing speed. We further determined test-retest reliability of functional network measures in sporadic SVD patients participating in a high-frequency (monthly) serial imaging study (RUN DMC-InTENse, median: 8 MRIs per participant). Functional networks for the whole brain and major subsystems (i.e., default mode network, DMN; fronto-parietal task control network, FPCN; visual network, VN; hand somatosensory-motor network, HSMN) were constructed based on resting-state multi-band functional MRI. In CADASIL, global efficiency (a graph metric capturing network integration) of the DMN was lower in patients with high disease burden (standardized beta = -.44; p [corrected] = .035) and mediated the negative effect of disease burden on processing speed (indirect path: std. beta = -.20, p =?.047; direct path: std. beta = -.19, p =?.25; total effect: std. beta = -.39, p =?.02). The corresponding analyses in sporadic SVD showed no effect. Intraclass correlations in the high-frequency serial MRI dataset of the sporadic SVD patients revealed poor test-retest reliability and analysis of individual variability suggested an influence of age, but not disease burden, on global efficiency. In conclusion, our results suggest that changes in functional connectivity networks mediate the effect of SVD-related brain damage on cognitive deficits. However, limited reliability of functional network measures, possibly due to age-related comorbidities, impedes the analysis in elderly SVD patients.
| S-EPMC7294060 | biostudies-literature
Project description:BACKGROUND:Once considered mere noise, fMRI-based functional connectivity has become a major neuroscience tool in part due to early studies demonstrating its reliability. These fundamental studies revealed only the tip of the iceberg; over the past decade, many test-retest reliability studies have continued to add nuance to our understanding of this complex topic. A summary of these diverse and at times contradictory perspectives is needed. OBJECTIVES:We aimed to summarize the existing knowledge regarding test-retest reliability of functional connectivity at the most basic unit of analysis: the individual edge level. This entailed (1) a meta-analytic estimate of reliability and (2) a review of factors influencing reliability. METHODS:A search of Scopus was conducted to identify studies that estimated edge-level test-retest reliability. To facilitate comparisons across studies, eligibility was restricted to studies measuring reliability via the intraclass correlation coefficient (ICC). The meta-analysis included a random effects pooled estimate of mean edge-level ICC, with studies nested within datasets. The review included a narrative summary of factors influencing edge-level ICC. RESULTS:From an initial pool of 212 studies, 44 studies were identified for the qualitative review and 25 studies for quantitative meta-analysis. On average, individual edges exhibited a "poor" ICC of 0.29 (95% CI?=?0.23 to 0.36). The most reliable measurements tended to involve: (1) stronger, within-network, cortical edges, (2) eyes open, awake, and active recordings, (3) more within-subject data, (4) shorter test-retest intervals, (5) no artifact correction (likely due in part to reliable artifact), and (6) full correlation-based connectivity with shrinkage. CONCLUSION:This study represents the first meta-analysis and systematic review investigating test-retest reliability of edge-level functional connectivity. Key findings suggest there is room for improvement, but care should be taken to avoid promoting reliability at the expense of validity. By pooling existing knowledge regarding this key facet of accuracy, this study supports broader efforts to improve inferences in the field.
| S-EPMC6907736 | biostudies-literature