Reliability of brain volume measurements: a test-retest dataset.
Ontology highlight
ABSTRACT:
SUBMITTER: Maclaren J
PROVIDER: S-EPMC4411010 | biostudies-literature | 2014
REPOSITORIES: biostudies-literature
Publications
Reliability of brain volume measurements: a test-retest dataset.
Maclaren Julian J Han Zhaoying Z Vos Sjoerd B SB Fischbein Nancy N Bammer Roland R
Scientific data 20141014
Evaluation of neurodegenerative disease progression may be assisted by quantification of the volume of structures in the human brain using magnetic resonance imaging (MRI). Automated segmentation software has improved the feasibility of this approach, but often the reliability of measurements is uncertain. We have established a unique dataset to assess the repeatability of brain segmentation and analysis methods. We acquired 120 T1-weighted volumes from 3 subjects (40 volumes/subject) in 20 sess ...[more]
Similar Datasets
Project description:We present a test-retest dataset for evaluation of long-term reliability of measures from structural and resting-state functional magnetic resonance imaging (sMRI and rfMRI) scans. The repeated scan dataset was collected from 61 healthy adults in two sessions using highly similar imaging parameters at an interval of 103-189 days. However, as the imaging parameters were not completely identical, the reliability estimated from this dataset shall reflect the lower bounds of the true reliability of sMRI/rfMRI measures. Furthermore, in conjunction with other test-retest datasets, our dataset may help explore the impact of different imaging parameters on reliability of sMRI/rfMRI measures, which is especially critical for assessing datasets collected from multiple centers. In addition, intelligence quotient (IQ) was measured for each participant using Raven's Advanced Progressive Matrices. The data can thus be used for purposes other than assessing reliability of sMRI/rfMRI alone. For example, data from each single session could be used to associate structural and functional measures of the brain with the IQ metrics to explore brain-IQ association.
| S-EPMC4792176 | biostudies-literature
Project description:Structural magnetic resonance (MR) connectomics holds promise for the diagnosis, outcome prediction, and treatment monitoring of many common neurodevelopmental, psychiatric, and neurodegenerative disorders for which there is currently no clinical utility for MR imaging (MRI). Before computational network metrics from the human connectome can be applied in a clinical setting, their precision and their normative intersubject variation must be understood to guide the study design and the interpretation of longitudinal data. In this work, the reproducibility of commonly used graph theoretic measures is investigated, as applied to the structural connectome of healthy adult volunteers. Two datasets are examined, one consisting of 10 subjects scanned twice at one MRI facility and one consisting of five subjects scanned once each at two different facilities using the same imaging platform. Global graph metrics are calculated for unweighed and weighed connectomes, and two levels of granularity of the connectome are evaluated: one based on the 82-node cortical and subcortical parcellation from FreeSurfer and one based on an atlas-free parcellation of the gray-white matter boundary consisting of 1000 cortical nodes. The consistency of the unweighed and weighed edges and the module assignments are also computed for the 82-node connectomes. Overall, the results demonstrate good-to-excellent test-retest reliability for the entire connectome-processing pipeline, including the graph analytics, in both the intrasite and intersite datasets. These findings indicate that measurements of computational network metrics derived from the structural connectome have sufficient precision to be tested as potential biomarkers for diagnosis, prognosis, and monitoring of interventions in neurological and psychiatric diseases.
| S-EPMC3634151 | biostudies-literature
Project description:Despite the widespread use of the HEXACO model as a descriptive taxonomy of personality traits, there remains limited information on the test-retest reliability of its commonly-used inventories. Studies typically report internal consistency estimates, such as alpha or omega, but there are good reasons to believe that these do not accurately assess reliability. We report 13-day test-retest correlations of the 100- and 60-item English HEXACO Personality Inventory-Revised (HEXACO-100 and HEXACO-60) domains, facets, and items. In order to test the validity of test-retest reliability, we then compare these estimates to correlations between self- and informant-reports (i.e., cross-rater agreement), a widely-used validity criterion. Median estimates of test-retest reliability were .88, .81, and .65 (N = 416) for domains, facets, and items, respectively. Facets' and items' test-retest reliabilities were highly correlated with their cross-rater agreement estimates, whereas internal consistencies were not. Overall, the HEXACO Personality Inventory-Revised demonstrates test-retest reliability similar to other contemporary measures. We recommend that short-term retest reliability should be routinely calculated to assess reliability.
| S-EPMC8757920 | biostudies-literature
Project description:Background and purpose: Large MRI studies often pool data gathered from widely varying imaging sequences. Pooled data creates a potential source of variation in structural analyses which may cause misinterpretation of findings. The purpose of this study is to determine if data acquired using different scan sequences, head coils and scanners offers consistent structural measurements. Materials and methods: Participants (163 right-handed males: 82 typically developing controls, 81 participants with autism spectrum disorder) were scanned on the same day using an MPRAGE sequence with a 12-channel headcoil on a Siemens 3T Trio scanner and an MP2RAGE sequence with a 64-channel headcoil on a Siemens 3T Prisma scanner. Segmentation was performed using FreeSurfer to identify regions exhibiting variation between sequences on measures of volume, surface area, and cortical thickness. Intraclass correlation coefficient (ICC) and mean percent difference (MPD) were used as test-retest reproducibility measures. Results: ICC for total brain segmented volume yielded a 0.99 intraclass correlation, demonstrating high overall volumetric reproducibility. Comparison of individual regions of interest resulted in greater variation. Volumetric variability, although low overall, was greatest in the entorhinal cortex (ICC = 0.71), frontal (ICC = 0.60) and temporal (ICC = 0.60) poles. Surface area variability was greatest in the insula (ICC = 0.65), temporal (ICC = 0.64) and frontal (ICC = 0.68) poles. Cortical thickness was most variable in the frontal (ICC = 0.41) and temporal (ICC = 0.35) poles. Conclusion: Data collected on different scanners and head coils using MPRAGE and MP2RAGE are generally consistent for surface area and volume estimates. However, regional variability may constrain accuracy in some regions and cortical thickness measurements exhibit higher generalized variability.
| S-EPMC9409374 | biostudies-literature
Project description:IntroductionThe human brain could be modeled as a complex network via functional magnetic resonance imaging (fMRI), and the architecture of these brain functional networks can be studied from multiple spatial scales with different graph theory tools. Detecting modules is an important mesoscale network measuring approach that has provided crucial insights for uncovering how brain organizes itself among different functional subsystems. Despite its successful application in a wide range of brain network studies, the lack of comprehensive reliability assessment prevents its potential extension to clinical trials.MethodsTo fill this gap, this paper, using resting-state test-retest fMRI data, systematically explored the reliabilities of five popular network metrics derived from modular structure. Considering the repeatability of network partition depends heavily on network size and module detection algorithm, we constructed three types of brain functional networks for each subject by using a set of coarse-to-fine brain atlases and adopted four methods for single-subject module detection and twelve methods for group-level module detection.ResultsThe results reported moderate-to-good reliability in modularity, intra- and inter-modular functional connectivities, within-modular degree and participation coefficient at both individual and group levels, indicating modular-relevant network metrics can provide robust evaluation results. Further analysis identified the significant influence of module detection algorithm and node definition approach on reliabilities of network partitions and its derived network analysis results.DiscussionThis paper provides important guidance for choosing reliable modular-relevant network metrics and analysis strategies in future studies.
| S-EPMC9770801 | biostudies-literature
Project description:In the last decade, many studies have used automated processes to analyze magnetic resonance imaging (MRI) data such as cortical thickness, which is one indicator of neuronal health. Due to the convenience of image processing software (e.g., FreeSurfer), standard practice is to rely on automated results without performing visual inspection of intermediate processing. In this work, structural MRIs of 40 healthy controls who were scanned twice were used to determine the test-retest reliability of FreeSurfer-derived cortical measures in four groups of subjects-those 25 that passed visual inspection (approved), those 15 that failed visual inspection (disapproved), a combined group, and a subset of 10 subjects (Travel) whose test and retest scans occurred at different sites. Test-retest correlation (TRC), intraclass correlation coefficient (ICC), and percent difference (PD) were used to measure the reliability in the Destrieux and Desikan-Killiany (DK) atlases. In the approved subjects, reliability of cortical thickness/surface area/volume (DK atlas only) were: TRC (0.82/0.88/0.88), ICC (0.81/0.87/0.88), PD (0.86/1.19/1.39), which represent a significant improvement over these measures when disapproved subjects are included. Travel subjects' results show that cortical thickness reliability is more sensitive to site differences than the cortical surface area and volume. To determine the effect of visual inspection on sample size required for studies of MRI-derived cortical thickness, the number of subjects required to show group differences was calculated. Significant differences observed across imaging sites, between visually approved/disapproved subjects, and across regions with different sizes suggest that these measures should be used with caution.
| S-EPMC4545736 | biostudies-literature
Project description:BackgroundVarious neurological and psychological disorders are related to cortical volume changes in specific brain regions, which can be measured in vivo using structural magnetic resonance imaging (sMRI). There is an increasing interest in MRI studies using rat models, especially in longitudinal studies of brain disorders and pharmacologic interventions. However, morphometric changes observed in sMRI are only meaningful if the measurements are reliable. To date, a systematic evaluation of the test-retest reliability of the morphometric measures in the rat brain is still lacking.New methodWe rigorously evaluated the test-retest reliability of morphometric measures derived from the voxel-based morphometry (VBM) analysis. 37 Sprague-Dawley rats were scanned twice at an interval of six hours and the gray matter volume was estimated using the VBM-DARTEL method. The intraclass coefficient, percent volume change and Pearson correlation coefficient were used to evaluate the reliability in 96 subregions of the rat brain.ResultsMost subregions showed excellent test-retest reliabilities within an interval of 6 h while a few regions demonstrated lower reliability, especially in the retrosplenial granular cortex. The results were consistent between different methods of reliability assessment.Comparison with existing methodTo the best of our knowledge, this is the first study to quantify the test-retest reliability of the VBM measurements of the rat brain.ConclusionAtlas-based cortical volume of the rat brain can be reliably estimated using the VBM-DARTEL method in most subregions. However, findings in subregions with lower reliability must be interpreted with caution.
| S-EPMC6461491 | biostudies-literature
Project description:Resting-state functional MRI (rs-fMRI) has emerged as a powerful tool for investigating brain functional connectivity (FC). Research in recent years has focused on assessing the reliability of FC across younger subjects within and between scan-sessions. Test-retest reliability in resting-state functional connectivity (RSFC) has not yet been examined in older adults. In this study, we investigated age-related differences in reliability and stability of RSFC across scans. In addition, we examined how global signal regression (GSR) affects RSFC reliability and stability. Three separate resting-state scans from 29 younger adults (18-35 yrs) and 26 older adults (55-85 yrs) were obtained from the International Consortium for Brain Mapping (ICBM) dataset made publically available as part of the 1000 Functional Connectomes project www.nitrc.org/projects/fcon_1000. 92 regions of interest (ROIs) with 5 cubic mm radius, derived from the default, cingulo-opercular, fronto-parietal and sensorimotor networks, were previously defined based on a recent study. Mean time series were extracted from each of the 92 ROIs from each scan and three matrices of z-transformed correlation coefficients were created for each subject, which were then used for evaluation of multi-scan reliability and stability. The young group showed higher reliability of RSFC than the old group with GSR (p-value = 0.028) and without GSR (p-value <0.001). Both groups showed a high degree of multi-scan stability of RSFC and no significant differences were found between groups. By comparing the test-retest reliability of RSFC with and without GSR across scans, we found significantly higher proportion of reliable connections in both groups without GSR, but decreased stability. Our results suggest that aging is associated with reduced reliability of RSFC which itself is highly stable within-subject across scans for both groups, and that GSR reduces the overall reliability but increases the stability in both age groups and could potentially alter group differences of RSFC.
| S-EPMC3515585 | biostudies-literature
Project description:Neural correlates of decision making under risk are being increasingly utilized as biomarkers of risk for substance abuse and other psychiatric disorders, treatment outcomes, and brain development. This research relies on the basic assumption that fMRI measures of decision making represent stable, trait-like individual differences. However, reliability needs to be established for each individual construct. Here we assessed long-term test-retest reliability (TRR) of regional brain activations related to decision making under risk using the Balloon Analogue Risk Taking task (BART) and identified regions with good TRRs and familial influences, an important prerequisite for the use of fMRI measures in genetic studies. A secondary goal was to examine the factors potentially affecting fMRI TRRs in one particular risk task, including the magnitude of neural activation, data analytical approaches, different methods of defining boundaries of a region, and participant motion. For the average BOLD response, reliabilities ranged across brain regions from poor to good (ICCs of 0 to 0.8, with a mean ICC of 0.17) and highest reliabilities were observed for parietal, occipital, and temporal regions. Among the regions that were of a priori theoretical importance due to their reported associations with decision making, the activation of left anterior insula and right caudate during the decision period showed the highest reliabilities (ICCs of 0.54 and 0.63, respectively). Among the regions with highest reliabilities, the right fusiform, right rostral anterior cingulate and left superior parietal regions also showed high familiality as indicated by intrapair monozygotic twin correlations (ranging from 0.66 to 0.69). Overall, regions identified by modeling the average BOLD response to a specific event type (rather than its modulation by a parametric regressor), regions including significantly activated vertices (compared to a whole parcel), and regions with greater magnitude of task-related activations showed greater reliabilities. Participant motion had a moderate negative effect on TRR. Regions activated during decision period rather than outcome period of risky decisions showed the greatest TRR and familiality. Regions with reliable activations can be utilized as neural markers of individual differences or endophenotypes in future clinical neuroscience and genetic studies of risk-taking.
| S-EPMC7846028 | biostudies-literature
Project description:IntroductionStructural MRI has long been used to characterize local morphological features of the human brain. Coordination patterns of the local morphological features among regions, however, are not well understood. Here, we constructed individual-level morphological brain networks and systematically examined their topological organization and long-term test-retest reliability under different analytical schemes of spatial smoothing, brain parcellation, and network type.MethodsThis study included 57 healthy participants and all participants completed two MRI scan sessions. Individual morphological brain networks were constructed by estimating interregional similarity in the distribution of regional gray matter volume in terms of the Kullback-Leibler divergence measure. Graph-based global and nodal network measures were then calculated, followed by the statistical comparison and intra-class correlation analysis.ResultsThe morphological brain networks were highly reproducible between sessions with significantly larger similarities for interhemispheric connections linking bilaterally homotopic regions. Further graph-based analyses revealed that the morphological brain networks exhibited nonrandom topological organization of small-worldness, high parallel efficiency and modular architecture regardless of the analytical choices of spatial smoothing, brain parcellation and network type. Moreover, several paralimbic and association regions were consistently revealed to be potential hubs. Nonetheless, the three studied factors particularly spatial smoothing significantly affected quantitative characterization of morphological brain networks. Further examination of long-term reliability revealed that all the examined network topological properties showed fair to excellent reliability irrespective of the analytical strategies, but performing spatial smoothing significantly improved reliability. Interestingly, nodal centralities were positively correlated with their reliabilities, and nodal degree and efficiency outperformed nodal betweenness with respect to reliability.ConclusionsOur findings support single-subject morphological network analysis as a meaningful and reliable method to characterize structural organization of the human brain; this method thus opens a new avenue toward understanding the substrate of intersubject variability in behavior and function and establishing morphological network biomarkers in brain disorders.
| S-EPMC4782249 | biostudies-literature