What Is the Test-Retest Reliability of Common Task-Functional MRI Measures? New Empirical Evidence and a Meta-Analysis.
Ontology highlight
ABSTRACT:
SUBMITTER: Elliott ML
PROVIDER: S-EPMC7370246 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Recognizing others' emotional expressions is vital for socioemotional development; impairments in this ability occur in several psychiatric disorders. Further study is needed to map the development of this ability and to evaluate its components as potential transdiagnostic endophenotypes. Before doing so, however, research is required to substantiate the test-retest reliability of scores of the face emotion identification tasks linked to developmental psychopathology. The current study estimated test-retest reliability of scores of one such task, the facial expression labeling task (FELT) among a sample of twin children (N = 157; ages 9-14). Participants completed the FELT at two visits two to five weeks apart. Participants discerned the emotion presented of faces depicting six emotions (i.e., happiness, anger, sadness, fear, surprise, and disgust) morphed with a neutral face to provide 10 levels of increasing emotional expressivity. The present study found strong test-retest reliability (Pearson r) of the FELT scores across all emotions. Results suggested that data from this task may be effectively analyzed using a latent growth curve model to estimate overall ability (i.e., intercept; r's = 0.76-0.85) and improvement as emotions become clearer (i.e., linear slope; r's = 0.69-0.83). Evidence of high test-retest reliability of this task's scores informs future developmental research and the potential identification of transdiagnostic endophenotypes for child psychopathology. (PsycINFO Database Record
| S-EPMC5568997 | biostudies-literature
Project description:Despite their wide-spread use, only limited information is available on the comparative test-retest reliability of task-based functional and resting state magnetic resonance imaging measures of blood oxygen level dependence (tb-fMRI and rs-fMRI) and cerebral blood flow (CBF) using arterial spin labeling. This information is critical to designing properly powered longitudinal studies. Here we comprehensively quantified and compared the test-retest reliability and reproducibility performance of 8 commonly applied fMRI tasks, 6 rs-fMRI metrics and CBF in 30 healthy volunteers. We find large variability in test-retest reliability performance across the different tb-fMRI paradigms and rs-fMRI metrics, ranging from poor to excellent. A larger extent of activation in tb-fMRI is linked to higher between-subject reliability of the respective task suggesting that differences in the amount of activation may be used as a first reliability estimate of novel tb-fMRI paradigms. For rs-fMRI, a good reliability of local activity estimates is paralleled by poor performance of global connectivity metrics. Evaluated CBF measures provide in general a good to excellent test-reliability matching or surpassing the best performing tb-fMRI and rs-fMRI metrics. This comprehensive effort allows for direct comparisons of test-retest reliability between the evaluated MRI domains and measures to aid the design of future tb-fMRI, rs-fMRI and CBF studies.
| S-EPMC6224062 | biostudies-literature
Project description:The YOUth cohort study is a unique longitudinal study on brain development in the general population. As part of the YOUth study, 2000 children will be included at 8, 9 or 10 years of age and planned to return every three years during adolescence. Magnetic resonance imaging (MRI) brain scans are collected, including structural T1-weighted imaging, diffusion-weighted imaging (DWI), resting-state functional MRI and task-based functional MRI. Here, we provide a comprehensive report of the MR acquisition in YOUth Child & Adolescent including the test-retest reliability of brain measures derived from each type of scan. To measure test-retest reliability, 17 adults were scanned twice with a week between sessions using the full YOUth MRI protocol. Intraclass correlation coefficients were calculated to quantify reliability. Global brain measures derived from structural T1-weighted and DWI scans were reliable. Resting-state functional connectivity was moderately reliable, as well as functional brain measures for both the inhibition task (stop versus go) and the emotion task (face versus house). Our results complement previous studies by presenting reliability results of regional brain measures collected with different MRI modalities. YOUth facilitates data sharing and aims for reliable and high-quality data. Here we show that using the state-of-the art YOUth MRI protocol brain measures can be estimated reliably.
| S-EPMC7365929 | biostudies-literature
Project description:Using healthy adult participants, seven measures of heart rate variability were obtained simultaneously from four devices in five behavioral conditions. Two devices were ECG-based and two utilized photoplethysmography. The 140 numerical values (measure, condition, device) are presented. The comparative operational reliability of the four devices was assessed, and it was found that the two ECG-base devices were more reliable than the photoplethysmographic devices. The interchangeability of devices was assessed by determining the between-device Limits of Agreement. Intraclass correlation coefficients were determined and used to calculate the standard error of measurement and the Minimal Detectable Difference. The Minimal Detectable Difference, MDD, quantifies the smallest statistically significant change in a measure and is therefore critical when HRV measures are used longitudinally to assess treatment response or disease progression.
| S-EPMC8147413 | biostudies-literature
Project description:IntroductionFunctional MRI (fMRI) is commonly used to investigate the neural mechanisms underlying psychological processes and behavioral responses. However, to draw well-founded conclusions from fMRI studies, more research on the reliability of fMRI is needed.MethodsWe invited a sample of 41 female students to participate in two identical fMRI sessions, separated by 5 weeks on average. To investigate the potential effect of left-handedness on the stability of neural activity, we oversampled left-handed participants (N = 20). Inside the scanner, we presented photographs of familiar and unfamiliar children's faces preceded by neutral and threatening primes to the participants. We calculated intraclass correlations (ICCs) to investigate the test-retest reliability of peak activity in areas that showed significant activity during the first session (primary visual cortex, fusiform face area, inferior frontal gyrus, and superior temporal gyrus). In addition, we examined how many trials were needed to reliably measure the effects.ResultsAcross all participants, only fusiform face area activity in response to faces showed good test-retest reliability (ICC = 0.71). All other test-retest reliabilities were low (0.01 ≤ ICC ≤ 0.35). Reliabilities varied only slightly with increasing numbers of trials, with no consistent increase in ICCs. Test-retest reliabilities for left-handed participants (0.28 ≤ ICC ≤0.66) were generally somewhat higher than for right-handed participants (-0.13 ≤ ICC ≤0.75), but not statistically significant.ConclusionOur study shows good test-retest reliability for fusiform facer area activity in response to faces, but low test-retest reliability for other contrasts and areas.
| S-EPMC6422824 | biostudies-literature
Project description:The present study aimed to: (1) analyze the test-retest reliability of the 30 s chair stand test and the 30 s arm curl test under dual-task conditions; (2) analyze the test-retest reliability of a new variable which assesses the total performance (cognitive + physical) in both tests. A total of 37 women with fibromyalgia participated in the study. Participants completed the 30 s arm curl test and 30 s chair stand test in both simple and dual-task conditions. These tests were repeated after seven days. In the 30 s chair stand dual-task test the reliability was low to good whereas that of the total performance variable was low to moderate. The reliability in both the 30 s arm curl dual-task test and the total performance variable were good to moderate. Both the 30 s chair stand test and 30 s arm curl test under dual-task conditions and the total performance variables had good test-retest reliability. However, it is necessary to consider the fluctuations of the intraclass correlation coefficient (ICC).
| S-EPMC6950610 | biostudies-literature
Project description:To examine the feasibility and test-retest reliability of encoding-task functional magnetic resonance imaging (fMRI) in mild Alzheimer disease (AD).Randomized, double-blind, placebo-controlled study.Memory clinical trials unit.We studied 12 patients with mild AD (mean [SEM] Mini-Mental State Examination score, 24.0 [0.7]; mean Clinical Dementia Rating score, 1.0) who had been taking donepezil hydrochloride for more than 6 months from the placebo arm of a larger 24-week study (n = 24, 4 scans on weeks 0, 6, 12, and 24, respectively).Placebo and 3 face-name, paired-associate encoding, block-design blood oxygenation level-dependent fMRI scans in 12 weeks.We performed whole-brain t maps (P < .001, 5 contiguous voxels) and hippocampal regions-of-interest analyses of extent (percentage of active voxels) and magnitude (percentage of signal change) for novel-greater-than-repeated face-name contrasts. We also calculated intraclass correlation coefficients and power estimates for hippocampal regions of interest.Task tolerability and data yield were high (95 of 96 scans yielded favorable-quality data). Whole-brain maps were stable. Right and left hippocampal regions-of-interest intraclass correlation coefficients were 0.59 to 0.87 and 0.67 to 0.74, respectively. To detect 25.0% to 50.0% changes in week-0 to week-12 hippocampal activity using left-right extent or right magnitude with 80.0% power (2-sided ? = .05) requires 14 to 51 patients. Using left magnitude requires 125 patients because of relatively small signal to variance ratios.Encoding-task fMRI was successfully implemented in a single-site, 24-week, AD randomized controlled trial. Week 0 to 12 whole-brain t maps were stable, and test-retest reliability of hippocampal fMRI measures ranged from moderate to substantial. Right hippocampal magnitude may be the most promising of these candidate measures in a leveraged context. These initial estimates of test-retest reliability and power justify evaluation of encoding-task fMRI as a potential biomarker for signal of effect in exploratory and proof-of-concept trials in mild AD. Validation of these results with larger sample sizes and assessment in multisite studies is warranted.
| S-EPMC3291175 | biostudies-literature
Project description:Vergence eye movements are the inward and outward rotation of the eyes responsible for binocular coordination. While studies have mapped and investigated the neural substrates of vergence, it is not well understood whether vergence eye movements evoke the blood oxygen level-dependent signal reliably in separate experimental visits. The test-retest reliability of stimulus-induced vergence eye movement tasks during a functional magnetic resonance imaging (fMRI) experiment is important for future randomized clinical trials (RCTs). In this study, we established region of interest (ROI) masks for the vergence neural circuit. Twenty-seven binocularly normal young adults participated in two functional imaging sessions measured on different days on the same 3T Siemens scanner. The fMRI experiments used a block design of sustained visual fixation and rest blocks interleaved between task blocks that stimulated eight or four vergence eye movements. The test-retest reliability of task-activation was assessed using the intraclass correlation coefficient (ICC), and that of spatial extent was assessed using the Dice coefficient. Functional activation during the vergence eye movement task of eight movements compared to rest was repeatable within the primary visual cortex (ICC = 0.8), parietal eye fields (ICC = 0.6), supplementary eye field (ICC = 0.5), frontal eye fields (ICC = 0.5), and oculomotor vermis (ICC = 0.6). The results demonstrate significant test-retest reliability in the ROIs of the vergence neural substrates for functional activation magnitude and spatial extent using the stimulus protocol of a task block stimulating eight vergence eye movements compared to sustained fixation. These ROIs can be used in future longitudinal RCTs to study patient populations with vergence dysfunctions.
| S-EPMC7186292 | biostudies-literature
Project description:The Balloon Analogue Risk Task (BART) provides a reliable and ecologically valid model for the assessment of individual risk-taking propensity and is frequently used in neuroimaging and developmental research. Although the test-retest reliability of risk-taking behavior during the BART is well established, the reliability of brain activation patterns in response to risk-taking during the BART remains elusive. In this study, we used functional magnetic resonance imaging (fMRI) and evaluated the test-retest reliability of brain responses in 34 healthy adults during a modified BART by calculating the intraclass correlation coefficients (ICC) and Dice's similarity coefficients (DSC). Analyses revealed that risk-induced brain activation patterns showed good test-retest reliability (median ICC = 0.62) and moderate to high spatial consistency, while brain activation patterns associated with win or loss outcomes only had poor to fair reliability (median ICC = 0.33 for win and 0.42 for loss). These findings have important implications for future utility of the BART in fMRI to examine brain responses to risk-taking and decision-making.
| S-EPMC7061333 | biostudies-literature
Project description:While structural network analysis consolidated the hypothesis of cerebral small vessel disease (SVD) being a disconnection syndrome, little is known about functional changes on the level of brain networks. In patients with genetically defined SVD (CADASIL, n =?41) and sporadic SVD (n =?46), we independently tested the hypothesis that functional networks change with SVD burden and mediate the effect of disease burden on cognitive performance, in particular slowing of processing speed. We further determined test-retest reliability of functional network measures in sporadic SVD patients participating in a high-frequency (monthly) serial imaging study (RUN DMC-InTENse, median: 8 MRIs per participant). Functional networks for the whole brain and major subsystems (i.e., default mode network, DMN; fronto-parietal task control network, FPCN; visual network, VN; hand somatosensory-motor network, HSMN) were constructed based on resting-state multi-band functional MRI. In CADASIL, global efficiency (a graph metric capturing network integration) of the DMN was lower in patients with high disease burden (standardized beta = -.44; p [corrected] = .035) and mediated the negative effect of disease burden on processing speed (indirect path: std. beta = -.20, p =?.047; direct path: std. beta = -.19, p =?.25; total effect: std. beta = -.39, p =?.02). The corresponding analyses in sporadic SVD showed no effect. Intraclass correlations in the high-frequency serial MRI dataset of the sporadic SVD patients revealed poor test-retest reliability and analysis of individual variability suggested an influence of age, but not disease burden, on global efficiency. In conclusion, our results suggest that changes in functional connectivity networks mediate the effect of SVD-related brain damage on cognitive deficits. However, limited reliability of functional network measures, possibly due to age-related comorbidities, impedes the analysis in elderly SVD patients.
| S-EPMC7294060 | biostudies-literature