Test-retest reliability of fMRI during an emotion processing task: Investigating the impact of analytical approaches on ICC values.
Ontology highlight
ABSTRACT:
SUBMITTER: Heilicher M
PROVIDER: S-EPMC9245148 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Recognizing others' emotional expressions is vital for socioemotional development; impairments in this ability occur in several psychiatric disorders. Further study is needed to map the development of this ability and to evaluate its components as potential transdiagnostic endophenotypes. Before doing so, however, research is required to substantiate the test-retest reliability of scores of the face emotion identification tasks linked to developmental psychopathology. The current study estimated test-retest reliability of scores of one such task, the facial expression labeling task (FELT) among a sample of twin children (N = 157; ages 9-14). Participants completed the FELT at two visits two to five weeks apart. Participants discerned the emotion presented of faces depicting six emotions (i.e., happiness, anger, sadness, fear, surprise, and disgust) morphed with a neutral face to provide 10 levels of increasing emotional expressivity. The present study found strong test-retest reliability (Pearson r) of the FELT scores across all emotions. Results suggested that data from this task may be effectively analyzed using a latent growth curve model to estimate overall ability (i.e., intercept; r's = 0.76-0.85) and improvement as emotions become clearer (i.e., linear slope; r's = 0.69-0.83). Evidence of high test-retest reliability of this task's scores informs future developmental research and the potential identification of transdiagnostic endophenotypes for child psychopathology. (PsycINFO Database Record
| S-EPMC5568997 | biostudies-literature
Project description:Response inhibition (RI) and error monitoring (EM) are important processes of adaptive goal-directed behavior, and neural correlates of these processes are being increasingly used as transdiagnostic biomarkers of risk for a range of neuropsychiatric disorders. Potential utility of these purported biomarkers relies on the assumption that individual differences in brain activation are reproducible over time; however, available data on test-retest reliability (TRR) of task-fMRI are very mixed. This study examined TRR of RI and EM-related activations using a stop signal task in young adults (n = 56, including 27 pairs of monozygotic (MZ) twins) in order to identify brain regions with high TRR and familial influences (as indicated by MZ twin correlations) and to examine factors potentially affecting reliability. We identified brain regions with good TRR of activations related to RI (inferior/middle frontal, superior parietal, and precentral gyri) and EM (insula, medial superior frontal and dorsolateral prefrontal cortex). No subcortical regions showed significant TRR. Regions with higher group-level activation showed higher TRR; increasing task duration improved TRR; within-session reliability was weakly related to the long-term TRR; motion negatively affected TRR, but this effect was abolished after the application of ICA-FIX, a data-driven noise removal method.
| S-EPMC7875883 | biostudies-literature
Project description:In recent years, interest has been growing in dynamic characteristic of brain signals from resting-state functional magnetic resonance imaging (rs-fMRI). Synchrony and metastability, as neurodynamic indexes, are considered as one of methods for analyzing dynamic characteristics. Although much research has studied the analysis of neurodynamic indices, few have investigated its reliability. In this paper, the datasets from the Human Connectome Project have been used to explore the test-retest reliabilities of synchrony and metastability from multiple angles through intra-class correlation (ICC). The results showed that both of these indexes had fair test-retest reliability, but they are strongly affected by the field strength, the spatial resolution, and scanning interval, less affected by the temporal resolution. Denoising processing can help improve their ICC values. In addition, the reliability of neurodynamic indexes was affected by the node definition strategy, but these effects were not apparent. In particular, by comparing the test-retest reliability of different resting-state networks, we found that synchrony of different networks was basically stable, but the metastability varied considerably. Among these, DMN and LIM had a relatively higher test-retest reliability of metastability than other networks. This paper provides a methodological reference for exploring the brain dynamic neural activity by using synchrony and metastability in fMRI signals.
| S-EPMC8773904 | biostudies-literature
Project description:Functional connectivity analysis has become a powerful tool for probing the human brain function and its breakdown in neuropsychiatry disorders. So far, most studies adopted resting-state paradigm to examine functional connectivity networks in the brain, thanks to its low demand and high tolerance that are essential for clinical studies. However, the test-retest reliability of resting-state connectivity measures is moderate, potentially due to its low behavioral constraint. On the other hand, naturalistic neuroimaging paradigms, an emerging approach for cognitive neuroscience with high ecological validity, could potentially improve the reliability of functional connectivity measures. To test this hypothesis, we characterized the test-retest reliability of functional connectivity measures during a natural viewing condition, and benchmarked it against resting-state connectivity measures acquired within the same functional magnetic resonance imaging (fMRI) session. We found that the reliability of connectivity and graph theoretical measures of brain networks is significantly improved during natural viewing conditions over resting-state conditions, with an average increase of almost 50% across various connectivity measures. Not only sensory networks for audio-visual processing become more reliable, higher order brain networks, such as default mode and attention networks, but also appear to show higher reliability during natural viewing. Our results support the use of natural viewing paradigms in estimating functional connectivity of brain networks, and have important implications for clinical application of fMRI. Hum Brain Mapp 38:2226-2241, 2017. © 2017 Wiley Periodicals, Inc.
| S-EPMC6867176 | biostudies-literature
Project description:Recent studies found low test-retest reliability in functional magnetic resonance imaging (fMRI), raising serious concerns among researchers, but these studies mostly focused on the reliability of individual fMRI features (e.g., individual connections in resting state connectivity maps). Meanwhile, neuroimaging researchers increasingly employ multivariate predictive models that aggregate information across a large number of features to predict outcomes of interest, but the test-retest reliability of predicted outcomes of these models has not previously been systematically studied. Here we apply 10 predictive modeling methods to resting state connectivity maps from the Human Connectome Project dataset to predict 61 outcome variables. Compared with mean reliability of individual resting state connections, we find mean reliability of the predicted outcomes of predictive models is substantially higher for all 10 modeling methods assessed. Moreover, improvement was consistently observed across all scanning and processing choices (i.e., scan lengths, censoring thresholds, volume- vs. surface-based processing). For the most reliable methods, the reliability of predicted outcomes was mostly, though not exclusively, in the "good" range (above 0.60). Finally, we identified three mechanisms that help to explain why predicted outcomes of predictive models have higher reliability than individual imaging features. We conclude that researchers can potentially achieve higher test-retest reliability by making greater use of predictive models.
| S-EPMC8599720 | biostudies-literature
Project description:We examined the reliability of measures of fMRI, subjective, and cardiovascular reactions to standardized versions of a Stroop color-word task and a multisource interference task. A sample of 14 men and 12 women (30-49 years old) completed the tasks on two occasions, separated by a median of 88 days. The reliability of fMRI BOLD signal changes in brain areas engaged by the tasks was moderate, and aggregating fMRI BOLD signal changes across the tasks improved test-retest reliability metrics. These metrics included voxel-wise intraclass correlation coefficients (ICCs) and overlap ratio statistics. Task-aggregated ratings of subjective arousal, valence, and control, as well as cardiovascular reactions evoked by the tasks showed ICCs of 0.57 to 0.87 (ps < .001), indicating moderate-to-strong reliability. These findings support using these tasks as a battery for fMRI studies of cardiovascular reactivity.
| S-EPMC3376244 | biostudies-literature
Project description: Not available
| S-BSST373 | biostudies-other
Project description:The Illinois Agility Test (IAT) is a standard agility course used to assess and train able-bodied athletes as well as wheelchair-sport athletes and rehabilitation of wheelchair users. It has been shown to be a reliable and valid tool to assess the able-bodied population, but the reliability of this test for assessing wheelchair propulsion has never been shown. The purpose of this study is to investigate the test-retest reliability of IAT to assess wheelchair propulsion. In this paper, the test-retest reliability of using IAT for wheelchair users is found for peak and average velocity, acceleration, tangential and total force of the push, each for the left and the right wheel. Each of these variables was found for thirty-two decisive points throughout the IAT path. The Intra-class Correlation Coefficient (ICC) was found to be very strong for 15 out of 16 variables. The average ICC was 89% and the average 95% confidence interval was [44% 96%]. In addition, thirty-seven other significant propulsion parameters were found that are clinically important, such as the number of pushes participants take to go around cones on the right, relative to turning around the cones on the left. Also, all thirty-seven variables were compared between the two sessions using four separate MANOVAs; the results showed no significant difference between IAT performed in the two sessions which were at least one week apart. This, in turn, backs the reliability of IAT for wheelchair users. These results are sufficient evidence to show that IAT is a reliable tool to test wheelchair agility for fifteen variables tested for non-wheelchair users. Since experienced wheelchair users are much more consistent in wheelchair propulsion compared to non-wheelchair-users, the results of this study show that IAT can be used as a reliable tool to assess and train wheelchair users, both for clinical and athletic applications.
| S-EPMC7595385 | biostudies-literature
Project description:Trait stability of measures is an essential requirement for individual differences research. Functional MRI has been increasingly used in studies that rely on the assumption of trait stability, such as attempts to relate task related brain activation to individual differences in behavior and psychopathology. However, recent research using adult samples has questioned the trait stability of task-fMRI measures, as assessed by test-retest correlations. To date, little is known about trait stability of task fMRI in children. Here, we examined within-session reliability and long-term stability of individual differences in task-fMRI measures using fMRI measures of brain activation provided by the adolescent brain cognitive development (ABCD) Study Release v4.0 as an individual's average regional activity, using its tasks focused on reward processing, response inhibition, and working memory. We also evaluated the effects of factors potentially affecting reliability and stability. Reliability and stability (quantified as the ratio of non-scanner related stable variance to all variances) was poor in virtually all brain regions, with an average value of 0.088 and 0.072 for short term (within-session) reliability and long-term (between-session) stability, respectively, in regions of interest (ROIs) historically-recruited by the tasks. Only one reliability or stability value in ROIs exceeded the 'poor' cut-off of 0.4, and in fact rarely exceeded 0.2 (only 4.9%). Motion had a pronounced effect on estimated reliability/stability, with the lowest motion quartile of participants having a mean reliability/stability 2.5 times higher (albeit still 'poor') than the highest motion quartile. Poor reliability and stability of task-fMRI, particularly in children, diminishes potential utility of fMRI data due to a drastic reduction of effect sizes and, consequently, statistical power for the detection of brain-behavior associations. This essential issue urgently needs to be addressed through optimization of task design, scanning parameters, data acquisition protocols, preprocessing pipelines, and data denoising methods.
| S-EPMC9017319 | biostudies-literature
Project description:Neural correlates of decision making under risk are being increasingly utilized as biomarkers of risk for substance abuse and other psychiatric disorders, treatment outcomes, and brain development. This research relies on the basic assumption that fMRI measures of decision making represent stable, trait-like individual differences. However, reliability needs to be established for each individual construct. Here we assessed long-term test-retest reliability (TRR) of regional brain activations related to decision making under risk using the Balloon Analogue Risk Taking task (BART) and identified regions with good TRRs and familial influences, an important prerequisite for the use of fMRI measures in genetic studies. A secondary goal was to examine the factors potentially affecting fMRI TRRs in one particular risk task, including the magnitude of neural activation, data analytical approaches, different methods of defining boundaries of a region, and participant motion. For the average BOLD response, reliabilities ranged across brain regions from poor to good (ICCs of 0 to 0.8, with a mean ICC of 0.17) and highest reliabilities were observed for parietal, occipital, and temporal regions. Among the regions that were of a priori theoretical importance due to their reported associations with decision making, the activation of left anterior insula and right caudate during the decision period showed the highest reliabilities (ICCs of 0.54 and 0.63, respectively). Among the regions with highest reliabilities, the right fusiform, right rostral anterior cingulate and left superior parietal regions also showed high familiality as indicated by intrapair monozygotic twin correlations (ranging from 0.66 to 0.69). Overall, regions identified by modeling the average BOLD response to a specific event type (rather than its modulation by a parametric regressor), regions including significantly activated vertices (compared to a whole parcel), and regions with greater magnitude of task-related activations showed greater reliabilities. Participant motion had a moderate negative effect on TRR. Regions activated during decision period rather than outcome period of risky decisions showed the greatest TRR and familiality. Regions with reliable activations can be utilized as neural markers of individual differences or endophenotypes in future clinical neuroscience and genetic studies of risk-taking.
| S-EPMC7846028 | biostudies-literature