Test-retest reliability of EEG network characteristics in infants.
Ontology highlight
ABSTRACT: Introduction
Functional Electroencephalography (EEG) networks in infants have been proposed as useful biomarkers for developmental brain disorders. However, the reliability of these networks and their characteristics has not been established. We evaluated the reliability of these networks and their characteristics in 10-month-old infants.Methods
Data were obtained during two EEG sessions 1 week apart and was subsequently analyzed at delta (0.5-3 Hz), theta (3-6 Hz), alpha1 (6-9 Hz), alpha2 (9-12 Hz), beta (12-25 Hz), and low gamma (25-45 Hz) frequency bands. Connectivity matrices were created by calculating the phase lag index between all channel pairs at given frequency bands. To determine the reliability of these connectivity matrices, intra-class correlations were calculated of global connectivity, local connectivity, and several graph characteristics.Results
Comparing both sessions, global connectivity, as well as global graph characteristics (characteristic path length and average clustering coefficient) are highly reliable across multiple frequency bands; the alpha1 and theta band having the highest reliability in general. In contrast, local connectivity characteristics were less reliable across all frequency bands.Conclusions
We conclude that global connectivity measures are highly reliable over sessions. Local connectivity measures show lower reliability over sessions. This research therefore underlines the possibility of these global network characteristics to be used both as biomarkers of neurodevelopmental disorders, but also as important factors explaining development of typical behavior.
SUBMITTER: van der Velde B
PROVIDER: S-EPMC6520303 | biostudies-literature | 2019 May
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Resting functional MRI studies of the infant brain are increasingly becoming an important tool in developmental neuroscience. Whereas the test-retest reliability of functional connectivity (FC) measures derived from resting fMRI data have been characterized in the adult and child brain, similar assessments have not been conducted in infants. In this study, we examined the intra-session test-retest reliability of FC measures from 119 infant brain MRI scans from four neurodevelopmental studies. We investigated edge-level and subject-level reliability within one MRI session (between and within runs) measured by the Intraclass correlation coefficient (ICC). First, using an atlas-based approach, we examined whole-brain connectivity as well as connectivity within two common resting fMRI networks - the default mode network (DMN) and the sensorimotor network (SMN). Second, we examined the influence of run duration, study site, and scanning manufacturer (e.g., Philips and General Electric) on ICCs. Lastly, we tested spatial similarity using the Jaccard Index from networks derived from independent component analysis (ICA). Consistent with resting fMRI studies from adults, our findings indicated poor edge-level reliability (ICC = 0.14-0.18), but moderate-to-good subject-level intra-session reliability for whole-brain, DMN, and SMN connectivity (ICC = 0.40-0.78). We also found significant effects of run duration, site, and scanning manufacturer on reliability estimates. Some ICA-derived networks showed strong spatial reproducibility (e.g., DMN, SMN, and Visual Network), and were labelled based on their spatial similarity to analogous networks measured in adults. These networks were reproducibly found across different study sites. However, other ICA-networks (e.g. Executive Control Network) did not show strong spatial reproducibility, suggesting that the reliability and/or maturational course of functional connectivity may vary by network. In sum, our findings suggest that developmental scientists may be on safe ground examining the functional organization of some major neural networks (e.g. DMN and SMN), but judicious interpretation of functional connectivity is essential to its ongoing success.
| S-EPMC8335644 | biostudies-literature
Project description:Auditory evoked steady-state responses are increasingly being used as a marker of brain function and dysfunction in various neuropsychiatric disorders, but research investigating the test-retest reliability of this response is lacking. The purpose of this study was to assess the consistency of the auditory steady-state response (ASSR) across sessions. Furthermore, the current study aimed to investigate how the reliability of the ASSR is impacted by stimulus parameters and analysis method employed. The consistency of this response across two sessions spaced approximately 1 week apart was measured in nineteen healthy adults using electroencephalography (EEG). The ASSR was entrained by both 40 Hz amplitude-modulated white noise and click train stimuli. Correlations between sessions were assessed with two separate analytical techniques: a) channel-level analysis across the whole-head array and b) signal-space projection from auditory dipoles. Overall, the ASSR was significantly correlated between sessions 1 and 2 (p<0.05, multiple comparison corrected), suggesting adequate test-retest reliability of this response. The current study also suggests that measures of inter-trial phase coherence may be more reliable between sessions than measures of evoked power. Results were similar between the two analysis methods, but reliability varied depending on the presented stimulus, with click train stimuli producing more consistent responses than white noise stimuli.
| S-EPMC3899078 | biostudies-literature
Project description:Diverse psychological mechanisms have been associated with modulations of different EEG frequencies. To the extent of our knowledge, there are few studies of the test-retest reliability of these modulations in the human brain. To assess evoked and induced alpha reliabilities related to cognitive processing, EEG data from twenty subjects were recorded in 58 derivations in two different sessions separated by 49.5 ± 48.9 (mean ± standard deviation) days. A visual oddball was selected as the cognitive task, and three main parameters were analyzed for evoked and induced alpha modulations (latency, amplitude and topography). Latency and amplitude for evoked and induced modulations showed stable behavior between the two sessions. The correlation between sessions for alpha evoked and induced topographies in the grand average (group level) was r = 0.923, p<0.001; r = 0.962, p<0.001, respectively. The within-subject correlation values for evoked modulation ranged from 0.472 to 0.974 (mean: 0.766), whereas induced activity showed a different range, 0.193 to 0.892 (mean: 0.655). Individual analysis of the test-retest reliability showed a higher heterogeneity in the induced modulation, probably due to the heterogeneous phases found in the second case. However, despite this heterogeneity in phase values for induced activity relative to the onset of the stimuli, an excellent correlation score was obtained for group topography, with values that were better than those of the grand average evoked topography. As a main conclusion, induced alpha activity can be observed as a stable and reproducible response in the cognitive processing of the human brain.
| S-EPMC7511026 | biostudies-literature
Project description:IntroductionThe human brain could be modeled as a complex network via functional magnetic resonance imaging (fMRI), and the architecture of these brain functional networks can be studied from multiple spatial scales with different graph theory tools. Detecting modules is an important mesoscale network measuring approach that has provided crucial insights for uncovering how brain organizes itself among different functional subsystems. Despite its successful application in a wide range of brain network studies, the lack of comprehensive reliability assessment prevents its potential extension to clinical trials.MethodsTo fill this gap, this paper, using resting-state test-retest fMRI data, systematically explored the reliabilities of five popular network metrics derived from modular structure. Considering the repeatability of network partition depends heavily on network size and module detection algorithm, we constructed three types of brain functional networks for each subject by using a set of coarse-to-fine brain atlases and adopted four methods for single-subject module detection and twelve methods for group-level module detection.ResultsThe results reported moderate-to-good reliability in modularity, intra- and inter-modular functional connectivities, within-modular degree and participation coefficient at both individual and group levels, indicating modular-relevant network metrics can provide robust evaluation results. Further analysis identified the significant influence of module detection algorithm and node definition approach on reliabilities of network partitions and its derived network analysis results.DiscussionThis paper provides important guidance for choosing reliable modular-relevant network metrics and analysis strategies in future studies.
| S-EPMC9770801 | biostudies-literature
Project description:Computational approaches have great potential for moving neuroscience toward mechanistic models of the functional integration among brain regions. Dynamic causal modeling (DCM) offers a promising framework for inferring the effective connectivity among brain regions and thus unraveling the neural mechanisms of both normal cognitive function and psychiatric disorders. While the benefit of such approaches depends heavily on their reliability, systematic analyses of the within-subject stability are rare. Here, we present a thorough investigation of the test-retest reliability of an fMRI paradigm for DCM analysis dedicated to unraveling intra- and interhemispheric integration among the core regions of the face perception network. First, we examined the reliability of face-specific BOLD activity in 25 healthy volunteers, who performed a face perception paradigm in two separate sessions. We found good to excellent reliability of BOLD activity within the DCM-relevant regions. Second, we assessed the stability of effective connectivity among these regions by analyzing the reliability of Bayesian model selection and model parameter estimation in DCM. Reliability was excellent for the negative free energy and good for model parameter estimation, when restricting the analysis to parameters with substantial effect sizes. Third, even when the experiment was shortened, reliability of BOLD activity and DCM results dropped only slightly as a function of the length of the experiment. This suggests that the face perception paradigm presented here provides reliable estimates for both conventional activation and effective connectivity measures. We conclude this paper with an outlook on potential clinical applications of the paradigm for studying psychiatric disorders. Hum Brain Mapp 37:730-744, 2016. © 2015 Wiley Periodicals, Inc.
| S-EPMC6867422 | biostudies-literature
Project description:"Resting-state" or task-free fMRI can assess intrinsic connectivity network (ICN) integrity in health and disease, suggesting a potential for use of these methods as disease-monitoring biomarkers. Numerous analytical options are available, including model-driven ROI-based correlation analysis and model-free, independent component analysis (ICA). High test-retest reliability will be a necessary feature of a successful ICN biomarker, yet available reliability data remains limited. Here, we examined ICN fMRI test-retest reliability in 24 healthy older subjects scanned roughly one year apart. We focused on the salience network, a disease-relevant ICN not previously subjected to reliability analysis, as well as the default mode network. Most ICN analytical methods proved reliable (intraclass coefficients>0.4) and were further improved by wavelet analysis. Seed-based ROI correlation analysis showed high scan-wise reliability, whereas graph theoretical analysis and temporal concatenation group ICA proved most reliable at the individual unit-wise level (voxels, ROIs). Including global signal regression in ROI-based correlation analyses reduced reliability. Our study provides a direct comparison between the most commonly used ICN fMRI methods and potential guidelines for measuring intrinsic connectivity in aging control and patient populations over time.
| S-EPMC4226138 | biostudies-other
Project description:Biomarker development is currently a high priority in neurodevelopmental disorder research. For many types of biomarkers (particularly biomarkers of diagnosis), reliability over short periods is critically important. In the field of autism spectrum disorder (ASD), resting electroencephalography (EEG) power spectral densities (PSD) are well-studied for their potential as biomarkers. Classically, such data have been decomposed into pre-specified frequency bands (e.g., delta, theta, alpha, beta, and gamma). Recent technical advances, such as the Fitting Oscillations and One-Over-F (FOOOF) algorithm, allow for targeted characterization of the features that naturally emerge within an EEG PSD, permitting a more detailed characterization of the frequency band-agnostic shape of each individual's EEG PSD. Here, using two resting EEGs collected a median of 6 days apart from 22 children with ASD and 25 typically developing (TD) controls during the Feasibility Visit of the Autism Biomarkers Consortium for Clinical Trials, we estimate test-retest reliability based on the characterization of the PSD shape in two ways: (1) Using the FOOOF algorithm we estimate six parameters (offset, slope, number of peaks, and amplitude, center frequency and bandwidth of the largest alpha peak) that characterize the shape of the EEG PSD; and (2) using nonparametric functional data analyses, we decompose the shape of the EEG PSD into a reduced set of basis functions that characterize individual power spectrum shapes. We show that individuals exhibit idiosyncratic PSD signatures that are stable over recording sessions using both characterizations. Our data show that EEG activity from a brief 2-min recording provides an efficient window into characterizing brain activity at the single-subject level with desirable psychometric characteristics that persist across different analytical decomposition methods. This is a necessary step towards analytical validation of biomarkers based on the EEG PSD and provides insights into parameters of the PSD that offer short-term reliability (and thus promise as potential biomarkers of trait or diagnosis) vs. those that are more variable over the short term (and thus may index state or other rapidly dynamic measures of brain function). Future research should address the longer-term stability of the PSD, for purposes such as monitoring development or response to treatment.
| S-EPMC7204836 | biostudies-literature
Project description:BACKGROUND:The DePaul Symptom Questionnaire (DSQ) was developed to provide a structured approach for collecting standardized symptomatology and health history information to allow researchers and clinicians to determine whether a patient meets the diagnostic criteria for myalgic encephalomyelitis/chronic fatigue syndrome (ME/CFS), myalgic encephalomyelitis (ME), and/or chronic fatigue syndrome (CFS). PURPOSE:The purpose of this study was to examine the test-retest reliability of the DSQ. METHODS:Test-retest reliability of the measure was examined with a sample of 26 adults self-identifying as having either ME/CFS, ME and/or CFS and 25 adults who did not self-identify as having these illnesses and were otherwise healthy controls. RESULTS:Overall, the majority of items on the DSQ exhibited good to excellent test-retest reliability, with Pearson's or kappa correlation coefficients that were 0.70 or higher. CONCLUSIONS:Thus, the present study suggests that the DSQ is a reliable diagnostic measure that can provide a standardized way of examining illness constructs and symptomatology among patients who identify as having ME/CFS, ME and/or CFS.
| S-EPMC4788471 | biostudies-other
Project description:BackgroundReliable clinical tests capable of measuring resistance are important tools for rehabilitation. One alternative that has recently increased in popularity is the use of elastic tubes, which stand out for being easy to handle, low cost, practical, and feasible.ObjectiveAnalyze the test-retest reliability of the knee extensors muscle fatigue resistance test (FRT) with elastic tubes.MethodsA total of 116 healthy young males, aged between 18 and 30 years old, participated in the study. Participants performed three pre-test stages: orientation, load presentation, and familiarization with equipment, lasting two weeks. Subsequently, they performed the FRT on two occasions (test and retest), with an interval of seven days. The reliability analyzes were performed using the intraclass correlation coefficient (ICC) with 95% confidence interval and typical measurement error (TME), also expressed as coefficient of variation (CV%).ResultsThe findings regarding the reliability of the test demonstrated satisfactory values (time: ICC = 0.66; 95%CI [0.50; 0.76]; CV(%) = 9.34; repetition: ICC = 0.61; 95%CI [0.46; 0.73], CV(%) = 13.66; rhythm: ICC = 0.52; 95%CI [0.35; 0.67], CV(%) = 10.29.ConclusionFrom the findings presented, it is concluded that the proposed clinical test with elastic tubes demonstrates evidence of acceptable values.
| S-EPMC6118382 | biostudies-literature
Project description:BackgroundNeurocognitive testing is an important concussion evaluation tool, but for neurocognitive tests to be useful, their psychometric properties must be well established. Test-retest reliability of computerized neurocognitive tests can influence their clinical utility. The reliability for a commonly used computerized neurocognitive test, CNS Vital Signs, is not well established. The purpose of this study was to examine test-retest reliability and reliable change indices for CNS Vital Signs in a healthy, physically active college population.HypothesisCNS Vital Signs yields acceptable test-retest reliability, with greater reliability between the second and third test administration compared with between the first and second administration.Study designCohort study.Level of evidenceLevel 3.MethodsForty healthy, active volunteers (16 men, 24 women; mean age, 21.05 ± 2.17 years) reported to a clinical laboratory for 3 sessions, 1 week apart. At each session, participants were administered CNS Vital Signs. Outcomes included standard scores for the following CNS Vital Signs domains: verbal memory, visual memory, psychomotor speed, cognitive flexibility, complex attention, processing speed, reaction time, executive functioning, and reasoning.ResultsParticipants performed significantly better on the second session and/or third session than they did on the first testing session on 6 of 9 neurocognitive domains. Pearson r test-retest correlations between sessions ranged from 0.11 to 0.87. Intraclass correlation coefficients ranged from 0.10 to 0.86.ConclusionClinicians should consider using reliable change indices to account for practice effects, identify meaningful score changes due to pathology, and inform clinical decisions.Clinical relevanceThis study highlights the importance of clinicians understanding the psychometric properties of computerized neurocognitive tests when using them in the management of sport-related concussion. If CNS Vital Signs is administered twice within a small time frame (such as 1 week), athletes should be expected to improve between the first and second administration.
| S-EPMC4547115 | biostudies-literature