Dataset Information

Looking for consistency in an uncertain world: test-retest reliability of neurophysiological and behavioral readouts in autism.

ABSTRACT:

Background

Autism spectrum disorders (ASD) are associated with altered sensory processing and perception. Scalp recordings of electrical brain activity time-locked to sensory events (event-related potentials; ERPs) provide precise information on the time-course of related altered neural activity, and can be used to model the cortical loci of the underlying neural networks. Establishing the test-retest reliability of these sensory brain responses in ASD is critical to their use as biomarkers of neural dysfunction in this population.

Methods

EEG and behavioral data were acquired from 33 children diagnosed with ASD aged 6-9.4 years old, while they performed a child-friendly task at two different time-points, separated by an average of 5.2 months. In two blocked conditions, participants responded to the occurrence of an auditory target that was either preceded or not by repeating visual stimuli. Intraclass correlation coefficients (ICCs) were used to assess test-retest reliability of measures of sensory (auditory and visual) ERPs and performance, for the two experimental conditions. To assess the degree of reliability of the variability of responses within individuals, this analysis was performed on the variance of the measurements, in addition to their means. This yielded a total of 24 measures for which ICCs were calculated.

Results

The data yielded significant good ICC values for 10 of the 24 measurements. These spanned across behavioral and ERPs data, experimental conditions, and mean as well as variance measures. Measures of the visual evoked responses accounted for a disproportionately large number of the significant ICCs; follow-up analyses suggested that the contribution of a greater number of trials to the visual compared to the auditory ERP partially accounted for this.

Conclusions

This analysis reveals that sensory ERPs and related behavior can be highly reliable across multiple measurement time-points in ASD. The data further suggest that the inter-trial and inter-participant variability reported in the ASD literature likely represents replicable individual participant neural processing differences. The stability of these neuronal readouts supports their use as biomarkers in clinical and translational studies on ASD. Given the minimum interval between test/retest sessions across our cohort, we also conclude that for the tested age-range of ~ 6 to 9.4 years, these reliability measures are valid for at least a 3-month interval. Limitations related to EEG task demands and study length in the context of a clinical trial are considered.

SUBMITTER: Beker S

PROVIDER: S-EPMC8483424 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundRhesus monkeys (Macaca mulatta) exhibit pronounced individual differences in social traits as measured by the macaque Social Responsiveness Scale-Revised. The macaque Social Responsiveness Scale was previously adapted from the Social Responsiveness Scale, an instrument designed to assess social and autistic trait variation in humans. To better understand potential biological underpinnings of this behavioral variation, we evaluated the trait-like consistency of several biological measures previously implicated in autism (e.g., arginine vasopressin, oxytocin, and their receptors, as well as ERK1/2, PTEN, and AKT(1-3) from the RAS-MAPK and PI3K-AKT pathways). We also tested which biological measures predicted macaque Social Responsiveness Scale-Revised scores.MethodsCerebrospinal fluid and blood samples were collected from N = 76 male monkeys, which, as a sample, showed a continuous distribution on the macaque Social Responsiveness Scale-Revised. In a subset of these subjects (n = 43), samples were collected thrice over a 10-month period. The following statistical tests were used: "Case 2A" intra-class correlation coefficients of consistency, principal component analysis, and general linear modeling.ResultsAll biological measures (except AKT) showed significant test-retest reliability within individuals across time points. We next performed principal component analysis on data from monkeys with complete biological measurement sets at the first time point (n = 57), to explore potential correlations between the reliable biological measures and their relationship to macaque Social Responsiveness Scale-Revised score; a three-component solution was found. Follow-up analyses revealed that cerebrospinal fluid arginine vasopressin concentration, but no other biological measure, robustly predicted individual differences in macaque Social Responsiveness Scale-Revised scores, such that monkeys with the lowest cerebrospinal fluid arginine vasopressin concentration exhibited the greatest social impairment. Finally, we confirmed that this result held in the larger study sample (in which cerebrospinal fluid arginine vasopressin values were available from n = 75 of the subjects).ConclusionsThese findings indicate that cerebrospinal fluid arginine vasopressin concentration is a stable trait-like measure and that it is linked to quantitative social trait variation in male rhesus monkeys.

Project description:BackgroundA psychometrically robust measurement instrument is prerequisite to tailor and monitor interventions aiming to improve evidence-based practice (EBP). The recently developed "Evidence-based Practice Inventory" (EBPI) questionnaire (five dimensions) provides a sound inventory for a comprehensive assessment of adherence to EBP, and identification of barriers and facilitators for EBP. The aims of this study were to establish a German language version of the EBPI and to examine the instrument's reliability in a diverse sample of healthcare professionals.MethodsThe English version of the EBPI was translated, adopted and subsequently test-retest reliability of the German language EBPI was examined in a nationwide online survey. Participants working in Germany were invited to complete the questionnaire twice. For each EBPI dimension, internal consistency reliability (Cronbach's alpha) and the relative test-retest reliability (intraclass correlation coefficient, ICC) were calculated. The standard error of measurement, limits of agreement and minimal detectable change values were estimated to quantify measurement error.ResultsA German language version of the EBPI was established. In the online survey, the EBPI was initially completed by 889 healthcare professionals. At follow-up, 344 individuals (39%) completed the questionnaire (74% female; mean work experience: 13.6 years). The ICCs for the five dimensions varied between 0.78 and 0.86. The standard error of measurement varied between 6.5 and 8.8% of the respective dimension scale range, and the limits of agreement between 24 and 37%. For internal consistency reliability, alpha varied between 0.64 and 0.90. There were neither floor nor ceiling effects, nor any other relevant feasibility issues.ConclusionsThe German language EBPI can be used to assess EBP adherence of healthcare professionals in clinical practice, and to identify barriers and facilitators for an EBP conform behaviour. Results on test-retest reliability indicate that the EBPI produces reliable scores when used for group comparisons, but the questionnaire seems insufficiently reliable for individual measurements over time. Methods of item response theory or Rasch measurement theory should be used for further evaluation and revision of the EBPI, informed by the results of this study.Trial registrationGerman Clinical Trials Register ( DRKS00013792 ). Registered 19 January 2018.

Project description:Biomarker development is currently a high priority in neurodevelopmental disorder research. For many types of biomarkers (particularly biomarkers of diagnosis), reliability over short periods is critically important. In the field of autism spectrum disorder (ASD), resting electroencephalography (EEG) power spectral densities (PSD) are well-studied for their potential as biomarkers. Classically, such data have been decomposed into pre-specified frequency bands (e.g., delta, theta, alpha, beta, and gamma). Recent technical advances, such as the Fitting Oscillations and One-Over-F (FOOOF) algorithm, allow for targeted characterization of the features that naturally emerge within an EEG PSD, permitting a more detailed characterization of the frequency band-agnostic shape of each individual's EEG PSD. Here, using two resting EEGs collected a median of 6 days apart from 22 children with ASD and 25 typically developing (TD) controls during the Feasibility Visit of the Autism Biomarkers Consortium for Clinical Trials, we estimate test-retest reliability based on the characterization of the PSD shape in two ways: (1) Using the FOOOF algorithm we estimate six parameters (offset, slope, number of peaks, and amplitude, center frequency and bandwidth of the largest alpha peak) that characterize the shape of the EEG PSD; and (2) using nonparametric functional data analyses, we decompose the shape of the EEG PSD into a reduced set of basis functions that characterize individual power spectrum shapes. We show that individuals exhibit idiosyncratic PSD signatures that are stable over recording sessions using both characterizations. Our data show that EEG activity from a brief 2-min recording provides an efficient window into characterizing brain activity at the single-subject level with desirable psychometric characteristics that persist across different analytical decomposition methods. This is a necessary step towards analytical validation of biomarkers based on the EEG PSD and provides insights into parameters of the PSD that offer short-term reliability (and thus promise as potential biomarkers of trait or diagnosis) vs. those that are more variable over the short term (and thus may index state or other rapidly dynamic measures of brain function). Future research should address the longer-term stability of the PSD, for purposes such as monitoring development or response to treatment.