Dataset Information

Reliability of structural MRI measurements: The effects of scan session, head tilt, inter-scan interval, acquisition sequence, FreeSurfer version and processing stream.

ABSTRACT:

Background

Large-scale longitudinal and multi-centre studies are used to explore neuroimaging markers of normal ageing, and neurodegenerative and mental health disorders. Longitudinal changes in brain structure are typically small, therefore the reliability of automated techniques is crucial. Determining the effects of different factors on reliability allows investigators to control those adversely affecting reliability, calculate statistical power, or even avoid particular brain measures with low reliability. This study examined the impact of several image acquisition and processing factors and documented the test-retest reliability of structural MRI measurements.

Methods

In Phase I, 20 healthy adults (11 females; aged 20-30 years) were scanned on two occasions three weeks apart on the same scanner using the ADNI-3 protocol. On each occasion, individuals were scanned twice (repetition), after re-entering the scanner (reposition) and after tilting their head forward. At one year follow-up, nine returning individuals and 11 new volunteers were recruited for Phase II (11 females; aged 22-31 years). Scans were acquired on two different scanners using the ADNI-2 and ADNI-3 protocols. Structural images were processed using FreeSurfer (v5.3.0, 6.0.0 and 7.1.0) to provide subcortical and cortical volume, cortical surface area and thickness measurements. Intra-class correlation coefficients (ICC) were calculated to estimate test-retest reliability. We examined the effect of repetition, reposition, head tilt, time between scans, MRI sequence and scanner on reliability of structural brain measurements. Mean percentage differences were also calculated in supplementary analyses.

Results

Using the FreeSurfer v7.1.0 longitudinal pipeline, we observed high reliability for subcortical and cortical volumes, and cortical surface areas at repetition, reposition, three weeks and one year (mean ICCs>0.97). Cortical thickness reliability was lower (mean ICCs>0.82). Head tilt had the greatest adverse impact on ICC estimates, for example reducing mean right cortical thickness to ICC=0.74. In contrast, changes in ADNI sequence or MRI scanner had a minimal effect. We observed an increase in reliability for updated FreeSurfer versions, with the longitudinal pipeline consistently having a higher reliability than the cross-sectional pipeline.

Discussion

Longitudinal studies should monitor or control head tilt to maximise reliability. We provided the ICC estimates and mean percentage differences for all FreeSurfer brain regions, which may inform power analyses for clinical studies and have implications for the design of future longitudinal studies.

SUBMITTER: Hedges EP

PROVIDER: S-EPMC8784825 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ObjectiveThe clinical use of Transcranial Magnetic Stimulation (TMS) as a technique to assess corticospinal excitability is limited by the time for data acquisition and the measurement variability. This study aimed at evaluating the reliability of Stimulus-Response (SR) curves acquired with a recently proposed rapid protocol on tibialis anterior muscle of healthy older adults.MethodsTwenty-four neurologically-intact adults (age:55-75 years) were recruited for this test-retest study. During each session, six SR curves, 3 at rest and 3 during isometric muscle contractions at 5% of maximum voluntary contraction (MVC), were acquired. Motor Evoked Potentials (MEPs) were normalized to the maximum peripherally evoked response; the coil position and orientation were monitored with an optical tracking system. Intra- and inter-session reliability of motor threshold (MT), area under the curve (AURC), MEPmax, stimulation intensity at which the MEP is mid-way between MEPmax and MEPmin (I50), slope in I50, MEP latency, and silent period (SP) were assessed in terms of Standard Error of Measurement (SEM), relative SEM, Minimum Detectable Change (MDC), and Intraclass Correlation Coefficient (ICC).ResultsThe relative SEM was ≤10% for MT, I50, latency and SP both at rest and 5%MVC, while it ranged between 11% and 37% for AURC, MEPmax, and slope. MDC values were overall quite large; e.g., MT required a change of 12%MSO at rest and 10%MSO at 5%MVC to be considered a real change. Inter-sessions ICC were >0.6 for all measures but slope at rest and MEPmax and latency at 5%MVC.ConclusionsMeasures derived from SR curves acquired in <4 minutes are affected by similar measurement errors to those found with long-lasting protocols, suggesting that the rapid method is at least as reliable as the traditional methods. As specifically designed to include older adults, this study provides normative data for future studies involving older neurological patients (e.g. stroke survivors).

Project description:BackgroundWorldwide, there is a large and growing group of older adults. Frailty is known as an important discriminatory factor for poor outcomes. The Clinical Frailty Scale (CFS) has become a frequently used frailty instrument in different clinical settings and health care sectors, and it has shown good predictive validity. The aims of this study were to describe and validate the translation and cultural adaptation of the CFS into Swedish (CFS-SWE), and to test the inter-rater reliability (IRR) for registered nurses using the CFS-SWE.MethodsAn observational study design was employed. The ISPOR principles were used for the translation, linguistic validation and cultural adaptation of the scale. To test the IRR, 12 participants were asked to rate 10 clinical case vignettes using the CFS-SWE. The IRR was assessed using intraclass correlation and Krippendorff's alpha agreement coefficient test.ResultsThe Clinical Frailty Scale was translated and culturally adapted into Swedish and is presented in its final form. The IRR for all raters, measured by an intraclass correlation test, resulted in an absolute agreement value among the raters of 0.969 (95% CI: 0.929-0.991) and a consistency value of 0.979 (95% CI: 0.953-0.994), which indicates excellent reliability. Krippendorff's alpha agreement coefficient for all raters was 0.969 (95% CI: 0.917-0.988), indicating near-perfect agreement. The sensitivity of the reliability was examined by separately testing the IRR of the group of specialised registered nurses and non-specialised registered nurses respectively, with consistent and similar results.ConclusionThe Clinical Frailty Scale was translated, linguistically validated and culturally adapted into Swedish following a well-established standard technique. The IRR was excellent, judged by two established, separately used, reliability tests. The reliability test results did not differ between non-specialised and specialised registered nurses. However, the use of case vignettes might reduce the generalisability of the reliability findings to real-life settings. The CFS has the potential to be a common reference tool, especially when older adults are treated and rehabilitated in different care sectors.