Dataset Information

Potholes and molehills: bias in the diagnostic performance of diffusion-tensor imaging in concussion.

ABSTRACT:

Purpose

To investigate the extent of bias in a clinical study involving "pothole analysis" of diffusion-tensor imaging (DTI) data used to quantify white matter lesion load in diseases with a heterogeneous spatial distribution of pathologic findings, such as mild traumatic brain injury (TBI), and create a mathematical model of the bias.

Materials and methods

Use of the same reference population to define normal findings and make comparisons with a patient group introduces bias, which potentially inflates reported diagnostic performance. In this institutional review board-approved prospective observational cohort study, DTI data were obtained in 20 patients admitted to the emergency department with mild TBI and in 16 control subjects. Potholes and molehills were defined as clusters of voxels with fractional anisotropy values more than 2 standard deviations below and above the mean of the corresponding voxels in the reference population, respectively. The number and volume of potholes and molehills in the two groups were compared by using a Mann-Whitney U test.

Results

Standard analysis showed significantly more potholes in mild TBI than in the control group (102.5 ± 34.3 vs 50.6 ± 28.9, P < .001). Repeat analysis by using leave-one-out cross-validation decreased the apparent difference in potholes between groups (mild TBI group, 102.5 ± 34.3; control group, 93.4 ± 27.2; P = .369). It was demonstrated that even with 100 subjects, this bias can decrease the voxelwise false-positive rate by more than 30% in the control group.

Conclusion

The pothole approach to neuroimaging data may introduce bias, which can be minimized by independent training and test groups or cross-validation methods. This bias is sufficient to call into question the previously reported diagnostic performance of DTI for mild TBI.

SUBMITTER: Watts R

PROVIDER: S-EPMC4263643 | biostudies-literature | 2014 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Potholes and molehills: bias in the diagnostic performance of diffusion-tensor imaging in concussion.

Watts Richard R Thomas Alex A Filippi Christopher G CG Nickerson Joshua P JP Freeman Kalev K

Radiology 20140314 1

<h4>Purpose</h4>To investigate the extent of bias in a clinical study involving "pothole analysis" of diffusion-tensor imaging (DTI) data used to quantify white matter lesion load in diseases with a heterogeneous spatial distribution of pathologic findings, such as mild traumatic brain injury (TBI), and create a mathematical model of the bias.<h4>Materials and methods</h4>Use of the same reference population to define normal findings and make comparisons with a patient group introduces bias, whi ...[more]

PMID: 24635677

Similar Datasets

Project description:Myelin sensitive MRI techniques, such as diffusion tensor imaging and myelin water imaging, have previously been used to reveal changes in myelin after sports-related concussions. What is not clear from these studies, however, is how myelin is affected: whether it becomes degraded and possibly removed, or whether the myelin sheath loosens and becomes "decompacted". Previously, our team revealed myelin specific changes in ice hockey players 2 weeks post-concussion using myelin water imaging. In that study, 45 subjects underwent a pre-season baseline scan, 11 of which sustained a concussion during play and received follow-up scans: eight were scanned within 3 days, 10 were scanned at 14 days, and nine were scanned at 60 days. In the current retrospective analysis, we used quantitative susceptibility mapping, along with the diffusion tensor imaging measures axial diffusivity and radial diffusivity, to investigate this myelin disruption. If sports-related concussive hits lead to myelin fragmentation in regions of lowered MWF, this should result in a measurable increase in magnetic susceptibility, due to the anisotropic myelin fragmenting into isotropic myelin debris, and the diamagnetic myelin tissue being removed, while no such changes should be expected if the myelin sheath simply loosens and becomes decompacted. An increase in radial diffusivity would likewise reveal myelin fragmentation, as myelin sheaths block water diffusion out of the axon, with little to no changes expected for myelin sheath loosening. Statistical analysis of the same voxels-of-interest that were found to have reduced myelin water fraction 2 weeks post-concussion, revealed no statistically significant changes in magnetic susceptibility, axial diffusivity, or radial diffusivity at any time-point post-concussion. This suggests that myelin water fraction changes are likely due to a loosening of the myelin sheath structure, as opposed to fragmentation and removal of myelin debris.

Project description:ObjectiveWe aimed to gain more insight into the pathomechanisms of metachromatic leukodystrophy (MLD), by comparing magnitude and direction of diffusion between patients and controls at diagnosis and during follow-up.MethodsFour late-infantile, 16 juvenile and 8 adult onset MLD patients [of which 13 considered eligible for hematopoietic cell transplantation (HCT)] and 47 controls were examined using diffusion tensor imaging. Fractional anisotropy (FA), mean diffusivity (MD), axial diffusivity (AD) and radial diffusivity (RD) were quantified and compared between groups using tract-based spatial statistics (TBSS). Diffusion measures were determined for normal-appearing white matter (NAWM), corpus callosum, thalamus (all based on subject-wise segmentation), and pyramidal tracts, determined with probabilistic tractography. Measures were compared between HCT-eligible patients, non-eligible patients and controls using general linear model and nonparametric permutation analyses (randomise) for TBSS data, considering family-wise error corrected p < 0.05 significant.ResultsThroughout white matter (WM), FA was decreased and MD and RD increased in both patient groups compared to controls, while AD was decreased in NAWM and corpus callosum. In the thalamus, no differences in FA were observed, but all diffusivities were increased in both patient groups. Differences were most pronounced between controls and patients non-eligible for HCT. Longitudinally (median follow-up 3.9 years), diffusion measures remained relatively stable for HCT-treated patients, but were progressively abnormal for non-eligible patients.InterpretationThe observed diffusion measures confirm that brain microstructure is changed in MLD, reflecting different pathological processes including loss of myelin and sulfatide accumulation. The observation of both increased and decreased AD probably reflects a balance between myelin and axonal loss vs. intracellular sulfatide storage in macrophages, depending on region and disease stage.

Dataset Information

Potholes and molehills: bias in the diagnostic performance of diffusion-tensor imaging in concussion.

Purpose

Materials and methods

Results

Conclusion

Publications

Potholes and molehills: bias in the diagnostic performance of diffusion-tensor imaging in concussion.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets