Dataset Information

Robust joint registration of multiple stains and MRI for multimodal 3D histology reconstruction: Application to the Allen human brain atlas.

ABSTRACT: Joint registration of a stack of 2D histological sections to recover 3D structure ("3D histology reconstruction") finds application in areas such as atlas building and validation of in vivo imaging. Straightforward pairwise registration of neighbouring sections yields smooth reconstructions but has well-known problems such as "banana effect" (straightening of curved structures) and "z-shift" (drift). While these problems can be alleviated with an external, linearly aligned reference (e.g., Magnetic Resonance (MR) images), registration is often inaccurate due to contrast differences and the strong nonlinear distortion of the tissue, including artefacts such as folds and tears. In this paper, we present a probabilistic model of spatial deformation that yields reconstructions for multiple histological stains that that are jointly smooth, robust to outliers, and follow the reference shape. The model relies on a spanning tree of latent transforms connecting all the sections and slices of the reference volume, and assumes that the registration between any pair of images can be see as a noisy version of the composition of (possibly inverted) latent transforms connecting the two images. Bayesian inference is used to compute the most likely latent transforms given a set of pairwise registrations between image pairs within and across modalities. We consider two likelihood models: Gaussian (ℓ₂ norm, which can be minimised in closed form) and Laplacian (ℓ₁ norm, minimised with linear programming). Results on synthetic deformations on multiple MR modalities, show that our method can accurately and robustly register multiple contrasts even in the presence of outliers. The framework is used for accurate 3D reconstruction of two stains (Nissl and parvalbumin) from the Allen human brain atlas, showing its benefits on real data with severe distortions. Moreover, we also provide the registration of the reconstructed volume to MNI space, bridging the gaps between two of the most widely used atlases in histology and MRI. The 3D reconstructed volumes and atlas registration can be downloaded from https://openneuro.org/datasets/ds003590. The code is freely available at https://github.com/acasamitjana/3dhirest.

SUBMITTER: Casamitjana A

PROVIDER: S-EPMC8678374 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundMagnetic resonance imaging (MRI), together with histology, is widely used to diagnose and to monitor treatment in oncology. Spatial correspondence between these modalities provides information about the ability of MRI to characterize cancerous tissue. However, registration is complicated by deformations during pathological processing, and differences in scale and information content.Methodology/principal findingsThis study proposes a methodology for establishing an accurate 3D relation between histological sections and high resolution in vivo MRI tumor data. The key features of the methodology are: 1) standardized acquisition and processing, 2) use of an intermediate ex vivo MRI, 3) use of a reference cutting plane, 4) dense histological sampling, 5) elastic registration, and 6) use of complete 3D data sets. Five rat pancreatic tumors imaged by T2*-w MRI were used to evaluate the proposed methodology. The registration accuracy was assessed by root mean squared (RMS) distances between manually annotated landmark points in both modalities. After elastic registration the average RMS distance decreased from 1.4 to 0.7 mm. The intermediate ex vivo MRI and the reference cutting plane shared by all three 3D images (in vivo MRI, ex vivo MRI, and 3D histology data) were found to be crucial for the accurate co-registration between the 3D histological data set and in vivo MRI. The MR intensity in necrotic regions, as manually annotated in 3D histology, was significantly different from other histologically confirmed regions (i.e., viable and hemorrhagic). However, the viable and the hemorrhagic regions showed a large overlap in T2(*)-w MRI signal intensity.ConclusionsThe established 3D correspondence between tumor histology and in vivo MRI enables extraction of MRI characteristics for histologically confirmed regions. The proposed methodology allows the creation of a tumor database of spatially registered multi-spectral MR images and multi-stained 3D histology.

Dataset Information

Robust joint registration of multiple stains and MRI for multimodal 3D histology reconstruction: Application to the Allen human brain atlas.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets