Dataset Information

Fluorescence Image Histology Pattern Transformation Using Image Style Transfer.

ABSTRACT: Confocal laser endomicroscopy (CLE) allow on-the-fly in vivo intraoperative imaging in a discreet field of view, especially for brain tumors, rather than extracting tissue for examination ex vivo with conventional light microscopy. Fluorescein sodium-driven CLE imaging is more interactive, rapid, and portable than conventional hematoxylin and eosin (H&E)-staining. However, it has several limitations: CLE images may be contaminated with artifacts (motion, red blood cells, noise), and neuropathologists are mainly trained on colorful stained histology slides like H&E while the CLE images are gray. To improve the diagnostic quality of CLE, we used a micrograph of an H&E slide from a glioma tumor biopsy and image style transfer, a neural network method for integrating the content and style of two images. This was done through minimizing the deviation of the target image from both the content (CLE) and style (H&E) images. The style transferred images were assessed and compared to conventional H&E histology by neurosurgeons and a neuropathologist who then validated the quality enhancement in 100 pairs of original and transformed images. Average reviewers' score on test images showed 84 out of 100 transformed images had fewer artifacts and more noticeable critical structures compared to their original CLE form. By providing images that are more interpretable than the original CLE images and more rapidly acquired than H&E slides, the style transfer method allows a real-time, cellular-level tissue examination using CLE technology that closely resembles the conventional appearance of H&E staining and may yield better diagnostic recognition than original CLE grayscale images.

SUBMITTER: Izadyyazdanabadi M

PROVIDER: S-EPMC6603166 | biostudies-literature | 2019

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Fluorescence Image Histology Pattern Transformation Using Image Style Transfer.

Izadyyazdanabadi Mohammadhassan M Belykh Evgenii E Zhao Xiaochun X Moreira Leandro Borba LB Gandhi Sirin S Cavallo Claudio C Eschbacher Jennifer J Nakaji Peter P Preul Mark C MC Yang Yezhou Y

Frontiers in oncology 20190625

Confocal laser endomicroscopy (CLE) allow on-the-fly <i>in vivo</i> intraoperative imaging in a discreet field of view, especially for brain tumors, rather than extracting tissue for examination <i>ex vivo</i> with conventional light microscopy. Fluorescein sodium-driven CLE imaging is more interactive, rapid, and portable than conventional hematoxylin and eosin (H&E)-staining. However, it has several limitations: CLE images may be contaminated with artifacts (motion, red blood cells, noise), an ...[more]

PMID: 31293966

Similar Datasets

Project description:Traditional histology is the gold standard for tissue studies, but it is intrinsically reliant on two-dimensional (2D) images. Study of volumetric tissue samples such as whole hearts produces a stack of misaligned and distorted 2D images that need to be reconstructed to recover a congruent volume with the original sample's shape. In this paper, we develop a mathematical framework called Transformation Diffusion (TD) for stack alignment refinement as a solution to the heat diffusion equation. This general framework does not require contour segmentation, is independent of the registration method used, and is trivially parallelizable. After the first stack sweep, we also replace registration operations by operations in the space of transformations, several orders of magnitude faster and less memory-consuming. Implementing TD with operations in the space of transformations produces our Transformation Diffusion Reconstruction (TDR) algorithm, applicable to general transformations that are closed under inversion and composition. In particular, we provide formulas for translation and affine transformations. We also propose an Approximated TDR (ATDR) algorithm that extends the same principles to tensor-product B-spline transformations. Using TDR and ATDR, we reconstruct a full mouse heart at pixel size 0.92µm×0.92µm, cut 10µm thick, spaced 20µm (84G). Our algorithms employ only local information from transformations between neighboring slices, but the TD framework allows theoretical analysis of the refinement as applying a global Gaussian low-pass filter to the unknown stack misalignments. We also show that reconstruction without an external reference produces large shape artifacts in a cardiac specimen while still optimizing slice-to-slice alignment. To overcome this problem, we use a pre-cutting blockface imaging process previously developed by our group that takes advantage of Brewster's angle and a polarizer to capture the outline of only the topmost layer of wax in the block containing embedded tissue for histological sectioning.

Project description:BackgroundIn order to select for quantitative plant resistance to pathogens, high throughput approaches that can precisely quantify disease severity are needed. Automation and use of calibrated image analysis should provide more accurate, objective and faster analyses than visual assessments. In contrast to conventional visible imaging, chlorophyll fluorescence imaging is not sensitive to environmental light variations and provides single-channel images prone to a segmentation analysis by simple thresholding approaches. Among the various parameters used in chlorophyll fluorescence imaging, the maximum quantum yield of photosystem II photochemistry (Fv/Fm) is well adapted to phenotyping disease severity. Fv/Fm is an indicator of plant stress that displays a robust contrast between infected and healthy tissues. In the present paper, we aimed at the segmentation of Fv/Fm images to quantify disease severity.ResultsBased on the Fv/Fm values of each pixel of the image, a thresholding approach was developed to delimit diseased areas. A first step consisted in setting up thresholds to reproduce visual observations by trained raters of symptoms caused by Xanthomonas fuscans subsp. fuscans (Xff) CFBP4834-R on Phaseolus vulgaris cv. Flavert. In order to develop a thresholding approach valuable on any cultivars or species, a second step was based on modeling pixel-wise Fv/Fm-distributions as mixtures of Gaussian distributions. Such a modeling may discriminate various stages of the symptom development but over-weights artifacts that can occur on mock-inoculated samples. Therefore, we developed a thresholding approach based on the probability of misclassification of a healthy pixel. Then, a clustering step is performed on the diseased areas to discriminate between various stages of alteration of plant tissues. Notably, the use of chlorophyll fluorescence imaging could detect pre-symptomatic area. The interest of this image analysis procedure for assessing the levels of quantitative resistance is illustrated with the quantitation of disease severity on five commercial varieties of bean inoculated with Xff CFBP4834-R.ConclusionsIn this paper, we describe an image analysis procedure for quantifying the leaf area impacted by the pathogen. In a perspective of high throughput phenotyping, the procedure was automated with the software R downloadable at http://www.r-project.org/. The R script is available at http://lisa.univ-angers.fr/PHENOTIC/telechargements.html.

Dataset Information

Fluorescence Image Histology Pattern Transformation Using Image Style Transfer.

Publications

Fluorescence Image Histology Pattern Transformation Using Image Style Transfer.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets