Dataset Information

An Image Analysis Solution For Quantification and Determination of Immunohistochemistry Staining Reproducibility.

ABSTRACT: With immunohistochemical (IHC) staining increasingly being used to guide clinical decisions, variability in staining quality and reproducibility are becoming essential factors in generating diagnoses using IHC tissue preparations. The current study tested a method to track and quantify the interrun, intrarun, and intersite variability of IHC staining intensity. Our hypothesis was that staining precision between laboratory sites, staining runs, and individual slides may be verified quantitatively, efficiently and effectively utilizing algorithm-based, automated image analysis. To investigate this premise, we tested the consistency of IHC staining in 40 routinely processed (formalin-fixed, paraffin-embedded) human tissues using 10 common antibiomarker antibodies on 2 Dako Omnis instruments at 2 locations (Carpinteria, CA: 30?m above sea level and Longmont, CO: 1500?m above sea level) programmed with identical, default settings and sample pretreatments. Digital images of IHC-labeled sections produced by a whole slide scanner were analyzed by a simple commercially available algorithm and compared with a board-certified veterinary pathologist's semiquantitative scoring of staining intensity. The image analysis output correlated well with pathology scores but had increased sensitivity for discriminating subtle variations and providing reproducible digital quantification across sites as well as within and among staining runs at the same site. Taken together, our data indicate that digital image analysis offers an objective and quantifiable means of verifying IHC staining parameters as a part of laboratory quality assurance systems.

SUBMITTER: Chlipala EA

PROVIDER: S-EPMC7368846 | biostudies-literature | 2020 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

An Image Analysis Solution For Quantification and Determination of Immunohistochemistry Staining Reproducibility.

Chlipala Elizabeth A EA Bendzinski Christine M CM Dorner Charlie C Sartan Raili R Copeland Karen K Pearce Roger R Doherty Faye F Bolon Brad B

Applied immunohistochemistry & molecular morphology : AIMM 20200701 6

With immunohistochemical (IHC) staining increasingly being used to guide clinical decisions, variability in staining quality and reproducibility are becoming essential factors in generating diagnoses using IHC tissue preparations. The current study tested a method to track and quantify the interrun, intrarun, and intersite variability of IHC staining intensity. Our hypothesis was that staining precision between laboratory sites, staining runs, and individual slides may be verified quantitatively ...[more]

PMID: 31082827

Similar Datasets

Project description:BackgroundMultipotent mesenchymal stem cells (MSCs) have the potential to repair and regenerate damaged tissues and are considered as attractive candidates for the development of cell-based regenerative therapies. Currently, there are more than 200 clinical trials involving the use of MSCs for a wide variety of indications. However, variations in their isolation, expansion, and particularly characterization have made the interpretation of study outcomes or the rigorous assessment of therapeutic efficacy difficult. An unbiased characterization of MSCs is of major importance and essential to guaranty that only the most suitable cells will be used. The development of standardized and reproducible assays to predict MSC potency is therefore mandatory. The currently used quantification methodologies for the determination of the trilineage potential of MSCs are usually based on absorbance measurements which are imprecise and prone to errors. We therefore aimed at developing a methodology first offering a standardized way to objectively quantify the trilineage potential of MSC preparations and second allowing to discriminate functional differences between clonally expanded cell populations.MethodMSCs originating from several patients were differentiated into osteoblasts, adipocytes, and chondroblasts for 14, 17, and 21 days. Differentiated cells were then stained with the classical dyes: Alizarin Red S for osteoblasts, Oil Red O for adipocytes, and Alcian Blue 8GX for chondroblasts. Quantification of differentiation was then performed with our newly developed digital image analysis (DIA) tool followed by the classical absorbance measurement. The results from the two techniques were then compared.ResultQuantification based on DIA allowed highly standardized and objective dye quantification with superior sensitivity compared to absorbance measurements. Furthermore, small differences between MSC lines in the differentiation potential were highlighted using DIA whereas no difference was detected using absorbance quantification.ConclusionOur approach represents a novel method that simplifies the laboratory procedures not only for the quantification of histological dyes and the degree of differentiation of MSCs, but also due to its color independence, it can be easily adapted for the quantification of a wide range of staining procedures in histology. The method is easily applicable since it is based on open source software and standard light microscopy.

Project description:Quantitative size, shape, and texture features derived from computed tomographic (CT) images may be useful as predictive, prognostic, or response biomarkers in non-small cell lung cancer (NSCLC). However, to be useful, such features must be reproducible, non-redundant, and have a large dynamic range. We developed a set of quantitative three-dimensional (3D) features to describe segmented tumors and evaluated their reproducibility to select features with high potential to have prognostic utility. Thirty-two patients with NSCLC were subjected to unenhanced thoracic CT scans acquired within 15 min of each other under an approved protocol. Primary lung cancer lesions were segmented using semi-automatic 3D region growing algorithms. Following segmentation, 219 quantitative 3D features were extracted from each lesion, corresponding to size, shape, and texture, including features in transformed spaces (laws, wavelets). The most informative features were selected using the concordance correlation coefficient across test-retest, the biological range and a feature independence measure. There were 66 (30.14%) features with concordance correlation coefficient???0.90 across test-retest and acceptable dynamic range. Of these, 42 features were non-redundant after grouping features with R (2) Bet???0.95. These reproducible features were found to be predictive of radiological prognosis. The area under the curve (AUC) was 91% for a size-based feature and 92% for the texture features (runlength, laws). We tested the ability of image features to predict a radiological prognostic score on an independent NSCLC (39 adenocarcinoma) samples, the AUC for texture features (runlength emphasis, energy) was 0.84 while the conventional size-based features (volume, longest diameter) was 0.80. Test-retest and correlation analyses have identified non-redundant CT image features with both high intra-patient reproducibility and inter-patient biological range. Thus making the case that quantitative image features are informative and prognostic biomarkers for NSCLC.

Project description:BACKGROUND:Multiplex immunohistochemistry (mIHC) permits the labeling of six or more distinct cell types within a single histologic tissue section. The classification of each cell type requires detection of the unique colored chromogens localized to cells expressing biomarkers of interest. The most comprehensive and reproducible method to evaluate such slides is to employ digital pathology and image analysis pipelines to whole-slide images (WSIs). Our suite of deep learning tools quantitatively evaluates the expression of six biomarkers in mIHC WSIs. These methods address the current lack of readily available methods to evaluate more than four biomarkers and circumvent the need for specialized instrumentation to spectrally separate different colors. The use case application for our methods is a study that investigates tumor immune interactions in pancreatic ductal adenocarcinoma (PDAC) with a customized mIHC panel. METHODS:Six different colored chromogens were utilized to label T-cells (CD3, CD4, CD8), B-cells (CD20), macrophages (CD16), and tumor cells (K17) in formalin-fixed paraffin-embedded (FFPE) PDAC tissue sections. We leveraged pathologist annotations to develop complementary deep learning-based methods: (1) ColorAE is a deep autoencoder which segments stained objects based on color; (2) U-Net is a convolutional neural network (CNN) trained to segment cells based on color, texture and shape; and ensemble methods that employ both ColorAE and U-Net, collectively referred to as (3) ColorAE:U-Net. We assessed the performance of our methods using: structural similarity and DICE score to evaluate segmentation results of ColorAE against traditional color deconvolution; F1 score, sensitivity, positive predictive value, and DICE score to evaluate the predictions from ColorAE, U-Net, and ColorAE:U-Net ensemble methods against pathologist-generated ground truth. We then used prediction results for spatial analysis (nearest neighbor). RESULTS:We observed that (1) the performance of ColorAE is comparable to traditional color deconvolution for single-stain IHC images (note: traditional color deconvolution cannot be used for mIHC); (2) ColorAE and U-Net are complementary methods that detect 6 different classes of cells with comparable performance; (3) combinations of ColorAE and U-Net into ensemble methods outperform using either ColorAE and U-Net alone; and (4) ColorAE:U-Net ensemble methods can be employed for detailed analysis of the tumor microenvironment (TME). We developed a suite of scalable deep learning methods to analyze 6 distinctly labeled cell populations in mIHC WSIs. We evaluated our methods and found that they reliably detected and classified cells in the PDAC tumor microenvironment. We also present a use case, wherein we apply the ColorAE:U-Net ensemble method across 3 mIHC WSIs and use the predictions to quantify all stained cell populations and perform nearest neighbor spatial analysis. Thus, we provide proof of concept that these methods can be employed to quantitatively describe the spatial distribution immune cells within the tumor microenvironment. These complementary deep learning methods are readily deployable for use in clinical research studies.

Project description:For a method to be widely adopted in medical research or clinical practice, it needs to be reproducible so that clinicians and regulators can have confidence in its use. Machine learning and deep learning have a particular set of challenges around reproducibility. Small differences in the settings or the data used for training a model can lead to large differences in the outcomes of experiments. In this work, three top-performing algorithms from the Camelyon grand challenges are reproduced using only information presented in the associated papers and the results are then compared to those reported. Seemingly minor details were found to be critical to performance and yet their importance is difficult to appreciate until the actual reproduction is attempted. We observed that authors generally describe the key technical aspects of their models well but fail to maintain the same reporting standards when it comes to data preprocessing which is essential to reproducibility. As an important contribution of the present study and its findings, we introduce a reproducibility checklist that tabulates information that needs to be reported in histopathology ML-based work in order to make it reproducible. Author summary For a method to be used a lot in medical research or clinical practice, it needs to be able to be reproduced so that people can trust it. Machine learning and deep learning have some challenges around this. For example, small changes in how a model is trained can lead to significant changes in the results of experiments. This makes it essential that researchers report how they do things in enough detail for the results of their experiments to be reproducible. In this work, we looked at three different algorithms used for digital pathology image analysis. We tried to reproduce them using only the information reported in their papers. We confirmed that even minor details could be essential. Authors often do not report all the details needed to reproduce their work. We also created a checklist of things that need to be reported to help other researchers make their work reproducible.

Dataset Information

An Image Analysis Solution For Quantification and Determination of Immunohistochemistry Staining Reproducibility.

Publications

An Image Analysis Solution For Quantification and Determination of Immunohistochemistry Staining Reproducibility.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets