Dataset Information

Comparison of Immune Response Assessment in Colon Cancer by Immunoscore (Automated Digital Pathology) and Pathologist Visual Scoring.

ABSTRACT: Adjunction of immune response into the TNM classification system improves the prediction of colon cancer (CC) prognosis. However, immune response measurements have not been used as robust biomarkers of pathology in clinical practice until the introduction of Immunoscore (IS), a standardized assay based on automated artificial intelligence assisted digital pathology. The strong prognostic impact of the immune response, as assessed by IS, has been widely validated and IS can help to refine treatment decision making in early CC. In this study, we compared pathologist visual scoring to IS. Four pathologists evaluated tumor specimens from 50 early-stage CC patients and classified the CD3+ and CD8+ T-cell densities at the tumor site (T-score) into 2 (High/Low) categories. Individual and overall pathologist scoring of immune response (before and after training for immune response assessment) were compared to the reference IS (High/Low). Pathologists' disagreement with the reference IS was observed in almost half of the cases (48%) and training only slightly improved the accuracy of pathologists' classification. Agreement among pathologists was minimal with a Kappa of 0.34 and 0.57 before and after training, respectively. The standardized IS assay outperformed expert pathologist assessment in the clinical setting.

SUBMITTER: Boquet I

PROVIDER: S-EPMC8909354 | biostudies-literature | 2022 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Comparison of Immune Response Assessment in Colon Cancer by Immunoscore (Automated Digital Pathology) and Pathologist Visual Scoring.

Boquet Isabelle I Kassambara Alboukadel A Lui Alfred A Tanner Alicia A Latil Marie M Lovera Yoann Y Arnoux Fanny F Hermitte Fabienne F Galon Jérôme J Catteau Aurelie A

Cancers 20220224 5

Adjunction of immune response into the TNM classification system improves the prediction of colon cancer (CC) prognosis. However, immune response measurements have not been used as robust biomarkers of pathology in clinical practice until the introduction of Immunoscore (IS), a standardized assay based on automated artificial intelligence assisted digital pathology. The strong prognostic impact of the immune response, as assessed by IS, has been widely validated and IS can help to refine treatme ...[more]

PMID: 35267475

Similar Datasets

Project description:The HercepTest was approved 20+ years ago as the companion diagnostic test for trastuzumab in human epidermal growth factor 2 (HER2) or ERBB2 gene-amplified/overexpressing breast cancers. Subsequent HER2 immunohistochemistry (IHC) assays followed, including the now most common Ventana 4B5 assay. Although this IHC assay has become the clinical standard, its reliability, reproducibility, and accuracy have largely been approved and accepted on the basis of concordance among small numbers of pathologists without validation in a real-world setting. In this study, we evaluated the concordance and interrater reliability of scoring HER2 IHC in 170 breast cancer biopsies by 18 breast cancer-specialized pathologists from 15 institutions. We used the Observers Needed to Evaluate Subjective Tests method to determine the plateau of concordance and the minimum number of pathologists needed to estimate interrater agreement values for large numbers of raters, as seen in the real-world setting. We report substantial discordance within the intermediate categories (<1% agreement for 1+ and 3.6% agreement for 2+) in the 4-category HER2 IHC scoring system. The discordance within the IHC 0 cases is also substantial with an overall percent agreement (OPA) of only 25% and poor interrater reliability metrics (0.49 Fleiss' kappa, 0.55 intraclass correlation coefficient). This discordance can be partially reduced by using a 3-category system (28.8% vs 46.5% OPA for 4-category and 3-category scoring systems, respectively). Observers Needed to Evaluate Subjective Tests plots suggest that the OPA for the task of determining a HER2 IHC score 0 from not 0 plateaus statistically around 59.4% at 10 raters. Conversely, at the task of scoring HER2 IHC as 3+ or not 3+ pathologists' concordance was much higher with an OPA that plateaus at 87.1% with 6 raters. This suggests that legacy HER2 IHC remains valuable for finding the patients in whom the ERBB2 gene is amplified but unacceptably discordant in assigning HER2-low or HER2-negative status for the emerging HER2-low therapies.

Project description:BackgroundKi67 labeling index (LI) is critical for treatment options and prognosis evaluation in breast cancer. Visual assessment (VA) is widely used to assess Ki67 LI, but has some limitations. In this study, we compared the consistency between VA and automated digital image analysis (DIA) of Ki67 LI in breast cancer, and to evaluate the application value of DIA in Ki67 LI assessment.MethodsKi67 immunostained slides of 155 cases of primary invasive breast cancer were eyeballing assessed by five breast pathologists and automated digital image analyzed by one breast pathologist respectively. Two score methods, hot-spot score and average score, were used to choose score areas. The intra-class correlation coefficient (ICC) was used to analyze the consistency between VA and DIA, and Wilcoxon signed-rank test was used to compare the median of paired-difference between VA and DIA values.Results(1) A perfect agreement was demonstrated between VA and DIA of Ki67 LI by ICC analysis (P<0.0001) in the whole cohort. A perfect agreement between VA and DIA of Ki67 LI was also showed in G2-G3, ER positive/HER2 negative cases. Average score and hot-spot score methods both demonstrated a perfect concordance between VA and DIA of Ki67 LI. (2) All cases were classified into three groups by VA values (≤10%, 11%-30% and >30% Ki67 LI). The concordance was relatively lower in intermediate Ki67 LI group (11%-30%) compared with high (>30%) Ki67 LI groups according to both methods. (3) All cases were classified into three groups by paired-difference (d) between VA values of hot-spot score and average score (d<5, 5≤d<10, d≥10) to evaluate the correlation between Ki67 staining distribution (heterogeneous or homogenous) and reproducibility of assessment. A perfect agreement was all demonstrated in three groups, and a slightly better Ki67 LI agreement between VA and DIA was indicated in homogenous staining slides than in heterogeneous staining ones. (4) VA values were relatively smaller than DIA values (average score: median of paired-difference -3.72; hot-spot score: median of paired-difference -9.12).ConclusionsAn excellent agreement between VA and DIA of Ki67 LI in breast cancer was demonstrated in the whole mixed cohort, suggesting that VA and DIA both could be used to assess Ki67 LI in clinical practice. Average score and hot-spot score methods both demonstrated a perfect concordance between VA and DIA of Ki67 LI. The almost perfect agreement between VA and DIA was observed in high Ki67 LI cases, displaying a homogenous staining pattern. The consistency between VA and DIA was relatively low in intermediate Ki67 LI group. The heterogeneity of tumors may slightly affect the concordance between VA and DIA of Ki67 LI. Assessment of VA provides lower Ki67 values than DIA, the biological importance of these values are not known at the moment.

Project description:Ki-67 assessment is a key step in the diagnosis of neuroendocrine neoplasms (NENs) from all anatomic locations. Several challenges exist related to quantifying the Ki-67 proliferation index due to lack of method standardization and inter-reader variability. The application of digital pathology coupled with machine learning has been shown to be highly accurate and reproducible for the evaluation of Ki-67 in NENs. We systematically reviewed all published studies on the subject of Ki-67 assessment in pancreatic NENs (PanNENs) employing digital image analysis (DIA). The most common advantages of DIA were improvement in the standardization and reliability of Ki-67 evaluation, as well as its speed and practicality, compared to the current gold standard approach of manual counts from captured images, which is cumbersome and time consuming. The main limitations were attributed to higher costs, lack of widespread availability (as of yet), operator qualification and training issues (if it is not done by pathologists), and most importantly, the drawback of image algorithms counting contaminating non-neoplastic cells and other signals like hemosiderin. However, solutions are rapidly developing for all of these challenging issues. A comparative meta-analysis for DIA versus manual counting shows very high concordance (global coefficient of concordance: 0.94, 95% CI: 0.83-0.98) between these two modalities. These findings support the widespread adoption of validated DIA methods for Ki-67 assessment in PanNENs, provided that measures are in place to ensure counting of only tumor cells either by software modifications or education of non-pathologist operators, as well as selection of standard regions of interest for analysis. NENs, being cellular and monotonous neoplasms, are naturally more amenable to Ki-67 assessment. However, lessons of this review may be applicable to other neoplasms where proliferation activity has become an integral part of theranostic evaluation including breast, brain, and hematolymphoid neoplasms.

Dataset Information

Comparison of Immune Response Assessment in Colon Cancer by Immunoscore (Automated Digital Pathology) and Pathologist Visual Scoring.

Publications

Comparison of Immune Response Assessment in Colon Cancer by Immunoscore (Automated Digital Pathology) and Pathologist Visual Scoring.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets