Dataset Information

Inter-observer Variability in the Diagnosis of Proliferative Verrucous Leukoplakia: Clinical Implications for Oral and Maxillofacial Surgeon Understanding: A Collaborative Pilot Study.

ABSTRACT: The use of diverse terminology may lead to inconsistent diagnosis and subsequent mistreatment of lesions within the proliferative verrucous leukoplakia (PVL) spectrum. The objectives of this study were: (a) to measure inter-observer variability between a variety of pathologists diagnosing PVL lesions; and (b) to evaluate the impact of diverse terminologies on understanding, interpretation, and subsequent treatment planning by oral and maxillofacial surgeons (OMFS). Six oral pathologists (OP) and six head and neck pathologists (HNP) reviewed 40 digitally scanned slides of PVL-type lesions. Inter-observer agreement on diagnoses was evaluated by Fleiss' kappa analysis. The most commonly used diagnostic terminologies were sent to ten OMFS to evaluate their resulting interpretations and potential follow-up treatment approaches. The overall means of the surgeons' responses were compared by Student t test. There was poor inter-observer agreement between pathologists on the diagnosis of PVL lesions (??=?0.270), although there was good agreement (??=?0.650) when diagnosing frankly malignant lesions. The lowest agreement was in diagnosing verrucous hyperplasia (VH) with/without dysplasia, atypical epithelial proliferation (AEP), and verrucous carcinoma (VC). The OMFS showed the lowest agreement on identical categories of non-malignant diagnoses, specifically VH and AEP. This study demonstrates a lack of standardized terminology and diagnostic criteria for the spectrum of PVL lesions. We recommend adopting standardized criteria and terminology, proposed and established by an expert panel white paper, to assist pathologists and clinicians in uniformly diagnosing and managing PVL spectrum lesions.

SUBMITTER: Upadhyaya JD

PROVIDER: S-EPMC7021885 | biostudies-literature | 2020 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Inter-observer Variability in the Diagnosis of Proliferative Verrucous Leukoplakia: Clinical Implications for Oral and Maxillofacial Surgeon Understanding: A Collaborative Pilot Study.

Upadhyaya Jasbir D JD Fitzpatrick Sarah G SG Cohen Donald M DM Bilodeau Elizabeth A EA Bhattacharyya Indraneel I Lewis James S JS Lai Jinping J Wright John M JM Bishop Justin A JA Leon Marino E ME Islam Mohammed N MN Seethala Raja R Padilla Ricardo J RJ Carlos Roman R Müller Susan S Thompson Lester D R LDR

Head and neck pathology 20190410 1

The use of diverse terminology may lead to inconsistent diagnosis and subsequent mistreatment of lesions within the proliferative verrucous leukoplakia (PVL) spectrum. The objectives of this study were: (a) to measure inter-observer variability between a variety of pathologists diagnosing PVL lesions; and (b) to evaluate the impact of diverse terminologies on understanding, interpretation, and subsequent treatment planning by oral and maxillofacial surgeons (OMFS). Six oral pathologists (OP) and ...[more]

PMID: 30972634

Similar Datasets

Project description:ObjectivesEstablishing the reproducibility of expert-derived measurements on CTA exams of aortic dissection is clinically important and paramount for ground-truth determination for machine learning.MethodsFour independent observers retrospectively evaluated CTA exams of 72 patients with uncomplicated Stanford type B aortic dissection and assessed the reproducibility of a recently proposed combination of four morphologic risk predictors (maximum aortic diameter, false lumen circumferential angle, false lumen outflow, and intercostal arteries). For the first inter-observer variability assessment, 47 CTA scans from one aortic center were evaluated by expert-observer 1 in an unconstrained clinical assessment without a standardized workflow and compared to a composite of three expert-observers (observers 2-4) using a standardized workflow. A second inter-observer variability assessment on 30 out of the 47 CTA scans compared observers 3 and 4 with a constrained, standardized workflow. A third inter-observer variability assessment was done after specialized training and tested between observers 3 and 4 in an external population of 25 CTA scans. Inter-observer agreement was assessed with intraclass correlation coefficients (ICCs) and Bland-Altman plots.ResultsPre-training ICCs of the four morphologic features ranged from 0.04 (-0.05 to 0.13) to 0.68 (0.49-0.81) between observer 1 and observers 2-4 and from 0.50 (0.32-0.69) to 0.89 (0.78-0.95) between observers 3 and 4. ICCs improved after training ranging from 0.69 (0.52-0.87) to 0.97 (0.94-0.99), and Bland-Altman analysis showed decreased bias and limits of agreement.ConclusionsManual morphologic feature measurements on CTA images can be optimized resulting in improved inter-observer reliability. This is essential for robust ground-truth determination for machine learning models.Key points• Clinical fashion manual measurements of aortic CTA imaging features showed poor inter-observer reproducibility. • A standardized workflow with standardized training resulted in substantial improvements with excellent inter-observer reproducibility. • Robust ground truth labels obtained manually with excellent inter-observer reproducibility are key to develop reliable machine learning models.

Dataset Information

Inter-observer Variability in the Diagnosis of Proliferative Verrucous Leukoplakia: Clinical Implications for Oral and Maxillofacial Surgeon Understanding: A Collaborative Pilot Study.

Publications

Inter-observer Variability in the Diagnosis of Proliferative Verrucous Leukoplakia: Clinical Implications for Oral and Maxillofacial Surgeon Understanding: A Collaborative Pilot Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets