Dataset Information

Pathologist characteristics associated with accuracy and reproducibility of melanocytic skin lesion interpretation.

ABSTRACT: BACKGROUND:Diagnostic interpretations of melanocytic skin lesions vary widely among pathologists, yet the underlying reasons remain unclear. OBJECTIVE:Identify pathologist characteristics associated with rates of accuracy and reproducibility. METHODS:Pathologists independently interpreted the same set of biopsy specimens from melanocytic lesions on 2 occasions. Diagnoses were categorized into 1 of 5 classes according to the Melanocytic Pathology Assessment Tool and Hierarchy for Diagnosis system. Reproducibility was determined by pathologists' concordance of diagnoses across 2 occasions. Accuracy was defined by concordance with a consensus reference standard. Associations of pathologist characteristics with reproducibility and accuracy were assessed individually and in multivariable logistic regression models. RESULTS:Rates of diagnostic reproducibility and accuracy were highest among pathologists with board certification and/or fellowship training in dermatopathology and in those with 5 or more years of experience. In addition, accuracy was high among pathologists with a higher proportion of melanocytic lesions in their caseload composition and higher volume of melanocytic lesions. LIMITATIONS:Data gathered in a test set situation by using a classification tool not currently in clinical use. CONCLUSION:Diagnoses are more accurate among pathologists with specialty training and those with more experience interpreting melanocytic lesions. These findings support the practice of referring difficult cases to more experienced pathologists to improve diagnostic accuracy, although the impact of these referrals on patient outcomes requires additional research.

SUBMITTER: Elder DE

PROVIDER: S-EPMC6016831 | biostudies-literature | 2018 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Pathologist characteristics associated with accuracy and reproducibility of melanocytic skin lesion interpretation.

Elder David E DE Piepkorn Michael W MW Barnhill Raymond L RL Longton Gary M GM Nelson Heidi D HD Knezevich Stevan R SR Pepe Margaret S MS Carney Patricia A PA Titus Linda J LJ Onega Tracy T Tosteson Anna N A ANA Weinstock Martin A MA Elmore Joann G JG

Journal of the American Academy of Dermatology 20180307 1

<h4>Background</h4>Diagnostic interpretations of melanocytic skin lesions vary widely among pathologists, yet the underlying reasons remain unclear.<h4>Objective</h4>Identify pathologist characteristics associated with rates of accuracy and reproducibility.<h4>Methods</h4>Pathologists independently interpreted the same set of biopsy specimens from melanocytic lesions on 2 occasions. Diagnoses were categorized into 1 of 5 classes according to the Melanocytic Pathology Assessment Tool and Hierarch ...[more]

PMID: 29524584

Similar Datasets

Project description:Objective To quantify the accuracy and reproducibility of pathologists' diagnoses of melanocytic skin lesions.Design Observer accuracy and reproducibility study.Setting 10 US states.Participants Skin biopsy cases (n=240), grouped into sets of 36 or 48. Pathologists from 10 US states were randomized to independently interpret the same set on two occasions (phases 1 and 2), at least eight months apart.Main outcome measures Pathologists' interpretations were condensed into five classes: I (eg, nevus or mild atypia); II (eg, moderate atypia); III (eg, severe atypia or melanoma in situ); IV (eg, pathologic stage T1a (pT1a) early invasive melanoma); and V (eg, ≥pT1b invasive melanoma). Reproducibility was assessed by intraobserver and interobserver concordance rates, and accuracy by concordance with three reference diagnoses.Results In phase 1, 187 pathologists completed 8976 independent case interpretations resulting in an average of 10 (SD 4) different diagnostic terms applied to each case. Among pathologists interpreting the same cases in both phases, when pathologists diagnosed a case as class I or class V during phase 1, they gave the same diagnosis in phase 2 for the majority of cases (class I 76.7%; class V 82.6%). However, the intraobserver reproducibility was lower for cases interpreted as class II (35.2%), class III (59.5%), and class IV (63.2%). Average interobserver concordance rates were lower, but with similar trends. Accuracy using a consensus diagnosis of experienced pathologists as reference varied by class: I, 92% (95% confidence interval 90% to 94%); II, 25% (22% to 28%); III, 40% (37% to 44%); IV, 43% (39% to 46%); and V, 72% (69% to 75%). It is estimated that at a population level, 82.8% (81.0% to 84.5%) of melanocytic skin biopsy diagnoses would have their diagnosis verified if reviewed by a consensus reference panel of experienced pathologists, with 8.0% (6.2% to 9.9%) of cases overinterpreted by the initial pathologist and 9.2% (8.8% to 9.6%) underinterpreted.Conclusion Diagnoses spanning moderately dysplastic nevi to early stage invasive melanoma were neither reproducible nor accurate in this large study of pathologists in the USA. Efforts to improve clinical practice should include using a standardized classification system, acknowledging uncertainty in pathology reports, and developing tools such as molecular markers to support pathologists' visual assessments.

Project description:Importance:Use of digital whole-slide imaging (WSI) for dermatopathology in general has been noted to be similar to traditional microscopy (TM); however, concern has been noted that WSI is inferior for interpretation of melanocytic lesions. Since approximately 1 of every 4 skin biopsies is of a melanocytic lesion, the use of WSI requires verification before use in clinical practice. Objective:To compare pathologists' accuracy and reproducibility in diagnosing melanocytic lesions using Melanocytic Pathology Assessment Tool and Hierarchy for Diagnosis (MPATH-Dx) categories when analyzing by TM vs WSI. Design, Setting, and Participants:A total of 87 pathologists in community-based and academic settings from 10 US states were randomized with stratification based on clinical experience to interpret in TM format 180 skin biopsy cases of melanocytic lesions, including 90 invasive melanoma, divided into 5 sets of 36 cases (phase 1). The pathologists were then randomized via stratified permuted block randomization with block size 2 to interpret cases in either TM (n?=?46) or WSI format (n?=?41), with each pathologist interpreting the same 36 cases on 2 separate occasions (phase 2). Diagnoses were categorized as MPATH-Dx categories I through V, with I indicating the least severe and V the most severe. Main Outcomes and Measures:Accuracy with respect to a consensus reference diagnosis and the reproducibility of repeated interpretations of the same cases. Results:Of the 87 pathologists in the study, 46% (40) were women and the mean (SD) age was 50.7 (10.2) years. Except for class III melanocytic lesions, the diagnostic categories showed no significant differences in diagnostic accuracy between TM and WSI interpretation. Discordance was lower among class III lesions for the TM interpretation arm (51%; 95% CI, 46%-57%) than for the WSI arm (61%; 95% CI, 53%-69%) (P?=?.05). This difference is likely to have clinical significance, because 6% of TM vs 11% of WSI class III lesions were interpreted as invasive melanoma. Reproducibility was similar between the traditional and digital formats overall (66.4%; 95% CI, 63.3%-69.3%; and 62.7%; 95% CI, 59.5%-65.7%, respectively), and for all classes, although class III showed a nonsignificant lower intraobserver agreement for digital. Significantly more mitotic figures were detected with TM compared with WSI: mean (SD) TM, 6.72 (2.89); WSI, 5.84 (2.56); P?=?.002. Conclusions and Relevance:Interpretive accuracy for melanocytic lesions was similar for WSI and TM slides except for class III lesions. We found no clinically meaningful differences in reproducibility for any of the diagnostic classes.

Project description:ImportanceIt is challenging to differentiate melanoma from melanocytic nevus on the volar skin in the absence of typical dermoscopic patterns.ObjectiveTo identify the frequency and clinical and dermoscopic characteristics of melanocytic lesions on the volar skin not displaying a parallel furrow pattern, lattice-like pattern, fibrillar pattern, or parallel ridge pattern on results of dermoscopy.Design, setting, and participantsIn this retrospective cohort study, a total of 504 melanocytic lesions on the volar skin were evaluated in the Shinshu University Hospital department of dermatology between January 1, 2000, and December 31, 2012. Dermoscopic images were independently assessed by 3 dermoscopists for the presence of established dermoscopic criteria. Statistical analysis was performed from October 1, 2017, to April 30, 2018.Main outcomes and measuresFrequency of dermoscopic criteria and corresponding clinical (patient age and size and location of lesion) and histopathologic features.ResultsOf 504 lesions, 110 (21.8%) (melanocytic nevus, 97; melanoma, 8; and equivocal melanocytic lesion, 5) from 108 patients (68 female and 40 male patients; mean age, 40.1 years [range, 1-86 years]) did not show a parallel furrow pattern, lattice-like pattern, fibrillar pattern, or parallel ridge pattern. Among them, the mean patient age was significantly higher for melanoma than for melanocytic nevus (65.3 vs 38.0 years; P < .001), as was mean maximum lesion diameter (11.8 vs 5.7 mm; P < .001). Melanomas and equivocal melanocytic lesions tended to be distributed on weight-bearing areas of the foot sole, such as the heel, while nevi were spread over non-weight-bearing regions. Dermoscopically, 95 melanocytic nevi (97.9%) were symmetrical in 1 or 2 axes while melanomas were not. A total of 91 melanocytic nevi (93.8%) had 1 or 2 colors per lesion, and 4 melanomas (50.0%) had more than 2 colors. Vascular structures were seen in 3 melanocytic nevi (3.1%) and 3 melanomas (37.5%). Blue-white structures were seen in 18 melanocytic nevi (18.6%) and 3 melanomas (37.5%). Dots and globules were seen in 22 melanocytic nevi (22.7%) and 4 melanomas (50.0%). Vascular structures, blue-white structures, and dots and globules were irregularly distributed in the melanomas. Ulcer, hyperkeratosis, and irregular streaks were observed only in melanomas.Conclusions and relevanceMore than one-fifth of melanocytic lesions on the volar skin did not display typical dermoscopic patterns. Asymmetry, numerous colors (≥3), and other melanoma-specific dermoscopic findings were more frequently observed for melanomas. Clinical information, including patient age and lesion size and location, was helpful in differentiating melanoma from melanocytic nevus. Further prospective clinical studies are warranted to clarify the diagnostic accuracy of dermoscopy combined with clinical information.

Dataset Information

Pathologist characteristics associated with accuracy and reproducibility of melanocytic skin lesion interpretation.

Publications

Pathologist characteristics associated with accuracy and reproducibility of melanocytic skin lesion interpretation.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets