Dataset Information

Inter-Observer Agreement of a New Endoscopic Score for Ulcerative Colitis Activity: Preliminary Experience.

ABSTRACT: Ulcerative colitis (UC) endoscopic scores translate mucosal damage into values standardizing image analysis. Due to potential limits of current endoscopic activity indexes, we have elaborated on a new score, the "Extended Mayo Endoscopic Score (EMES)," and evaluated its inter-observer agreement in a multicenter endoscopy team, comparing concordance with the Mayo subscore. Sixteen UC consecutive patients underwent follow-up colonoscopy. Recorded videos were anonymously loaded on a web platform. Thirteen expert endoscopists evaluated UC activity using both Mayo and EMES. EMES was described in every colon segment: erythema (0: absent, 1: mild, 2: moderate, 3: severe), vascular pattern (0: normal, 1: reduction, 2: disappearance), erosions and ulcers (0: absent, 1: from 1 to 5, 2: 6 to 10, 3: >10). Weighted Fleiss' kappa with 95% confidence interval (CI) and p-value defined inter-rater agreement. Global inter-observer agreement of EMES was moderate (kappa = 0.56, 95% CI = 0.46-0.67, p < 0.001). The evaluation of each colonic segment showed moderate agreement for all segments: ascending (kappa = 0.46, 95% CI = 0.32-0.60, p < 0.001), transverse (kappa = 0.48, 95% CI = 0.29-0.67, p < 0.001); descending (kappa = 0.49, 95% CI = 0.35-0.64, p < 0.001), sigmoid (kappa = 0.52, 95% CI = 0.39-0.65, p < 0.001) and rectum (kappa = 0.55, 95% CI = 0.42-0.69, p < 0.001). Mayo subscore agreement was similar to global EMES (kappa = 0.53, 95% CI = 0.39-0.66, p = 0.001). Therefore, our report emphasizes the importance of assessing inter-observer agreement for EMES, but also for other known scoring systems, including the Mayo subscore.

SUBMITTER: Principi M

PROVIDER: S-EPMC7236596 | biostudies-literature | 2020 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Inter-Observer Agreement of a New Endoscopic Score for Ulcerative Colitis Activity: Preliminary Experience.

Principi Mariabeatrice M Contaldo Antonella A Bianchi Francesco Paolo FP Losurdo Giuseppe G Iannone Andrea A Ierardi Enzo E Tafuri Silvio S Di Leo Alfredo A Ibd Endoscopy Team Work

Diagnostics (Basel, Switzerland) 20200412 4

Ulcerative colitis (UC) endoscopic scores translate mucosal damage into values standardizing image analysis. Due to potential limits of current endoscopic activity indexes, we have elaborated on a new score, the "Extended Mayo Endoscopic Score (EMES)," and evaluated its inter-observer agreement in a multicenter endoscopy team, comparing concordance with the Mayo subscore. Sixteen UC consecutive patients underwent follow-up colonoscopy. Recorded videos were anonymously loaded on a web platform. T ...[more]

PMID: 32290549

Similar Datasets

Project description:BackgroundRecent developments in diagnostic techniques for malaria, particularly DNA probes and sero-immunology, have raised questions as to how these techniques might be used to facilitate malaria diagnosis at the most peripheral levels of the primary health care system. At present, malaria diagnosis is based on the standard microscopic examination of blood films in most field epidemiologic studies and is likely to remain so in the immediate future in Africa. The objective of this study was to assess inter-observer agreement for the examination of Giemsa-stained slides for Plasmodium falciparum parasites.MethodsChildren aged 0 to 10 years were enrolled yearly in Bancoumana village (West Africa), mainly during the transmission season (June to October). The blood smears obtained from the persistently negative children in June 1996, August 1996, October 1996 and March 1997 were systematically re-examined. A stratified random sample (10%) proportional to the following parasite density classes 1-100, 101-5000, and 5001 and over was taken from the slides collected. The kappa statistics and the intra-class correlation were used as measures of agreement the first and the second slide examinations.ResultsThe weighted kappa statistic, widely used as a chance-corrected measure for nominal agreement, showed excellent inter-observer agreement (κ(w)=0.7926; 95% CI [0.7588, 0.8263]; p=0.01). The intra-class correlation co-efficient had the same value of 0.7926 confirming the appropriateness of the weighted kappa statistic. Inter-observer agreement for slides read as negative by one observer, or as containing more than 100 parasites per μl, was excellent: 97% (493/506) and 92% (145/158), respectively. In contrast, the inter-observer agreement for slides read by one observer as containing 1-100 parasites/μl was poor, 36% (96/268).ConclusionsIn field conditions in Mali, there was a high reproducibility for slides reported as negative or as having more than 100 parasites per μl. However, smears with readings of 1-100 parasites per μl were less reproducible and should be re-examined carefully.

Project description:BackgroundThe significance of endoscopic evaluation in the diagnosis and management of ulcerative colitis (UC) has been widely recognized. Over the years, scholars have established several endoscopic scores. Herein, we assessed the clinical application value of the Mayo Endoscopic Subscore (Mayo ES), the Degree of Ulcerative Colitis Burden of Luminal Inflammation (DUBLIN) score, and the Ulcerative Colitis Endoscopic Index of Severity (UCEIS) score in UC patients, by comparing their correlation with disease activity and their predictive potential for treatment response and clinical outcomes.MethodsUC patients hospitalized from September 2015 to September 2019 were retrospectively analysed. We employed Spearman's rank correlation coefficient to assess the linear association of the assessed endoscopic scores with the clinical parameters. The receiver-operating characteristic curve was applied to evaluate the predictive capabilities of the endoscopic scores for treatment escalation and 1-year readmission.ResultsA total of 178 patients were enrolled; most of them (82%) suffered moderate or severe colitis. Among them, 48 (27%) patients received treatment escalation and 59 (33%) were readmitted within 1 year. The DUBLIN and UCEIS scores demonstrated higher correlations with clinical parameters than the Mayo ES. The DUBLIN scores significantly differed between patients with mild, moderate, and severe colitis (all P < 0.001). The UCEIS scores demonstrated the best predictabilities for treatment escalation and 1-year readmission with an area under the curve of 0.88 and 0.75, respectively. Compared to the UCEIS and DUBLIN scores, the predictive capabilities of the Mayo ES for treatment escalation (both P < 0.001) and 1-year readmission (P < 0.001 and P = 0.002, respectively) were lower. The UCEIS scores exhibited a significant difference between the steroid-responsive group and the steroid-dependent or steroid-refractory group (both P < 0.001), while no significant differences in the Mayo ES and DUBLIN scores were found among the three groups (both P > 0.05).ConclusionThis study demonstrates that both the DUBLIN and UCEIS scores outperform the Mayo ES in assessing disease severity and predicting treatment response and clinical outcomes in UC patients.

Project description:BackgroundVariability in endoscopic assessment necessitates rigorous investigation of descriptors for scoring severity of ulcerative colitis (UC).ObjectiveTo evaluate variation in the overall endoscopic assessment of severity, the intra- and interindividual variation of descriptive terms and to create an Ulcerative Colitis Endoscopic Index of Severity which could be validated.DesignA two-phase study used a library of 670 video sigmoidoscopies from patients with Mayo Clinic scores 0-11, supplemented by 10 videos from five people without UC and five hospitalised patients with acute severe UC. In phase 1, each of 10 investigators viewed 16/24 videos to assess agreement on the Baron score with a central reader and agreed definitions of 10 endoscopic descriptors. In phase 2, each of 30 different investigators rated 25/60 different videos for the descriptors and assessed overall severity on a 0-100 visual analogue scale. κ Statistics tested inter- and intraobserver variability for each descriptor. A general linear mixed regression model based on logit link and β distribution of variance was used to predict overall endoscopic severity from descriptors.ResultsThere was 76% agreement for 'severe', but 27% agreement for 'normal' appearances between phase I investigators and the central reader. In phase 2, weighted κ values ranged from 0.34 to 0.65 and 0.30 to 0.45 within and between observers for the 10 descriptors. The final model incorporated vascular pattern, (normal/patchy/complete obliteration) bleeding (none/mucosal/luminal mild/luminal moderate or severe), erosions and ulcers (none/erosions/superficial/deep), each with precise definitions, which explained 90% of the variance (pR(2), Akaike Information Criterion) in the overall assessment of endoscopic severity, predictions varying from 4 to 93 on a 100-point scale (from normal to worst endoscopic severity).ConclusionThe Ulcerative Colitis Endoscopic Index of Severity accurately predicts overall assessment of endoscopic severity of UC. Validity and responsiveness need further testing before it can be applied as an outcome measure in clinical trials or clinical practice.

Project description:Invasive lobular breast carcinoma (ILC) is the second most common breast carcinoma (BC) subtype and is mainly driven by loss of E-cadherin expression. Correct classification of BC as ILC is important for patient treatment. This study assessed the degree of agreement among pathologists for the diagnosis of ILC. Two sets of hormone receptor (HR)-positive/HER2-negative BCs were independently reviewed by participating pathologists. In set A (61 cases), participants were provided with hematoxylin/eosin (HE)-stained sections. In set B (62 cases), participants were provided with HE-stained sections and E-cadherin immunohistochemistry (IHC). Tumor characteristics were balanced. Participants classified specimens as non-lobular BC versus mixed BC versus ILC. Pairwise inter-observer agreement and agreement with a pre-defined reference diagnosis were determined with Cohen's kappa statistics. Subtype calls were correlated with molecular features, including CDH1/E-cadherin mutation status. Thirty-five pathologists completed both sets, providing 4,305 subtype calls. Pairwise inter-observer agreement was moderate in set A (median κ = 0.58, interquartile range [IQR]: 0.48-0.66) and substantial in set B (median κ = 0.75, IQR: 0.56-0.86, p < 0.001). Agreement with the reference diagnosis was substantial in set A (median κ = 0.67, IQR: 0.57-0.75) and almost perfect in set B (median κ = 0.86, IQR: 0.73-0.93, p < 0.001). The median frequency of CDH1/E-cadherin mutations in specimens classified as ILC was 65% in set A (IQR: 56-72%) and 73% in set B (IQR: 65-75%, p < 0.001). Cases with variable subtype calls included E-cadherin-positive ILCs harboring CDH1 missense mutations, and E-cadherin-negative ILCs with tubular elements and focal P-cadherin expression. ILCs with trabecular growth pattern were often misclassified as non-lobular BC in set A but not in set B. In conclusion, subtyping of BC as ILC achieves almost perfect agreement with a pre-defined reference standard, if assessment is supported by E-cadherin IHC. CDH1 missense mutations associated with preserved E-cadherin protein expression, E- to P-cadherin switching in ILC with tubular elements, and trabecular ILC were identified as potential sources of discordant classification.

Project description:BackgroundEndoscopy is routine in trials of ulcerative colitis therapies.AimTo investigate agreement between central and local Mayo endoscopic subscore (MES) reads in the OCTAVE programme METHODS: Flexible sigmoidoscopy was performed in tofacitinib induction (OCTAVE Induction 1&2, NCT01465763 and NCT01458951), maintenance (OCTAVE Sustain, NCT01458574) and open-label, long-term extension (OCTAVE Open, NCT01470612) studies. Kappa statistics and Bowker's tests evaluated agreement/disagreement between centrally and locally read MES, with potential determinants of differences analysed by logistic regression.ResultsModerate-to-substantial agreement was observed between central and local reads at screening (77.1% agreement; kappa 0.62 [95% confidence interval 0.59-0.66]), OCTAVE Induction 1&2 week (Wk) 8 (63.8%; 0.62 [0.59-0.66]), OCTAVE Sustain Wk 52 (55.6%; 0.56 [0.50-0.62]) and for induction non-responders at OCTAVE Open month 2 (59.9%; 0.54 [0.48-0.60]). Where disagreements occurred, local reads were systematically lower than central reads at OCTAVE Induction 1&2 Wk 8, OCTAVE Sustain Wk 52 and OCTAVE Open month 2 (Bowker's P < 0.0001); this difference was not observed at screening (P = 0.0852). Using multivariable logistic regression, geographical region, C-reactive protein (Wk 8), partial Mayo score (Wk 8) and prior tumour necrosis factor antagonist failure were associated with disparity at OCTAVE Induction 1&2 Wk 8 (P < 0.05). In OCTAVE Induction 1&2 and OCTAVE Sustain, significantly higher proportions of patients endoscopic improvement, remission and endoscopic remission with tofacitinib vs placebo, using either central or local reads.ConclusionModerate-to-substantial agreement was observed between central and local endoscopic reads. Where disagreements occurred, local reads were systematically lower than central reads at most timepoints, suggesting potential bias. ClinicalTrials.gov identifier: NCT01465763, NCT01458951, NCT01458574, NCT01470612.

Dataset Information

Inter-Observer Agreement of a New Endoscopic Score for Ulcerative Colitis Activity: Preliminary Experience.

Publications

Inter-Observer Agreement of a New Endoscopic Score for Ulcerative Colitis Activity: Preliminary Experience.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets