Dataset Information

Developing an instrument to assess the endoscopic severity of ulcerative colitis: the Ulcerative Colitis Endoscopic Index of Severity (UCEIS).

ABSTRACT: BACKGROUND: Variability in endoscopic assessment necessitates rigorous investigation of descriptors for scoring severity of ulcerative colitis (UC). OBJECTIVE: To evaluate variation in the overall endoscopic assessment of severity, the intra- and interindividual variation of descriptive terms and to create an Ulcerative Colitis Endoscopic Index of Severity which could be validated. DESIGN: A two-phase study used a library of 670 video sigmoidoscopies from patients with Mayo Clinic scores 0-11, supplemented by 10 videos from five people without UC and five hospitalised patients with acute severe UC. In phase 1, each of 10 investigators viewed 16/24 videos to assess agreement on the Baron score with a central reader and agreed definitions of 10 endoscopic descriptors. In phase 2, each of 30 different investigators rated 25/60 different videos for the descriptors and assessed overall severity on a 0-100 visual analogue scale. ? Statistics tested inter- and intraobserver variability for each descriptor. A general linear mixed regression model based on logit link and ? distribution of variance was used to predict overall endoscopic severity from descriptors. RESULTS: There was 76% agreement for 'severe', but 27% agreement for 'normal' appearances between phase I investigators and the central reader. In phase 2, weighted ? values ranged from 0.34 to 0.65 and 0.30 to 0.45 within and between observers for the 10 descriptors. The final model incorporated vascular pattern, (normal/patchy/complete obliteration) bleeding (none/mucosal/luminal mild/luminal moderate or severe), erosions and ulcers (none/erosions/superficial/deep), each with precise definitions, which explained 90% of the variance (pR(2), Akaike Information Criterion) in the overall assessment of endoscopic severity, predictions varying from 4 to 93 on a 100-point scale (from normal to worst endoscopic severity). CONCLUSION: The Ulcerative Colitis Endoscopic Index of Severity accurately predicts overall assessment of endoscopic severity of UC. Validity and responsiveness need further testing before it can be applied as an outcome measure in clinical trials or clinical practice.

SUBMITTER: Travis SP

PROVIDER: S-EPMC3292713 | biostudies-literature | 2012 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Developing an instrument to assess the endoscopic severity of ulcerative colitis: the Ulcerative Colitis Endoscopic Index of Severity (UCEIS).

Travis Simon P L SP Schnell Dan D Krzeski Piotr P Abreu Maria T MT Altman Douglas G DG Colombel Jean-Frédéric JF Feagan Brian G BG Hanauer Stephen B SB Lémann Marc M Lichtenstein Gary R GR Marteau Phillippe R PR Reinisch Walter W Sands Bruce E BE Yacyshyn Bruce R BR Bernhardt Christian A CA Mary Jean-Yves JY Sandborn William J WJ

Gut 20111013 4

<h4>Background</h4>Variability in endoscopic assessment necessitates rigorous investigation of descriptors for scoring severity of ulcerative colitis (UC).<h4>Objective</h4>To evaluate variation in the overall endoscopic assessment of severity, the intra- and interindividual variation of descriptive terms and to create an Ulcerative Colitis Endoscopic Index of Severity which could be validated.<h4>Design</h4>A two-phase study used a library of 670 video sigmoidoscopies from patients with Mayo Cl ...[more]

PMID: 21997563

Similar Datasets

Project description:BackgroundThe significance of endoscopic evaluation in the diagnosis and management of ulcerative colitis (UC) has been widely recognized. Over the years, scholars have established several endoscopic scores. Herein, we assessed the clinical application value of the Mayo Endoscopic Subscore (Mayo ES), the Degree of Ulcerative Colitis Burden of Luminal Inflammation (DUBLIN) score, and the Ulcerative Colitis Endoscopic Index of Severity (UCEIS) score in UC patients, by comparing their correlation with disease activity and their predictive potential for treatment response and clinical outcomes.MethodsUC patients hospitalized from September 2015 to September 2019 were retrospectively analysed. We employed Spearman's rank correlation coefficient to assess the linear association of the assessed endoscopic scores with the clinical parameters. The receiver-operating characteristic curve was applied to evaluate the predictive capabilities of the endoscopic scores for treatment escalation and 1-year readmission.ResultsA total of 178 patients were enrolled; most of them (82%) suffered moderate or severe colitis. Among them, 48 (27%) patients received treatment escalation and 59 (33%) were readmitted within 1 year. The DUBLIN and UCEIS scores demonstrated higher correlations with clinical parameters than the Mayo ES. The DUBLIN scores significantly differed between patients with mild, moderate, and severe colitis (all P < 0.001). The UCEIS scores demonstrated the best predictabilities for treatment escalation and 1-year readmission with an area under the curve of 0.88 and 0.75, respectively. Compared to the UCEIS and DUBLIN scores, the predictive capabilities of the Mayo ES for treatment escalation (both P < 0.001) and 1-year readmission (P < 0.001 and P = 0.002, respectively) were lower. The UCEIS scores exhibited a significant difference between the steroid-responsive group and the steroid-dependent or steroid-refractory group (both P < 0.001), while no significant differences in the Mayo ES and DUBLIN scores were found among the three groups (both P > 0.05).ConclusionThis study demonstrates that both the DUBLIN and UCEIS scores outperform the Mayo ES in assessing disease severity and predicting treatment response and clinical outcomes in UC patients.

Project description:BackgroundAt present, many indicators reflect the clinical disease activity of ulcerative colitis (UC). However, commonly used inflammatory markers do not show good utility for indicating endoscopic disease activity. The purpose of this study was to evaluate high sensitivity C-reactive protein (hs-CRP), C-reactive protein to albumin ratio (CAR), inflammatory markers, and complete blood count (CBC) related parameters in patients with UC as simple, non-invasive, and independent markers of endoscopic activity (EA).MethodsWe retrospectively collected extensive data from the hospital medical records of 386 patients who presented with UC to the First Affiliated Hospital of Xinjiang Medical University (Urumqi, China) from 2018 to 2022 January. The Mayo endoscopic score (MES) was used to evaluate endoscopic disease activity. All included patients were defined as the MES-All group; those with extensive colitis (E3) were defined as the MES-E3 group. Demographics, laboratory parameters, endoscopic results, the extent of disease, and drug history were recorded and analyzed.ResultsFor patients in the MES-All or MES-E3 group, hs-CRP, CAR, neutrophil to lymphocyte ratio (NLR), and platelet to lymphocyte ratio (PLR) were significantly higher in EA UC patients than in those with mucosal healing. The mean platelet volume (MPV) and lymphocyte to monocyte ratio were significantly lower in active disease than in the patient's remission (p < 0.001). ROC analysis showed that in the MES-All and MES-E3 groups, the cutoff values of hs-CRP activity under endoscopy were 5.32 mg/L (AUC 0.850, sensitivity 77.6%, specificity 81.9%) and 5.16 mg/L (AUC 0.902, sensitivity 86.9%, specificity 85.4%) respectively, and the cutoff values of CAR were 0.14 (AUC 0.853, sensitivity 76.8%, specificity 84.8%) and 0.18 (AUC 0.904, sensitivity 81.8%, specificity 89.6%) respectively. Multivariate logistic regression analysis showed that hs-CRP, CAR, NLR, and PLR identified UC EA, while decreased MPV reflected inflammatory activity in the UC mucosa.ConclusionEspecially in patients with extensive colitis, hs-CRP and CAR are closely related to EA and show a higher diagnostic value compared to the related CBC parameters. The aforementioned indicators are simple and non-invasive independent markers that reflect the EA in UC.

Project description:IntroductionThe Mayo Clinic Endoscopic Subscore is a commonly used grading system to assess the severity of ulcerative colitis. Correctly grading colonoscopies using the Mayo Clinic Endoscopic Subscore is a challenging task, with suboptimal rates of interrater and intrarater variability observed even among experienced and sufficiently trained experts. In recent years, several machine learning algorithms have been proposed in an effort to improve the standardization and reproducibility of Mayo Clinic Endoscopic Subscore grading.MethodsHere we propose an end-to-end fully automated system based on deep learning to predict a binary version of the Mayo Clinic Endoscopic Subscore directly from raw colonoscopy videos. Differently from previous studies, the proposed method mimics the assessment done in practice by a gastroenterologist, that is, traversing the whole colonoscopy video, identifying visually informative regions and computing an overall Mayo Clinic Endoscopic Subscore. The proposed deep learning-based system has been trained and deployed on raw colonoscopies using Mayo Clinic Endoscopic Subscore ground truth provided only at the colon section level, without manually selecting frames driving the severity scoring of ulcerative colitis.Results and conclusionOur evaluation on 1672 endoscopic videos obtained from a multisite data set obtained from the etrolizumab Phase II Eucalyptus and Phase III Hickory and Laurel clinical trials, show that our proposed methodology can grade endoscopic videos with a high degree of accuracy and robustness (Area Under the Receiver Operating Characteristic Curve?=?0.84 for Mayo Clinic Endoscopic Subscore???1, 0.85 for Mayo Clinic Endoscopic Subscore???2 and 0.85 for Mayo Clinic Endoscopic Subscore???3) and reduced amounts of manual annotation.Plain language summaryPatient, caregiver and provider thoughts on educational materials about prescribing and medication safety Artificial intelligence can be used to automatically assess full endoscopic videos and estimate the severity of ulcerative colitis. In this work, we present an artificial intelligence algorithm for the automatic grading of ulcerative colitis in full endoscopic videos. Our artificial intelligence models were trained and evaluated on a large and diverse set of colonoscopy videos obtained from concluded clinical trials. We demonstrate not only that artificial intelligence is able to accurately grade full endoscopic videos, but also that using diverse data sets obtained from multiple sites is critical to train robust AI models that could potentially be deployed on real-world data.

Project description:ImportanceAssessing endoscopic disease severity in ulcerative colitis (UC) is a key element in determining therapeutic response, but its use in clinical practice is limited by the requirement for experienced human reviewers.ObjectiveTo determine whether deep learning models can grade the endoscopic severity of UC as well as experienced human reviewers.Design, setting, and participantsIn this diagnostic study, retrospective grading of endoscopic images using the 4-level Mayo subscore was performed by 2 independent reviewers with score discrepancies adjudicated by a third reviewer. Using 16 514 images from 3082 patients with UC who underwent colonoscopy at a single tertiary care referral center in the United States between January 1, 2007, and December 31, 2017, a 159-layer convolutional neural network (CNN) was constructed as a deep learning model to train and categorize images into 2 clinically relevant groups: remission (Mayo subscore 0 or 1) and moderate to severe disease (Mayo subscore, 2 or 3). Ninety percent of the cohort was used to build the model and 10% was used to test it; the process was repeated 10 times. A set of 30 full-motion colonoscopy videos, unseen by the model, was then used for external validation to mimic real-world application.Main outcomes and measuresModel performance was assessed using area under the receiver operating curve (AUROC), sensitivity and specificity, positive predictive value (PPV), and negative predictive value (NPV). Kappa statistics (κ) were used to measure agreement of the CNN relative to adjudicated human reference cores.ResultsThe authors included 16 514 images from 3082 unique patients (median [IQR] age, 41.3 [26.1-61.8] years, 1678 [54.4%] female), with 3980 images (24.1%) classified as moderate-to-severe disease by the adjudicated reference score. The CNN was excellent for distinguishing endoscopic remission from moderate-to-severe disease with an AUROC of 0.966 (95% CI, 0.967-0.972); a PPV of 0.87 (95% CI, 0.85-0.88) with a sensitivity of 83.0% (95% CI, 80.8%-85.4%) and specificty of 96.0% (95% CI, 95.1%-97.1%); and NPV of 0.94 (95% CI, 0.93-0.95). Weighted κ agreement between the CNN and the adjudicated reference score was also good for identifying exact Mayo subscores (κ = 0.84; 95% CI, 0.83-0.86) and was similar to the agreement between experienced reviewers (κ = 0.86; 95% CI, 0.85-0.87). Applying the CNN to entire colonoscopy videos had similar accuracy for identifying moderate to severe disease (AUROC, 0.97; 95% CI, 0.963-0.969).Conclusions and relevanceThis study found that deep learning model performance was similar to experienced human reviewers in grading endoscopic severity of UC. Given its scalability, this approach could improve the use of colonoscopy for UC in both research and routine practice.

Dataset Information

Developing an instrument to assess the endoscopic severity of ulcerative colitis: the Ulcerative Colitis Endoscopic Index of Severity (UCEIS).

Publications

Developing an instrument to assess the endoscopic severity of ulcerative colitis: the Ulcerative Colitis Endoscopic Index of Severity (UCEIS).

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets