Dataset Information

Development of Reliable, Valid and Responsive Scoring Systems for Endoscopy and Histology in Animal Models for Inflammatory Bowel Disease.

ABSTRACT:

Background and aims

Although several endoscopic and histopathologic indices are available for evaluating the severity of inflammation in mouse models of colitis, the reliability of these scoring instruments is unknown. Our aim was to evaluate the reliability of the individual items in the existing indices and develop new scoring systems by selection of the most reliable index items.

Methods

Two observers scored the histological slides [n = 224] and endoscopy videos [n = 201] from treated and untreated Interleukin[IL]-10 knock-out and T-cell transferred SCID mice. Intra-rater and inter-rater reliability for endoscopy and histology scores, and each individual item, were measured using intraclass correlation coefficients [ICCs]. The Mouse Colitis Histology Index [MCHI] and Mouse Colitis Endoscopy Index [MCEI] were developed using the most reliable items. Both were correlated to the colon density and to each other and were evaluated for their ability to detect changes in pathobiology.

Results

The intraclass correlation coefficients (ICCs) for inter-rater agreement (95% CIs) for the total histology and endoscopy scores were 0.90 [0.87-0.92] and 0.80 [0.76-0.84], respectively. The MCHI and MCEI were highly correlated with colon density, with a Spearman Rho = 0.81[0.75-0.85] and 0.73 [0.66-0.79], respectively, and with each other, Spearman Rho = 0.71 [0.63-0.77]. The MCHI and MCEI were able to distinguish between the experimental groups within the models, with pairwise differences between the treated and untreated groups being statistically significant [p < 0.001].

Conclusions

These histological and endoscopic indices are valid and reliable measures of intestinal inflammation in mice, and they are responsive to treatment effects in pre-clinical studies.

SUBMITTER: Koelink PJ

PROVIDER: S-EPMC6022651 | biostudies-literature | 2018 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development of Reliable, Valid and Responsive Scoring Systems for Endoscopy and Histology in Animal Models for Inflammatory Bowel Disease.

Koelink Pim J PJ Wildenberg Manon E ME Stitt Larry W LW Feagan Brian G BG Koldijk Martin M van 't Wout Angélique B AB Atreya Raja R Vieth Michael M Brandse Johannan F JF Duijst Suzanne S Te Velde Anje A AA D'Haens Geert R A M GRAM Levesque Barrett G BG van den Brink Gijs R GR

Journal of Crohn's & colitis 20180601 7

<h4>Background and aims</h4>Although several endoscopic and histopathologic indices are available for evaluating the severity of inflammation in mouse models of colitis, the reliability of these scoring instruments is unknown. Our aim was to evaluate the reliability of the individual items in the existing indices and develop new scoring systems by selection of the most reliable index items.<h4>Methods</h4>Two observers scored the histological slides [n = 224] and endoscopy videos [n = 201] from ...[more]

PMID: 29608662

Similar Datasets

Project description:ContextThe Landing Error Scoring System (LESS) is a clinical tool often used in research and practice to identify athletes presenting high injury-risk biomechanical patterns during a jump-landing task.ObjectiveTo systematically review the literature addressing the psychometric properties of the LESS.Data sourcesThree electronic databases (PubMed, Web of Science, and Scopus) were searched on March 28, 2018, using the term "Landing Error Scoring System."Study selectionAll studies using the LESS as main outcome measure and addressing its reliability, validity against motion capture system, and predictive validity were included. Original English-language studies published in peer-reviewed journals were reviewed. Studies using modified versions of the LESS were excluded.Study designSystematic literature review.Level of evidenceLevel 4.Data extractionStudy design, population, LESS testing procedures, LESS scores, statistical analysis, and main results were extracted from studies using a standardized template.ResultsTen studies met inclusion criteria and were appraised using Newcastle-Ottawa Quality Assessment Scale adapted for cross-sectional studies. The overall LESS score demonstrated good-to-excellent intrarater (intraclass correlation coefficient [ICC], 0.82-0.99), interrater (ICC, 0.83-0.92), and intersession reliability (ICC, 0.81). The validity of the overall LESS score against 3-dimensional jump-landing biomechanics was good when individuals were divided into 4 quartiles based on LESS scores. The validity of individual LESS items versus 3-dimensional motion capture data was moderate-to-excellent for most of the items addressing key risk factors for anterior cruciate ligament (ACL) injury. The predictive value of the LESS for ACL and other noncontact lower-extremity injuries remains uncertain based on the current scientific evidence.ConclusionThe LESS is a reliable screening tool. However, further work is needed to improve the LESS validity against motion capture system and confirm its predictive validity for ACL and other noncontact lower-extremity injuries.

Project description:BACKGROUND:Regular physical activity can not only help with weight management, but also lower cardiovascular risks, cancer rates, and chronic disease burden. Yet, only approximately 20% of Americans currently meet the physical activity guidelines recommended by the US Department of Health and Human Services. With the rapid development of mobile technologies, mobile apps have the potential to improve participation rates in exercise programs, particularly if they are evidence-based and are of sufficient content quality. OBJECTIVE:The goal of this study was to develop and test an instrument, which was designed to score the content quality of exercise program apps with respect to the exercise guidelines set forth by the American College of Sports Medicine (ACSM). METHODS:We conducted two focus groups (N=14) to elicit input for developing a preliminary 27-item scoring instruments based on the ACSM exercise prescription guidelines. Three reviewers who were no sports medicine experts independently scored 28 exercise program apps using the instrument. Inter- and intra-rater reliability was assessed among the 3 reviewers. An expert reviewer, a Fellow of the ACSM, also scored the 28 apps to create criterion scores. Criterion validity was assessed by comparing nonexpert reviewers' scores to the criterion scores. RESULTS:Overall, inter- and intra-rater reliability was high with most coefficients being greater than .7. Inter-rater reliability coefficients ranged from .59 to .99, and intra-rater reliability coefficients ranged from .47 to 1.00. All reliability coefficients were statistically significant. Criterion validity was found to be excellent, with the weighted kappa statistics ranging from .67 to .99, indicating a substantial agreement between the scores of expert and nonexpert reviewers. Finally, all apps scored poorly against the ACSM exercise prescription guidelines. None of the apps received a score greater than 35, out of a possible maximal score of 70. CONCLUSIONS:We have developed and presented valid and reliable scoring instruments for exercise program apps. Our instrument may be useful for consumers and health care providers who are looking for apps that provide safe, progressive general exercise programs for health and fitness.

Project description:Background & aimsStenosis is a common complication of Crohn's disease (CD) that has no effective medical therapy. Development of antifibrotic agents will require testing in randomized controlled trials. Computed tomography enterography- and magnetic resonance enterography-based technologies might be used to measure outcomes in these trials. These approaches have been validated in studies of patients with symptomatic strictures who underwent imaging evaluations followed by resection with histopathologic grading of the intestinal tissue for inflammation and/or fibrosis (the reference standard). Imaging findings have correlated with findings from quantitative or semiquantitative histologic evaluation of the degree of fibromuscular stenosis and/or inflammation on the resection specimen. However, it is not clear whether histologic findings are an accurate reference standard. We performed a systematic review of all published histologic scoring systems used to assess stenosing CD.MethodsWe performed a comprehensive search of Embase and MEDLINE of studies through March 13, 2019, that used a histologic scoring system to characterize small bowel CD and assessed inflammatory and fibrotic alterations within the same adult individual. All scores fitting the criteria were included in our analysis, independent of the presence of stricturing disease, as long as inflammation and fibrosis were evaluated separately but in the same scoring system.ResultsWe observed substantial heterogeneity among the scoring systems, which were not derived from modern principles for evaluative index development. None had undergone formal validity or reliability testing. None of the existing indices had been constructed according to accepted methods for the development of evaluative indices. Basic knowledge regarding their operating properties were lacking. Specific indices for evaluating the important pathologic component of myofibroblast hypertrophy or hyperplasia have not been proposed.ConclusionsIn a systematic review of publications, we found a lack of validated histopathologic scoring systems for assessment of fibromuscular stenosis. Data that describe the operating properties of existing cross-sectional imaging techniques for stenosing CD should be questioned. Development and validation of a histopathology index is an important research priority.

Project description:IntroductionSince the advent of artificial intelligence (AI) in clinical studies, luminal gastrointestinal endoscopy has made great progress, especially in the detection and characterization of neoplastic and preneoplastic lesions. Several studies have recently shown the potential of AI-driven endoscopy for the investigation of inflammatory bowel disease (IBD). This systematic review provides an overview of the current position and future potential of AI in IBD endoscopy.MethodsA systematic search was carried out in PubMed and Scopus up to 2 December 2020 using the following search terms: artificial intelligence, machine learning, computer-aided, inflammatory bowel disease, ulcerative colitis (UC), Crohn's disease (CD). All studies on human digestive endoscopy were included. A qualitative analysis and a narrative description were performed for each selected record according to the Joanna Briggs Institute methodologies and the PRISMA statement.ResultsOf 398 identified records, 18 were ultimately included. Two-thirds of these (12/18) were published in 2020 and most were cross-sectional studies (15/18). No relevant bias at the study level was reported, although the risk of publication bias across studies cannot be ruled out at this early stage. Eleven records dealt with UC, five with CD and two with both. Most of the AI systems involved convolutional neural network, random forest and deep neural network architecture. Most studies focused on capsule endoscopy readings in CD (n = 5) and on the AI-assisted assessment of mucosal activity in UC (n = 10) for automated endoscopic scoring or real-time prediction of histological disease.DiscussionAI-assisted endoscopy in IBD is a rapidly evolving research field with promising technical results and additional benefits when tested in an experimental clinical scenario. External validation studies being conducted in large and prospective cohorts in real-life clinical scenarios will help confirm the added value of AI in assessing UC mucosal activity and in CD capsule reading.Plain language summaryArtificial intelligence for inflammatory bowel disease endoscopy Artificial intelligence (AI) is a promising technology in many areas of medicine. In recent years, AI-assisted endoscopy has been introduced into several research fields, including inflammatory bowel disease (IBD) endoscopy, with promising applications that have the potential to revolutionize clinical practice and gastrointestinal endoscopy.We have performed the first systematic review of AI and its application in the field of IBD and endoscopy.A formal process of paper selection and analysis resulted in the assessment of 18 records. Most of these (12/18) were published in 2020 and were cross-sectional studies (15/18). No relevant biases were reported. All studies showed positive results concerning the novel technology evaluated, so the risk of publication bias cannot be ruled out at this early stage.Eleven records dealt with UC, five with CD and two with both. Most studies focused on capsule endoscopy reading in CD patients (n = 5) and on AI-assisted assessment of mucosal activity in UC patients (n = 10) for automated endoscopic scoring and real-time prediction of histological disease.We found that AI-assisted endoscopy in IBD is a rapidly growing research field. All studies indicated promising technical results. When tested in an experimental clinical scenario, AI-assisted endoscopy showed it could potentially improve the management of patients with IBD.Confirmatory evidence from real-life clinical scenarios should be obtained to verify the added value of AI-assisted IBD endoscopy in assessing UC mucosal activity and in CD capsule reading.

Dataset Information

Development of Reliable, Valid and Responsive Scoring Systems for Endoscopy and Histology in Animal Models for Inflammatory Bowel Disease.

Background and aims

Methods

Results

Conclusions

Publications

Development of Reliable, Valid and Responsive Scoring Systems for Endoscopy and Histology in Animal Models for Inflammatory Bowel Disease.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets