Dataset Information

An objective comparison of detection and segmentation algorithms for artefacts in clinical endoscopy.

ABSTRACT: We present a comprehensive analysis of the submissions to the first edition of the Endoscopy Artefact Detection challenge (EAD). Using crowd-sourcing, this initiative is a step towards understanding the limitations of existing state-of-the-art computer vision methods applied to endoscopy and promoting the development of new approaches suitable for clinical translation. Endoscopy is a routine imaging technique for the detection, diagnosis and treatment of diseases in hollow-organs; the esophagus, stomach, colon, uterus and the bladder. However the nature of these organs prevent imaged tissues to be free of imaging artefacts such as bubbles, pixel saturation, organ specularity and debris, all of which pose substantial challenges for any quantitative analysis. Consequently, the potential for improved clinical outcomes through quantitative assessment of abnormal mucosal surface observed in endoscopy videos is presently not realized accurately. The EAD challenge promotes awareness of and addresses this key bottleneck problem by investigating methods that can accurately classify, localize and segment artefacts in endoscopy frames as critical prerequisite tasks. Using a diverse curated multi-institutional, multi-modality, multi-organ dataset of video frames, the accuracy and performance of 23 algorithms were objectively ranked for artefact detection and segmentation. The ability of methods to generalize to unseen datasets was also evaluated. The best performing methods (top 15%) propose deep learning strategies to reconcile variabilities in artefact appearance with respect to size, modality, occurrence and organ type. However, no single method outperformed across all tasks. Detailed analyses reveal the shortcomings of current training strategies and highlight the need for developing new optimal metrics to accurately quantify the clinical applicability of methods.

SUBMITTER: Ali S

PROVIDER: S-EPMC7026422 | biostudies-literature | 2020 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

An objective comparison of detection and segmentation algorithms for artefacts in clinical endoscopy.

Ali Sharib S Zhou Felix F Braden Barbara B Bailey Adam A Yang Suhui S Cheng Guanju G Zhang Pengyi P Li Xiaoqiong X Kayser Maxime M Soberanis-Mukul Roger D RD Albarqouni Shadi S Wang Xiaokang X Wang Chunqing C Watanabe Seiryo S Oksuz Ilkay I Ning Qingtian Q Yang Shufan S Khan Mohammad Azam MA Gao Xiaohong W XW Realdon Stefano S Loshchenov Maxim M Schnabel Julia A JA East James E JE Wagnieres Georges G Loschenov Victor B VB Grisan Enrico E Daul Christian C Blondel Walter W Rittscher Jens J

Scientific reports 20200217 1

We present a comprehensive analysis of the submissions to the first edition of the Endoscopy Artefact Detection challenge (EAD). Using crowd-sourcing, this initiative is a step towards understanding the limitations of existing state-of-the-art computer vision methods applied to endoscopy and promoting the development of new approaches suitable for clinical translation. Endoscopy is a routine imaging technique for the detection, diagnosis and treatment of diseases in hollow-organs; the esophagus, ...[more]

PMID: 32066744

Similar Datasets

Project description:Background and aimsBig data analytics leverage patterns in data to harvest valuable information, but are rarely implemented in clinical care. Optimising thiopurine therapy for inflammatory bowel disease [IBD] has proved difficult. Current methods using 6-thioguanine nucleotide [6-TGN] metabolites have failed in randomized controlled trials [RCTs], and have not been used to predict objective remission [OR]. Our aims were to: 1) develop machine learning algorithms [MLA] using laboratory values and age to identify patients in objective remission on thiopurines; and 2) determine whether achieving algorithm-predicted objective remission resulted in fewer clinical events per year.MethodsObjective remission was defined as the absence of objective evidence of intestinal inflammation. MLAs were developed to predict three outcomes: objective remission, non-adherence, and preferential shunting to 6-methylmercaptopurine [6-MMP]. The performance of the algorithms was evaluated using the area under the receiver operating characteristic curve [AuROC]. Clinical event rates of new steroid prescriptions, hospitalisations, and abdominal surgeries were measured.ResultsRetrospective review was performed on medical records of 1080 IBD patients on thiopurines. The AuROC for algorithm-predicted remission in the validation set was 0.79 vs 0.49 for 6-TGN. The mean number of clinical events per year in patients with sustained algorithm-predicted remission [APR] was 1.08 vs 3.95 in those that did not have sustained APR [p < 1 x 10-5]. Reductions in the individual endpoints of steroid prescriptions/year [-1.63, p < 1 x 10-5], hospitalisations/year [-1.05, p < 1 x 10-5], and surgeries/year [-0.19, p = 0.065] were seen with algorithm-predicted remission.ConclusionsA machine learning algorithm was able to identify IBD patients on thiopurines with algorithm-predicted objective remission, a state associated with significant clinical benefits, including decreased steroid prescriptions, hospitalisations, and surgeries.

Project description:BackgroundCommunity detection algorithms are fundamental tools to uncover important features in networks. There are several studies focused on social networks but only a few deal with biological networks. Directly or indirectly, most of the methods maximize modularity, a measure of the density of links within communities as compared to links between communities.ResultsHere we analyze six different community detection algorithms, namely, Combo, Conclude, Fast Greedy, Leading Eigen, Louvain and Spinglass, on two important biological networks to find their communities and evaluate the results in terms of topological and functional features through Kyoto Encyclopedia of Genes and Genomes pathway and Gene Ontology term enrichment analysis. At a high level, the main assessment criteria are 1) appropriate community size (neither too small nor too large), 2) representation within the community of only one or two broad biological functions, 3) most genes from the network belonging to a pathway should also belong to only one or two communities, and 4) performance speed. The first network in this study is a network of Protein-Protein Interactions (PPI) in Saccharomyces cerevisiae (Yeast) with 6532 nodes and 229,696 edges and the second is a network of PPI in Homo sapiens (Human) with 20,644 nodes and 241,008 edges. All six methods perform well, i.e., find reasonably sized and biologically interpretable communities, for the Yeast PPI network but the Conclude method does not find reasonably sized communities for the Human PPI network. Louvain method maximizes modularity by using an agglomerative approach, and is the fastest method for community detection. For the Yeast PPI network, the results of Spinglass method are most similar to the results of Louvain method with regard to the size of communities and core pathways they identify, whereas for the Human PPI network, Combo and Spinglass methods yield the most similar results, with Louvain being the next closest.ConclusionsFor Yeast and Human PPI networks, Louvain method is likely the best method to find communities in terms of detecting known core pathways in a reasonable time.

Dataset Information

An objective comparison of detection and segmentation algorithms for artefacts in clinical endoscopy.

Publications

An objective comparison of detection and segmentation algorithms for artefacts in clinical endoscopy.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets