Diagnostic yield Evaluation Studies of a real-time endoscopic Image diagNosis support system using Artificial Intelligence technology
Ontology highlight
ABSTRACT:
DISEASE(S): Colorectal Neoplasms
PROVIDER: 2656527 | ecrin-mdr-crc |
REPOSITORIES: ECRIN MDR
Similar Datasets
Project description:Gaps in colonoscopy skills among endoscopists, primarily due to experience, have been identified, and solutions are critically needed. Hence, the development of a real-time robust detection system for colorectal neoplasms is considered to significantly reduce the risk of missed lesions during colonoscopy. Here, we develop an artificial intelligence (AI) system that automatically detects early signs of colorectal cancer during colonoscopy; the AI system shows the sensitivity and specificity are 97.3% (95% confidence interval [CI]?=?95.9%-98.4%) and 99.0% (95% CI?=?98.6%-99.2%), respectively, and the area under the curve is 0.975 (95% CI?=?0.964-0.986) in the validation set. Moreover, the sensitivities are 98.0% (95% CI?=?96.6%-98.8%) in the polypoid subgroup and 93.7% (95% CI?=?87.6%-96.9%) in the non-polypoid subgroup; To accelerate the detection, tensor metrics in the trained model was decomposed, and the system can predict cancerous regions 21.9?ms/image on average. These findings suggest that the system is sufficient to support endoscopists in the high detection against non-polypoid lesions, which are frequently missed by optical colonoscopy. This AI system can alert endoscopists in real-time to avoid missing abnormalities such as non-polypoid polyps during colonoscopy, improving the early detection of this disease.
| S-EPMC6783454 | biostudies-literature
Project description:Artificial intelligence models match or exceed dermatologists in melanoma image classification. Less is known about their robustness against real-world variations, and clinicians may incorrectly assume that a model with an acceptable area under the receiver operating characteristic curve or related performance metric is ready for clinical use. Here, we systematically assessed the performance of dermatologist-level convolutional neural networks (CNNs) on real-world non-curated images by applying computational "stress tests". Our goal was to create a proxy environment in which to comprehensively test the generalizability of off-the-shelf CNNs developed without training or evaluation protocols specific to individual clinics. We found inconsistent predictions on images captured repeatedly in the same setting or subjected to simple transformations (e.g., rotation). Such transformations resulted in false positive or negative predictions for 6.5-22% of skin lesions across test datasets. Our findings indicate that models meeting conventionally reported metrics need further validation with computational stress tests to assess clinic readiness.
| S-EPMC7820258 | biostudies-literature
Project description:BackgroundWe aimed to develop and validate a real-time deep convolutional neural networks (DCNNs) system for detecting early gastric cancer (EGC).MethodsAll 45,240 endoscopic images from 1364 patients were divided into a training dataset (35823 images from 1085 patients) and a validation dataset (9417 images from 279 patients). Another 1514 images from three other hospitals were used as external validation. We compared the diagnostic performance of the DCNN system with endoscopists, and then evaluated the performance of endoscopists with or without referring to the system. Thereafter, we evaluated the diagnostic ability of the DCNN system in video streams. The accuracy, sensitivity, specificity, positive predictive value, negative predictive value and Cohen's kappa coefficient were measured to assess the detection performance.FindingThe DCNN system showed good performance in EGC detection in validation datasets, with accuracy (85.1%-91.2%), sensitivity (85.9%-95.5%), specificity (81.7%-90.3%), and AUC (0.887-0.940). The DCNN system showed better diagnostic performance than endoscopists and improved the performance of endoscopists. The DCNN system was able to process oesophagogastroduodenoscopy (OGD) video streams to detect EGC lesions in real time.InterpretationWe developed a real-time DCNN system for EGC detection with high accuracy and stability. Multicentre prospective validation is needed to acquire high-level evidence for its clinical application.FundingThis work was supported by the National Natural Science Foundation of China (grant nos. 81672935 and 81871947), Jiangsu Clinical Medical Center of Digestive System Diseases and Gastrointestinal Cancer (grant no. YXZXB2016002), and Nanjing Science and Technology Development Foundation (grant no. 2017sb332019).
| S-EPMC7708824 | biostudies-literature
Project description:EUS is an important diagnostic tool in pancreatic lesions. Performance of single-center and/or single study artificial intelligence (AI) in the analysis of EUS-images of pancreatic lesions has been reported. The aim of this study was to quantitatively study the pooled rates of diagnostic performance of AI in EUS image analysis of pancreas using rigorous systematic review and meta-analysis methodology. Multiple databases were searched (from inception to December 2020) and studies that reported on the performance of AI in EUS analysis of pancreatic adenocarcinoma were selected. The random-effects model was used to calculate the pooled rates. In cases where multiple 2 × 2 contingency tables were provided for different thresholds, we assumed the data tables as independent from each other. Heterogeneity was assessed by I2% and 95% prediction intervals. Eleven studies were analyzed. The pooled overall accuracy, sensitivity, specificity, positive predictive value, and negative predictive value were 86% (95% confidence interval [82.8-88.6]), 90.4% (88.1-92.3), 84% (79.3-87.8), 90.2% (87.4-92.3) and 89.8% (86-92.7), respectively. On subgroup analysis, the corresponding pooled parameters in studies that used neural networks were 85.5% (80-89.8), 91.8% (87.8-94.6), 84.6% (73-91.7), 87.4% (82-91.3), and 91.4% (83.7-95.6)], respectively. Based on our meta-analysis, AI seems to perform well in the EUS-image analysis of pancreatic lesions.
| S-EPMC9258019 | biostudies-literature
Project description:PurposePre-visit planning (PVP) is believed to improve effectiveness, efficiency, and experience of care, yet numerous implementation barriers exist. There are opportunities for technology-enabled and artificial intelligence (AI) support to augment existing human-driven PVP processes-from appointment reminders and pre-visit questionnaires to pre-visit order sets and care gap closures. This study aimed to explore the current state of PVP, barriers to implementation, evidence of impact, and potential use of non-AI and AI tools to support PVP.MethodsWe used an environmental scan approach involving: (1) literature review; (2) key informant interviews with PVP experts in ambulatory care; and (3) a search of the public domain for technology-enabled and AI solutions that support PVP. We then synthesized the findings using a qualitative matrix analysis.ResultsWe found 26 unique PVP implementations in the literature and conducted 16 key informant interviews. Demonstration of impact is typically limited to process outcomes, with improved patient outcomes remaining elusive. Our key informants reported that many PVP barriers are human effort-related and see potential for non-AI and AI technologies to support certain aspects of PVP. We identified 8 examples of commercially available technology-enabled tools that support PVP, some with AI capabilities; however, few of these have been independently evaluated.ConclusionsAs health systems transition toward value-based payment models in a world where the coronavirus disease 2019 pandemic has shifted patient care into the virtual space, PVP activities-driven by humans and supported by technology-may become more important and powerful and should be rigorously evaluated.
| S-EPMC8437572 | biostudies-literature
Project description:The goal of this substudy is to investigate the accuracy of a computer-aided polyp characterization (CADx) system. The main question[s] it aims to answer are:
• How high is the specificity of the AI system when characterizing colorectal polyps
Participants will receive a standard colonoscopy, assisted by the artificial intelligence (AI) assisted system GI Genius.
Researchers will compare the AI system´s characterization with the histopathology to see how accurate the system is.
| 10350 | ecrin-mdr-crc
Project description:Artificial intelligence-driven voice technology deployed on mobile phones and smart speakers has the potential to improve patient management and organizational workflow. Voice chatbots have been already implemented in health care-leveraging innovative telehealth solutions during the COVID-19 pandemic. They allow for automatic acute care triaging and chronic disease management, including remote monitoring, preventive care, patient intake, and referral assistance. This paper focuses on the current clinical needs and applications of artificial intelligence-driven voice chatbots to drive operational effectiveness and improve patient experience and outcomes.
| S-EPMC8153030 | biostudies-literature
Project description:IntroductionStandards for Reporting of Diagnostic Accuracy Study (STARD) was developed to improve the completeness and transparency of reporting in studies investigating diagnostic test accuracy. However, its current form, STARD 2015 does not address the issues and challenges raised by artificial intelligence (AI)-centred interventions. As such, we propose an AI-specific version of the STARD checklist (STARD-AI), which focuses on the reporting of AI diagnostic test accuracy studies. This paper describes the methods that will be used to develop STARD-AI.Methods and analysisThe development of the STARD-AI checklist can be distilled into six stages. (1) A project organisation phase has been undertaken, during which a Project Team and a Steering Committee were established; (2) An item generation process has been completed following a literature review, a patient and public involvement and engagement exercise and an online scoping survey of international experts; (3) A three-round modified Delphi consensus methodology is underway, which will culminate in a teleconference consensus meeting of experts; (4) Thereafter, the Project Team will draft the initial STARD-AI checklist and the accompanying documents; (5) A piloting phase among expert users will be undertaken to identify items which are either unclear or missing. This process, consisting of surveys and semistructured interviews, will contribute towards the explanation and elaboration document and (6) On finalisation of the manuscripts, the group's efforts turn towards an organised dissemination and implementation strategy to maximise end-user adoption.Ethics and disseminationEthical approval has been granted by the Joint Research Compliance Office at Imperial College London (reference number: 19IC5679). A dissemination strategy will be aimed towards five groups of stakeholders: (1) academia, (2) policy, (3) guidelines and regulation, (4) industry and (5) public and non-specific stakeholders. We anticipate that dissemination will take place in Q3 of 2021.
| S-EPMC8240576 | biostudies-literature
Project description:In late December 2019, a new type of coronavirus was discovered, which was later named severe acute respiratory syndrome coronavirus 2(SARS-CoV-2). Since its discovery, the virus has spread globally, with 2,975,875 deaths as of 15 April 2021, and has had a huge impact on our health systems and economy. How to suppress the continued spread of new coronary pneumonia is the main task of many scientists and researchers. The introduction of artificial intelligence technology has provided a huge contribution to the suppression of the new coronavirus. This article discusses the main application of artificial intelligence technology in the suppression of coronavirus from three major aspects of identification, prediction, and development through a large amount of literature research, and puts forward the current main challenges and possible development directions. The results show that it is an effective measure to combine artificial intelligence technology with a variety of new technologies to predict and identify COVID-19 patients.
| S-EPMC8720541 | biostudies-literature
Project description:ObjectiveTo develop an artificial intelligence (AI)-based algorithm which can automatically detect food items from images acquired by an egocentric wearable camera for dietary assessment.DesignTo study human diet and lifestyle, large sets of egocentric images were acquired using a wearable device, called eButton, from free-living individuals. Three thousand nine hundred images containing real-world activities, which formed eButton data set 1, were manually selected from thirty subjects. eButton data set 2 contained 29 515 images acquired from a research participant in a week-long unrestricted recording. They included both food- and non-food-related real-life activities, such as dining at both home and restaurants, cooking, shopping, gardening, housekeeping chores, taking classes, gym exercise, etc. All images in these data sets were classified as food/non-food images based on their tags generated by a convolutional neural network.ResultsA cross data-set test was conducted on eButton data set 1. The overall accuracy of food detection was 91·5 and 86·4 %, respectively, when one-half of data set 1 was used for training and the other half for testing. For eButton data set 2, 74·0 % sensitivity and 87·0 % specificity were obtained if both 'food' and 'drink' were considered as food images. Alternatively, if only 'food' items were considered, the sensitivity and specificity reached 85·0 and 85·8 %, respectively.ConclusionsThe AI technology can automatically detect foods from low-quality, wearable camera-acquired real-world egocentric images with reasonable accuracy, reducing both the burden of data processing and privacy concerns.
| S-EPMC8114337 | biostudies-literature