Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

An image retrieval framework for real-time endoscopic image retargeting.

ABSTRACT: Serial endoscopic examinations of a patient are important for early diagnosis of malignancies in the gastrointestinal tract. However, retargeting for optical biopsy is challenging due to extensive tissue variations between examinations, requiring the method to be tolerant to these changes whilst enabling real-time retargeting.This work presents an image retrieval framework for inter-examination retargeting. We propose both a novel image descriptor tolerant of long-term tissue changes and a novel descriptor matching method in real time. The descriptor is based on histograms generated from regional intensity comparisons over multiple scales, offering stability over long-term appearance changes at the higher levels, whilst remaining discriminative at the lower levels. The matching method then learns a hashing function using random forests, to compress the string and allow for fast image comparison by a simple Hamming distance metric.A dataset that contains 13 in vivo gastrointestinal videos was collected from six patients, representing serial examinations of each patient, which includes videos captured with significant time intervals. Precision-recall for retargeting shows that our new descriptor outperforms a number of alternative descriptors, whilst our hashing method outperforms a number of alternative hashing approaches.We have proposed a novel framework for optical biopsy in serial endoscopic examinations. A new descriptor, combined with a novel hashing method, achieves state-of-the-art retargeting, with validation on in vivo videos from six patients. Real-time performance also allows for practical integration without disturbing the existing clinical workflow.

SUBMITTER: Ye M

PROVIDER: S-EPMC5541128 | biostudies-other | 2017 Aug

REPOSITORIES: biostudies-other

ACCESS DATA

Json Xml

Similar Datasets

Real-time endoscopic image orientation correction system using an accelerometer and gyrosensor.

Project description:The discrepancy between spatial orientations of an endoscopic image and a physician's working environment can make it difficult to interpret endoscopic images. In this study, we developed and evaluated a device that corrects the endoscopic image orientation using an accelerometer and gyrosensor. The acceleration of gravity and angular velocity were retrieved from the accelerometer and gyrosensor attached to the handle of the endoscope. The rotational angle of the endoscope handle was calculated using a Kalman filter with transmission delay compensation. Technical evaluation of the orientation correction system was performed using a camera by comparing the optical rotational angle from the captured image with the rotational angle calculated from the sensor outputs. For the clinical utility test, fifteen anesthesiology residents performed a video endoscopic examination of an airway model with and without using the orientation correction system. The participants reported numbers written on papers placed at the left main, right main, and right upper bronchi of the airway model. The correctness and the total time it took participants to report the numbers were recorded. During the technical evaluation, errors in the calculated rotational angle were less than 5 degrees. In the clinical utility test, there was a significant time reduction when using the orientation correction system compared with not using the system (median, 52 vs. 76 seconds; P = .012). In this study, we developed a real-time endoscopic image orientation correction system, which significantly improved physician performance during a video endoscopic exam.

| S-EPMC5669437 | biostudies-literature

Development of a real-time endoscopic image diagnosis support system using deep learning technology in colonoscopy.

Project description:Gaps in colonoscopy skills among endoscopists, primarily due to experience, have been identified, and solutions are critically needed. Hence, the development of a real-time robust detection system for colorectal neoplasms is considered to significantly reduce the risk of missed lesions during colonoscopy. Here, we develop an artificial intelligence (AI) system that automatically detects early signs of colorectal cancer during colonoscopy; the AI system shows the sensitivity and specificity are 97.3% (95% confidence interval [CI]?=?95.9%-98.4%) and 99.0% (95% CI?=?98.6%-99.2%), respectively, and the area under the curve is 0.975 (95% CI?=?0.964-0.986) in the validation set. Moreover, the sensitivities are 98.0% (95% CI?=?96.6%-98.8%) in the polypoid subgroup and 93.7% (95% CI?=?87.6%-96.9%) in the non-polypoid subgroup; To accelerate the detection, tensor metrics in the trained model was decomposed, and the system can predict cancerous regions 21.9?ms/image on average. These findings suggest that the system is sufficient to support endoscopists in the high detection against non-polypoid lesions, which are frequently missed by optical colonoscopy. This AI system can alert endoscopists in real-time to avoid missing abnormalities such as non-polypoid polyps during colonoscopy, improving the early detection of this disease.

| S-EPMC6783454 | biostudies-literature

An iterative framework for EEG-based image search: robust retrieval with weak classifiers.

Project description:We revisit the framework for brain-coupled image search, where the Electroencephalography (EEG) channel under rapid serial visual presentation protocol is used to detect user preferences. Extending previous works on the synergy between content-based image labeling and EEG-based brain-computer interface (BCI), we propose a different perspective on iterative coupling. Previously, the iterations were used to improve the set of EEG-based image labels before propagating them to the unseen images for the final retrieval. In our approach we accumulate the evidence of the true labels for each image in the database through iterations. This is done by propagating the EEG-based labels of the presented images at each iteration to the rest of images in the database. Our results demonstrate a continuous improvement of the labeling performance across iterations despite the moderate EEG-based labeling (AUC <75%). The overall analysis is done in terms of the single-trial EEG decoding performance and the image database reorganization quality. Furthermore, we discuss the EEG-based labeling performance with respect to a search task given the same image database.

| S-EPMC3748021 | biostudies-literature

Towards real-time intravascular endoscopic magnetic resonance imaging.

Project description:Fast, minimally invasive, high-resolution intravascular imaging is essential for identifying vascular pathological features and for developing novel diagnostic tools and treatments. Intravascular magnetic resonance imaging (MRI) with active internal probes offers high sensitivity to pathological features without ionizing radiation or the limited luminal views of conventional X-rays, but has been unable to provide a high-speed, high-resolution, endoscopic view. Herein, real-time MRI endoscopy is introduced for performing MRI from a viewpoint intrinsically locked to a miniature active, internal transmitter-receiver in a clinical 3.0-T MRI scanner. Real-time MRI endoscopy at up to 2 frames/s depicts vascular wall morphological features, atherosclerosis, and calcification at 80 to 300 ?m resolution during probe advancement through diseased human iliac artery specimens and atherosclerotic rabbit aortas in vivo. MRI endoscopy offers the potential for fast, minimally invasive, transluminal, high-resolution imaging of vascular disease on a common clinical platform suitable for evaluating and targeting atherosclerosis in both experimental and clinical settings.

| S-EPMC3064492 | biostudies-literature

Real-time image-based rigid registration of three-dimensional ultrasound.

Project description:Registration of three-dimensional ultrasound (3DUS) volumes is necessary in several applications, such as when stitching volumes to expand the field of view or when stabilizing a temporal sequence of volumes to cancel out motion of the probe or anatomy. Current systems that register 3DUS volumes either use external tracking systems (electromagnetic or optical), which add expense and impose limitations on acquisitions, or are image-based methods that operate offline and are incapable of providing immediate feedback to clinicians. This paper presents a real-time image-based algorithm for rigid registration of 3DUS volumes designed for acquisitions in which small probe displacements occur between frames. Described is a method for feature detection and descriptor formation that takes into account the characteristics of 3DUS imaging. Volumes are registered by determining a correspondence between these features. A global set of features is maintained and integrated into the registration, which limits the accumulation of registration error. The system operates in real-time (i.e. volumes are registered as fast or faster than they are acquired) by using an accelerated framework on a graphics processing unit. The algorithm's parameter selection and performance is analyzed and validated in studies which use both water tank and clinical images. The resulting registration accuracy is comparable to similar feature-based registration methods, but in contrast to these methods, can register 3DUS volumes in real-time.

| S-EPMC3267836 | biostudies-literature

An intravital window to image the colon in real time.

Project description:Intravital microscopy is a powerful technique to observe dynamic processes with single-cell resolution in live animals. No intravital window has been developed for imaging the colon due to its anatomic location and motility, although the colon is a key organ where the majority of microbiota reside and common diseases such as inflammatory bowel disease, functional gastrointestinal disorders, and colon cancer occur. Here we describe an intravital murine colonic window with a stabilizing ferromagnetic scaffold for chronic imaging, minimizing motion artifacts while maximizing long-term survival by preventing colonic obstruction. Using this setup, we image fluorescently-labeled stem cells, bacteria, and immune cells in live animal colons. Furthermore, we image nerve activity via calcium imaging in real time to demonstrate that electrical sacral nerve stimulation can activate colonic enteric neurons. The simple implantable apparatus enables visualization of live processes in the colon, which will open the window to a broad range of studies.

| S-EPMC6906443 | biostudies-literature

An adaptive framework for real-time ECG transmission in mobile environments.

Project description:Wireless electrocardiogram (ECG) monitoring involves the measurement of ECG signals and their timely transmission over wireless networks to remote healthcare professionals. However, fluctuations in wireless channel conditions pose quality-of-service challenges for real-time ECG monitoring services in a mobile environment. We present an adaptive framework for layered coding and transmission of ECG data that can cope with a time-varying wireless channel. The ECG is segmented into layers with differing importance with respect to the quality of the reconstructed signal. According to this observation, we have devised a simple and efficient real-time scheduling algorithm based on the earliest deadline first (EDF) policy, which decides the order of transmitting or retransmitting packets that contain ECG data at any given time for the delivery of scalable ECG data over a lossy channel. The algorithm takes into account the differing priorities of packets in each layer, which prevents the perceived quality of the reconstructed ECG signal from degrading abruptly as channel conditions worsen, while using the available bandwidth efficiently. Extensive simulations demonstrate this improvement in perceived quality.

| S-EPMC4109261 | biostudies-other

Diagnostic yield Evaluation Studies of a real-time endoscopic Image diagNosis support system using Artificial Intelligence technology

Project description:Primary outcome(s): Adenoma Detection Rate

| 2656527 | ecrin-mdr-crc

Real-time video-assisted retrieval of airway foreign body in very young pediatric patients.

Project description:ObjectivesAdvancements in medical endoscopy and techniques of rigid bronchoscopy for foreign body removal have enabled higher diagnostic accuracy, reduced morbidity and precise manipulation. However, in pediatric patients, endoscope-combined forceps may be too big to fit into the small sized airway. Here we present our method of endoscope assisted rigid bronchoscopy in pediatric patients and compare the clinical benefits with conventional naked-eye rigid bronchoscopy.MethodsWe used a 2.7 mm, 0° straight endoscope and small caliber grasping forceps with 3.0 to 4.5 mm sized rigid bronchoscopy for very young (<3 years of age) patients of foreign body aspiration. As an assistant held the rigid bronchoscope in situ, the operator could manipulate the endoscope and forceps bimanually. With endoscopic guidance, the foreign body retrieval was performed carefully. The clinical advantages were compared between our endoscope-assisted method (n=29) and the conventional bronchoscopy method (n=33) in terms of operation time and recovery (hospital stay).ResultsBimanual endoscope-assisted rigid bronchoscopy method was technically feasible and safe. The operation time was less, compared to the conventional technique and the patients recovered more quickly. In all cases, our method completely removed the foreign body without need of a second bronchoscopy procedure.ConclusionBimanual endoscope-assisted retrieval of airway foreign body in very young age pediatric patients was superior to the conventional naked-eye method concerning accurate manipulation and safety.

| S-EPMC4240493 | biostudies-literature

Towards real-time image deconvolution: application to confocal and STED microscopy.

Project description:Although deconvolution can improve the quality of any type of microscope, the high computational time required has so far limited its massive spreading. Here we demonstrate the ability of the scaled-gradient-projection (SGP) method to provide accelerated versions of the most used algorithms in microscopy. To achieve further increases in efficiency, we also consider implementations on graphic processing units (GPUs). We test the proposed algorithms both on synthetic and real data of confocal and STED microscopy. Combining the SGP method with the GPU implementation we achieve a speed-up factor from about a factor 25 to 690 (with respect the conventional algorithm). The excellent results obtained on STED microscopy images demonstrate the synergy between super-resolution techniques and image-deconvolution. Further, the real-time processing allows conserving one of the most important property of STED microscopy, i.e the ability to provide fast sub-diffraction resolution recordings.

| S-EPMC3755287 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data