Deep Learning Analysis of In Vivo Hyperspectral Images for Automated Intraoperative Nerve Detection.
Ontology highlight
ABSTRACT:
SUBMITTER: Barberio M
PROVIDER: S-EPMC8391550 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:With the continuous progress of development, deep learning has made good progress in the analysis and recognition of images, which has also triggered some researchers to explore the area of combining deep learning with hyperspectral medical images and achieve some progress. This paper introduces the principles and techniques of hyperspectral imaging systems, summarizes the common medical hyperspectral imaging systems, and summarizes the progress of some emerging spectral imaging systems through analyzing the literature. In particular, this article introduces the more frequently used medical hyperspectral images and the pre-processing techniques of the spectra, and in other sections, it discusses the main developments of medical hyperspectral combined with deep learning for disease diagnosis. On the basis of the previous review, tne limited factors in the study on the application of deep learning to hyperspectral medical images are outlined, promising research directions are summarized, and the future research prospects are provided for subsequent scholars.
| S-EPMC9784550 | biostudies-literature
Project description:The approximity of the inferior alveolar nerve (IAN) to the roots of lower third molars (M3) is a risk factor for the occurrence of nerve damage and subsequent sensory disturbances of the lower lip and chin following the removal of third molars. To assess this risk, the identification of M3 and IAN on dental panoramic radiographs (OPG) is mandatory. In this study, we developed and validated an automated approach, based on deep-learning, to detect and segment the M3 and IAN on OPGs. As a reference, M3s and IAN were segmented manually on 81 OPGs. A deep-learning approach based on U-net was applied on the reference data to train the convolutional neural network (CNN) in the detection and segmentation of the M3 and IAN. Subsequently, the trained U-net was applied onto the original OPGs to detect and segment both structures. Dice-coefficients were calculated to quantify the degree of similarity between the manually and automatically segmented M3s and IAN. The mean dice-coefficients for M3s and IAN were 0.947 ± 0.033 and 0.847 ± 0.099, respectively. Deep-learning is an encouraging approach to segment anatomical structures and later on in clinical decision making, though further enhancement of the algorithm is advised to improve the accuracy.
| S-EPMC6588560 | biostudies-literature
Project description:Coronavirus is still the leading cause of death worldwide. There are a set number of COVID-19 test units accessible in emergency clinics because of the expanding cases daily. Therefore, it is important to implement an automatic detection and classification system as a speedy elective finding choice to forestall COVID-19 spreading among individuals. Medical images analysis is one of the most promising research areas, it provides facilities for diagnosis and making decisions of a number of diseases such as Coronavirus. This paper conducts a comparative study of the use of the recent deep learning models (VGG16, VGG19, DenseNet201, Inception_ResNet_V2, Inception_V3, Resnet50, and MobileNet_V2) to deal with detection and classification of coronavirus pneumonia. The experiments were conducted using chest X-ray & CT dataset of 6087 images (2780 images of bacterial pneumonia, 1493 of coronavirus, 231 of Covid19, and 1583 normal) and confusion matrices are used to evaluate model performances. Results found out that the use of inception_Resnet_V2 and Densnet201 provide better results compared to other models used in this work (92.18% accuracy for Inception-ResNetV2 and 88.09% accuracy for Densnet201).Communicated by Ramaswamy H. Sarma.
| S-EPMC7256347 | biostudies-literature
Project description:The main goal of brain cancer surgery is to perform an accurate resection of the tumor, preserving as much normal brain tissue as possible for the patient. The development of a non-contact and label-free method to provide reliable support for tumor resection in real-time during neurosurgical procedures is a current clinical need. Hyperspectral imaging is a non-contact, non-ionizing, and label-free imaging modality that can assist surgeons during this challenging task without using any contrast agent. In this work, we present a deep learning-based framework for processing hyperspectral images of in vivo human brain tissue. The proposed framework was evaluated by our human image database, which includes 26 in vivo hyperspectral cubes from 16 different patients, among which 258,810 pixels were labeled. The proposed framework is able to generate a thematic map where the parenchymal area of the brain is delineated and the location of the tumor is identified, providing guidance to the operating surgeon for a successful and precise tumor resection. The deep learning pipeline achieves an overall accuracy of 80% for multiclass classification, improving the results obtained with traditional support vector machine (SVM)-based approaches. In addition, an aid visualization system is presented, where the final thematic map can be adjusted by the operating surgeon to find the optimal classification threshold for the current situation during the surgical procedure.
| S-EPMC6412736 | biostudies-literature
Project description:Caveolae are nanoscopic and mechanosensitive invaginations of the plasma membrane, essential for adipocyte biology. Transmission electron microscopy (TEM) offers the highest resolution for caveolae visualization, but provides complicated images that are difficult to classify or segment using traditional automated algorithms such as threshold-based methods. As a result, the time-consuming tasks of localization and quantification of caveolae are currently performed manually. We used the Keras library in R to train a convolutional neural network with a total of 36,000 TEM image crops obtained from adipocytes previously annotated manually by an expert. The resulting model can differentiate caveolae from non-caveolae regions with a 97.44% accuracy. The predictions of this model are further processed to obtain caveolae central coordinate detection and cytoplasm boundary delimitation. The model correctly finds negligible caveolae predictions in images from caveolae depleted Cav1-/- adipocytes. In large reconstructions of adipocyte sections, model and human performances are comparable. We thus provide a new tool for accurate caveolae automated analysis that could speed up and assist in the characterization of the cellular mechanical response.
| S-EPMC9755247 | biostudies-literature
Project description:Brain surgery is one of the most common and effective treatments for brain tumour. However, neurosurgeons face the challenge of determining the boundaries of the tumour to achieve maximum resection, while avoiding damage to normal tissue that may cause neurological sequelae to patients. Hyperspectral (HS) imaging (HSI) has shown remarkable results as a diagnostic tool for tumour detection in different medical applications. In this work, we demonstrate, with a robust k-fold cross-validation approach, that HSI combined with the proposed processing framework is a promising intraoperative tool for in-vivo identification and delineation of brain tumours, including both primary (high-grade and low-grade) and secondary tumours. Analysis of the in-vivo brain database, consisting of 61 HS images from 34 different patients, achieve a highest median macro F1-Score result of 70.2 ± 7.9% on the test set using both spectral and spatial information. Here, we provide a benchmark based on machine learning for further developments in the field of in-vivo brain tumour detection and delineation using hyperspectral imaging to be used as a real-time decision support tool during neurosurgical workflows.
| S-EPMC10646050 | biostudies-literature
Project description:Likely drug candidates which are identified in traditional pre-clinical drug screens often fail in patient trials, increasing the societal burden of drug discovery. A major contributing factor to this phenomenon is the failure of traditional in vitro models of drug response to accurately mimic many of the more complex properties of human biology. We have recently introduced a new microphysiological system for growing vascularized, perfused microtissues that more accurately models human physiology and is suitable for large drug screens. In this work, we develop a machine learning model that can quickly and accurately flag compounds which effectively disrupt vascular networks from images taken before and after drug application in vitro. The system is based on a convolutional neural network and achieves near perfect accuracy while committing potentially no expensive false negatives.
| S-EPMC7904235 | biostudies-literature
Project description:PURPOSE:To develop and test deep learning classifiers that detect gonioscopic angle closure and primary angle closure disease (PACD) based on fully automated analysis of anterior segment OCT (AS-OCT) images. METHODS:Subjects were recruited as part of the Chinese-American Eye Study (CHES), a population-based study of Chinese Americans in Los Angeles, California, USA. Each subject underwent a complete ocular examination including gonioscopy and AS-OCT imaging in each quadrant of the anterior chamber angle (ACA). Deep learning methods were used to develop 3 competing multi-class convolutional neural network (CNN) classifiers for modified Shaffer grades 0, 1, 2, 3, and 4. Binary probabilities for closed (grades 0 and 1) and open (grades 2, 3, and 4) angles were calculated by summing over the corresponding grades. Classifier performance was evaluated by 5-fold cross-validation and on an independent test dataset. Outcome measures included area under the receiver operating characteristic curve (AUC) for detecting gonioscopic angle closure and PACD, defined as either 2 or 3 quadrants of gonioscopic angle closure per eye. RESULTS:A total of 4036 AS-OCT images with corresponding gonioscopy grades (1943 open, 2093 closed) were obtained from 791 CHES subjects. Three competing CNN classifiers were developed with a cross-validation dataset of 3396 images (1632 open, 1764 closed) from 664 subjects. The remaining 640 images (311 open, 329 closed) from 127 subjects were segregated into a test dataset. The best-performing classifier was developed by applying transfer learning to the ResNet-18 architecture. For detecting gonioscopic angle closure, this classifier achieved an AUC of 0.933 (95% confidence interval, 0.925-0.941) on the cross-validation dataset and 0.928 on the test dataset. For detecting PACD based on 2- and 3-quadrant definitions, the ResNet-18 classifier achieved AUCs of 0.964 and 0.952, respectively, on the test dataset. CONCLUSION:Deep learning classifiers effectively detect gonioscopic angle closure and PACD based on automated analysis of AS-OCT images. These methods could be used to automate clinical evaluations of the ACA and improve access to eye care in high-risk populations.
| S-EPMC6888901 | biostudies-literature
Project description:Coronary luminal dimensions change during the cardiac cycle. However, contemporary volumetric intravascular ultrasound (IVUS) analysis is performed in non-gated images as existing methods to acquire gated or to retrospectively gate IVUS images have failed to dominate in research. We developed a novel deep learning (DL)-methodology for end-diastolic frame detection in IVUS and compared its efficacy against expert analysts and a previously established methodology using electrocardiographic (ECG)-estimations as reference standard. Near-infrared spectroscopy-IVUS (NIRS-IVUS) data were prospectively acquired from 20 coronary arteries and co-registered with the concurrent ECG-signal to identify end-diastolic frames. A DL-methodology which takes advantage of changes in intensity of corresponding pixels in consecutive NIRS-IVUS frames and consists of a network model designed in a bidirectional gated-recurrent-unit (Bi-GRU) structure was trained to detect end-diastolic frames. The efficacy of the DL-methodology in identifying end-diastolic frames was compared with two expert analysts and a conventional image-based (CIB)-methodology that relies on detecting vessel movement to estimate phases of the cardiac cycle. A window of ± 100 ms from the ECG estimations was used to define accurate end-diastolic frames detection. The ECG-signal identified 3,167 end-diastolic frames. The mean difference between DL and ECG estimations was 3 ± 112 ms while the mean differences between the 1st-analyst and ECG, 2nd-analyst and ECG and CIB-methodology and ECG were 86 ± 192 ms, 78 ± 183 ms and 59 ± 207 ms, respectively. The DL-methodology was able to accurately detect 80.4%, while the two analysts and the CIB-methodology detected 39.0%, 43.4% and 42.8% of end-diastolic frames, respectively (P < 0.05). The DL-methodology can identify NIRS-IVUS end-diastolic frames accurately and should be preferred over expert analysts and CIB-methodologies, which have limited efficacy.
| S-EPMC8255253 | biostudies-literature
Project description:BackgroundTunneling nanotubes (TNTs) are cellular structures connecting cell membranes and mediating intercellular communication. TNTs are manually identified and counted by a trained investigator; however, this process is time-intensive. We therefore sought to develop an automated approach for quantitative analysis of TNTs.MethodsWe used a convolutional neural network (U-Net) deep learning model to segment phase contrast microscopy images of both cancer and non-cancer cells. Our method was composed of preprocessing and model development. We developed a new preprocessing method to label TNTs on a pixel-wise basis. Two sequential models were employed to detect TNTs. First, we identified the regions of images with TNTs by implementing a classification algorithm. Second, we fed parts of the image classified as TNT-containing into a modified U-Net model to estimate TNTs on a pixel-wise basis.ResultsThe algorithm detected 49.9% of human expert-identified TNTs, counted TNTs, and calculated the number of TNTs per cell, or TNT-to-cell ratio (TCR); it detected TNTs that were not originally detected by the experts. The model had 0.41 precision, 0.26 recall, and 0.32 f-1 score on a test dataset. The predicted and true TCRs were not significantly different across the training and test datasets (p = 0.78).ConclusionsOur automated approach labeled and detected TNTs and cells imaged in culture, resulting in comparable TCRs to those determined by human experts. Future studies will aim to improve on the accuracy, precision, and recall of the algorithm.
| S-EPMC9562025 | biostudies-literature