Browse
Submit Data
Databases
API
Help

Dataset Information

20 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Improved Diagnostic Imaging of Brain Tumors by Multimodal Microscopy and Deep Learning.

ABSTRACT: Fluorescence-guided surgery is a state-of-the-art approach for intraoperative imaging during neurosurgical removal of tumor tissue. While the visualization of high-grade gliomas is reliable, lower grade glioma often lack visible fluorescence signals. Here, we present a hybrid prototype combining visible light optical coherence microscopy (OCM) and high-resolution fluorescence imaging for assessment of brain tumor samples acquired by 5-aminolevulinic acid (5-ALA) fluorescence-guided surgery. OCM provides high-resolution information of the inherent tissue scattering and absorption properties of tissue. We here explore quantitative attenuation coefficients derived from volumetric OCM intensity data and quantitative high-resolution 5-ALA fluorescence as potential biomarkers for tissue malignancy including otherwise difficult-to-assess low-grade glioma. We validate our findings against the gold standard histology and use attenuation and fluorescence intensity measures to differentiate between tumor core, infiltrative zone and adjacent brain tissue. Using large field-of-view scans acquired by a near-infrared swept-source optical coherence tomography setup, we provide initial assessments of tumor heterogeneity. Finally, we use cross-sectional OCM images to train a convolutional neural network that discriminates tumor from non-tumor tissue with an accuracy of 97%. Collectively, the present hybrid approach offers potential to translate into an in vivo imaging setup for substantially improved intraoperative guidance of brain tumor surgeries.

SUBMITTER: Gesperger J

PROVIDER: S-EPMC7408054 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

Deep Representation Learning For Multimodal Brain Networks.

Project description:Applying network science approaches to investigate the functions and anatomy of the human brain is prevalent in modern medical imaging analysis. Due to the complex network topology, for an individual brain, mining a discriminative network representation from the multimodal brain networks is non-trivial. The recent success of deep learning techniques on graph-structured data suggests a new way to model the non-linear cross-modality relationship. However, current deep brain network methods either ignore the intrinsic graph topology or require a network basis shared within a group. To address these challenges, we propose a novel end-to-end deep graph representation learning (Deep Multimodal Brain Networks - DMBN) to fuse multimodal brain networks. Specifically, we decipher the cross-modality relationship through a graph encoding and decoding process. The higher-order network mappings from brain structural networks to functional networks are learned in the node domain. The learned network representation is a set of node features that are informative to induce brain saliency maps in a supervised manner. We test our framework in both synthetic and real image data. The experimental results show the superiority of the proposed method over some other state-of-the-art deep brain network models.

| S-EPMC8293685 | biostudies-literature

Deep Multiview Learning to Identify Population Structure with Multimodal Imaging.

Project description:We present an effective deep multiview learning framework to identify population structure using multimodal imaging data. Our approach is based on canonical correlation analysis (CCA). We propose to use deep generalized CCA (DGCCA) to learn a shared latent representation of non-linearly mapped and maximally correlated components from multiple imaging modalities with reduced dimensionality. In our empirical study, this representation is shown to effectively capture more variance in original data than conventional generalized CCA (GCCA) which applies only linear transformation to the multi-view data. Furthermore, subsequent cluster analysis on the new feature set learned from DGCCA is able to identify a promising population structure in an Alzheimer's disease (AD) cohort. Genetic association analyses of the clustering results demonstrate that the shared representation learned from DGCCA yields a population structure with a stronger genetic basis than several competing feature learning methods.

| S-EPMC7917002 | biostudies-literature

Deep-brain imaging via epi-fluorescence Computational Cannula Microscopy.

Project description:Here we demonstrate widefield (field diameter?=?200??m) fluorescence microscopy and video imaging inside the rodent brain at a depth of 2?mm using a simple surgical glass needle (cannula) of diameter 0.22?mm as the primary optical element. The cannula guides excitation light into the brain and the fluorescence signal out of the brain. Concomitant image-processing algorithms are utilized to convert the spatially scrambled images into fluorescent images and video. The small size of the cannula enables minimally invasive imaging, while the long length (>2?mm) allow for deep-brain imaging with no additional complexity in the optical system. Since no scanning is involved, widefield fluorescence video at the native frame rate of the camera can be achieved.

| S-EPMC5357895 | biostudies-other

Single-frame deep-learning super-resolution microscopy for intracellular dynamics imaging.

Project description:Single-molecule localization microscopy (SMLM) can be used to resolve subcellular structures and achieve a tenfold improvement in spatial resolution compared to that obtained by conventional fluorescence microscopy. However, the separation of single-molecule fluorescence events that requires thousands of frames dramatically increases the image acquisition time and phototoxicity, impeding the observation of instantaneous intracellular dynamics. Here we develop a deep-learning based single-frame super-resolution microscopy (SFSRM) method which utilizes a subpixel edge map and a multicomponent optimization strategy to guide the neural network to reconstruct a super-resolution image from a single frame of a diffraction-limited image. Under a tolerable signal density and an affordable signal-to-noise ratio, SFSRM enables high-fidelity live-cell imaging with spatiotemporal resolutions of 30 nm and 10 ms, allowing for prolonged monitoring of subcellular dynamics such as interplays between mitochondria and endoplasmic reticulum, the vesicle transport along microtubules, and the endosome fusion and fission. Moreover, its adaptability to different microscopes and spectra makes it a useful tool for various imaging systems.

| S-EPMC10195829 | biostudies-literature

Deep Collaborative Learning With Application to the Study of Multimodal Brain Development.

Project description:ObjectiveMulti-modal functional magnetic resonance imaging has been widely used for brain research. Conventional data-fusion methods cannot capture complex relationship (e.g., nonlinear predictive relationship) between multiple data. This paper aims to develop a neural network framework to extract phenotype related cross-data relationships and use it to study the brain development.MethodsWe propose a novel method, deep collaborative learning (DCL), to address the limitation of existing methods. DCL first uses a deep network to represent original data and then seeks their correlations, while also linking the data representation with phenotypical information.ResultsWe studied the difference of functional connectivity (FCs) between different age groups and also use FCs as a fingerprint to predict cognitive abilities. Our experiments demonstrated higher accuracy of using DCL over other conventional models when classifying populations of different ages and cognitive scores. Moreover, DCL revealed that brain connections became stronger at adolescence stage. Furthermore, DCL detected strong correlations between default mode network and other networks which were overlooked by linear canonical correlation analysis, demonstrating DCL's ability of detecting nonlinear correlations.ConclusionThe results verified the superiority of DCL over conventional data-fusion methods. In addition, the stronger brain connection demonstrated the importance of adolescence stage for brain development.SignificanceDCL can better combine complex correlations between multiple data sets in addition to their fitting to phenotypes, with the potential to overcome the limitations of several current data-fusion models.

| S-EPMC8177041 | biostudies-literature

Improved Classification of Blood-Brain-Barrier Drugs Using Deep Learning.

Project description:Blood-Brain-Barrier (BBB) is a strict permeability barrier for maintaining the Central Nervous System (CNS) homeostasis. One of the most important conditions to judge a CNS drug is to figure out whether it has BBB permeability or not. In the past 20 years, the existing prediction approaches are usually based on the data of the physical characteristics and chemical structure of drugs. However, these methods are usually only applicable to small molecule compounds based on passive diffusion through BBB. To deal this problem, one of the most famous methods is multi-core SVM method, which is based on clinical phenotypes about Drug Side Effects and Drug Indications to predict drug penetration of BBB. This paper proposed a Deep Learning method to predict the Blood-Brain-Barrier permeability based on the clinical phenotypes data. The validation result on three datasets proved that Deep Learning method achieves better performance than the other existing methods. The average accuracy of our method reaches 0.97, AUC reaches 0.98, and the F1 score is 0.92. The results proved that Deep Learning methods can significantly improve the prediction accuracy of drug BBB permeability and it can help researchers to reduce clinical trials and find new CNS drugs.

| S-EPMC6584536 | biostudies-literature

Brain Tumor Segmentation and Survival Prediction Using Multimodal MRI Scans With Deep Learning.

Project description:Gliomas are the most common primary brain malignancies. Accurate and robust tumor segmentation and prediction of patients' overall survival are important for diagnosis, treatment planning and risk factor identification. Here we present a deep learning-based framework for brain tumor segmentation and survival prediction in glioma, using multimodal MRI scans. For tumor segmentation, we use ensembles of three different 3D CNN architectures for robust performance through a majority rule. This approach can effectively reduce model bias and boost performance. For survival prediction, we extract 4,524 radiomic features from segmented tumor regions, then, a decision tree and cross validation are used to select potent features. Finally, a random forest model is trained to predict the overall survival of patients. The 2018 MICCAI Multimodal Brain Tumor Segmentation Challenge (BraTS), ranks our method at 2nd and 5th place out of 60+ participating teams for survival prediction tasks and segmentation tasks respectively, achieving a promising 61.0% accuracy on the classification of short-survivors, mid-survivors and long-survivors.

| S-EPMC6707136 | biostudies-literature

Multimodal Diagnostic Imaging for Hyperacute Stroke.

Project description:In April 2015, the American Roentgen Ray Society and the American Society of Neuroradiology cosponsored a unique program designed to evaluate the state of the art in the imaging work-up of acute stroke. This topic has grown in importance because of the recent randomized controlled trials demonstrating the clear efficacy of endovascular stroke treatment. The authors, who were participants in that symposium, will highlight the points of emphasis in this article.

| S-EPMC7964283 | biostudies-literature

Multimodal Imaging in a Patient with Hemidystonia Responsive to GPi Deep Brain Stimulation.

Project description:BackgroundDystonia is a syndrome with varied phenomenology but our understanding of its mechanisms is deficient. With neuroimaging techniques, such as fiber tractography (FT) and magnetoencephalography (MEG), pathway connectivity can be studied to that end. We present a hemidystonia patient treated with deep brain stimulation (DBS).MethodsAfter 10 years of left axial hemidystonia, a 45-year-old male underwent unilateral right globus pallidus internus (GPi) DBS. Whole brain MEG before and after anticholinergic medication was performed prior to surgery. 26-direction diffusion tensor imaging (DTI) was obtained in a 3?T MRI machine along with FT. The patient was assessed before and one year after surgery by using the Burke-Fahn-Marsden Dystonia Rating Scale (BFMDRS).ResultsIn the eyes-closed MEG study there was an increase in brain coherence in the gamma band after medication in the middle and inferior frontal region. FT demonstrated over 50% more intense ipsilateral connectivity in the right hemisphere compared to the left. After DBS, BFMDRS motor and disability scores both dropped by 71%.ConclusionMultimodal neuroimaging techniques can offer insights into the pathophysiology of dystonia and can direct choices for developing therapeutics. Unilateral pallidal DBS can provide significant symptom control in axial hemidystonia poorly responsive to medication.

| S-EPMC5514339 | biostudies-literature

Multimodal Brain Tumor Classification Using Deep Learning and Robust Feature Selection: A Machine Learning Application for Radiologists.

Project description:Manual identification of brain tumors is an error-prone and tedious process for radiologists; therefore, it is crucial to adopt an automated system. The binary classification process, such as malignant or benign is relatively trivial; whereas, the multimodal brain tumors classification (T1, T2, T1CE, and Flair) is a challenging task for radiologists. Here, we present an automated multimodal classification method using deep learning for brain tumor type classification. The proposed method consists of five core steps. In the first step, the linear contrast stretching is employed using edge-based histogram equalization and discrete cosine transform (DCT). In the second step, deep learning feature extraction is performed. By utilizing transfer learning, two pre-trained convolutional neural network (CNN) models, namely VGG16 and VGG19, were used for feature extraction. In the third step, a correntropy-based joint learning approach was implemented along with the extreme learning machine (ELM) for the selection of best features. In the fourth step, the partial least square (PLS)-based robust covariant features were fused in one matrix. The combined matrix was fed to ELM for final classification. The proposed method was validated on the BraTS datasets and an accuracy of 97.8%, 96.9%, 92.5% for BraTs2015, BraTs2017, and BraTs2018, respectively, was achieved.

| S-EPMC7459797 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data