Browse
Submit Data
Databases
API
Help

Dataset Information

21 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Improved Diagnostic Imaging of Brain Tumors by Multimodal Microscopy and Deep Learning.

ABSTRACT: Fluorescence-guided surgery is a state-of-the-art approach for intraoperative imaging during neurosurgical removal of tumor tissue. While the visualization of high-grade gliomas is reliable, lower grade glioma often lack visible fluorescence signals. Here, we present a hybrid prototype combining visible light optical coherence microscopy (OCM) and high-resolution fluorescence imaging for assessment of brain tumor samples acquired by 5-aminolevulinic acid (5-ALA) fluorescence-guided surgery. OCM provides high-resolution information of the inherent tissue scattering and absorption properties of tissue. We here explore quantitative attenuation coefficients derived from volumetric OCM intensity data and quantitative high-resolution 5-ALA fluorescence as potential biomarkers for tissue malignancy including otherwise difficult-to-assess low-grade glioma. We validate our findings against the gold standard histology and use attenuation and fluorescence intensity measures to differentiate between tumor core, infiltrative zone and adjacent brain tissue. Using large field-of-view scans acquired by a near-infrared swept-source optical coherence tomography setup, we provide initial assessments of tumor heterogeneity. Finally, we use cross-sectional OCM images to train a convolutional neural network that discriminates tumor from non-tumor tissue with an accuracy of 97%. Collectively, the present hybrid approach offers potential to translate into an in vivo imaging setup for substantially improved intraoperative guidance of brain tumor surgeries.

SUBMITTER: Gesperger J

PROVIDER: S-EPMC7408054 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

Multimodal deep learning to predict prognosis in adult and pediatric brain tumors.

Project description:BackgroundThe introduction of deep learning in both imaging and genomics has significantly advanced the analysis of biomedical data. For complex diseases such as cancer, different data modalities may reveal different disease characteristics, and the integration of imaging with genomic data has the potential to unravel additional information than when using these data sources in isolation. Here, we propose a DL framework that combines these two modalities with the aim to predict brain tumor prognosis.MethodsUsing two separate glioma cohorts of 783 adults and 305 pediatric patients we developed a DL framework that can fuse histopathology images with gene expression profiles. Three strategies for data fusion were implemented and compared: early, late, and joint fusion. Additional validation of the adult glioma models was done on an independent cohort of 97 adult patients.ResultsHere we show that the developed multimodal data models achieve better prediction results compared to the single data models, but also lead to the identification of more relevant biological pathways. When testing our adult models on a third brain tumor dataset, we show our multimodal framework is able to generalize and performs better on new data from different cohorts. Leveraging the concept of transfer learning, we demonstrate how our pediatric multimodal models can be used to predict prognosis for two more rare (less available samples) pediatric brain tumors.ConclusionsOur study illustrates that a multimodal data fusion approach can be successfully implemented and customized to model clinical outcome of adult and pediatric brain tumors.

| S-EPMC10060397 | biostudies-literature

Deep Representation Learning For Multimodal Brain Networks.

Project description:Applying network science approaches to investigate the functions and anatomy of the human brain is prevalent in modern medical imaging analysis. Due to the complex network topology, for an individual brain, mining a discriminative network representation from the multimodal brain networks is non-trivial. The recent success of deep learning techniques on graph-structured data suggests a new way to model the non-linear cross-modality relationship. However, current deep brain network methods either ignore the intrinsic graph topology or require a network basis shared within a group. To address these challenges, we propose a novel end-to-end deep graph representation learning (Deep Multimodal Brain Networks - DMBN) to fuse multimodal brain networks. Specifically, we decipher the cross-modality relationship through a graph encoding and decoding process. The higher-order network mappings from brain structural networks to functional networks are learned in the node domain. The learned network representation is a set of node features that are informative to induce brain saliency maps in a supervised manner. We test our framework in both synthetic and real image data. The experimental results show the superiority of the proposed method over some other state-of-the-art deep brain network models.

| S-EPMC8293685 | biostudies-literature

Multimodal deep learning enhances diagnostic precision in left ventricular hypertrophy.

Project description:AimsDetermining the aetiology of left ventricular hypertrophy (LVH) can be challenging due to the similarity in clinical presentation and cardiac morphological features of diverse causes of disease. In particular, distinguishing individuals with hypertrophic cardiomyopathy (HCM) from the much larger set of individuals with manifest or occult hypertension (HTN) is of major importance for family screening and the prevention of sudden death. We hypothesized that an artificial intelligence method based joint interpretation of 12-lead electrocardiograms and echocardiogram videos could augment physician interpretation.Methods and resultsWe chose not to train on proximate data labels such as physician over-reads of ECGs or echocardiograms but instead took advantage of electronic health record derived clinical blood pressure measurements and diagnostic consensus (often including molecular testing) among physicians in an HCM centre of excellence. Using more than 18 000 combined instances of electrocardiograms and echocardiograms from 2728 patients, we developed LVH-fusion. On held-out test data, LVH-fusion achieved an F1-score of 0.71 in predicting HCM, and 0.96 in predicting HTN. In head-to-head comparison with human readers LVH-fusion had higher sensitivity and specificity rates than its human counterparts. Finally, we use explainability techniques to investigate local and global features that positively and negatively impact LVH-fusion prediction estimates providing confirmation from unsupervised analysis the diagnostic power of lateral T-wave inversion on the ECG and proximal septal hypertrophy on the echocardiogram for HCM.ConclusionThese results show that deep learning can provide effective physician augmentation in the face of a common diagnostic dilemma with far reaching implications for the prevention of sudden cardiac death.

| S-EPMC9707995 | biostudies-literature

Deep Multiview Learning to Identify Population Structure with Multimodal Imaging.

Project description:We present an effective deep multiview learning framework to identify population structure using multimodal imaging data. Our approach is based on canonical correlation analysis (CCA). We propose to use deep generalized CCA (DGCCA) to learn a shared latent representation of non-linearly mapped and maximally correlated components from multiple imaging modalities with reduced dimensionality. In our empirical study, this representation is shown to effectively capture more variance in original data than conventional generalized CCA (GCCA) which applies only linear transformation to the multi-view data. Furthermore, subsequent cluster analysis on the new feature set learned from DGCCA is able to identify a promising population structure in an Alzheimer's disease (AD) cohort. Genetic association analyses of the clustering results demonstrate that the shared representation learned from DGCCA yields a population structure with a stronger genetic basis than several competing feature learning methods.

| S-EPMC7917002 | biostudies-literature

Deep-brain imaging via epi-fluorescence Computational Cannula Microscopy.

Project description:Here we demonstrate widefield (field diameter = 200 μm) fluorescence microscopy and video imaging inside the rodent brain at a depth of 2 mm using a simple surgical glass needle (cannula) of diameter 0.22 mm as the primary optical element. The cannula guides excitation light into the brain and the fluorescence signal out of the brain. Concomitant image-processing algorithms are utilized to convert the spatially scrambled images into fluorescent images and video. The small size of the cannula enables minimally invasive imaging, while the long length (>2 mm) allow for deep-brain imaging with no additional complexity in the optical system. Since no scanning is involved, widefield fluorescence video at the native frame rate of the camera can be achieved.

| S-EPMC5357895 | biostudies-literature

Single-frame deep-learning super-resolution microscopy for intracellular dynamics imaging.

Project description:Single-molecule localization microscopy (SMLM) can be used to resolve subcellular structures and achieve a tenfold improvement in spatial resolution compared to that obtained by conventional fluorescence microscopy. However, the separation of single-molecule fluorescence events that requires thousands of frames dramatically increases the image acquisition time and phototoxicity, impeding the observation of instantaneous intracellular dynamics. Here we develop a deep-learning based single-frame super-resolution microscopy (SFSRM) method which utilizes a subpixel edge map and a multicomponent optimization strategy to guide the neural network to reconstruct a super-resolution image from a single frame of a diffraction-limited image. Under a tolerable signal density and an affordable signal-to-noise ratio, SFSRM enables high-fidelity live-cell imaging with spatiotemporal resolutions of 30 nm and 10 ms, allowing for prolonged monitoring of subcellular dynamics such as interplays between mitochondria and endoplasmic reticulum, the vesicle transport along microtubules, and the endosome fusion and fission. Moreover, its adaptability to different microscopes and spectra makes it a useful tool for various imaging systems.

| S-EPMC10195829 | biostudies-literature

Deep Collaborative Learning With Application to the Study of Multimodal Brain Development.

Project description:ObjectiveMulti-modal functional magnetic resonance imaging has been widely used for brain research. Conventional data-fusion methods cannot capture complex relationship (e.g., nonlinear predictive relationship) between multiple data. This paper aims to develop a neural network framework to extract phenotype related cross-data relationships and use it to study the brain development.MethodsWe propose a novel method, deep collaborative learning (DCL), to address the limitation of existing methods. DCL first uses a deep network to represent original data and then seeks their correlations, while also linking the data representation with phenotypical information.ResultsWe studied the difference of functional connectivity (FCs) between different age groups and also use FCs as a fingerprint to predict cognitive abilities. Our experiments demonstrated higher accuracy of using DCL over other conventional models when classifying populations of different ages and cognitive scores. Moreover, DCL revealed that brain connections became stronger at adolescence stage. Furthermore, DCL detected strong correlations between default mode network and other networks which were overlooked by linear canonical correlation analysis, demonstrating DCL's ability of detecting nonlinear correlations.ConclusionThe results verified the superiority of DCL over conventional data-fusion methods. In addition, the stronger brain connection demonstrated the importance of adolescence stage for brain development.SignificanceDCL can better combine complex correlations between multiple data sets in addition to their fitting to phenotypes, with the potential to overcome the limitations of several current data-fusion models.

| S-EPMC8177041 | biostudies-literature

Improved Classification of Blood-Brain-Barrier Drugs Using Deep Learning.

Project description:Blood-Brain-Barrier (BBB) is a strict permeability barrier for maintaining the Central Nervous System (CNS) homeostasis. One of the most important conditions to judge a CNS drug is to figure out whether it has BBB permeability or not. In the past 20 years, the existing prediction approaches are usually based on the data of the physical characteristics and chemical structure of drugs. However, these methods are usually only applicable to small molecule compounds based on passive diffusion through BBB. To deal this problem, one of the most famous methods is multi-core SVM method, which is based on clinical phenotypes about Drug Side Effects and Drug Indications to predict drug penetration of BBB. This paper proposed a Deep Learning method to predict the Blood-Brain-Barrier permeability based on the clinical phenotypes data. The validation result on three datasets proved that Deep Learning method achieves better performance than the other existing methods. The average accuracy of our method reaches 0.97, AUC reaches 0.98, and the F1 score is 0.92. The results proved that Deep Learning methods can significantly improve the prediction accuracy of drug BBB permeability and it can help researchers to reduce clinical trials and find new CNS drugs.

| S-EPMC6584536 | biostudies-literature

Brain Tumor Segmentation and Survival Prediction Using Multimodal MRI Scans With Deep Learning.

Project description:Gliomas are the most common primary brain malignancies. Accurate and robust tumor segmentation and prediction of patients' overall survival are important for diagnosis, treatment planning and risk factor identification. Here we present a deep learning-based framework for brain tumor segmentation and survival prediction in glioma, using multimodal MRI scans. For tumor segmentation, we use ensembles of three different 3D CNN architectures for robust performance through a majority rule. This approach can effectively reduce model bias and boost performance. For survival prediction, we extract 4,524 radiomic features from segmented tumor regions, then, a decision tree and cross validation are used to select potent features. Finally, a random forest model is trained to predict the overall survival of patients. The 2018 MICCAI Multimodal Brain Tumor Segmentation Challenge (BraTS), ranks our method at 2nd and 5th place out of 60+ participating teams for survival prediction tasks and segmentation tasks respectively, achieving a promising 61.0% accuracy on the classification of short-survivors, mid-survivors and long-survivors.

| S-EPMC6707136 | biostudies-literature

Multimodal Diagnostic Imaging for Hyperacute Stroke.

Project description:In April 2015, the American Roentgen Ray Society and the American Society of Neuroradiology cosponsored a unique program designed to evaluate the state of the art in the imaging work-up of acute stroke. This topic has grown in importance because of the recent randomized controlled trials demonstrating the clear efficacy of endovascular stroke treatment. The authors, who were participants in that symposium, will highlight the points of emphasis in this article.

| S-EPMC7964283 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data