Establishment of intelligent image aided diagnosis platform for colorectal adenoma and cancer risk prediction model based on multimodal feature fusion of traditional Chinese and Western Medicine
Ontology highlight
ABSTRACT:
DISEASE(S): Colorectal Adenoma
PROVIDER: 87533 | ecrin-mdr-crc |
REPOSITORIES: ECRIN MDR
Similar Datasets
Project description:The medical image fusion is the process of coalescing multiple images from multiple imaging modalities to obtain a fused image with a large amount of information for increasing the clinical applicability of medical images. In this paper, we attempt to give an overview of multimodal medical image fusion methods, putting emphasis on the most recent advances in the domain based on (1) the current fusion methods, including based on deep learning, (2) imaging modalities of medical image fusion, and (3) performance analysis of medical image fusion on mainly data set. Finally, the conclusion of this paper is that the current multimodal medical image fusion research results are more significant and the development trend is on the rise but with many challenges in the research field.
| S-EPMC7195632 | biostudies-literature
Project description:We report the RNA-seq data of 40 advanced colorectal adenoma patients form Dongguk University Ilsan International Hospital. The polyps with a diameter of 1cm or greater were regarded as advenced colorectal adenoma and obtained through colonoscopy. The data consist of 22 tublar adenoma, 6 tublovillous adenoma, 5 sessile serrated adenoma/polyp, 1 traditional serrated adenoma, intramucosal adenocarcinoma, neuroendocrine tumor, hyperplastic polyp, inflammatory polyp, high grade dysplasia, and atypical glands with adjacent hyperplastic mucosa.
2023-08-07 | GSE154548 | GEO
Project description:This study proposed an end-to-end unsupervised medical fusion generative adversarial network, MedFusionGAN, to fuse computed tomography (CT) and high-resolution isotropic 3D T1-Gd Magnetic resonance imaging (MRI) image sequences to generate an image with CT bone structure and MRI soft tissue contrast to improve target delineation and to reduce the radiotherapy planning time. We used a publicly available multicenter medical dataset (GLIS-RT, 230 patients) from the Cancer Imaging Archive. To improve the models generalization, we consider different imaging protocols and patients with various brain tumor types, including metastases. The proposed MedFusionGAN consisted of one generator network and one discriminator network trained in an adversarial scenario. Content, style, and L1 losses were used for training the generator to preserve the texture and structure information of the MRI and CT images. The MedFusionGAN successfully generates fused images with MRI soft-tissue and CT bone contrast. The results of the MedFusionGAN were quantitatively and qualitatively compared with seven traditional and eight deep learning (DL) state-of-the-art methods. Qualitatively, our method fused the source images with the highest spatial resolution without adding the image artifacts. We reported nine quantitative metrics to quantify the preservation of structural similarity, contrast, distortion level, and image edges in fused images. Our method outperformed both traditional and DL methods on six out of nine metrics. And it got the second performance rank for three and two quantitative metrics when compared with traditional and DL methods, respectively. To compare soft-tissue contrast, intensity profile along tumor and tumor contours of the fusion methods were evaluated. MedFusionGAN provides a more consistent, better intensity profile, and a better segmentation performance. The proposed end-to-end unsupervised method successfully fused MRI and CT images. The fused image could improve targets and OARs delineation, which is an important aspect of radiotherapy treatment planning.
| S-EPMC10704723 | biostudies-literature
Project description:Alzheimer's disease (AD) is one of the most common neurodegenerative diseases. The formation of amyloid plaques by aggregated amyloid beta (A?) peptides is a primary event in AD pathology. Understanding the metabolomic features and related pathways is critical for studying plaque-related pathological events (e.g., cell death and neuron dysfunction). Mass spectrometry imaging (MSI), due to its high sensitivity and ability to obtain the spatial distribution of metabolites, has been applied to AD studies. However, limited studies of metabolites in amyloid plaques have been performed due to the drawbacks of the commonly used techniques such as matrix-assisted laser desorption/ionization MSI. In the current study, we obtained high spatial resolution (?17 ?m) MS images of the AD mouse brain using the Single-probe, a microscale sampling and ionization device, coupled to a mass spectrometer under ambient conditions. The adjacent slices were used to obtain fluorescence microscopy images to locate amyloid plaques. The MS image and the fluorescence microscopy image were fused to spatially correlate histological protein hallmarks with metabolomic features. The fused images produced significantly improved spatial resolution (?5 ?m), allowing for the determination of fine structures in MS images and metabolomic biomarkers representing amyloid plaques.
| S-EPMC6885010 | biostudies-literature
Project description:PurposeTo allow for comprehensive noninvasive diagnostics of coronary artery disease (CAD) by using three-dimensional (3D) image fusion of CT coronary angiography, CT-derived fractional flow reserve (CT FFR), whole-heart dynamic 3D cardiac MRI perfusion, and 3D cardiac MRI late gadolinium enhancement (LGE).Materials and methodsSeventeen patients (54 years ± 10 [standard deviation], one female) who underwent cardiac CT and cardiac MRI were included (combined subcohort of three prospective trials). Software facilitating multimodal 3D image fusion was developed. Postprocessing of CT data included segmentation of the coronary tree and heart contours, calculation of CT FFR values, and color coding of the coronary tree according to CT FFR. Postprocessing of cardiac MRI data included segmentation of the left ventricle (LV) in cardiac MRI perfusion and cardiac MRI LGE, co-registration of cardiac MRI to CT data, and projection of cardiac MRI perfusion and LGE values onto the high spatial resolution LV from CT.ResultsImage quality was rated as good to excellent (scores: 2.5-2.6; 3 = excellent). CT coronary angiography revealed significant stenoses in seven of 17 cases (41%). CT FFR was possible in 16 of 17 cases (94%) and showed pathologic flow in seven of 17 cases (41%), six of which coincided with cases revealing significant stenoses at CT coronary angiography. Cardiac MRI perfusion identified eight of 17 patients (47%) with hypoperfusion (ischemic burden of 17% ± 5). Cardiac MRI LGE showed myocardial scar in three of 17 cases (18%, scar burden of 7% ± 4). Conventional two-dimensional readout of CT coronary angiography and cardiac MRI resulted in eight of 17 cases (47%) with uncertain findings. Most of these divergent findings could be solved when adding information from CT FFR and 3D image fusion (six of eight, 75%).ConclusionMultimodal 3D cardiac image fusion is feasible and may help with comprehensive noninvasive CAD diagnostics.Supplemental material is available for this article.© RSNA, 2020.
| S-EPMC7977970 | biostudies-literature
Project description:Diseases pose a significant threat to the citrus industry, and the accurate detection of these diseases represent key factors for their early diagnosis and precise control. Existing diagnostic methods primarily rely on image models trained on vast datasets and limited their applicability due to singular backgrounds. To devise a more accurate, robust, and versatile model for citrus disease classification, this study focused on data diversity, knowledge assistance, and modal fusion. Leaves from healthy plants and plants infected with 10 prevalent diseases (citrus greening, citrus canker, anthracnose, scab, greasy spot, melanose, sooty mold, nitrogen deficiency, magnesium deficiency, and iron deficiency) were used as materials. Initially, three datasets with white, natural, and mixed backgrounds were constructed to analyze their effects on the training accuracy, test generalization ability, and classification balance. This diversification of data significantly improved the model's adaptability to natural settings. Subsequently, by leveraging agricultural domain knowledge, a structured citrus disease features glossary was developed to enhance the efficiency of data preparation and the credibility of identification results. To address the underutilization of multimodal data in existing models, this study explored semantic embedding methods for disease images and structured descriptive texts. Convolutional networks with different depths (VGG16, ResNet50, MobileNetV2, and ShuffleNetV2) were used to extract the visual features of leaves. Concurrently, TextCNN and fastText were used to extract textual features and semantic relationships. By integrating the complementary nature of the image and text information, a joint learning model for citrus disease features was achieved. ShuffleNetV2 + TextCNN, the optimal multimodal model, achieved a classification accuracy of 98.33% on the mixed dataset, which represented improvements of 9.78% and 21.11% over the single-image and single-text models, respectively. This model also exhibited faster convergence, superior classification balance, and enhanced generalization capability, compared with the other methods. The image-text multimodal feature fusion network proposed in this study, which integrates text and image features with domain knowledge, can identify and classify citrus diseases in scenarios with limited samples and multiple background noise. The proposed model provides a more reliable decision-making basis for the precise application of biological and chemical control strategies for citrus production.
| S-EPMC10711083 | biostudies-literature
Project description:Quantifying heterogeneities within cell populations is important for many fields including cancer research and neurobiology; however, techniques to isolate individual cells are limited. Here, we describe a high-throughput, non-disruptive, and cost-effective isolation method that is capable of capturing individually targeted cells using widely available techniques. Using high-resolution microscopy, laser microcapture microscopy, image analysis, and machine learning, our technology enables scalable molecular genetic analysis of single cells, targetable by morphology or location within the sample.
| S-EPMC5768687 | biostudies-literature
Project description:Objectives To analyze the surgical effects of resecting skull base tumors using multimodal three-dimensional (3D) image fusion technology in the neurosurgery department and present some typical cases. Methods From October 2019 to October 2021, we included 47 consecutive patients with skull base tumors in the Neurosurgery Department at Zhuhai People's Hospital in this study. Pre-operative head computed tomography and magnetic resonance imaging data acquisition was performed using the GE AW workstation software for registration fusion, image fusion, and 3D reconstruction. The surgical approach and surgical plan were designed based on the multimodal 3D image, and the resection rate, complication rate, and operative time of the surgery using the multimodal image fusion technique were analyzed. Results The reconstructed multimodal 3D images precisely demonstrated the size, location, and shape of the tumor along with the anatomical relationship between the tumor and surrounding structures, which is consistent with the intraoperative findings. Among 47 patients, 39 patients (78.7%) underwent total resection, 5 (14.9%) underwent subtotal resection, and 3 (6.4%) underwent partial resection. The mean operative time was 4.42 ± 1.32 h. No patient died during the inpatient period. Post-operative complications included 6 cases of cerebrospinal fluid leakage (14.9%), 3 cases of intracranial infection (6.4%), 6 cases of facial paralysis (12.8%), 2 cases of dysphagia (4.3%), and 1 case of diplopia (2.1%), all of which were improved after symptomatic treatment. The application value of pre-operative 3D image fusion technology was evaluated as outstanding in 40 cases (85.1%) and valuable in 7 cases (14.9%). Conclusions Pre-operative multimodal image fusion technology can provide valuable visual information in skull base tumor surgery and help neurosurgeons design the surgical incision, choose a more rational surgical approach, and precisely resect the tumor. The multimodal image fusion technique should be strongly recommended for skull base tumor surgery.
| S-EPMC9133916 | biostudies-literature
Project description:We present a novel platform for testing the effects of interventions on the life- and healthspan of a short-lived freshwater organism with complex behavior and physiology-the planktonic crustacean Daphnia magna. Within this platform, dozens of complex behavioral features of both routine motion and response to stimuli are continuously quantified over large synchronized cohorts via an automated phenotyping pipeline. We build predictive machine-learning models calibrated using chronological age and extrapolate onto phenotypic age. We further apply the model to estimate the phenotypic age under pharmacological perturbation. Our platform provides a scalable framework for drug screening and characterization in both life-long and instant assays as illustrated using a long-term dose-response profile of metformin and a short-term assay of well-studied substances such as caffeine and alcohol.
| S-EPMC8920439 | biostudies-literature
Project description:A perception module is a vital component of a modern robotic system. Vision, radar, thermal, and LiDAR are the most common choices of sensors for environmental awareness. Relying on singular sources of information is prone to be affected by specific environmental conditions (e.g., visual cameras are affected by glary or dark environments). Thus, relying on different sensors is an essential step to introduce robustness against various environmental conditions. Hence, a perception system with sensor fusion capabilities produces the desired redundant and reliable awareness critical for real-world systems. This paper proposes a novel early fusion module that is reliable against individual cases of sensor failure when detecting an offshore maritime platform for UAV landing. The model explores the early fusion of a still unexplored combination of visual, infrared, and LiDAR modalities. The contribution is described by suggesting a simple methodology that intends to facilitate the training and inference of a lightweight state-of-the-art object detector. The early fusion based detector achieves solid detection recalls up to 99% for all cases of sensor failure and extreme weather conditions such as glary, dark, and foggy scenarios in fair real-time inference duration below 6 ms.
| S-EPMC10006912 | biostudies-literature