Fast and accurate view classification of echocardiograms using deep learning.
Ontology highlight
ABSTRACT:
SUBMITTER: Madani A
PROVIDER: S-EPMC6395045 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:A proper echocardiographic study requires several video clips recorded from different acquisition angles for observation of the complex cardiac anatomy. However, these video clips are not necessarily labeled in a database. Identification of the acquired view becomes the first step of analyzing an echocardiogram. Currently, there is no consensus whether the mislabeled samples can be used to create a feasible clinical prediction model of ejection fraction (EF). The aim of this study was to test two types of input methods for the classification of images, and to test the accuracy of the prediction model for EF in a learning database containing mislabeled images that were not checked by observers. We enrolled 340 patients with five standard views (long axis, short axis, 3-chamber view, 4-chamber view and 2-chamber view) and 10 images in a cycle, used for training a convolutional neural network to classify views (total 17,000 labeled images). All DICOM images were rigidly registered and rescaled into a reference image to fit the size of echocardiographic images. We employed 5-fold cross validation to examine model performance. We tested models trained by two types of data, averaged images and 10 selected images. Our best model (from 10 selected images) classified video views with 98.1% overall test accuracy in the independent cohort. In our view classification model, 1.9% of the images were mislabeled. To determine if this 98.1% accuracy was acceptable for creating the clinical prediction model using echocardiographic data, we tested the prediction model for EF using learning data with a 1.9% error rate. The accuracy of the prediction model for EF was warranted, even with training data containing 1.9% mislabeled images. The CNN algorithm can classify images into five standard views in a clinical setting. Our results suggest that this approach may provide a clinically feasible accuracy level of view classification for the analysis of echocardiographic data.
| S-EPMC7277840 | biostudies-literature
Project description:Echocardiography uses ultrasound technology to capture high temporal and spatial resolution images of the heart and surrounding structures, and is the most common imaging modality in cardiovascular medicine. Using convolutional neural networks on a large new dataset, we show that deep learning applied to echocardiography can identify local cardiac structures, estimate cardiac function, and predict systemic phenotypes that modify cardiovascular risk but not readily identifiable to human interpretation. Our deep learning model, EchoNet, accurately identified the presence of pacemaker leads (AUC = 0.89), enlarged left atrium (AUC = 0.86), left ventricular hypertrophy (AUC = 0.75), left ventricular end systolic and diastolic volumes ( R2 = 0.74 and R2 = 0.70), and ejection fraction ( R2 = 0.50), as well as predicted systemic phenotypes of age ( R2 = 0.46), sex (AUC = 0.88), weight ( R2 = 0.56), and height ( R2 = 0.33). Interpretation analysis validates that EchoNet shows appropriate attention to key cardiac structures when performing human-explainable tasks and highlights hypothesis-generating regions of interest when predicting systemic phenotypes difficult for human interpretation. Machine learning on echocardiography images can streamline repetitive tasks in the clinical workflow, provide preliminary interpretation in areas with insufficient qualified cardiologists, and predict phenotypes challenging for human evaluation.
| S-EPMC6981156 | biostudies-literature
Project description:BackgroundCoronary artery calcification (CAC), often assessed by computed tomography (CT), is a powerful marker of coronary artery disease that can guide preventive therapies. Computed tomographies, however, are not always accessible or serially obtainable. It remains unclear whether other widespread tests such as transthoracic echocardiograms (TTEs) can be used to predict CAC.MethodsUsing a data set of 2,881 TTE videos paired with coronary calcium CTs, we trained a video-based artificial intelligence convolutional neural network to predict CAC scores from parasternal long-axis views. We evaluated the model's ability to classify patients from a held-out sample as well as an external site sample into zero CAC and high CAC (CAC ≥ 400 Agatston units) groups by receiver operating characteristic and precision-recall curves. We also investigated whether such classifications prognosticated significant differences in 1-year mortality rates by the log-rank test of Kaplan-Meier curves.ResultsTransthoracic echocardiogram artificial intelligence models had high discriminatory abilities in predicting zero CAC (receiver operating characteristic area under the curve [AUC] = 0.81 [95% CI, 0.74-0.88], F1 score = 0.95) and high CAC (AUC = 0.74 [0.68-0.8], F1 score = 0.74). This performance was confirmed in an external test data set of 92 TTEs (AUC = 0.75 [0.65-0.85], F1 score = 0.77; and AUC = 0.85 [0.76-0.93], F1 score = 0.59, respectively). Risk stratification by TTE-predicted CAC performed similarly to CT CAC scores in prognosticating significant differences in 1-year survival in high-CAC patients (CT CAC ≥ 400 vs CT CAC < 400, P = .03; TTE-predicted CAC ≥ 400 vs TTE-predicted CAC < 400, P = .02).ConclusionsA video-based deep learning model successfully used TTE videos to predict zero CAC and high CAC with high accuracy. Transthoracic echocardiography-predicted CAC prognosticated differences in 1-year survival similar to CT CAC. Deep learning of TTEs holds promise for future adjunctive coronary artery disease risk stratification to guide preventive therapies.
| S-EPMC10164107 | biostudies-literature
Project description:Characterization of suspended nanoparticles in their native environment plays a central role in a wide range of fields, from medical diagnostics and nanoparticle-enhanced drug delivery to nanosafety and environmental nanopollution assessment. Standard optical approaches for nanoparticle sizing assess the size via the diffusion constant and, as a consequence, require long trajectories and that the medium has a known and uniform viscosity. However, in most biological applications, only short trajectories are available, while simultaneously, the medium viscosity is unknown and tends to display spatiotemporal variations. In this work, we demonstrate a label-free method to quantify not only size but also refractive index of individual subwavelength particles using 2 orders of magnitude shorter trajectories than required by standard methods and without prior knowledge about the physicochemical properties of the medium. We achieved this by developing a weighted average convolutional neural network to analyze holographic images of single particles, which was successfully applied to distinguish and quantify both size and refractive index of subwavelength silica and polystyrene particles without prior knowledge of solute viscosity or refractive index. We further demonstrate how these features make it possible to temporally resolve aggregation dynamics of 31 nm polystyrene nanoparticles, revealing previously unobserved time-resolved dynamics of the monomer number and fractal dimension of individual subwavelength aggregates.
| S-EPMC7905872 | biostudies-literature
Project description:High-throughput microscopy of many single cells generates high-dimensional data that are far from straightforward to analyze. One important problem is automatically detecting the cellular compartment where a fluorescently-tagged protein resides, a task relatively simple for an experienced human, but difficult to automate on a computer. Here, we train an 11-layer neural network on data from mapping thousands of yeast proteins, achieving per cell localization classification accuracy of 91%, and per protein accuracy of 99% on held-out images. We confirm that low-level network features correspond to basic image characteristics, while deeper layers separate localization classes. Using this network as a feature calculator, we train standard classifiers that assign proteins to previously unseen compartments after observing only a small number of training examples. Our results are the most accurate subcellular localization classifications to date, and demonstrate the usefulness of deep learning for high-throughput microscopy.
| S-EPMC5427497 | biostudies-literature
Project description:A question of fundamental biological significance is to what extent the expression of a subset of genes can be used to recover the full transcriptome, with important implications for biological discovery and clinical application. To address this challenge, we propose two novel deep learning methods, PMI and GAIN-GTEx, for gene expression imputation. In order to increase the applicability of our approach, we leverage data from GTEx v8, a reference resource that has generated a comprehensive collection of transcriptomes from a diverse set of human tissues. We show that our approaches compare favorably to several standard and state-of-the-art imputation methods in terms of predictive performance and runtime in two case studies and two imputation scenarios. In comparison conducted on the protein-coding genes, PMI attains the highest performance in inductive imputation whereas GAIN-GTEx outperforms the other methods in in-place imputation. Furthermore, our results indicate strong generalization on RNA-Seq data from 3 cancer types across varying levels of missingness. Our work can facilitate a cost-effective integration of large-scale RNA biorepositories into genomic studies of disease, with high applicability across diverse tissue types.
| S-EPMC8076954 | biostudies-literature
Project description:In this paper, deep learning is coupled with explainable artificial intelligence techniques for the discovery of representative genomic sequences in SARS-CoV-2. A convolutional neural network classifier is first trained on 553 sequences from the National Genomics Data Center repository, separating the genome of different virus strains from the Coronavirus family with 98.73% accuracy. The network's behavior is then analyzed, to discover sequences used by the model to identify SARS-CoV-2, ultimately uncovering sequences exclusive to it. The discovered sequences are validated on samples from the National Center for Biotechnology Information and Global Initiative on Sharing All Influenza Data repositories, and are proven to be able to separate SARS-CoV-2 from different virus strains with near-perfect accuracy. Next, one of the sequences is selected to generate a primer set, and tested against other state-of-the-art primer sets, obtaining competitive results. Finally, the primer is synthesized and tested on patient samples (n = 6 previously tested positive), delivering a sensitivity similar to routine diagnostic methods, and 100% specificity. The proposed methodology has a substantial added value over existing methods, as it is able to both automatically identify promising primer sets for a virus from a limited amount of data, and deliver effective results in a minimal amount of time. Considering the possibility of future pandemics, these characteristics are invaluable to promptly create specific detection methods for diagnostics.
| S-EPMC7806918 | biostudies-literature
Project description:For many RNA molecules, the secondary structure is essential for the correct function of the RNA. Predicting RNA secondary structure from nucleotide sequences is a long-standing problem in genomics, but the prediction performance has reached a plateau over time. Traditional RNA secondary structure prediction algorithms are primarily based on thermodynamic models through free energy minimization, which imposes strong prior assumptions and is slow to run. Here, we propose a deep learning-based method, called UFold, for RNA secondary structure prediction, trained directly on annotated data and base-pairing rules. UFold proposes a novel image-like representation of RNA sequences, which can be efficiently processed by Fully Convolutional Networks (FCNs). We benchmark the performance of UFold on both within- and cross-family RNA datasets. It significantly outperforms previous methods on within-family datasets, while achieving a similar performance as the traditional methods when trained and tested on distinct RNA families. UFold is also able to predict pseudoknots accurately. Its prediction is fast with an inference time of about 160 ms per sequence up to 1500 bp in length. An online web server running UFold is available at https://ufold.ics.uci.edu. Code is available at https://github.com/uci-cbcl/UFold.
| S-EPMC8860580 | biostudies-literature
Project description:Volumetric functional imaging is widely used for recording neuron activities in vivo, but there exist tradeoffs between the quality of the extracted calcium traces, imaging speed, and laser power. While deep-learning methods have recently been applied to denoise images, their applications to downstream analyses, such as recovering high-SNR calcium traces, have been limited. Further, these methods require temporally-sequential pre-registered data acquired at ultrafast rates. Here, we demonstrate a supervised deep-denoising method to circumvent these tradeoffs for several applications, including whole-brain imaging, large-field-of-view imaging in freely moving animals, and recovering complex neurite structures in C. elegans. Our framework has 30× smaller memory footprint, and is fast in training and inference (50-70 ms); it is highly accurate and generalizable, and further, trained with only small, non-temporally-sequential, independently-acquired training datasets (∼500 pairs of images). We envision that the framework will enable faster and long-term imaging experiments necessary to study neuronal mechanisms of many behaviors.
| S-EPMC9440141 | biostudies-literature
Project description:Atrial fibrillation (AF) often escapes detection, given its frequent paroxysmal and asymptomatic presentation. Deep learning of transthoracic echocardiograms (TTEs), which have structural information, could help identify occult AF. We created a two-stage deep learning algorithm using a video-based convolutional neural network model that (1) distinguished whether TTEs were in sinus rhythm or AF and then (2) predicted which of the TTEs in sinus rhythm were in patients who had experienced AF within 90 days. Our model, trained on 111,319 TTE videos, distinguished TTEs in AF from those in sinus rhythm with high accuracy in a held-out test cohort (AUC 0.96 (0.95-0.96), AUPRC 0.91 (0.90-0.92)). Among TTEs in sinus rhythm, the model predicted the presence of concurrent paroxysmal AF (AUC 0.74 (0.71-0.77), AUPRC 0.19 (0.16-0.23)). Model discrimination remained similar in an external cohort of 10,203 TTEs (AUC of 0.69 (0.67-0.70), AUPRC 0.34 (0.31-0.36)). Performance held across patients who were women (AUC 0.76 (0.72-0.81)), older than 65 years (0.73 (0.69-0.76)), or had a CHA2DS2VASc ≥2 (0.73 (0.79-0.77)). The model performed better than using clinical risk factors (AUC 0.64 (0.62-0.67)), TTE measurements (0.64 (0.62-0.67)), left atrial size (0.63 (0.62-0.64)), or CHA2DS2VASc (0.61 (0.60-0.62)). An ensemble model in a cohort subset combining the TTE model with an electrocardiogram (ECGs) deep learning model performed better than using the ECG model alone (AUC 0.81 vs. 0.79, p = 0.01). Deep learning using TTEs can predict patients with active or occult AF and could be used for opportunistic AF screening that could lead to earlier treatment.
| S-EPMC11016113 | biostudies-literature