Deep Learning to Automate Reference-Free Image Quality Assessment of Whole-Heart MR Images.
Ontology highlight
ABSTRACT: Purpose
To develop and characterize an algorithm that mimics human expert visual assessment to quantitatively determine the quality of three-dimensional (3D) whole-heart MR images.Materials and methods
In this study, 3D whole-heart cardiac MRI scans from 424 participants (average age, 57 years ± 18 [standard deviation]; 66.5% men) were used to generate an image quality assessment algorithm. A deep convolutional neural network for image quality assessment (IQ-DCNN) was designed, trained, optimized, and cross-validated on a clinical database of 324 (training set) scans. On a separate test set (100 scans), two hypotheses were tested: (a) that the algorithm can assess image quality in concordance with human expert assessment as assessed by human-machine correlation and intra- and interobserver agreement and (b) that the IQ-DCNN algorithm may be used to monitor a compressed sensing reconstruction process where image quality progressively improves. Weighted κ values, agreement and disagreement counts, and Krippendorff α reliability coefficients were reported.Results
Regression performance of the IQ-DCNN was within the range of human intra- and interobserver agreement and in very good agreement with the human expert (R 2 = 0.78, κ = 0.67). The image quality assessment during compressed sensing reconstruction correlated with the cost function at each iteration and was successfully applied to rank the results in very good agreement with the human expert.Conclusion
The proposed IQ-DCNN was trained to mimic expert visual image quality assessment of 3D whole-heart MR images. The results from the IQ-DCNN were in good agreement with human expert reading, and the network was capable of automatically comparing different reconstructed volumes.Supplemental material is available for this article.© RSNA, 2020.
SUBMITTER: Piccini D
PROVIDER: S-EPMC8082371 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundMuscle wasting (Sarcopenia) is associated with poor outcomes in cancer patients. Early identification of sarcopenia can facilitate nutritional and exercise intervention. Cross-sectional skeletal muscle (SM) area at the third lumbar vertebra (L3) slice of a computed tomography (CT) image is increasingly used to assess body composition and calculate SM index (SMI), a validated surrogate marker for sarcopenia in cancer. Manual segmentation of SM requires multiple steps, which limits use in routine clinical practice. This project aims to develop an automatic method to segment L3 muscle in CT scans.MethodsAttenuation correction CTs from full body PET-CT scans from patients enrolled in two prospective trials were used. The training set consisted of 66 non-small cell lung cancer (NSCLC) patients who underwent curative intent radiotherapy. An additional 42 NSCLC patients prescribed curative intent chemo-radiotherapy from a second trial were used for testing. Each patient had multiple CT scans taken at different time points prior to and post- treatment (147 CTs in the training and validation set and 116 CTs in the independent testing set). Skeletal muscle at L3 vertebra was manually segmented by two observers, according to the Alberta protocol to serve as ground truth labels. This included 40 images segmented by both observers to measure inter-observer variation. An ensemble of 2.5D fully convolutional neural networks (U-Nets) was used to perform the segmentation. The final layer of U-Net produced the binary classification of the pixels into muscle and non-muscle area. The model performance was calculated using Dice score and absolute percentage error (APE) in skeletal muscle area between manual and automated contours.ResultsWe trained five 2.5D U-Nets using 5-fold cross validation and used them to predict the contours in the testing set. The model achieved a mean Dice score of 0.92 and an APE of 3.1% on the independent testing set. This was similar to inter-observer variation of 0.96 and 2.9% for mean Dice and APE respectively. We further quantified the performance of sarcopenia classification using computer generated skeletal muscle area. To meet a clinical diagnosis of sarcopenia based on Alberta protocol the model achieved a sensitivity of 84% and a specificity of 95%.ConclusionsThis work demonstrates an automated method for accurate and reproducible segmentation of skeletal muscle area at L3. This is an efficient tool for large scale or routine computation of skeletal muscle area in cancer patients which may have applications on low quality CTs acquired as part of PET/CT studies for staging and surveillance of patients with cancer.
| S-EPMC8138051 | biostudies-literature
Project description:PurposeThe trend towards faster acquisition protocols in whole-body positron emission tomography/magnetic resonance (PET/MR) arises the question of whether short PET data acquisition protocols in a whole-body multi-station context allow for reduced PET acquisition times while providing adequate PET image quality and accurate quantification parameters. The study goal is to investigate how reducing PET acquisition times affects PET image quality and quantification in whole-body PET/MR in patients with oncologic findings.MethodsFifty-one patients with different oncologic findings underwent a clinical whole-body 18F-Fluorodeoxyglucose PET/MR examination. PET data was reconstructed with 4, 3, 2, and 1 min/bed time intervals for each patient to simulate the effect of reduced PET acquisition times. The 4-minute PET reconstructions served as reference standard. All whole-body PET data sets were analyzed regarding image quality, lesion detectability, PET quantification and standardized uptake values.ResultsA total of 91 lesions were detected in the 4-minute PET reconstructions. The same number of congruent lesions was also noticed in the 3 and 2 minutes-per-bed (mpb) reconstructed images. A total of 2 lesions in 2 patients was not detected in the 1 minute PET data reconstructions due to poor image quality. Image noise in the blood pool increased from 22.2% (4 mpb) to 42.1% (1 mpb). Signal-to-noise ratio declined with shorter timeframes from 13.1 (4 mpb) to 9.3 (1 mpb). SUVmean and SUVmax showed no significant changes between 4 and 1 mpb reconstructed timeframes.ConclusionsReconstruction of PET data with different time intervals has shown that 2 minutes acquisition time per bed position instead of 4 minutes is sufficient to provide accurate lesion detection and adequate image quality in a clinical setting, despite the trends to lower image quality with shorter PET acquisition times. This provides latitude for potential reduction of PET acquisition times in fast PET/MR whole-body examinations.
| S-EPMC6207312 | biostudies-literature
Project description:The detailed anatomical information of the brain provided by 3D magnetic resonance imaging (MRI) enables various neuroscience research. However, due to the long scan time for 3D MR images, 2D images are mainly obtained in clinical environments. The purpose of this study is to generate 3D images from a sparsely sampled 2D images using an inpainting deep neural network that has a U-net-like structure and DenseNet sub-blocks. To train the network, not only fidelity loss but also perceptual loss based on the VGG network were considered. Various methods were used to assess the overall similarity between the inpainted and original 3D data. In addition, morphological analyzes were performed to investigate whether the inpainted data produced local features similar to the original 3D data. The diagnostic ability using the inpainted data was also evaluated by investigating the pattern of morphological changes in disease groups. Brain anatomy details were efficiently recovered by the proposed neural network. In voxel-based analysis to assess gray matter volume and cortical thickness, differences between the inpainted data and the original 3D data were observed only in small clusters. The proposed method will be useful for utilizing advanced neuroimaging techniques with 2D MRI data.
| S-EPMC7814079 | biostudies-literature
Project description:To summarize the distribution of glioma location within a patient population, registration of individual MR images to anatomical reference space is required. In this study, we quantified the accuracy of MR image registration to anatomical reference space with linear and non-linear transformations using estimated tumor targets of glioblastoma and lower-grade glioma, and anatomical landmarks at pre- and post-operative time-points using six commonly used registration packages (FSL, SPM5, DARTEL, ANTs, Elastix, and NiftyReg). Routine clinical pre- and post-operative, post-contrast T1-weighted images of 20 patients with glioblastoma and 20 with lower-grade glioma were collected. The 2009a Montreal Neurological Institute brain template was used as anatomical reference space. Tumors were manually segmented in the patient space and corresponding healthy tissue was delineated as a target volume in the anatomical reference space. Accuracy of the tumor alignment was quantified using the Dice score and the Hausdorff distance. To measure the accuracy of general brain alignment, anatomical landmarks were placed in patient and in anatomical reference space, and the landmark distance after registration was quantified. Lower-grade gliomas were registered more accurately than glioblastoma. Registration accuracy for pre- and post-operative MR images did not differ. SPM5 and DARTEL registered tumors most accurate, and FSL least accurate. Non-linear transformations resulted in more accurate general brain alignment than linear transformations, but tumor alignment was similar between linear and non-linear transformation. We conclude that linear transformation suffices to summarize glioma locations in anatomical reference space.
| S-EPMC7290158 | biostudies-literature
Project description:ObjectivesTo compare the image quality and diagnostic performance of conventional motion-corrected periodically rotated overlapping parallel line with enhanced reconstruction (PROPELLER) MRI sequences with post-processed PROPELLER MRI sequences using deep learning-based (DL) reconstructions.MethodsIn this prospective study of 30 patients, conventional (19 min 18 s) and accelerated MRI sequences (7 min 16 s) using the PROPELLER technique were acquired. Accelerated sequences were post-processed using DL. The image quality and diagnostic confidence were qualitatively assessed by 2 readers using a 5-point Likert scale. Analysis of the pathological findings of cartilage, rotator cuff tendons and muscles, glenoid labrum and subacromial bursa was performed. Inter-reader agreement was calculated using Cohen's kappa statistic. Quantitative evaluation of image quality was measured using the signal-to-noise ratio (SNR) and contrast-to-noise ratio (CNR).ResultsMean image quality and diagnostic confidence in evaluation of all shoulder structures were higher in DL sequences (p value = 0.01). Inter-reader agreement ranged between kappa values of 0.155 (assessment of the bursa) and 0.947 (assessment of the rotator cuff muscles). In 17 cases, thickening of the subacromial bursa of more than 2 mm was only visible in DL sequences. The pathologies of the other structures could be properly evaluated by conventional and DL sequences. Mean SNR (p value = 0.01) and CNR (p value = 0.02) were significantly higher for DL sequences.ConclusionsThe accelerated PROPELLER sequences with DL post-processing showed superior image quality and higher diagnostic confidence compared to the conventional PROPELLER sequences. Subacromial bursa can be thoroughly assessed in DL sequences, while the other structures of the shoulder joint can be assessed in conventional and DL sequences with a good agreement between sequences.Key points• MRI of the shoulder requires long scan times and can be hampered by motion artifacts. • Deep learning-based convolutional neural networks are used to reduce image noise and scan time while maintaining optimal image quality. The radial k-space acquisition technique (PROPELLER) can reduce the scan time and has potential to reduce motion artifacts. • DL sequences show a higher diagnostic confidence than conventional sequences and therefore are preferred for assessment of the subacromial bursa, while conventional and DL sequences show comparable performance in the evaluation of the shoulder joint.
| S-EPMC9935676 | biostudies-literature
Project description:BackgroundComputed tomography (CT) chest scans have become commonly used in clinical diagnosis. Image quality assessment (IQA) for CT images plays an important role in CT examination. It is worth noting that IQA is still a manual and subjective process, and even experienced radiologists make mistakes due to human limitations (fatigue, perceptual biases, and cognitive biases). There are also kinds of biases because of poor consensus among radiologists. Excellent IQA methods can reliably give an objective evaluation result and also reduce the workload of radiologists. This study proposes a deep learning (DL)-based automatic IQA method, to assess whether the image quality of respiratory phase on CT chest images are optimal or not, so that the CT chest images can be used in the patient's physical condition assessment.MethodsThis retrospective study analysed 212 patients' chest CT images, with 188 patients allocated to a training set (150 patients), validation set (18 patients), and a test set (20 patients). The remaining 24 patients were used for the observer study. Data augmentation methods were applied to address the problem of insufficient data. The DL-based IQA method combines image selection, tracheal carina segmentation, and bronchial beam detection. To automatically select the CT image containing the tracheal carina, an image selection model was employed. Afterward, the area-based approach and score-based approach were proposed and used to further optimize the tracheal carina segmentation and bronchial beam detection results, respectively. Finally, the score about the image quality of the patient's respiratory phase images given by the DL-based automatic IQA method was compared with the mean opinion score (MOS) given in the observer study, in which four blinded experienced radiologists took part.ResultsThe DL-based automatic IQA method achieved good performance in assessing the image quality of the respiratory phase images. For the CT sequence of the same patient, the DL-based IQA method had an accuracy of 92% in the assessment score, while the radiologists had an accuracy of 88%. The Kappa value of the assessment score between the DL-based IQA method and radiologists was 0.75, with a sensitivity of 85%, specificity of 91%, positive predictive value (PPV) of 92%, negative predictive value (NPV) of 93%, and accuracy of 88%.ConclusionsThis study develops and validates a DL-based automatic IQA method for the respiratory phase on CT chest images. The performance of this method surpassed that of the experienced radiologists on the independent test set used in this study. In clinical practice, it is possible to reduce the workload of radiologists and minimize errors caused by human limitations.
| S-EPMC10963826 | biostudies-literature
Project description:This study evaluated the feasibility of using only diagnostically relevant magnetic resonance (MR) images together with deep learning for positron emission tomography (PET)/MR attenuation correction (deepMRAC) in the pelvis. Such an approach could eliminate dedicated MRAC sequences that have limited diagnostic utility but can substantially lengthen acquisition times for multibed position scans. We used axial T2 and T1 LAVA Flex magnetic resonance imaging images that were acquired for diagnostic purposes as inputs to a 3D deep convolutional neural network. The network was trained to produce a discretized (air, water, fat, and bone) substitute computed tomography (CT) (CTsub). Discretized (CTref-discrete) and continuously valued (CTref) reference CT images were created to serve as ground truth for network training and attenuation correction, respectively. Training was performed with data from 12 subjects. CTsub, CTref, and the system MRAC were used for PET/MR attenuation correction, and quantitative PET values of the resulting images were compared in 6 test subjects. Overall, the network produced CTsub with Dice coefficients of 0.79 ± 0.03 for cortical bone, 0.98 ± 0.01 for soft tissue (fat: 0.94 ± 0.0; water: 0.88 ± 0.02), and 0.49 ± 0.17 for bowel gas when compared with CTref-discrete. The root mean square error of the whole PET image was 4.9% by using deepMRAC and 11.6% by using the system MRAC. In evaluating 16 soft tissue lesions, the distribution of errors for maximum standardized uptake value was significantly narrower using deepMRAC (-1.0% ± 1.3%) than using system MRAC method (0.0% ± 6.4%) according to the Brown-Forsy the test (P < .05). These results indicate that improved PET/MR attenuation correction can be achieved in the pelvis using only diagnostically relevant MR images.
| S-EPMC6173790 | biostudies-literature
Project description:The study objective was to investigate the performance of a dedicated convolutional neural network (CNN) optimized for wrist cartilage segmentation from 2D MR images. CNN utilized a planar architecture and patch-based (PB) training approach that ensured optimal performance in the presence of a limited amount of training data. The CNN was trained and validated in 20 multi-slice MRI datasets acquired with two different coils in 11 subjects (healthy volunteers and patients). The validation included a comparison with the alternative state-of-the-art CNN methods for the segmentation of joints from MR images and the ground-truth manual segmentation. When trained on the limited training data, the CNN outperformed significantly image-based and PB-U-Net networks. Our PB-CNN also demonstrated a good agreement with manual segmentation (Sørensen-Dice similarity coefficient [DSC] = 0.81) in the representative (central coronal) slices with a large amount of cartilage tissue. Reduced performance of the network for slices with a very limited amount of cartilage tissue suggests the need for fully 3D convolutional networks to provide uniform performance across the joint. The study also assessed inter- and intra-observer variability of the manual wrist cartilage segmentation (DSC = 0.78-0.88 and 0.9, respectively). The proposed deep learning-based segmentation of the wrist cartilage from MRI could facilitate research of novel imaging markers of wrist osteoarthritis to characterize its progression and response to therapy.
| S-EPMC7784718 | biostudies-literature
Project description:Histopathological characterization of colorectal polyps is critical for determining the risk of colorectal cancer and future rates of surveillance for patients. However, this characterization is a challenging task and suffers from significant inter- and intra-observer variability.We built an automatic image analysis method that can accurately classify different types of colorectal polyps on whole-slide images to help pathologists with this characterization and diagnosis.Our method is based on deep-learning techniques, which rely on numerous levels of abstraction for data representation and have shown state-of-the-art results for various image analysis tasks.Our method covers five common types of polyps (i.e., hyperplastic, sessile serrated, traditional serrated, tubular, and tubulovillous/villous) that are included in the US Multisociety Task Force guidelines for colorectal cancer risk assessment and surveillance. We developed multiple deep-learning approaches by leveraging a dataset of 2074 crop images, which were annotated by multiple domain expert pathologists as reference standards.We evaluated our method on an independent test set of 239 whole-slide images and measured standard machine-learning evaluation metrics of accuracy, precision, recall, and F1 score and their 95% confidence intervals.Our evaluation shows that our method with residual network architecture achieves the best performance for classification of colorectal polyps on whole-slide images (overall accuracy: 93.0%, 95% confidence interval: 89.0%-95.9%).Our method can reduce the cognitive burden on pathologists and improve their efficacy in histopathological characterization of colorectal polyps and in subsequent risk assessment and follow-up recommendations.
| S-EPMC5545773 | biostudies-other
Project description:PurposeWe sought to develop a whole-heart magnetic resonance angiography technique with three-dimensional (3D) respiratory motion compensation and reduced scan time.MethodsA novel respiratory motion compensation method was implemented that acquires a 1D navigator (NAV) and a low-resolution 3D-image of the heart (3D-LOC) just before the angiography data. The central 10% of SSFP k-space was fully acquired using NAV-gating, and then 10% of peripheral k-space was randomly undersampled to complete the scan. Spatial registration of the 3D-LOC information was used to correct the central and peripheral k-space lines for the bulk respiratory motion in three dimensions, and then the remaining k-space data was estimated using compressed sensing (CS). Ten volunteers each underwent two angiography acquisitions with 1 mm(3) resolution: (i) conventional NAV with CS, and (ii) the new 3D-LOC with CS.ResultsCompared with conventional NAV, the new 3D-LOC with CS technique had a shorter scan time (4.8 ± 1.1 versus 6.3 ± 1.7 min; P < 0.001), better objective vessel sharpness for all three coronary arteries (P < 0.05), and no difference in subjective vessel sharpness for all three coronary arteries.ConclusionCompared with conventional NAV with CS, acceleration and respiratory motion correction using 3D-LOC with CS reduces scan time and improves objective vessel sharpness.
| S-EPMC5292940 | biostudies-literature