Deep Learning Predicts Total Knee Replacement from Magnetic Resonance Images.
Ontology highlight
ABSTRACT:
SUBMITTER: Tolpadi AA
PROVIDER: S-EPMC7156761 | biostudies-literature | 2020 Apr
REPOSITORIES: biostudies-literature
Publications
Deep Learning Predicts Total Knee Replacement from Magnetic Resonance Images.
Tolpadi Aniket A AA Lee Jinhee J JJ Pedoia Valentina V Majumdar Sharmila S
Scientific reports 20200414 1
Knee Osteoarthritis (OA) is a common musculoskeletal disorder in the United States. When diagnosed at early stages, lifestyle interventions such as exercise and weight loss can slow OA progression, but at later stages, only an invasive option is available: total knee replacement (TKR). Though a generally successful procedure, only 2/3 of patients who undergo the procedure report their knees feeling "normal" post-operation, and complications can arise that require revision. This necessitates a mo ...[more]
Similar Datasets
Project description:Obesity is increasingly prevalent and associated with increased risk of developing type 2 diabetes, cardiovascular diseases, and cancer. Magnetic resonance imaging (MRI) is an accurate method for determination of body fat volume and distribution. However, quantifying body fat from numerous MRI slices is tedious and time-consuming. Here we developed a deep learning-based method for measuring visceral and subcutaneous fat in the abdominal region of mice. Congenic mice only differ from C57BL/6 (B6) Apoe knockout (Apoe-/-) mice in chromosome 9 that is replaced by C3H/HeJ genome. Male congenic mice had lighter body weight than B6-Apoe-/- mice after being fed 14 weeks of Western diet. Axial and coronal T1-weighted sequencing at 1-mm-thickness and 1-mm-gap was acquired with a 7T Bruker ClinScan scanner. A deep learning approach was developed for segmenting visceral and subcutaneous fat based on the U-net architecture made publicly available through the open-source ANTsRNet library-a growing repository of well-known neural networks. The volumes of subcutaneous and visceral fat measured through our approach were highly comparable with those from manual measurements. The Dice score, root-mean-square error (RMSE), and correlation analysis demonstrated the similarity between two methods in quantifying visceral and subcutaneous fat. Analysis with the automated method showed significant reductions in volumes of visceral and subcutaneous fat but not non-fat tissues in congenic mice compared to B6 mice. These results demonstrate the accuracy of deep learning in quantification of abdominal fat and its significance in determining body weight.
| S-EPMC6147491 | biostudies-literature
Project description:Magnetic resonance imaging (MRI) is widely used for ischemic stroke lesion detection in mice. A challenge is that lesion segmentation often relies on manual tracing by trained experts, which is labor-intensive, time-consuming, and prone to inter- and intra-rater variability. Here, we present a fully automated ischemic stroke lesion segmentation method for mouse T2-weighted MRI data. As an end-to-end deep learning approach, the automated lesion segmentation requires very little preprocessing and works directly on the raw MRI scans. We randomly split a large dataset of 382 MRI scans into a subset (n = 293) to train the automated lesion segmentation and a subset (n = 89) to evaluate its performance. We compared Dice coefficients and accuracy of lesion volume against manual segmentation, as well as its performance on an independent dataset from an open repository with different imaging characteristics. The automated lesion segmentation produced segmentation masks with a smooth, compact, and realistic appearance that are in high agreement with manual segmentation. We report dice scores higher than the agreement between two human raters reported in previous studies, highlighting the ability to remove individual human bias and standardize the process across research studies and centers.
| S-EPMC10432383 | biostudies-literature
Project description:Background No investigations have thoroughly explored the feasibility of combining magnetic resonance (MR) images and deep-learning methods for predicting the progression of knee osteoarthritis (KOA). We thus aimed to develop a potential deep-learning model for predicting OA progression based on MR images for the clinical setting. Methods A longitudinal case-control study was performed using data from the Foundation for the National Institutes of Health (FNIH), composed of progressive cases [182 osteoarthritis (OA) knees with both radiographic and pain progression for 24–48 months] and matched controls (182 OA knees not meeting the case definition). DeepKOA was developed through 3-dimensional (3D) DenseNet169 to predict KOA progression over 24–48 months based on sagittal intermediate-weighted turbo-spin echo sequences with fat-suppression (SAG-IW-TSE-FS), sagittal 3D dual-echo steady-state water excitation (SAG-3D-DESS-WE) and its axial and coronal multiplanar reformation, and their combined MR images with patient-level labels at baseline, 12, and 24 months to eventually determine the probability of progression. The classification performance of the DeepKOA was evaluated using 5-fold cross-validation. An X-ray-based model and traditional models that used clinical variables via multilayer perceptron were built. Combined models were also constructed, which integrated clinical variables with DeepKOA. The area under the curve (AUC) was used as the evaluation metric. Results The performance of SAG-IW-TSE-FS in predicting OA progression was similar or higher to that of other single and combined sequences. The DeepKOA based on SAG-IW-TSE-FS achieved an AUC of 0.664 (95% CI: 0.585–0.743) at baseline, 0.739 (95% CI: 0.703–0.775) at 12 months, and 0.775 (95% CI: 0.686–0.865) at 24 months. The X-ray-based model achieved an AUC ranging from 0.573 to 0.613 at 3 time points. However, adding clinical variables to DeepKOA did not improve performance (P>0.05). Initial visualizations from gradient-weighted class activation mapping (Grad-CAM) indicated that the frequency with which the patellofemoral joint was highlighted increased as time progressed, which contrasted the trend observed in the tibiofemoral joint. The meniscus, the infrapatellar fat pad, and muscles posterior to the knee were highlighted to varying degrees. Conclusions This study initially demonstrated the feasibility of DeepKOA in the prediction of KOA progression and identified the potential responsible structures which may enlighten the future development of more clinically practical methods.
| S-EPMC10423358 | biostudies-literature
Project description:With age, the prevalence of diseases such as fatty liver disease, cirrhosis, and type two diabetes increases. Approaches to both predict abdominal age and identify risk factors for accelerated abdominal age may ultimately lead to advances that will delay the onset of these diseases. We build an abdominal age predictor by training convolutional neural networks to predict abdominal age (or "AbdAge") from 45,552 liver magnetic resonance images [MRIs] and 36,784 pancreas MRIs (R-Squared = 73.3 ± 0.6; mean absolute error = 2.94 ± 0.03 years). Attention maps show that the prediction is driven by both liver and pancreas anatomical features, and surrounding organs and tissue. Abdominal aging is a complex trait, partially heritable (h_g2 = 26.3 ± 1.9%), and associated with 16 genetic loci (e.g. in PLEKHA1 and EFEMP1), biomarkers (e.g body impedance), clinical phenotypes (e.g, chest pain), diseases (e.g. hypertension), environmental (e.g smoking), and socioeconomic (e.g education, income) factors.
| S-EPMC9007982 | biostudies-literature
Project description:BackgroundEpithelial ovarian cancer (EOC) segmentation is an indispensable step in assessing the extent of disease and guiding the treatment plan that follows. Currently, manual segmentation is the most commonly used method, despite it being tedious, time-consuming and subject to inter- and intra-observer variability. This study aims to assess the feasibility of deep learning methods in the automatic segmentation of EOC on T2-weighted magnetic resonance images.MethodsA total of 339 EOC patients from eight different clinical centers were enrolled and divided into 4 groups: training set (n=154), validation set (n=25), internal test set (n=50) and external test set (n=110). Six common-used algorithms, including convolutional neural networks (CNNs) (U-Net, DeepLabv3, U-Net++ and PSPNet) and transformers (TransUnet and Swin-Unet), were used to conduct automatic segmentations. The performances of these automatic segmentation methods were evaluated by means of dice similarity coefficient (DSC), Hausdorff distance (HD), average symmetric surface distance (ASSD), precision and recall.ResultsAll the results look promising, which demonstrates the feasibility of using deep learning for EOC segmentation. Overall, CNNs and transformers showed similar performances in both internal and external test sets. Among all the models, U-Net++ performed best with a DSC, HD, ASSD, precision and recall of 0.851, 25.3, 1.75, 0.838, 0.882 and 0.740, 42.5, 4.21, 0.825, 0.725 in internal and external test sets, respectively.ConclusionsFully automated segmentation of EOC is possible with deep learning. The segmentation performance is related to the International Federation of Gynecology and Obstetrics (FIGO) stages and histological types of EOC.
| S-EPMC10006162 | biostudies-literature
Project description:BACKGROUND:Magnetic resonance imaging (MRI) of the knee is the preferred method for diagnosing knee injuries. However, interpretation of knee MRI is time-intensive and subject to diagnostic error and variability. An automated system for interpreting knee MRI could prioritize high-risk patients and assist clinicians in making diagnoses. Deep learning methods, in being able to automatically learn layers of features, are well suited for modeling the complex relationships between medical images and their interpretations. In this study we developed a deep learning model for detecting general abnormalities and specific diagnoses (anterior cruciate ligament [ACL] tears and meniscal tears) on knee MRI exams. We then measured the effect of providing the model's predictions to clinical experts during interpretation. METHODS AND FINDINGS:Our dataset consisted of 1,370 knee MRI exams performed at Stanford University Medical Center between January 1, 2001, and December 31, 2012 (mean age 38.0 years; 569 [41.5%] female patients). The majority vote of 3 musculoskeletal radiologists established reference standard labels on an internal validation set of 120 exams. We developed MRNet, a convolutional neural network for classifying MRI series and combined predictions from 3 series per exam using logistic regression. In detecting abnormalities, ACL tears, and meniscal tears, this model achieved area under the receiver operating characteristic curve (AUC) values of 0.937 (95% CI 0.895, 0.980), 0.965 (95% CI 0.938, 0.993), and 0.847 (95% CI 0.780, 0.914), respectively, on the internal validation set. We also obtained a public dataset of 917 exams with sagittal T1-weighted series and labels for ACL injury from Clinical Hospital Centre Rijeka, Croatia. On the external validation set of 183 exams, the MRNet trained on Stanford sagittal T2-weighted series achieved an AUC of 0.824 (95% CI 0.757, 0.892) in the detection of ACL injuries with no additional training, while an MRNet trained on the rest of the external data achieved an AUC of 0.911 (95% CI 0.864, 0.958). We additionally measured the specificity, sensitivity, and accuracy of 9 clinical experts (7 board-certified general radiologists and 2 orthopedic surgeons) on the internal validation set both with and without model assistance. Using a 2-sided Pearson's chi-squared test with adjustment for multiple comparisons, we found no significant differences between the performance of the model and that of unassisted general radiologists in detecting abnormalities. General radiologists achieved significantly higher sensitivity in detecting ACL tears (p-value = 0.002; q-value = 0.019) and significantly higher specificity in detecting meniscal tears (p-value = 0.003; q-value = 0.019). Using a 1-tailed t test on the change in performance metrics, we found that providing model predictions significantly increased clinical experts' specificity in identifying ACL tears (p-value < 0.001; q-value = 0.006). The primary limitations of our study include lack of surgical ground truth and the small size of the panel of clinical experts. CONCLUSIONS:Our deep learning model can rapidly generate accurate clinical pathology classifications of knee MRI exams from both internal and external datasets. Moreover, our results support the assertion that deep learning models can improve the performance of clinical experts during medical imaging interpretation. Further research is needed to validate the model prospectively and to determine its utility in the clinical setting.
| S-EPMC6258509 | biostudies-other
Project description:BackgroundHigh-resolution medical images that include facial regions can be used to recognize the subject's face when reconstructing 3-dimensional (3D)-rendered images from 2-dimensional (2D) sequential images, which might constitute a risk of infringement of personal information when sharing data. According to the Health Insurance Portability and Accountability Act (HIPAA) privacy rules, full-face photographic images and any comparable image are direct identifiers and considered as protected health information. Moreover, the General Data Protection Regulation (GDPR) categorizes facial images as biometric data and stipulates that special restrictions should be placed on the processing of biometric data.ObjectiveThis study aimed to develop software that can remove the header information from Digital Imaging and Communications in Medicine (DICOM) format files and facial features (eyes, nose, and ears) at the 2D sliced-image level to anonymize personal information in medical images.MethodsA total of 240 cranial magnetic resonance (MR) images were used to train the deep learning model (144, 48, and 48 for the training, validation, and test sets, respectively, from the Alzheimer's Disease Neuroimaging Initiative [ADNI] database). To overcome the small sample size problem, we used a data augmentation technique to create 576 images per epoch. We used attention-gated U-net for the basic structure of our deep learning model. To validate the performance of the software, we adapted an external test set comprising 100 cranial MR images from the Open Access Series of Imaging Studies (OASIS) database.ResultsThe facial features (eyes, nose, and ears) were successfully detected and anonymized in both test sets (48 from ADNI and 100 from OASIS). Each result was manually validated in both the 2D image plane and the 3D-rendered images. Furthermore, the ADNI test set was verified using Microsoft Azure's face recognition artificial intelligence service. By adding a user interface, we developed and distributed (via GitHub) software named "Deface program" for medical images as an open-source project.ConclusionsWe developed deep learning-based software for the anonymization of MR images that distorts the eyes, nose, and ears to prevent facial identification of the subject in reconstructed 3D images. It could be used to share medical big data for secondary research while making both data providers and recipients compliant with the relevant privacy regulations.
| S-EPMC7759440 | biostudies-literature
Project description:Deep Learning based Convolutional Neural Networks (CNNs) are the state-of-the-art machine learning technique with medical image data. They have the ability to process large amounts of data and learn image features directly from the raw data. Based on their training, these networks are ultimately able to classify unknown data and make predictions. Magnetic resonance imaging (MRI) is the imaging modality of choice for many spinal cord disorders. Proper interpretation requires time and expertise from radiologists, so there is great interest in using artificial intelligence to more quickly interpret and diagnose medical imaging data. In this study, a CNN was trained and tested using thoracolumbar MR images from 500 dogs. T1- and T2-weighted MR images in sagittal and transverse planes were used. The network was trained with unremarkable images as well as with images showing the following spinal cord pathologies: intervertebral disc extrusion (IVDE), intervertebral disc protrusion (IVDP), fibrocartilaginous embolism (FCE)/acute non-compressive nucleus pulposus extrusion (ANNPE), syringomyelia and neoplasia. 2,693 MR images from 375 dogs were used for network training. The network was tested using 7,695 MR images from 125 dogs. The network performed best in detecting IVDPs on sagittal T1-weighted images, with a sensitivity of 100% and specificity of 95.1%. The network also performed very well in detecting IVDEs, especially on sagittal T2-weighted images, with a sensitivity of 90.8% and specificity of 98.98%. The network detected FCEs and ANNPEs with a sensitivity of 62.22% and a specificity of 97.90% on sagittal T2-weighted images and with a sensitivity of 91% and a specificity of 90% on transverse T2-weighted images. In detecting neoplasms and syringomyelia, the CNN did not perform well because of insufficient training data or because the network had problems differentiating different hyperintensities on T2-weighted images and thus made incorrect predictions. This study has shown that it is possible to train a CNN in terms of recognizing and differentiating various spinal cord pathologies on canine MR images. CNNs therefore have great potential to act as a "second eye" for imagers in the future, providing a faster focus on the altered image area and thus increasing workflow in radiology.
| S-EPMC8593183 | biostudies-literature
Project description:ObjectiveThe aim of the study is to develop and validate a deep learning model to predict the platinum sensitivity of patients with epithelial ovarian cancer (EOC) based on contrast-enhanced magnetic resonance imaging (MRI).MethodsIn this retrospective study, 93 patients with EOC who received platinum-based chemotherapy (≥4 cycles) and debulking surgery at the Sun Yat-sen Memorial Hospital from January 2011 to January 2020 were enrolled and randomly assigned to the training and validation cohorts (2:1). Two different models were built based on either the primary tumor or whole volume of the abdomen as the volume of interest (VOI) within the same cohorts, and then a pre-trained convolutional neural network Med3D (Resnet 10 version) was transferred to automatically extract 1,024 features from two MRI sequences (CE-T1WI and T2WI) of each patient to predict platinum sensitivity. The performance of the two models was compared.ResultsA total of 93 women (mean age, 50.5 years ± 10.5 [standard deviation]) were evaluated (62 in the training cohort and 31 in the validation cohort). The AUCs of the whole abdomen model were 0.97 and 0.98 for the training and validation cohorts, respectively, which was better than the primary tumor model (AUCs of 0.88 and 0.81 in the training and validation cohorts, respectively). In k-fold cross-validation and stratified analysis, the whole abdomen model maintained a stable performance, and the decision function value generated by the model was a prognostic indicator that successfully discriminates high- and low-risk recurrence patients.ConclusionThe non-manually segmented whole-abdomen deep learning model based on MRI exhibited satisfactory predictive performance for platinum sensitivity and may assist gynecologists in making optimal treatment decisions.
| S-EPMC9727155 | biostudies-literature
Project description:Chromosomal instability (CIN) is a hallmark of human cancer yet not readily testable for patients with cancer in routine clinical setting. In this study, we sought to explore whether CIN status can be predicted using ubiquitously available hematoxylin and eosin histology through a deep learning-based model. When applied to a cohort of 1,010 patients with breast cancer (Training set: n = 858, Test set: n = 152) from The Cancer Genome Atlas where 485 patients have high CIN status, our model accurately classified CIN status, achieving an area under the curve of 0.822 with 81.2% sensitivity and 68.7% specificity in the test set. Patch-level predictions of CIN status suggested intra-tumor heterogeneity within slides. Moreover, presence of patches with high predicted CIN score within an entire slide was more predictive of clinical outcome than the average CIN score of the slide, thus underscoring the clinical importance of intra-tumor heterogeneity.
| S-EPMC8099498 | biostudies-literature