Dataset Information

Consistency and objectivity of automated embryo assessments using deep neural networks.

ABSTRACT: OBJECTIVE:To evaluate the consistency and objectivity of deep neural networks in embryo scoring and making disposition decisions for biopsy and cryopreservation in comparison to grading by highly trained embryologists. DESIGN:Prospective double-blind study using retrospective data. SETTING:U.S.-based large academic fertility center. PATIENTS:Not applicable. INTERVENTION(S):Embryo images (748 recorded at 70 hours postinsemination [hpi]) and 742 at 113 hpi) were used to evaluate embryologists and neural networks in embryo grading. The performance of 10 embryologists and a neural network were also evaluated in disposition decision making using 56 embryos. MAIN OUTCOME MEASURES:Coefficients of variation (%CV) and measures of consistencies were compared. RESULTS:Embryologists exhibited a high degree of variability (%CV averages: 82.84% for 70 hpi and 44.98% for 113 hpi) in grading embryo. When selecting blastocysts for biopsy or cryopreservation, embryologists had an average consistency of 52.14% and 57.68%, respectively. The neural network outperformed the embryologists in selecting blastocysts for biopsy and cryopreservation with a consistency of 83.92%. Cronbach's ? analysis revealed an ? coefficient of 0.60 for the embryologists and 1.00 for the network. CONCLUSIONS:The results of our study show a high degree of interembryologist and intraembryologist variability in scoring embryos, likely due to the subjective nature of traditional morphology grading. This may ultimately lead to less precise disposition decisions and discarding of viable embryos. The application of a deep neural network, as shown in our study, can introduce improved reliability and high consistency during the process of embryo selection and disposition, potentially improving outcomes in an embryology laboratory.

SUBMITTER: Bormann CL

PROVIDER: S-EPMC7583085 | biostudies-literature | 2020 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Consistency and objectivity of automated embryo assessments using deep neural networks.

Bormann Charles L CL Thirumalaraju Prudhvi P Kanakasabapathy Manoj Kumar MK Kandula Hemanth H Souter Irene I Dimitriadis Irene I Gupta Raghav R Pooniwala Rohan R Shafiee Hadi H

Fertility and sterility 20200401 4

<h4>Objective</h4>To evaluate the consistency and objectivity of deep neural networks in embryo scoring and making disposition decisions for biopsy and cryopreservation in comparison to grading by highly trained embryologists.<h4>Design</h4>Prospective double-blind study using retrospective data.<h4>Setting</h4>U.S.-based large academic fertility center.<h4>Patients</h4>Not applicable.<h4>Intervention(s)</h4>Embryo images (748 recorded at 70 hours postinsemination [hpi]) and 742 at 113 hpi) were ...[more]

PMID: 32228880

Similar Datasets

Project description:Objectives: The aim of this study is to develop a scar detection method for routine computed tomography angiography (CTA) imaging using deep convolutional neural networks (CNN), which relies solely on anatomical information as input and is compatible with existing clinical workflows. Background: Identifying cardiac patients with scar tissue is important for assisting diagnosis and guiding interventions. Late gadolinium enhancement (LGE) magnetic resonance imaging (MRI) is the gold standard for scar imaging; however, there are common instances where it is contraindicated. CTA is an alternative imaging modality that has fewer contraindications and is faster than Cardiovascular magnetic resonance imaging but is unable to reliably image scar. Methods: A dataset of LGE MRI (200 patients, 83 with scar) was used to train and validate a CNN to detect ischemic scar slices using segmentation masks as input to the network. MRIs were segmented to produce 3D left ventricle meshes, which were sampled at points along the short axis to extract anatomical masks, with scar labels from LGE as ground truth. The trained CNN was tested with an independent CTA dataset (25 patients, with ground truth established with paired LGE MRI). Automated segmentation was performed to provide the same input format of anatomical masks for the network. The CNN was compared against manual reading of the CTA dataset by 3 experts. Results: Note that 84.7% cross-validated accuracy (AUC: 0.896) for detecting scar slices in the left ventricle on the MRI data was achieved. The trained network was tested against the CTA-derived data, with no further training, where it achieved an 88.3% accuracy (AUC: 0.901). The automated pipeline outperformed the manual reading by clinicians. Conclusion: Automatic ischemic scar detection can be performed from a routine cardiac CTA, without any scar-specific imaging or contrast agents. This requires only a single acquisition in the cardiac cycle. In a clinical setting, with near zero additional cost, scar presence could be detected to triage images, reduce reading times, and guide clinical decision-making.

Project description:Importance:Retinopathy of prematurity (ROP) is a leading cause of childhood blindness worldwide. The decision to treat is primarily based on the presence of plus disease, defined as dilation and tortuosity of retinal vessels. However, clinical diagnosis of plus disease is highly subjective and variable. Objective:To implement and validate an algorithm based on deep learning to automatically diagnose plus disease from retinal photographs. Design, Setting, and Participants:A deep convolutional neural network was trained using a data set of 5511 retinal photographs. Each image was previously assigned a reference standard diagnosis (RSD) based on consensus of image grading by 3 experts and clinical diagnosis by 1 expert (ie, normal, pre-plus disease, or plus disease). The algorithm was evaluated by 5-fold cross-validation and tested on an independent set of 100 images. Images were collected from 8 academic institutions participating in the Imaging and Informatics in ROP (i-ROP) cohort study. The deep learning algorithm was tested against 8 ROP experts, each of whom had more than 10 years of clinical experience and more than 5 peer-reviewed publications about ROP. Data were collected from July 2011 to December 2016. Data were analyzed from December 2016 to September 2017. Exposures:A deep learning algorithm trained on retinal photographs. Main Outcomes and Measures:Receiver operating characteristic analysis was performed to evaluate performance of the algorithm against the RSD. Quadratic-weighted ? coefficients were calculated for ternary classification (ie, normal, pre-plus disease, and plus disease) to measure agreement with the RSD and 8 independent experts. Results:Of the 5511 included retinal photographs, 4535 (82.3%) were graded as normal, 805 (14.6%) as pre-plus disease, and 172 (3.1%) as plus disease, based on the RSD. Mean (SD) area under the receiver operating characteristic curve statistics were 0.94 (0.01) for the diagnosis of normal (vs pre-plus disease or plus disease) and 0.98 (0.01) for the diagnosis of plus disease (vs normal or pre-plus disease). For diagnosis of plus disease in an independent test set of 100 retinal images, the algorithm achieved a sensitivity of 93% with 94% specificity. For detection of pre-plus disease or worse, the sensitivity and specificity were 100% and 94%, respectively. On the same test set, the algorithm achieved a quadratic-weighted ? coefficient of 0.92 compared with the RSD, outperforming 6 of 8 ROP experts. Conclusions and Relevance:This fully automated algorithm diagnosed plus disease in ROP with comparable or better accuracy than human experts. This has potential applications in disease detection, monitoring, and prognosis in infants at risk of ROP.

Project description:Identifying the cerebral arterial branches is essential for undertaking a computational approach to cerebrovascular imaging. However, the complexity and inter-individual differences involved in this process have not been thoroughly studied. We used machine learning to examine the anatomical profile of the cerebral arterial tree. The method is less sensitive to inter-subject and cohort-wise anatomical variations and exhibits robust performance with an unprecedented in-depth vessel range. We applied machine learning algorithms to disease-free healthy control subjects (n = 42), patients with stroke with intracranial atherosclerosis (ICAS) (n = 46), and patients with stroke mixed with the existing controls (n = 69). We trained and tested 70% and 30% of each study cohort, respectively, incorporating spatial coordinates and geometric vessel feature vectors. Cerebral arterial images were analyzed based on the 'segmentation-stacking' method using magnetic resonance angiography. We precisely classified the cerebral arteries across the exhaustive scope of vessel components using advanced geometric characterization, redefinition of vessel unit conception, and post-processing algorithms. We verified that the neural network ensemble, with multiple joint models as the combined predictor, classified all vessel component types independent of inter-subject variations in cerebral arterial anatomy. The validity of the categorization performance of the model was tested, considering the control, ICAS, and control-blended stroke cohorts, using the area under the receiver operating characteristic (ROC) curve and precision-recall curve. The classification accuracy rarely fell outside each image's 90-99% scope, independent of cohort-dependent cerebrovascular structural variations. The classification ensemble was calibrated with high overall area rates under the ROC curve of 0.99-1.00 [0.97-1.00] in the test set across various study cohorts. Identifying an all-inclusive range of vessel components across controls, ICAS, and stroke patients, the accuracy rates of the prediction were: internal carotid arteries, 91-100%; middle cerebral arteries, 82-98%; anterior cerebral arteries, 88-100%; posterior cerebral arteries, 87-100%; and collections of superior, anterior inferior, and posterior inferior cerebellar arteries, 90-99% in the chunk-level classification. Using a voting algorithm on the queued classified vessel factors and anatomically post-processing the automatically classified results intensified quantitative prediction performance. We employed stochastic clustering and deep neural network ensembles. Ma-chine intelligence-assisted prediction of vessel structure allowed us to personalize quantitative predictions of various types of cerebral arterial structures, contributing to precise and efficient decisions regarding the cerebrovascular disease.

Dataset Information

Consistency and objectivity of automated embryo assessments using deep neural networks.

Publications

Consistency and objectivity of automated embryo assessments using deep neural networks.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets