Dataset Information

Development, Validation, and Dissemination of a Breast Cancer Recurrence Detection and Timing Informatics Algorithm.

ABSTRACT: Background:This study developed, validated, and disseminated a generalizable informatics algorithm for detecting breast cancer recurrence and timing using a gold standard measure of recurrence coupled with data derived from a readily available common data model that pools health insurance claims and electronic health records data. Methods:The algorithm has two parts: to detect the presence of recurrence and to estimate the timing of recurrence. The primary data source was the Cancer Research Network Virtual Data Warehouse (VDW). Sixteen potential indicators of recurrence were considered for model development. The final recurrence detection and timing models were determined, respectively, by maximizing the area under the ROC curve (AUROC) and minimizing average absolute error. Detection and timing algorithms were validated using VDW data in comparison with a gold standard recurrence capture from a third site in which recurrences were validated through chart review. Performance of this algorithm, stratified by stage at diagnosis, was compared with other published algorithms. All statistical tests were two-sided. Results:Detection model AUROCs were 0.939 (95% confidence interval [CI] = 0.917 to 0.955) in the training data set (n?=?3370) and 0.956 (95% CI?=?0.944 to 0.971) and 0.900 (95% CI?=?0.872 to 0.928), respectively, in the two validation data sets (n?=?3370 and 3961, respectively). Timing models yielded average absolute prediction errors of 12.6% (95% CI?=?10.5% to 14.5%) in the training data and 11.7% (95% CI?=?9.9% to 13.5%) and 10.8% (95% CI?=?9.6% to 12.2%) in the validation data sets, respectively, and were statistically significantly lower by 12.6% (95% CI?=?8.8% to 16.5%, P < .001) than those estimated using previously reported timing algorithms. Similar covariates were included in both detection and timing algorithms but differed substantially from previous studies. Conclusions:Valid and reliable detection of recurrence using data derived from electronic medical records and insurance claims is feasible. These tools will enable extensive, novel research on quality, effectiveness, and outcomes for breast cancer patients and those who develop recurrence.

SUBMITTER: Ritzwoller DP

PROVIDER: S-EPMC5972574 | biostudies-literature | 2018 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development, Validation, and Dissemination of a Breast Cancer Recurrence Detection and Timing Informatics Algorithm.

Ritzwoller Debra P DP Hassett Michael J MJ Uno Hajime H Cronin Angel M AM Carroll Nikki M NM Hornbrook Mark C MC Kushi Lawrence C LC

Journal of the National Cancer Institute 20180301 3

<h4>Background</h4>This study developed, validated, and disseminated a generalizable informatics algorithm for detecting breast cancer recurrence and timing using a gold standard measure of recurrence coupled with data derived from a readily available common data model that pools health insurance claims and electronic health records data.<h4>Methods</h4>The algorithm has two parts: to detect the presence of recurrence and to estimate the timing of recurrence. The primary data source was the Canc ...[more]

PMID: 29873757

Similar Datasets

Project description:BackgroundBreast cancer (BC) grading plays a critical role in patient management despite the considerable inter- and intra-observer variability, highlighting the need for decision support tools to improve reproducibility and prognostic accuracy for use in clinical practice. The objective was to evaluate the ability of a digital artificial intelligence (AI) assay (PDxBr) to enrich BC grading and improve risk categorization for predicting recurrence.MethodsIn our population-based longitudinal clinical development and validation study, we enrolled 2075 patients from Mount Sinai Hospital with infiltrating ductal carcinoma of the breast. With 3:1 balanced training and validation cohorts, patients were retrospectively followed for a median of 6 years. The main outcome was to validate an automated BC phenotyping system combined with clinical features to produce a binomial risk score predicting BC recurrence at diagnosis.ResultsThe PDxBr training model (n = 1559 patients) had a C-index of 0.78 (95% CI, 0.76-0.81) versus clinical 0.71 (95% CI, 0.67-0.74) and image feature models 0.72 (95% CI, 0.70-0.74). A risk score of 58 (scale 0-100) stratified patients as low or high risk, hazard ratio (HR) 5.5 (95% CI 4.19-7.2, p < 0.001), with a sensitivity 0.71, specificity 0.77, NPV 0.95, and PPV 0.32 for predicting BC recurrence within 6 years. In the validation cohort (n = 516), the C-index was 0.75 (95% CI, 0.72-0.79) versus clinical 0.71 (95% CI 0.66-0.75) versus image feature models 0.67 (95% CI, 0.63-071). The validation cohort had an HR of 4.4 (95% CI 2.7-7.1, p < 0.001), sensitivity of 0.60, specificity 0.77, NPV 0.94, and PPV 0.24 for predicting BC recurrence within 6 years. PDxBr also improved Oncotype Recurrence Score (RS) performance: RS 31 cutoff, C-index of 0.36 (95% CI 0.26-0.45), sensitivity 37%, specificity 48%, HR 0.48, p = 0.04 versus Oncotype RS plus AI-grade C-index 0.72 (95% CI 0.67-0.79), sensitivity 78%, specificity 49%, HR 4.6, p < 0.001 versus Oncotype RS plus PDxBr, C-index 0.76 (95% CI 0.70-0.82), sensitivity 67%, specificity 80%, HR 6.1, p < 0.001.ConclusionsPDxBr is a digital BC test combining automated AI-BC prognostic grade with clinical-pathologic features to predict the risk of early-stage BC recurrence. With future validation studies, we anticipate the PDxBr model will enrich current gene expression assays and enhance treatment decision-making.

Project description:Breast cancer has a long natural history. Established and emerging biologic markers address overall risk but not necessarily timing of recurrence. 346 adjuvant naïve breast cancer cases from Guy's Hospital with 23 years minimum follow-up and archival blocks were recut and reassessed for hormone-receptors (HR), HER2-receptor and grade. Disease-specific survival (DSS) was analyzed by recursive partitioning. To validate insights from this analysis, gene-signatures (proliferative and HR-negative) were evaluated for their ability to predict early versus late metastatic risk in 683 node-negative, adjuvant naïve breast cancers annotated with expression microarray data. Risk partitioning showed that adjuvant naïve node-negative outcome risk was primarily partitioned by tumor receptor status and grade but not tumor size. HR-positive and HER2-negative (HRpos) risk was partitioned by tumor grade; low grade cases have very low early risk but a 20% fall-off in DSS 10 or more years after diagnosis. Higher grade HRpos cases have risk over >20 years. Triple-negative (Tneg) and HER2-positive (HER2pos) cases DSS events occurred primarily within the first 5 years. Among node-positive cases, only low grade conferred late risk, suggesting that proliferative gene signatures that identify proliferation would be important for predicting early but not late recurrence. Using pooled data from four publicly available data sets for node-negative tumors annotated with gene expression and outcome data, we evaluated four prognostic gene signatures: two proliferation-based and two immune function-based. Tumor proliferative capacity predicted early but not late metastatic risk for HRpos cases. The immune function or HRneg specific signatures predicted only early metastatic risk in Tneg and HER2pos cases. Breast cancer prognostic signatures need to inform both risk and timing of metastatic events and may best be applied within subsets. Current signatures predict for outcome risk within 5 years of diagnosis. Predictors of late risk for HR positive disease are needed.

Project description:BackgroundThe radiological differential diagnosis between tumor recurrence and radiation-induced necrosis (ie, pseudoprogression) is of paramount importance in the management of glioma patients.ObjectiveThis research aims to develop a deep learning methodology for automated differentiation of tumor recurrence from radiation necrosis based on routine magnetic resonance imaging (MRI) scans.MethodsIn this retrospective study, 146 patients who underwent radiation therapy after glioma resection and presented with suspected recurrent lesions at the follow-up MRI examination were selected for analysis. Routine MRI scans were acquired from each patient, including T1, T2, and gadolinium-contrast-enhanced T1 sequences. Of those cases, 96 (65.8%) were confirmed as glioma recurrence on postsurgical pathological examination, while 50 (34.2%) were diagnosed as necrosis. A light-weighted deep neural network (DNN) (ie, efficient radionecrosis neural network [ERN-Net]) was proposed to learn radiological features of gliomas and necrosis from MRI scans. Sensitivity, specificity, accuracy, and area under the curve (AUC) were used to evaluate performance of the model in both image-wise and subject-wise classifications. Preoperative diagnostic performance of the model was also compared to that of the state-of-the-art DNN models and five experienced neurosurgeons.ResultsDNN models based on multimodal MRI outperformed single-modal models. ERN-Net achieved the highest AUC in both image-wise (0.915) and subject-wise (0.958) classification tasks. The evaluated DNN models achieved an average sensitivity of 0.947 (SD 0.033), specificity of 0.817 (SD 0.075), and accuracy of 0.903 (SD 0.026), which were significantly better than the tested neurosurgeons (P=.02 in sensitivity and P<.001 in specificity and accuracy).ConclusionsDeep learning offers a useful computational tool for the differential diagnosis between recurrent gliomas and necrosis. The proposed ERN-Net model, a simple and effective DNN model, achieved excellent performance on routine MRI scans and showed a high clinical applicability.

Dataset Information

Development, Validation, and Dissemination of a Breast Cancer Recurrence Detection and Timing Informatics Algorithm.

Publications

Development, Validation, and Dissemination of a Breast Cancer Recurrence Detection and Timing Informatics Algorithm.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets