Dataset Information

Generating real-world evidence from unstructured clinical notes to examine clinical utility of genetic tests: use case in BRCAness.

ABSTRACT:

Background

Next-generation sequencing provides comprehensive information about individuals' genetic makeup and is commonplace in oncology clinical practice. However, the utility of genetic information in the clinical decision-making process has not been examined extensively from a real-world, data-driven perspective. Through mining real-world data (RWD) from clinical notes, we could extract patients' genetic information and further associate treatment decisions with genetic information.

Methods

We proposed a real-world evidence (RWE) study framework that incorporates context-based natural language processing (NLP) methods and data quality examination before final association analysis. The framework was demonstrated in a Foundation-tested women cancer cohort (N?=?196). Upon retrieval of patients' genetic information using NLP system, we assessed the completeness of genetic data captured in unstructured clinical notes according to a genetic data-model. We examined the distribution of different topics regarding BRCA1/2 throughout patients' treatment process, and then analyzed the association between BRCA1/2 mutation status and the discussion/prescription of targeted therapy.

Results

We identified seven topics in the clinical context of genetic mentions including: Information, Evaluation, Insurance, Order, Negative, Positive, and Variants of unknown significance. Our rule-based system achieved a precision of 0.87, recall of 0.93 and F-measure of 0.91. Our machine learning system achieved a precision of 0.901, recall of 0.899 and F-measure of 0.9 for four-topic classification and a precision of 0.833, recall of 0.823 and F-measure of 0.82 for seven-topic classification. We found in result-containing sentences, the capture of BRCA1/2 mutation information was 75%, but detailed variant information (e.g. variant types) is largely missing. Using cleaned RWD, significant associations were found between BRCA1/2 positive mutation and targeted therapies.

Conclusions

In conclusion, we demonstrated a framework to generate RWE using RWD from different clinical sources. Rule-based NLP system achieved the best performance for resolving contextual variability when extracting RWD from unstructured clinical notes. Data quality issues such as incompleteness and discrepancies exist thus manual data cleaning is needed before further analysis can be performed. Finally, we were able to use cleaned RWD to evaluate the real-world utility of genetic information to initiate a prescription of targeted therapy.

SUBMITTER: Zhao Y

PROVIDER: S-EPMC7789545 | biostudies-literature | 2021 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Generating real-world evidence from unstructured clinical notes to examine clinical utility of genetic tests: use case in BRCAness.

Zhao Yiqing Y Weroha Saravut J SJ Goode Ellen L EL Liu Hongfang H Wang Chen C

BMC medical informatics and decision making 20210106 1

<h4>Background</h4>Next-generation sequencing provides comprehensive information about individuals' genetic makeup and is commonplace in oncology clinical practice. However, the utility of genetic information in the clinical decision-making process has not been examined extensively from a real-world, data-driven perspective. Through mining real-world data (RWD) from clinical notes, we could extract patients' genetic information and further associate treatment decisions with genetic information.< ...[more]

PMID: 33407429

Similar Datasets

Project description:IntroductionInternational guidelines advocate regular surveillance of patients following urothelial carcinoma (UC). A validated molecular diagnostic non-invasive urine test, Cxbladder Monitor, correctly identifies patients with a UC history who have low-probability of recurrence. The present study assesses the clinical utility of Cxbladder Monitor in reducing the number and frequency of urologic procedures ordered without missing detection of recurrent UC.MethodsData from 828 physician-patient assessments were generated from 18 participant physicians who each evaluated the same real-world clinical case data for 30 patients undergoing surveillance for recurrent UC. Each physician ordered tests and procedures and their timing, following review of the patient's demographic data, pre-existing conditions, risk factors and clinical history before and after disclosure of Cxbladder Monitor results. Changes in the number, type and timing of procedures ordered were assessed.ResultsThe addition of Cxbladder Monitor significantly reduced the overall number of tests ordered by 38.7%, including flexible cystoscopy by 43%, for patients whose Cxbladder Monitor result was low-probability. When the result was elevated-probability, the number of procedures ordered, including cystoscopy, was increased consistent with the increased risk of recurrent UC. Importantly, based on the tests ordered by each physician for each of the patients, all cases of recurrent UC would have been detected.ConclusionThe increase in clinical utility of Cxbladder Monitor for the management of patients undergoing surveillance for recurrent UC was shown to be driven by the reduction in procedures ordered for low-probability patients and for the more invasive procedures ordered for elevated-probability patients. In this study, the total number of procedures ordered, including the number of cystoscopies, was reduced especially in patients with low-probability of UC. The invasive procedures were ordered in a more targeted fashion for elevated-probability patients, without compromising the detection of recurrent UC. CLINICALTRIALS.Gov identifierNCT02700659.FundingPacific Edge Limited.

Project description:Melanoma currently lacks a reliable blood-based biomarker of disease activity, although circulating tumor DNA (ctDNA) may fill this role. We investigated the clinical utility (i.e., impact on clinical outcomes and interpretation of radiographic data) of measuring ctDNA in patients with metastatic or high-risk resected melanoma. Patients were prospectively accrued into ≥ 1 of three cohorts, as follows. Cohort A: patients with radiographically measurable metastatic melanoma who underwent comparison of ctDNA measured by a BEAMing digital PCR assay to tissue mutational status and total tumor burden; when appropriate, determinations about initiation of targeted therapy were based on ctDNA data. Cohorts B and C: patients with BRAF- or NRAS-mutant melanoma who had either undergone surgical resection of high-risk disease (cohort B) or were receiving or had received medical therapy for advanced disease (cohort C). Patients were followed longitudinally with serial ctDNA measurements with contemporaneous radiographic imaging to ascertain times to detection of disease activity and progressive disease, respectively. The sensitivity and specificity of the ctDNA assay were 86.8% and 100%, respectively. Higher tumor burden and visceral metastases were found to be associated with detectable ctDNA. In two patients in cohort A, ctDNA test results revealed a targetable mutation where tumor testing had not; both patients experienced a partial response to targeted therapy. In four of 30 patients with advanced melanoma, ctDNA assessments indicated evidence of melanoma activity that predicted radiographic evidence of disease progression by 8, 14, 25, and 38 weeks, respectively. CtDNA was detectable in three of these four patients coincident with radiographic evaluations that alone were interpreted as showing no evidence of neoplastic disease. Our findings provide evidence for the clinical utility of integrating ctDNA data in managing patients with melanoma in a real-world setting.

Project description:Introduction: One of the mainstays of chemotherapy in acute myeloid leukemia (AML) is induction with a goal to achieve morphological complete remission (CR). However, not all patients by this remission criterion achieve long-term remission and a subset relapse. This relapse is explained by the presence of measurable residual disease (MRD). Methods: We accrued 451 consecutive patients of adult AML (from March 2012 to December 2017) after informed consent. All patients received standard chemotherapy. MRD testing was done at post-induction and, if feasible, post-consolidation using 8- and later 10-color FCM. Analysis of MRD was done using a combination of difference from normal and leukemia-associated immunophenotype approaches. Conventional karyotyping and FISH were done as per standard recommendations, and patients were classified into favorable, intermediate, and poor cytogenetic risk groups. The presence of FLT3-ITD, NPM1, and CEBPA mutations was detected by a fragment length analysis-based assay. Results: As compared to Western data, our cohort of patients was younger with a median age of 35 years. There were 62 induction deaths in this cohort (13.7%), and 77 patients (17.1%) were not in morphological remission. The median follow-up was 26.0 months. Poor-risk cytogenetics and the presence of FLT3-ITD were significantly associated with inferior outcome. The presence of post-induction MRD assessment was significantly associated with adverse outcome with respect to OS (p = 0.01) as well as RFS (p = 0.004). Among established genetic subgroups, detection of MRD in intermediate cytogenetic and NPM1 mutated groups was also highly predictive of inferior outcome. On multivariate analysis, immunophenotypic MRD at the end of induction and FLT3-ITD emerged as independent prognostic factors predictive for outcome. Conclusion: This is the first data from a resource-constrained real-world setting demonstrating the utility of AML MRD as well as long-term outcome of AML. Our data is in agreement with other studies that determination of MRD is extremely important in predicting outcome. AML MRD is a very useful guide for guiding post-remission strategies in AML and should be incorporated into routine treatment algorithms.

Dataset Information

Generating real-world evidence from unstructured clinical notes to examine clinical utility of genetic tests: use case in BRCAness.

Background

Methods

Results

Conclusions

Publications

Generating real-world evidence from unstructured clinical notes to examine clinical utility of genetic tests: use case in BRCAness.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets