Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Text Classification of Cancer Clinical Trial Eligibility Criteria.

ABSTRACT: Automatic identification of clinical trials for which a patient is eligible is complicated by the fact that trial eligibility are stated in natural language. A potential solution to this problem is to employ text classification methods for common types of eligibility criteria. In this study, we focus on seven common exclusion criteria in cancer trials: prior malignancy, human immunodeficiency virus, hepatitis B, hepatitis C, psychiatric illness, drug/substance abuse, and autoimmune illness. Our dataset consists of 764 phase III cancer trials with these exclusions annotated at the trial level. We experiment with common transformer models as well as a new pre-trained clinical trial BERT model. Our results demonstrate the feasibility of automatically classifying common exclusion criteria. Additionally, we demonstrate the value of a pre-trained language model specifically for clinical trials, which yield the highest average performance across all criteria.

SUBMITTER: Yang Y

PROVIDER: S-EPMC10785908 | biostudies-literature | 2023

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Text Classification of Cancer Clinical Trial Eligibility Criteria.

Yang Yumeng Y Jayaraj Soumya S Ludmir Ethan E Roberts Kirk K

AMIA ... Annual Symposium proceedings. AMIA Symposium 20230101

Automatic identification of clinical trials for which a patient is eligible is complicated by the fact that trial eligibility are stated in natural language. A potential solution to this problem is to employ text classification methods for common types of eligibility criteria. In this study, we focus on seven common exclusion criteria in cancer trials: prior malignancy, human immunodeficiency virus, hepatitis B, hepatitis C, psychiatric illness, drug/substance abuse, and autoimmune illness. Our ...[more]

PMID: 38222417

Similar Datasets

An Ensemble Learning Strategy for Eligibility Criteria Text Classification for Clinical Trial Recruitment: Algorithm Development and Validation.

Project description:BACKGROUND:Eligibility criteria are the main strategy for screening appropriate participants for clinical trials. Automatic analysis of clinical trial eligibility criteria by digital screening, leveraging natural language processing techniques, can improve recruitment efficiency and reduce the costs involved in promoting clinical research. OBJECTIVE:We aimed to create a natural language processing model to automatically classify clinical trial eligibility criteria. METHODS:We proposed a classifier for short text eligibility criteria based on ensemble learning, where a set of pretrained models was integrated. The pretrained models included state-of-the-art deep learning methods for training and classification, including Bidirectional Encoder Representations from Transformers (BERT), XLNet, and A Robustly Optimized BERT Pretraining Approach (RoBERTa). The classification results by the integrated models were combined as new features for training a Light Gradient Boosting Machine (LightGBM) model for eligibility criteria classification. RESULTS:Our proposed method obtained an accuracy of 0.846, a precision of 0.803, and a recall of 0.817 on a standard data set from a shared task of an international conference. The macro F1 value was 0.807, outperforming the state-of-the-art baseline methods on the shared task. CONCLUSIONS:We designed a model for screening short text classification criteria for clinical trials based on multimodel ensemble learning. Through experiments, we concluded that performance was improved significantly with a model ensemble compared to a single model. The introduction of focal loss could reduce the impact of class imbalance to achieve better performance.

| S-EPMC7367522 | biostudies-literature

How Have Cancer Clinical Trial Eligibility Criteria Evolved Over Time?

Project description:Knowledge reuse of cancer trial designs may benefit from a temporal understanding of the evolution of the target populations of cancer studies over time. Therefore, we conducted a retrospective analysis of the trends of cancer trial eligibility criteria between 1999 and 2014. The yearly distributions of eligibility concepts for chemicals and drugs, procedures, observations, and medical conditions extracted from free-text eligibility criteria of 32,000 clinical trials for 89 cancer types were analyzed. We identified the concepts that trend upwards or downwards in all or selected cancer types, and the concepts that show anomalous trends for some cancers. Later, concept trends were studied in a disease-specific manner and illustrated for breast cancer. Criteria trends observed in this study are also validated and interpreted using evidence from the existing medical literature. This study contributes a method for concept trend analysis and original knowledge of the trends in cancer clinical trial eligibility criteria.

| S-EPMC5001741 | biostudies-literature

A knowledge base of clinical trial eligibility criteria.

Project description:ObjectiveWe present the Clinical Trial Knowledge Base, a regularly updated knowledge base of discrete clinical trial eligibility criteria equipped with a web-based user interface for querying and aggregate analysis of common eligibility criteria.Materials and methodsWe used a natural language processing (NLP) tool named Criteria2Query (Yuan et al., 2019) to transform free text clinical trial eligibility criteria from ClinicalTrials.gov into discrete criteria concepts and attributes encoded using the widely adopted Observational Medical Outcomes Partnership (OMOP) Common Data Model (CDM) and stored in a relational SQL database. A web application accessible via RESTful APIs was implemented to enable queries and visual aggregate analyses. We demonstrate CTKB's potential role in EHR phenotype knowledge engineering using ten validated phenotyping algorithms.ResultsAt the time of writing, CTKB contained 87,504 distinctive OMOP CDM standard concepts, including Condition (47.82%), Drug (23.01%), Procedure (13.73%), Measurement (24.70%) and Observation (5.28%), with 34.78% for inclusion criteria and 65.22% for exclusion criteria, extracted from 352,110 clinical trials. The average hit rate of criteria concepts in eMERGE phenotype algorithms is 77.56%.ConclusionCTKB is a novel comprehensive knowledge base of discrete eligibility criteria concepts with the potential to enable knowledge engineering for clinical trial cohort definition, clinical trial population representativeness assessment, electronical phenotyping, and data gap analyses for using electronic health records to support clinical trial recruitment.

| S-EPMC8407851 | biostudies-literature

A practical method for transforming free-text eligibility criteria into computable criteria.

Project description:Formalizing eligibility criteria in a computer-interpretable language would facilitate eligibility determination for study subjects and the identification of studies on similar patient populations. Because such formalization is extremely labor intensive, we transform the problem from one of fully capturing the semantics of criteria directly in a formal expression language to one of annotating free-text criteria in a format called ERGO annotation. The annotation can be done manually, or it can be partially automated using natural-language processing techniques. We evaluated our approach in three ways. First, we assessed the extent to which ERGO annotations capture the semantics of 1000 eligibility criteria randomly drawn from ClinicalTrials.gov. Second, we demonstrated the practicality of the annotation process in a feasibility study. Finally, we demonstrate the computability of ERGO annotation by using it to (1) structure a library of eligibility criteria, (2) search for studies enrolling specified study populations, and (3) screen patients for potential eligibility for a study. We therefore demonstrate a new and practical method for incrementally capturing the semantics of free-text eligibility criteria into computable form.

| S-EPMC3129371 | biostudies-literature

Parsable Clinical Trial Eligibility Criteria Representation Using Natural Language Processing.

Project description:Successful clinical trials offer better treatments to current or future patients and advance scientific research.1,2,3 Clinical trials define the target population using specific eligibility criteria to ensure an optimal enrollment sample.4 Clinical trial eligibility criteria are often described in unstructured free-text5 which makes automation of the recruitment process challenging. This contributes to the long-standing problem of insufficient enrollment of clinical trials.6,7 This study uses a machine learning approach to extract clinical trial eligibility criteria, and convert them into structured queryable formats using descriptive statistics based on medical entity frequency and binary entity relationships. We present a JSON-based structural representation of clinical trials eligibility criteria for clinical trials to follow.

| S-EPMC10148319 | biostudies-literature

Chia, a large annotated corpus of clinical trial eligibility criteria.

Project description:We present Chia, a novel, large annotated corpus of patient eligibility criteria extracted from 1,000 interventional, Phase IV clinical trials registered in ClinicalTrials.gov. This dataset includes 12,409 annotated eligibility criteria, represented by 41,487 distinctive entities of 15 entity types and 25,017 relationships of 12 relationship types. Each criterion is represented as a directed acyclic graph, which can be easily transformed into Boolean logic to form a database query. Chia can serve as a shared benchmark to develop and test future machine learning, rule-based, or hybrid methods for information extraction from free-text clinical trial eligibility criteria.

| S-EPMC7452886 | biostudies-literature

Clinical Trial Eligibility Criteria and Recently Approved Cancer Therapies for Patients With Brain Metastases.

Project description:Brain metastases cause significant morbidity and mortality in patients with advanced cancer. In the era of precision oncology and immunotherapy, there are rapidly evolving systemic treatment options. These novel therapies may have variable intracranial efficacy, and patients with brain metastases remain a population of special interest. Typically, only patients with stable, asymptomatic and/or treated brain metastases are enrolled in clinical trials, or may be excluded altogether, particularly in the setting of leptomeningeal carcinomatosis. Consequently, this leads to significant concerns on the external validity of clinical trial evidence to real-world clinical practice. Here we describe the current trends in cancer clinical trial eligibility for patients with brain metastases in both early and late phase trials, with a focus on targeted and immunotherapies. We evaluate recent newly FDA approved therapies and the clinical trial evidence base leading to approval. This includes analysis of inclusion and exclusion criteria, requirements for baseline screening for brain metastases, surveillance cerebral imaging and incorporation of trial endpoints for patients with brain metastases. Finally, the use of alternative sources of data such as real-world evidence with registries and collaborative studies will be discussed.

| S-EPMC8761732 | biostudies-literature

Impact of prior malignancies on outcome of colorectal cancer; revisiting clinical trial eligibility criteria.

Project description:BackgroundMost clinical trials on colorectal cancer (CRC) exclude cases who have history of a prior malignancy. However, no prior research studied this history's actual impact on the survival of CRC. In the paper, we study the effects of having a malignancy preceding CRC diagnosis on its survival outcomes.MethodsCRC patients diagnosed during 1973-2008 were reviewed using the SEER 18 database. We calculated overall survival and cancer-specific survival of subsequent CRC, and more specifically stage IV CRC, using Kaplan-Meier test and adjusted Cox models.ResultsA total 550,325 CRC patients were reviewed, of whom 31,663 had history of a prior malignancy. The most commonly reported sites of a prior malignancy were: prostate, breast, urinary bladder, lung, and endometrium. Patients with history of a prior non-leukemic malignancy or history of a prior leukemia were found to have worse overall survival (HR = 1.165 95%CI = 1.148-1.183, P < 0.001) and (HR = 1.825 95%CI = 1.691-1.970, P < 0.001), respectively. However, CRC patients with history of a prior non-leukemic malignancy showed an improved colorectal cancer-specific survival (HR = .930 95%CI = .909-.952, P < 0.001). Analysis of stage IV CRC patients showed that patients with history of any non-leukemic malignancy did not have a significant change in overall survival. Whereas, patients with a prior leukemia showed a worse overall survival (HR = 1.535, 95%CI = 1.303-1.809, P < 0.001). When analyzed separately, right CRC and left CRC showed similar survival patterns.ConclusionA prior malignancy before CRC -in general- can be associated with worse clinical survival outcomes. These worse outcomes are not observed in stage IV CRC. Considering these results when including/excluding stage IV CRC patients with prior malignancies in clinical trials may play help improve their generalizability.

| S-EPMC6716811 | biostudies-literature

Effect of prior cancer on survival of hepatocellular carcinoma: implications for clinical trial eligibility criteria.

Project description:BackgroundPatients with cancer history are usually excluded from hepatocellular carcinoma (HCC) clinical trials. However, whether previous malignancy affects the oncological outcomes of HCC patients has not been fully assessed. This study aimed to evaluate whether prior cancer compromised the survival of HCC patients.MethodsPatients with HCC were extracted from the Surveillance, Epidemiology, and End Results database between 2004 and 2015, and then they were classified into groups with and without prior cancer. The Kaplan-Meier and multivariate Cox regression analysis were adopted to evaluate whether prior cancer impacted clinical outcomes after propensity score matching (PSM) adjusting baseline differences. Validation was performed in the cohort from our institution.ResultsWe identified 2642 HCC patients with prior cancer. After PSM, the median overall survival (OS) time were 14.5 and 12.0 months respectively for groups with and without prior cancer. Prior cancer did not compromise prognosis in patients with HCC (p = 0.49). The same tendency was found in subgroups stratified by tumor stages and cancer interval period: OS was similar between groups with and without prior cancer (both p values> 0.1). In the multivariate Cox regression model, prior cancer did not adversely impact patients' survival (HR: 1.024; 95% CI: 0.961-1.092). In the validation cohort from our institution, prior cancer had no significant association with worse outcomes (p = 0.48).ConclusionFor HCC patients, prior cancer did not compromise their survival, regardless of tumor stage and cancer interval period. Exclusion criteria for HCC clinical trials could be reconsidered.

| S-EPMC7871582 | biostudies-literature

Transformer-Based Named Entity Recognition for Parsing Clinical Trial Eligibility Criteria.

Project description:The rapid adoption of electronic health records (EHRs) systems has made clinical data available in electronic format for research and for many downstream applications. Electronic screening of potentially eligible patients using these clinical databases for clinical trials is a critical need to improve trial recruitment efficiency. Nevertheless, manually translating free-text eligibility criteria into database queries is labor intensive and inefficient. To facilitate automated screening, free-text eligibility criteria must be structured and coded into a computable format using controlled vocabularies. Named entity recognition (NER) is thus an important first step. In this study, we evaluate 4 state-of-the-art transformer-based NER models on two publicly available annotated corpora of eligibility criteria released by Columbia University (i.e., the Chia data) and Facebook Research (i.e.the FRD data). Four transformer-based models (i.e., BERT, ALBERT, RoBERTa, and ELECTRA) pretrained with general English domain corpora vs. those pretrained with PubMed citations, clinical notes from the MIMIC-III dataset and eligibility criteria extracted from all the clinical trials on ClinicalTrials.gov were compared. Experimental results show that RoBERTa pretrained with MIMIC-III clinical notes and eligibility criteria yielded the highest strict and relaxed F-scores in both the Chia data (i.e., 0.658/0.798) and the FRD data (i.e., 0.785/0.916). With promising NER results, further investigations on building a reliable natural language processing (NLP)-assisted pipeline for automated electronic screening are needed.

| S-EPMC8373041 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data