Dataset Information

Analysis of Not Structurable Oncological Study Eligibility Criteria for Improved Patient-Trial Matching.

ABSTRACT:

Background

Higher enrolment rates of cancer patients into clinical trials are necessary to increase cancer survival. As a prerequisite, an improved semiautomated matching of patient characteristics with clinical trial eligibility criteria is needed. This is based on the computer interpretability, i.e., structurability of eligibility criteria texts. To increase structurability, the common content, phrasing, and structuring problems of oncological eligibility criteria need to be better understood.

Objectives

We aimed to identify oncological eligibility criteria that were not possible to be structured by our manual approach and categorize them by the underlying structuring problem. Our results shall contribute to improved criteria phrasing in the future as a prerequisite for increased structurability.

Methods

The inclusion and exclusion criteria of 159 oncological studies from the Clinical Trial Information System of the National Center for Tumor Diseases Heidelberg were manually structured and grouped into content-related subcategories. Criteria identified as not structurable were analyzed further and manually categorized by the underlying structuring problem.

Results

The structuring of criteria resulted in 4,742 smallest meaningful components (SMCs) distributed across seven main categories (Diagnosis, Therapy, Laboratory, Study, Findings, Demographics, and Lifestyle, Others). A proportion of 645 SMCs (13.60%) was not possible to be structured due to content- and structure-related issues. Of these, a subset of 415 SMCs (64.34%) was considered not remediable, as supplementary medical knowledge would have been needed or the linkage among the sentence components was too complex. The main category "Diagnosis and Study" contained these two subcategories to the largest parts and thus were the least structurable. In the inclusion criteria, reasons for lacking structurability varied, while missing supplementary medical knowledge was the largest factor within the exclusion criteria.

Conclusion

Our results suggest that further improvement of eligibility criterion phrasing only marginally contributes to increased structurability. Instead, physician-based confirmation of the matching results and the exclusion of factors harming the patient or biasing the study is needed.

SUBMITTER: Dieter J

PROVIDER: S-EPMC8412998 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundManual eligibility screening (ES) for a clinical trial typically requires a labor-intensive review of patient records that utilizes many resources. Leveraging state-of-the-art natural language processing (NLP) and information extraction (IE) technologies, we sought to improve the efficiency of physician decision-making in clinical trial enrollment. In order to markedly reduce the pool of potential candidates for staff screening, we developed an automated ES algorithm to identify patients who meet core eligibility characteristics of an oncology clinical trial.MethodsWe collected narrative eligibility criteria from ClinicalTrials.gov for 55 clinical trials actively enrolling oncology patients in our institution between 12/01/2009 and 10/31/2011. In parallel, our ES algorithm extracted clinical and demographic information from the Electronic Health Record (EHR) data fields to represent profiles of all 215 oncology patients admitted to cancer treatment during the same period. The automated ES algorithm then matched the trial criteria with the patient profiles to identify potential trial-patient matches. Matching performance was validated on a reference set of 169 historical trial-patient enrollment decisions, and workload, precision, recall, negative predictive value (NPV) and specificity were calculated.ResultsWithout automation, an oncologist would need to review 163 patients per trial on average to replicate the historical patient enrollment for each trial. This workload is reduced by 85% to 24 patients when using automated ES (precision/recall/NPV/specificity: 12.6%/100.0%/100.0%/89.9%). Without automation, an oncologist would need to review 42 trials per patient on average to replicate the patient-trial matches that occur in the retrospective data set. With automated ES this workload is reduced by 90% to four trials (precision/recall/NPV/specificity: 35.7%/100.0%/100.0%/95.5%).ConclusionBy leveraging NLP and IE technologies, automated ES could dramatically increase the trial screening efficiency of oncologists and enable participation of small practices, which are often left out from trial enrollment. The algorithm has the potential to significantly reduce the effort to execute clinical research at a point in time when new initiatives of the cancer care community intend to greatly expand both the access to trials and the number of available trials.

Project description:BackgroundLung cancer is a major health problem. CT lung screening can reduce lung cancer mortality through early diagnosis by at least 20%. Screening high-risk individuals is most effective. Retrospective analyses suggest that identifying individuals for screening by accurate prediction models is more efficient than using categorical age-smoking criteria, such as the US Preventive Services Task Force (USPSTF) criteria. This study prospectively compared the effectiveness of the USPSTF2013 and PLCOm2012 model eligibility criteria.MethodsIn this prospective cohort study, participants from the International Lung Screening Trial (ILST), aged 55-80 years, who were current or former smokers (ie, had ≥30 pack-years smoking history or ≤15 quit-years since last permanently quitting), and who met USPSTF2013 criteria or a PLCOm2012 risk threshold of at least 1·51% within 6 years of screening, were recruited from nine screening sites in Canada, Australia, Hong Kong, and the UK. After enrolment, patients were assessed with the USPSTF2013 criteria and the PLCOm2012 risk model with a threshold of at least 1·70% at 6 years. Data were collected locally and centralised. Main outcomes were the comparison of lung cancer detection rates and cumulative life expectancies in patients with lung cancer between USPSTF2013 criteria and the PLCOm2012 model. In this Article, we present data from an interim analysis. To estimate the incidence of lung cancers in individuals who were USPSTF2013-negative and had PLCOm2012 of less than 1·51% at 6 years, ever-smokers in the Prostate Lung Colorectal and Ovarian Cancer Screening Trial (PLCO) who met these criteria and their lung cancer incidence were applied to the ILST sample size for the mean follow-up occurring in the ILST. This trial is registered at ClinicalTrials.gov, NCT02871856. Study enrolment is almost complete.FindingsBetween June 17, 2015, and Dec 29, 2020, 5819 participants from the International Lung Screening Trial (ILST) were enrolled on the basis of meeting USPSTF2013 criteria or the PLCOm2012 risk threshold of at least 1·51% at 6 years. The same number of individuals was selected for the PLCOm2012 model as for the USPSTF2013 criteria (4540 [78%] of 5819). After a mean follow-up of 2·3 years (SD 1·0), 135 lung cancers occurred in 4540 USPSTF2013-positive participants and 162 in 4540 participants included in the PLCOm2012 of at least 1·70% at 6 years group (cancer sensitivity difference 15·8%, 95% CI 10·7-22·1%; absolute odds ratio 4·00, 95% CI 1·89-9·44; p<0·0001). Compared to USPSTF2013-positive individuals, PLCOm2012-selected participants were older (mean age 65·7 years [SD 5·9] vs 63·3 years [5·7]; p<0·0001), had more comorbidities (median 2 [IQR 1-3] vs 1 [1-2]; p<0·0001), and shorter life expectancy (13·9 years [95% CI 12·8-14·9] vs 14·8 [13·6-16·0] years). Model-based difference in cumulative life expectancies for those diagnosed with lung cancer were higher in those who had PLCOm2012 risk of at least 1·70% at 6 years than individuals who were USPSTF2013-positive (2248·6 years [95% CI 2089·6-2425·9] vs 2000·7 years [1841·2-2160·3]; difference 247·9 years, p=0·015).InterpretationPLCOm2012 appears to be more efficient than the USPSTF2013 criteria for selecting individuals to enrol into lung cancer screening programmes and should be used for identifying high-risk individuals who benefit from the inclusion in these programmes.FundingTerry Fox Research Institute, The UBC-VGH Hospital Foundation and the BC Cancer Foundation, the Alberta Cancer Foundation, the Australian National Health and Medical Research Council, Cancer Research UK and a consortium of funders, and the Roy Castle Lung Cancer Foundation for the UK Lung Screen Uptake Trial.

Project description:ImportanceAlthough independent charity patient assistance programs improve patient access to costly prescription drugs, recent federal investigations have raised questions about their potential to increase pharmaceutical spending and to violate the federal Anti-Kickback Statute. Little is known about the design of the programs, patient eligibility, or drug coverage.ObjectiveTo examine the eligibility criteria of the independent charity patient assistance programs and the drugs covered by them.Design, setting, and participantsDescriptive cross-sectional study of the 6 largest independent charities offering patient assistance programs for patients including, but not limited to, Medicare beneficiaries in 2018. These charities offered 274 different disease-specific patient assistance programs. Drugs were identified for subgroup analysis that had any use reported on the Medicare Part D spending dashboard and any off-patent brand-name drugs that incurred more than $10 000 in Medicare spending per beneficiary in 2016.ExposuresSupport by independent charity patient assistance programs.Main outcomes and measuresThe primary outcomes were the characteristics of patient assistance programs, including assistance type, insurance coverage (vs uninsured), and income eligibility. The secondary outcomes were the cost of the drugs covered by the patient assistance programs and the coverage of expensive off-patent brand-name drugs vs substitutable generic drugs.ResultsAmong the 6 independent charity foundations included in the analysis, their total revenue in 2017 ranged from $24 million to $532 million, and expenditures on patient assistance programs ranged from $24 million to $353 million, representing on average, 86% of their revenue. Of the 274 patient assistance programs offered by these organizations, 168 (61%) provided only co-payment assistance, and the most common therapeutic area covered was cancer or cancer treatment-related symptoms (113 patient assistance programs; 41%). A total of 267 programs (97%) required insurance coverage as an eligibility criterion (ie, excluded uninsured patients). The most common income eligibility limit was 500% of the federal poverty level. The median annual cost of the drugs per beneficiary covered by the programs was $1157 (interquartile range, $247-$5609) compared with $367 (interquartile range, $100-$1500) for the noncovered drugs. Off-patent brand-name drugs (cost: >$10 000) were covered by a mean of 3.1 (SD, 2.0) patient assistance programs, whereas their generic equivalents were covered by a mean of 1.2 (SD, 1.0) patient assistance programs.Conclusions and relevanceIn 2018, among 274 patient assistance programs operated by the 6 independent charity foundations, the majority did not provide coverage for uninsured patients. Medications that were covered by the patient assistance programs were generally more expensive than those that were not covered.