Browse
Submit Data
Databases
API
Help

Dataset Information

22 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Assessing the incremental value of new biomarkers based on OR rules.

ABSTRACT: In early detection of disease, a single biomarker often has inadequate classification performance, making it important to identify new biomarkers to combine with the existing marker for improved performance. A biologically natural method for combining biomarkers is to use logic rules, e.g., the OR/AND rules. In our motivating example of early detection of pancreatic cancer, the established biomarker CA19-9 is only present in a subclass of cancers; it is of interest to identify new biomarkers present in the other subclasses and declare disease when either marker is positive. While there has been research on developing biomarker combinations using the OR/AND rules, inference regarding the incremental value of the new marker within this framework is lacking and challenging due to statistical non-regularity. In this article, we aim to answer the inferential question of whether combining the new biomarker achieves better classification performance than using the existing biomarker alone, based on a nonparametrically estimated OR rule that maximizes the weighted average of sensitivity and specificity. We propose and compare various procedures for testing the incremental value of the new biomarker and constructing its confidence interval, using bootstrap, cross-validation, and a novel fuzzy p-value-based technique. We compare the performance of different methods via extensive simulation studies and apply them to the pancreatic cancer example.

SUBMITTER: Wang L

PROVIDER: S-EPMC7307975 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

Assessing incremental value of biomarkers with multi-phase nested case-control studies.

Project description:Accurate risk prediction models are needed to identify different risk groups for individualized prevention and treatment strategies. In the Nurses' Health Study, to examine the effects of several biomarkers and genetic markers on the risk of rheumatoid arthritis (RA), a three-phase nested case-control (NCC) design was conducted, in which two sequential NCC subcohorts were formed with one nested within the other, and one set of new markers measured on each of the subcohorts. One objective of the study is to evaluate clinical values of novel biomarkers in improving upon existing risk models because of potential cost associated with assaying biomarkers. In this paper, we develop robust statistical procedures for constructing risk prediction models for RA and estimating the incremental value (IncV) of new markers based on three-phase NCC studies. Our method also takes into account possible time-varying effects of biomarkers in risk modeling, which allows us to more robustly assess the biomarker utility and address the question of whether a marker is better suited for short-term or long-term risk prediction. The proposed procedures are shown to perform well in finite samples via simulation studies.

| S-EPMC4819437 | biostudies-literature

Developing risk prediction models for kidney injury and assessing incremental value for novel biomarkers.

Project description:The field of nephrology is actively involved in developing biomarkers and improving models for predicting patients' risks of AKI and CKD and their outcomes. However, some important aspects of evaluating biomarkers and risk models are not widely appreciated, and statistical methods are still evolving. This review describes some of the most important statistical concepts for this area of research and identifies common pitfalls. Particular attention is paid to metrics proposed within the last 5 years for quantifying the incremental predictive value of a new biomarker.

| S-EPMC4123400 | biostudies-literature

Assessing the incremental predictive performance of novel biomarkers over standard predictors.

Project description:It is unclear to what extent the incremental predictive performance of a novel biomarker is impacted by the method used to control for standard predictors. We investigated whether adding a biomarker to a model with a published risk score overestimates its incremental performance as compared to adding it to a multivariable model with individual predictors (or a composite risk score estimated from the sample of interest) and to a null model. We used 1000 simulated datasets (with a range of risk factor distributions and event rates) to compare these methods, using the continuous net reclassification index (NRI), the integrated discrimination index (IDI), and change in the C-statistic as discrimination metrics. The new biomarker was added to the following: null model, model including a published risk score, model including a composite risk score estimated from the sample of interest, and multivariable model with individual predictors. We observed a gradient in the incremental performance of the biomarker, with the null model resulting in the highest predictive performance of the biomarker and the model using individual predictors resulting in the lowest (mean increases in C-statistic between models without and with the biomarker: 0.261, 0.085, 0.030, and 0.031; NRI: 0.767, 0.621, 0.513, and 0.530; IDI: 0.153, 0.093, 0.053 and 0.057, respectively). These findings were supported by the Framingham Study data predicting atrial fibrillation using novel biomarkers. We recommend that authors report the effect of a new biomarker after controlling for standard predictors modeled as individual variables.

| S-EPMC4047140 | biostudies-literature

Subgroup specific incremental value of new markers for risk prediction.

Project description:In many clinical applications, understanding when measurement of new markers is necessary to provide added accuracy to existing prediction tools could lead to more cost effective disease management. Many statistical tools for evaluating the incremental value (IncV) of the novel markers over the routine clinical risk factors have been developed in recent years. However, most existing literature focuses primarily on global assessment. Since the IncVs of new markers often vary across subgroups, it would be of great interest to identify subgroups for which the new markers are most/least useful in improving risk prediction. In this paper we provide novel statistical procedures for systematically identifying potential traditional-marker based subgroups in whom it might be beneficial to apply a new model with measurements of both the novel and traditional markers. We consider various conditional time-dependent accuracy parameters for censored failure time outcome to assess the subgroup-specific IncVs. We provide non-parametric kernel-based estimation procedures to calculate the proposed parameters. Simultaneous interval estimation procedures are provided to account for sampling variation and adjust for multiple testing. Simulation studies suggest that our proposed procedures work well in finite samples. The proposed procedures are applied to the Framingham Offspring Study to examine the added value of an inflammation marker, C-reactive protein, on top of the traditional Framingham risk score for predicting 10-year risk of cardiovascular disease.

| S-EPMC3633735 | biostudies-literature

iBLAST: Incremental BLAST of new sequences via automated e-value correction.

Project description:Search results from local alignment search tools use statistical scores that are sensitive to the size of the database to report the quality of the result. For example, NCBI BLAST reports the best matches using similarity scores and expect values (i.e., e-values) calculated against the database size. Given the astronomical growth in genomics data throughout a genomic research investigation, sequence databases grow as new sequences are continuously being added to these databases. As a consequence, the results (e.g., best hits) and associated statistics (e.g., e-values) for a specific set of queries may change over the course of a genomic investigation. Thus, to update the results of a previously conducted BLAST search to find the best matches on an updated database, scientists must currently rerun the BLAST search against the entire updated database, which translates into irrecoverable and, in turn, wasted execution time, money, and computational resources. To address this issue, we devise a novel and efficient method to redeem past BLAST searches by introducing iBLAST. iBLAST leverages previous BLAST search results to conduct the same query search but only on the incremental (i.e., newly added) part of the database, recomputes the associated critical statistics such as e-values, and combines these results to produce updated search results. Our experimental results and fidelity analyses show that iBLAST delivers search results that are identical to NCBI BLAST at a substantially reduced computational cost, i.e., iBLAST performs (1 + δ)/δ times faster than NCBI BLAST, where δ represents the fraction of database growth. We then present three different use cases to demonstrate that iBLAST can enable efficient biological discovery at a much faster speed with a substantially reduced computational cost.

| S-EPMC8062096 | biostudies-literature

Prognostic value of estimated functional capacity incremental to cardiac biomarkers in stable cardiac patients.

Project description:BackgroundFew studies have investigated functional capacity self-assessment tools in either prediction of future major adverse cardiac outcomes beyond all-cause mortality or direct comparisons with clinically available biomarkers.Methods and resultsWe estimated functional capacity using the Duke Activity Status Index (DASI) questionnaire in 8987 sequential stable patients without acute coronary syndrome who were undergoing elective diagnostic coronary angiography with 3-year follow-up of major adverse cardiac events (death, nonfatal myocardial infarction, or stroke). A low DASI score provided independent prediction of a 4.8-fold increase in future risk of incident major adverse cardiac events at 3 years (quartiles 1 versus 4 hazard ratio [95% CI] 4.76 [4.03 to 5.61], P<0.001), and a 3.8-fold increased risk after adjusting for traditional risk factors (3.77 [3.15 to 4.51], P<0.001). The prognostic value of the DASI score was evident in both primary and secondary prevention cohorts, with and without heart failure, as well as high and low C-reactive protein and B-type natriuretic peptide levels. The DASI score reclassified 15% of patients (P<0.001) beyond traditional risk factors in predicting future MACE.ConclusionA simple self-assessment tool of functional capacity in stable patients undergoing elective diagnostic cardiac evaluation provides independent and incremental prognostic value for prediction of both significant coronary angiographic disease and long-term adverse clinical events.

| S-EPMC4323823 | biostudies-literature

Model-based clustering for assessing the prognostic value of imaging biomarkers and mixed type tests.

Project description:A model-based clustering method is proposed to address two research aims in Alzheimer's disease (AD): to evaluate the accuracy of imaging biomarkers in AD prognosis, and to integrate biomarker information and standard clinical test results into the diagnoses. One challenge in such biomarker studies is that it is often desired or necessary to conduct the evaluation without relying on clinical diagnoses or some other standard references. This is because (1) biomarkers may provide prognostic information long before any standard reference can be acquired; (2) these references are often based on or provide unfair advantage to standard tests. Therefore, they can mask the prognostic value of a useful biomarker, especially when the biomarker is much more accurate than the standard tests. In addition, the biomarkers and existing tests may be of mixed type and vastly different distributions. A model-based clustering method based on finite mixture modeling framework is introduced. The model allows for the inclusion of mixed typed manifest variables with possible differential covariates to evaluate the prognostic value of biomarkers in addition to standard tests without relying on potentially inaccurate reference diagnoses. Maximum likelihood parameter estimation is carried out via the EM algorithm. Accuracy measures and the ROC curves of the biomarkers are derived subsequently. Finally, the method is illustrated with a real example in AD.

| S-EPMC5613685 | biostudies-literature

Semi-supervised incremental learning with few examples for discovering medical association rules.

Project description:BackgroundAssociation Rules are one of the main ways to represent structural patterns underlying raw data. They represent dependencies between sets of observations contained in the data. The associations established by these rules are very useful in the medical domain, for example in the predictive health field. Classic algorithms for association rule mining give rise to huge amounts of possible rules that should be filtered in order to select those most likely to be true. Most of the proposed techniques for these tasks are unsupervised. However, the accuracy provided by unsupervised systems is limited. Conversely, resorting to annotated data for training supervised systems is expensive and time-consuming. The purpose of this research is to design a new semi-supervised algorithm that performs like supervised algorithms but uses an affordable amount of training data.MethodsIn this work we propose a new semi-supervised data mining model that combines unsupervised techniques (Fisher's exact test) with limited supervision. Starting with a small seed of annotated data, the model improves results (F-measure) obtained, using a fully supervised system (standard supervised ML algorithms). The idea is based on utilising the agreement between the predictions of the supervised system and those of the unsupervised techniques in a series of iterative steps.ResultsThe new semi-supervised ML algorithm improves the results of supervised algorithms computed using the F-measure in the task of mining medical association rules, but training with an affordable amount of manually annotated data.ConclusionsUsing a small amount of annotated data (which is easily achievable) leads to results similar to those of a supervised system. The proposal may be an important step for the practical development of techniques for mining association rules and generating new valuable scientific medical knowledge.

| S-EPMC8785547 | biostudies-literature

Performance-based measures of physical function as mortality predictors: Incremental value beyond self-reports.

Project description:BackgroundAlthough previous studies have indicated that performance assessments strongly predict future survival, few have evaluated the incremental value in the presence of controls for self-reported activity and mobility limitations.ObjectiveWe assess and compare the added value of four tests - walking speed, chair stands, grip strength, and peak expiratory flow (PEF) - for predicting all-cause mortality.MethodsUsing population-based samples of older adults in Costa Rica (n = 2290, aged 60+) and Taiwan (n = 1219, aged 53+), we estimate proportional hazards models of mortality for an approximate five-year period. Receiver Operator Characteristic (ROC) curves are used to assess the prognostic value of each performance assessment.ResultsSelf-reported measures of physical limitations contribute substantial gains in mortality prediction, whereas performance-based assessments yield modest incremental gains. PEF provides the greatest added value, followed by grip strength. Our results suggest that including more than two performance assessments may provide little improvement in mortality prediction.ConclusionsPEF and grip strength are often simpler to administer in home interview settings, impose less of a burden on some respondents, and, in the presence of self-reported limitations, appear to be better predictors of mortality than do walking speed or chair stands.CommentsBeing unable to perform the test is often a strong predictor of mortality, but these indicators are not well-defined. Exclusion rates vary by the specific task and are likely to depend on the underlying demographic, health, social and cultural characteristics of the sample.

| S-EPMC4392849 | biostudies-literature

External Validation of the Extraprostatic Extension Grade on MRI and Its Incremental Value to Clinical Models for Assessing Extraprostatic Cancer.

Project description:ObjectivesTo externally validate the extraprostatic extension (EPE) grade criteria on MRI and analyze the incremental value of EPE grade to clinical models of prostate cancer.MethodsA consecutive 130 patients who underwent preoperative prostate MRI followed by radical prostatectomy between January 2015 to January 2020 in our institution were retrospectively enrolled. The EPE grade, Cancer of the Prostate Risk Assessment (CAPRA), and Memorial Sloan Kettering Cancer Center nomogram (MSKCCn) score for each patient were assigned. Significant clinicopathological factors in univariate and multivariate analyses were combined with EPE grade to build the Clinical + EPE grade model, and the CAPRA and MSKCCn score were also combined with EPE grade to build the CAPRA + EPE grade and MSKCCn + EPE grade model, respectively. The area under the curve (AUC), sensitivity and specificity of these models were calculated to evaluate their diagnostic performance. Calibration and decision curve analyses were used to analyze their calibration performance and clinical utility.ResultsThe AUC for predicting EPE was 0.767-0.778 for EPE grade, 0.704 for CAPRA, and 0.723 for MSKCCn. After combination with EPE grade, the AUCs of these clinical models increased significantly than using clinical models along (P < 0.05), but was comparable with using EPE grade alone (P > 0.05). The calibration curves of EPE grade, clinical models and combined models showed that these models are well-calibrated for EPE. In the decision curve analysis, EPE grade showed slightly higher net benefit than MSKCCn and CAPRA.ConclusionThe EPE grade showed good performance for evaluating EPE in our cohort and possessed well clinical utility. Further combinations with the EPE grade could improve the diagnostic performance of clinical models.

| S-EPMC8047629 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data