Sensitivity, Specificity, PPV, and NPV for Predictive Biomarkers.
Ontology highlight
ABSTRACT:
SUBMITTER: Simon R
PROVIDER: S-EPMC4609556 | biostudies-literature | 2015 Aug
REPOSITORIES: biostudies-literature
Publications
Sensitivity, Specificity, PPV, and NPV for Predictive Biomarkers.
Journal of the National Cancer Institute 20150624 8
Molecularly targeted cancer drugs are often developed with companion diagnostics that attempt to identify which patients will have better outcome on the new drug than the control regimen. Such predictive biomarkers are playing an increasingly important role in precision oncology. For diagnostic tests, sensitivity, specificity, positive predictive value, and negative predictive are usually used as performance measures. This paper discusses these indices for predictive biomarkers, provides methods ...[more]
Similar Datasets
Project description:PurposeTo describe and demonstrate appropriate statistical approaches for estimating sensitivity, specificity, predictive values and their 95% confidence intervals (95% CI) for correlated eye data.MethodsWe described generalized estimating equations (GEE) and cluster bootstrap to account for inter-eye correlation and applied them for analyzing the data from a clinical study of telemedicine for the detection of retinopathy of prematurity (ROP).ResultsAmong 100 infants (200 eyes) selected for analysis, 20 infants had referral-warranted ROP (RW-ROP) in both eyes and 9 infants with RW-ROP only in one eye based on clinical eye examination. In the per-eye analysis that included both eyes of an infant, the image evaluation for RW-ROP had sensitivity of 83.7% and specificity of 86.8%. The 95% CI's from the naïve approach that ignored the inter-eye correlation were narrower than those of the GEE approach and cluster bootstrap for both sensitivity (width of 95% CI: 22.4% vs. 23.2% vs. 23.9%) and specificity (11.4% vs. 12.5% vs. 11.6%). The 95% CIs for sensitivity and specificity calculated from left eyes and right eyes separately were wider (35.2% and 30.8% respectively for sensitivity, 25.4% and 17.3% respectively for specificity).ConclusionsWhen an ocular test is performed in both eyes of some or all of the study subjects, the statistical analyses are best performed at the eye-level and account for the inter-eye correlation by using either the GEE or cluster bootstrap. Ignoring the inter-eye correlation results in 95% CIs that are inappropriately narrow and analyzing data from two eyes separately are not efficient.
| S-EPMC7500131 | biostudies-literature
Project description:Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) antibody tests of varying specificity and sensitivity are now available. For informing individuals whether they have had coronavirus disease 2019 (COVID-19), they need to be very accurate. For measuring population prevalence of past infection, the numbers of false positives and negatives need to be roughly equal. With a series of worked examples for a notional population of 100,000 people, we show that even test systems with a high specificity can yield a large number of false positive results, especially where the population prevalence is low. For example, at a true population prevalence of 5%, using a test with 99% sensitivity and specificity, 16% of positive results will be false and thus 950 people will be incorrectly informed they have had the infection. Further confirmatory testing may be needed. Giving false reassurance on which personal or societal decisions might be based could be harmful for individuals, undermine public confidence and foster further outbreaks.
| S-EPMC7287442 | biostudies-literature
Project description:BACKGROUND:Many cancer biomarker research studies seek to develop markers that can accurately detect or predict future onset of disease. To design and evaluate these studies, one must specify the levels of accuracy sought. However, justified target levels are rarely available. METHODS:We describe a way to calculate target levels of sensitivity and specificity for a biomarker intended to be applied in a defined clinical context. The calculation requires knowledge of the prevalence or incidence of cases in the clinical population and the ratio of benefit associated with the clinical consequences of a positive biomarker test in cases (true positive) to cost associated with a positive biomarker test in controls (false positive). Guidance is offered on soliciting the cost/benefit ratio. The calculations are based on the longstanding decision theory concept of providing a net benefit on average in the population, and they rely on some assumptions about uniformity of costs and benefits to those tested. RESULTS:Calculations are illustrated with 3 applications: predicting colon cancer recurrence in stage 1 patients; predicting interval breast cancer (between mammography screenings); and screening for ovarian cancer. CONCLUSIONS:It is feasible to specify target levels of biomarker performance that enable evaluation of the potential clinical impact of biomarkers in early-phase studies. Nevertheless, biomarkers meeting the criteria should still be tested rigorously in studies that measure the actual impact on patient outcomes of using the biomarker to make clinical decisions.
| S-EPMC5003106 | biostudies-literature
Project description:BACKGROUND:The expression of suicidal ideation is considered to be an important warning sign for suicide. However, the predictive properties of suicidal ideation as a test of later suicide are unclear.AimsTo assess the strength of the association between suicidal ideation and later suicide measured by odds ratio (OR), sensitivity, specificity and positive predictive value (PPV). METHOD:We located English-language studies indexed in PubMed that reported the expression or non-expression of suicidal ideation among people who later died by suicide or did not. A random effects meta-analysis was used to assess the pooled OR, sensitivity, specificity and PPV of suicidal ideation for later suicide among groups of people from psychiatric and non-psychiatric settings. RESULTS:There was a moderately strong but highly heterogeneous association between suicidal ideation and later suicide (n = 71, OR = 3.41, 95% CI 2.59-4.49, 95% prediction interval 0.42-28.1, I2 = 89.4, Q-value = 661, d.f.(Q) = 70, P ?0.001). Studies conducted in primary care and other non-psychiatric settings had similar pooled odds to studies of current and former psychiatric patients (OR = 3.86 v. OR = 3.23, P = 0.7). The pooled sensitivity of suicidal ideation for later suicide was 41% (95% CI 35-48) and the pooled specificity was 86% (95% CI 76-92), with high between-study heterogeneity. Studies of suicidal ideation expressed by current and former psychiatric patients had a significantly higher pooled sensitivity (46% v. 22%) and lower pooled specificity (81% v. 96%) than studies conducted in non-psychiatric settings. The PPV among non-psychiatric cohorts (0.3%, 95% CI 0.1%-0.5%) was significantly lower (Q-value = 35.6, P < 0.001) than among psychiatric samples (3.9%, 95% CI 2.2-6.6). CONCLUSIONS:Estimates of the extent of the association between suicidal ideation and later suicide are limited by unexplained between-study heterogeneity. The utility of suicidal ideation as a test for later suicide is limited by a modest sensitivity and low PPV.Declaration interestM.M.L. and C.J.R. have provided expert evidence in civil, criminal and coronial matters. I.B.H. has been a Commissioner in Australia's National Mental Health Commission since 2012. He is the Co-Director, Health and Policy at the Brain and Mind Centre (BMC) University of Sydney. The BMC operates an early-intervention youth services at Camperdown under contract to Headspace. I.B.H. has previously led community-based and pharmaceutical industry-supported (Wyeth, Eli Lily, Servier, Pfizer, AstraZeneca) projects focused on the identification and better management of anxiety and depression. He is a Board Member of Psychosis Australia Trust and a member of Veterans Mental Health Clinical Reference group. He was a member of the Medical Advisory Panel for Medibank Private until October 2017. He is the Chief Scientific Advisor to, and an equity shareholder in, InnoWell. InnoWell has been formed by the University of Sydney and PricewaterhouseCoopers to administer the $30 M Australian Government Funded Project Synergy. Project Synergy is a 3-year programme for the transformation of mental health services through the use of innovative technologies.
| S-EPMC6401538 | biostudies-literature
Project description:Background Ovarian cancer is usually detected at later stages and no effective screening approach, has been identified. Therefore, sensitive and specific biomarkers for detecting ovarian cancer are urgently needed. Objective This study aimed to investigate the efficacy of six biomarkers for the early clinical diagnosis of ovarian cancer. Subjects & methods The study included 120 patients (benign ovarian tumors and early and late ovarian carcinoma) and 30 control healthy volunteers. MiRNA-204, CA125, CA19.9, hepcidin, microfibril-associated glycoprotein 2, and ferroportin levels were determined in all patients and control volunteers. Results The combined area under the receiver operating characteristic curves for miRNA-204, CA125, and CA19.9 were 0.938, 1.000, and 0.998 for benign tumors and early and late ovarian carcinomas, respectively. The sensitivities of miRNA-204, CA125, and CA19.9 were 98.04%, 100.00%, and 96.19% and the specificities were 58.33%, 62.50%, and 57.78%, respectively. Conclusion The positive predictivity of miRNA-204, CA125, and CA19.9 for ovarian cancer is high (59.57%, 58.24%, and 61.67%, respectively). Thus, the combination of these three biomarkers is a good diagnostic tool for ovarian cancer.
| S-EPMC9348731 | biostudies-literature
Project description:BackgroundCurrent diagnoses of urinary tract infection (UTI) by standard urine culture (SUC) has significant limitations in sensitivity, especially for fastidious organisms, and the ability to identify organisms in polymicrobial infections. The significant rate of both SUC "negative" or "mixed flora/contamination" results in UTI cases and the high prevalence of asymptomatic bacteriuria indicate the need for an accurate diagnostic test to help identify true UTI cases. This study aimed to determine if infection-associated urinary biomarkers can differentiate definitive UTI cases from non-UTI controls.MethodsMidstream clean-catch voided urine samples were collected from asymptomatic volunteers and symptomatic subjects ≥ 60 years old diagnosed with a UTI in a urology specialty setting. Microbial identification and density were assessed using a multiplex PCR/pooled antibiotic susceptibility test (M-PCR/P-AST) and SUC. Three biomarkers [neutrophil gelatinase-associated lipocalin (NGAL), and Interleukins 8 and 1β (IL-8, and IL-1β)] were also measured via enzyme-linked immunosorbent assay (ELISA). Definitive UTI cases were defined as symptomatic subjects with a UTI diagnosis and positive microorganism detection by SUC and M-PCR, while definitive non-UTI cases were defined as asymptomatic volunteers.ResultsWe observed a strong positive correlation (R2 > 0.90; p < 0.0001) between microbial density and the biomarkers NGAL, IL-8, and IL-1β for symptomatic subjects. Biomarker consensus criteria of two or more positive biomarkers had sensitivity 84.0%, specificity 91.2%, positive predictive value 93.7%, negative predictive value 78.8%, accuracy 86.9%, positive likelihood ratio of 9.58, and negative likelihood ratio of 0.17 in differentiating definitive UTI from non-UTI cases, regardless of non-zero microbial density. NGAL, IL-8, and IL-1β showed a significant elevation in symptomatic cases with positive microbe identification compared to asymptomatic cases with or without microbe identification. Biomarker consensus exhibited high accuracy in distinguishing UTI from non-UTI cases.ConclusionWe demonstrated that positive infection-associated urinary biomarkers NGAL, IL-8, and IL-1β, in symptomatic subjects with positive SUC and/or M-PCR results was associated with definitive UTI cases. A consensus criterion with ≥ 2 of the biomarkers meeting the positivity thresholds showed a good balance of sensitivity (84.0%), specificity (91.2%), and accuracy (86.9%). Therefore, this biomarker consensus is an excellent supportive diagnostic tool for resolving the presence of active UTI, particularly if SUC and M-PCR results disagree.
| S-EPMC10829179 | biostudies-literature
Project description:Development of oncologic therapies has traditionally been performed in a sequence of clinical trials intended to assess safety (phase I), preliminary efficacy (phase II), and improvement over the standard of care (phase III) in homogeneous (in terms of tumor type and disease stage) patient populations. As cancer has become increasingly understood on the molecular level, newer "targeted" drugs that inhibit specific cancer cell growth and survival mechanisms have increased the need for new clinical trial designs, wherein pertinent questions on the relationship between patient biomarkers and response to treatment can be answered. Herein, we review the clinical trial design literature from initial to more recently proposed designs for targeted agents or those treatments hypothesized to have enhanced effectiveness within patient subgroups (e.g., those with a certain biomarker value or who harbor a certain genetic tumor mutation). We also describe a number of real clinical trials where biomarker-based designs have been utilized, including a discussion of their respective advantages and challenges. As cancers become further categorized and/or reclassified according to individual patient and tumor features, we anticipate a continued need for novel trial designs to keep pace with the changing frontier of clinical cancer research.
| S-EPMC4737867 | biostudies-other
Project description:BACKGROUND:We assessed the sensitivity, specificity and positive and negative predictive value (PPV and NPV) of molecular and serological tests for the diagnosis of SARS-CoV-2 infection. METHODS:A total of 346 patients were enrolled in the emergency room. We evaluated three Reverse Transcriptase-real time PCRs (RT-PCRs) including six different gene targets, five serologic rapid diagnostic tests (RDT) and one ELISA. The final classification of infected/non-infected patients was performed using Latent Class Analysis combined with clinical re-assessment of incongruous cases. RESULTS:Out of these, 24.6% of patients were classified as infected. The molecular test RQ-SARS-nCoV-2 showed the highest performance with 91.8% sensitivity, 100% specificity, 100.0% PPV and 97.4% NPV respectively. Considering the single gene targets, S and RdRp of RQ-SARS-nCoV-2 had the highest sensitivity (94.1%). The in-house RdRp presented the lowest sensitivity (62.4%). The specificity ranged from 99.2% for in-house RdRp and N2 to 95.0% for E. The PPV ranged from 97.1% of N2 to 85.4% of E and the NPV from 98.1% of S to 89.0% of in-house RdRp. All serological tests had < 50% sensitivity and low PPV and NPV. VivaDiag IgM (RDT) had 98.5% specificity, with 84.0% PPV, but 24.7% sensitivity. CONCLUSION:Molecular tests for SARS-CoV-2 infection showed excellent specificity, but significant differences in sensitivity. Serological tests have limited utility in a clinical context.
| S-EPMC7555224 | biostudies-literature
Project description:Introduction:Atrial fibrillation (AF) is the commonest arrhythmia and a major cause of stroke and health care utilization. Researchers and administrators use electronic health data to assess disease burden, quality and variance in care, value of interventions and prognosis. We performed a systematic review and meta-analysis to assess the validity of AF case definitions in administrative databases. Methods:Medline was searched from 2000 to 2018. Extracted information included sensitivity, specificity, positive and negative predictive values (PPV and NPV) for various AF case definitions. Estimates were pooled using random-effects models due to significant heterogeneity between studies. Results:We identified 24 studies, including 21 from North America or Scandinavia. Hospital, ambulatory and mixed data sources were assessed in 10, 4 and 10 studies, respectively. Nine different AF case definitions were evaluated, most based on ICD-9 or 10 codes. Twenty-two studies assessed case definitions in patients diagnosed with AF and thus could generate PPV alone. Half the studies sampled unrestricted populations including a mix of those with and without AF to assess sensitivity. Only 13 studies included ECG confirmation as a gold standard. The pooled random effects estimates were: sensitivity 80% (95% CI 72-86%); specificity 98% (96-99%); PPV 88% (82-94%); NPV 97% (94-99%). Only 3 studies reported all accuracy parameters and included rhythm monitoring in the gold standard definition. Conclusion:Relatively few studies examined sensitivity, and fewer still included rhythm monitoring in the gold standard comparison. Administrative data may fail to identify a significant proportion of patients with AF. This, in turn, may bias estimates of quality of care and prognosis.
| S-EPMC6712502 | biostudies-literature
Project description:PurposeThe Aurora kinases are a family of conserved serine-threonine kinases with key roles in mitotic cell division. As with other promising anticancer targets, patient selection strategies to identify a responsive subtype will likely be required for successful clinical development of Aurora kinase inhibitors. The purpose of this study was to evaluate the antitumor activity of the Aurora and angiogenic kinase inhibitor ENMD-2076 against preclinical models of breast cancer with identification of candidate predictive biomarkers.Experimental designTwenty-nine breast cancer cell lines were exposed to ENMD-2076 and the effects on proliferation, apoptosis, and cell-cycle distribution were evaluated. In vitro activity was confirmed in MDA-MB-468 and MDA-MB-231 triple-negative breast cancer xenografts. Systematic gene expression analysis was used to identify up- and downregulated pathways in the sensitive and resistant cell lines, including within the triple-negative breast cancer subset.ResultsENMD-2076 showed antiproliferative activity against breast cancer cell lines, with more robust activity against cell lines lacking estrogen receptor expression and those without increased HER2 expression. Within the triple-negative breast cancer subset, cell lines with a p53 mutation and increased p53 expression were more sensitive to the cytotoxic and proapoptotic effects of ENMD-2076 exposure than cell lines with decreased p53 expression.ConclusionsENMD-2076 exhibited robust anticancer activity against models of triple-negative breast cancer and the candidate predictive biomarkers identified in this study may be useful in selecting patients for Aurora kinase inhibitors in the future.
| S-EPMC3537923 | biostudies-literature