Dataset Information

Modeling individual and relative accuracy of screening tools in geriatric oncology.

ABSTRACT: Background:Classification probabilities reflect to what degree a screening test represents the true disease state and include true positive (TPF) and false positive fractions (FPF). With two tests, one can compare TPF and FPF using relative probabilities which offer advantages in terms of interpretation and statistical modeling. Our objective was to highlight how individual and relative TPF and FPF can be easily estimated and compared within a regression modeling framework. This allows the modeling of tests' accuracy while adjusting for multiple covariates, and thus provides valuable information in addition to the crude TPF and FPF. We illustrate our purpose with the G8 and VES-13 screening tests aimed at identifying elderly cancer patients in need for a comprehensive geriatric assessment (CGA). Methods:Prospective cohort with a paired design. TPF and FPF of each test, as well as relative TPF and FPF were modeled using log-linear models. Results:G8 detected patients in need for CGA better than VES-13 at the expense of misclassifying a large number of normal patients. Both tests had better TPF with older age and poorer performance status (PS), and for all cancer subtypes compared with prostate cancer. Effect of age and PS on TPF was more pronounced with VES-13. Age affected FPF, but not differentially. Conclusions:Regression modeling helps provide a thorough assessment of the accuracy of diagnostic tests and should be used more frequently. In the context of screening, we encourage the use of G8 as failing to identify patients in need of a CGA might be more problematic than over-detection. Moreover, although we identified variables associated with the sensitivity of these tests, this association was less pronounced for the G8.

SUBMITTER: Bellera CA

PROVIDER: S-EPMC5834042 | biostudies-literature | 2017 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Modeling individual and relative accuracy of screening tools in geriatric oncology.

Bellera C A CA Artaud F F Rainfray M M Soubeyran P L PL Mathoulin-Pélissier S S

Annals of oncology : official journal of the European Society for Medical Oncology 20170501 5

<h4>Background</h4>Classification probabilities reflect to what degree a screening test represents the true disease state and include true positive (TPF) and false positive fractions (FPF). With two tests, one can compare TPF and FPF using relative probabilities which offer advantages in terms of interpretation and statistical modeling. Our objective was to highlight how individual and relative TPF and FPF can be easily estimated and compared within a regression modeling framework. This allows t ...[more]

PMID: 28327973

Similar Datasets

Project description:In the study of numeracy, some hypotheses have been based on response time (RT) as a dependent variable and some on accuracy, and considerable controversy has arisen about the presence or absence of correlations between RT and accuracy, between RT or accuracy and individual differences like IQ and math ability, and between various numeracy tasks. In this article, we show that an integration of the two dependent variables is required, which we accomplish with a theory-based model of decision making. We report data from four tasks: numerosity discrimination, number discrimination, memory for two-digit numbers, and memory for three-digit numbers. Accuracy correlated across tasks, as did RTs. However, the negative correlations that might be expected between RT and accuracy were not obtained; if a subject was accurate, it did not mean that they were fast (and vice versa). When the diffusion decision-making model was applied to the data (Ratcliff, 1978), we found significant correlations across the tasks between the quality of the numeracy information (drift rate) driving the decision process and between the speed/accuracy criterion settings, suggesting that similar numeracy skills and similar speed-accuracy settings are involved in the four tasks. In the model, accuracy is related to drift rate and RT is related to speed-accuracy criteria, but drift rate and criteria are not related to each other across subjects. This provides a theoretical basis for understanding why negative correlations were not obtained between accuracy and RT. We also manipulated criteria by instructing subjects to maximize either speed or accuracy, but still found correlations between the criteria settings between and within tasks, suggesting that the settings may represent an individual trait that can be modulated but not equated across subjects. Our results demonstrate that a decision-making model may provide a way to reconcile inconsistent and sometimes contradictory results in numeracy research.

Project description:IntroductionThe 30-item Geriatric Depression Scale (GDS-30) and the shorter GDS-15, GDS-5 and GDS-4 are recommended as depression screening tools for elderly individuals. Existing meta-analyses on the diagnostic accuracy of the GDS have not been able to conduct subgroup analyses, have included patients already identified as depressed who would not be screened in practice and have not accounted for possible bias due to selective reporting of results from only better-performing cut-offs in primary studies. Individual participant data meta-analysis (IPDMA), which involves a standard systematic review, then a synthesis of individual participant data, rather than summary results, could address these limitations. The objective of our IPDMA is to generate accuracy estimates to detect major depression for all possible cut-offs of each version of the GDS among studies using different reference standards, separately and among participant subgroups based on age, sex, dementia diagnosis and care settings. In addition, we will use a modelling approach to generate individual participant probabilities for major depression based on GDS scores (rather than a dichotomous cut-off) and participant characteristics (eg, sex, age, dementia status, care setting).Methods and analysisIndividual participant data comparing GDS scores to a major depression diagnosis based on a validated structured or semistructured diagnostic interview will be sought via a systematic review. Data sources will include Medline, Medline In-Process & Other Non-Indexed Citations, PsycINFO and Web of Science. Bivariate random-effects models will be used to estimate diagnostic accuracy parameters for each cut-off of the different versions of the GDS. Prespecified subgroup analyses will be conducted. Risk of bias will be assessed with the Quality Assessment of Diagnostic Accuracy Studies-2 tool.Ethics and disseminationThe findings of this study will be of interest to stakeholders involved in research, clinical practice and policy.Prospero registration numberCRD42018104329.

Dataset Information

Modeling individual and relative accuracy of screening tools in geriatric oncology.

Publications

Modeling individual and relative accuracy of screening tools in geriatric oncology.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets