ROC Anatomy-Getting the Most Out of Your Diagnostic Test.
Ontology highlight
ABSTRACT:
SUBMITTER: Baduashvili A
PROVIDER: S-EPMC6712123 | biostudies-literature | 2019 Sep
REPOSITORIES: biostudies-literature
Publications
ROC Anatomy-Getting the Most Out of Your Diagnostic Test.
Baduashvili Amiran A Guyatt Gordon G Evans Arthur T AT
Journal of general internal medicine 20190703 9
Clinical decision-making relies heavily on making a correct diagnosis. Clinicians have a responsibility to understand the full spectrum of the diagnostic information conveyed by a physical exam finding, laboratory test result, or imaging. Many laboratory tests, such as troponin and B-type natriuretic peptide (BNP), are continuous tests with many possible results. Yet, there is a tendency to dichotomize tests into positive and negative, and use sensitivity and specificity to describe the test cha ...[more]
Similar Datasets
Project description:The receiver operating characteristic (ROC) curve is often used to evaluate the performance of a biomarker measured on continuous scale to predict the disease status or a clinical condition. Motivated by the need for novel study designs with better estimation efficiency and reduced study cost, we consider a biased sampling scheme that consists of a SRC and a supplemental TDC. Using this approach, investigators can oversample or undersample subjects falling into certain regions of the biomarker measure, yielding improved precision for the estimation of the ROC curve with a fixed sample size. Test-result-dependent sampling will introduce bias in estimating the predictive accuracy of the biomarker if standard ROC estimation methods are used. In this article, we discuss three approaches for analyzing data of a test-result-dependent structure with a special focus on the empirical likelihood method. We establish asymptotic properties of the empirical likelihood estimators for covariate-specific ROC curves and covariate-independent ROC curves and give their corresponding variance estimators. Simulation studies show that the empirical likelihood method yields good properties and is more efficient than alternative methods. Recommendations on number of regions, cutoff points, and subject allocation is made based on the simulation results. The proposed methods are illustrated with a data example based on an ongoing lung cancer clinical trial.
| S-EPMC3577107 | biostudies-literature
Project description:Diagnostic tests are approaches used in clinical practice to identify with high accuracy the disease of a particular patient and thus to provide early and proper treatment. Reporting high-quality results of diagnostic tests, for both basic and advanced methods, is solely the responsibility of the authors. Despite the existence of recommendation and standards regarding the content or format of statistical aspects, the quality of what and how the statistic is reported when a diagnostic test is assessed varied from excellent to very poor. This article briefly reviews the steps in the evaluation of a diagnostic test from the anatomy, to the role in clinical practice, and to the statistical methods used to show their performances. The statistical approaches are linked with the phase, clinical question, and objective and are accompanied by examples. More details are provided for phase I and II studies while the statistical treatment of phase III and IV is just briefly presented. Several free online resources useful in the calculation of some statistics are also given.
| S-EPMC6558629 | biostudies-literature
Project description:Background. A common research goal in transcriptome projects is to find genes that are differentially expressed in different phenotype classes. Biologists might wish to validate such gene candidates experimentally, or use them for downstream systems biology analysis. Producing a coherent differential gene expression analysis from RNA-seq count data requires an understanding of how numerous sources of variation such as the replicate size, the hypothesized biological effect size, and the specific method for making differential expression calls interact. We believe an explicit demonstration of such interactions in real RNA-seq data sets is of practical interest to biologists. Results. Using two large public RNA-seq data sets-one representing strong, and another mild, biological effect size-we simulated different replicate size scenarios, and tested the performance of several commonly-used methods for calling differentially expressed genes in each of them. We found that, when biological effect size was mild, RNA-seq experiments should focus on experimental validation of differentially expressed gene candidates. Importantly, at least triplicates must be used, and the differentially expressed genes should be called using methods with high positive predictive value (PPV), such as NOISeq or GFOLD. In contrast, when biological effect size was strong, differentially expressed genes mined from unreplicated experiments using NOISeq, ASC and GFOLD had between 30 to 50% mean PPV, an increase of more than 30-fold compared to the cases of mild biological effect size. Among methods with good PPV performance, having triplicates or more substantially improved mean PPV to over 90% for GFOLD, 60% for DESeq2, 50% for NOISeq, and 30% for edgeR. At a replicate size of six, we found DESeq2 and edgeR to be reasonable methods for calling differentially expressed genes at systems level analysis, as their PPV and sensitivity trade-off were superior to the other methods'. Conclusion. When biological effect size is weak, systems level investigation is not possible using RNAseq data, and no meaningful result can be obtained in unreplicated experiments. Nonetheless, NOISeq or GFOLD may yield limited numbers of gene candidates with good validation potential, when triplicates or more are available. When biological effect size is strong, NOISeq and GFOLD are effective tools for detecting differentially expressed genes in unreplicated RNA-seq experiments for qPCR validation. When triplicates or more are available, GFOLD is a sharp tool for identifying high confidence differentially expressed genes for targeted qPCR validation; for downstream systems level analysis, combined results from DESeq2 and edgeR are useful.
| S-EPMC4631466 | biostudies-literature
Project description:Animal anatomy has traditionally relied on detailed dissections to produce anatomical illustrations, but modern imaging modalities, such as MRI and CT, now represent an enormous resource that allows for fast non-invasive visualizations of animal anatomy in living animals. These modalities also allow for creation of three-dimensional representations that can be of considerable value in the dissemination of anatomical studies. In this methodological review, we present our experiences using MRI, CT and μCT to create advanced representation of animal anatomy, including bones, inner organs and blood vessels in a variety of animals, including fish, amphibians, reptiles, mammals, and spiders. The images have a similar quality to most traditional anatomical drawings and are presented together with interactive movies of the anatomical structures, where the object can be viewed from different angles. Given that clinical scanners found in the majority of larger hospitals are fully suitable for these purposes, we encourage biologists to take advantage of these imaging techniques in creation of three-dimensional graphical representations of internal structures.
| S-EPMC3062562 | biostudies-literature
Project description:Proficiency testing of metagenomics-based detection of food-borne pathogens using a complex artificial sequencing dataset
| PRJEB37463 | ENA
Project description:Field test for diagnostic P deficiency genes
2012-04-12 | E-MTAB-634 | biostudies-arrayexpress
Project description:Out-of-hospital cardiac arrest (OHCA) is a global health problem with low survival. Regional variation in survival has heightened interest in combining cardiac arrest registries to understand and improve OHCA outcomes. While individual OHCA registries exist in Australian and New Zealand ambulance services, until recently these registries have not been combined. The aim of this protocol paper is to describe the rationale and methods of the Australian Resuscitation Outcomes Consortium (Aus-ROC) OHCA epidemiological registry (Epistry).The Aus-ROC Epistry is designed as a population-based cohort study. Data collection started in 2014. Six ambulance services in Australia (Ambulance Victoria, SA Ambulance Service, St John Ambulance Western Australia and Queensland Ambulance Service) and New Zealand (St John New Zealand and Wellington Free Ambulance) currently contribute data. All OHCA attended by ambulance, regardless of aetiology or patient age, are included in the Epistry. The catchment population is approximately 19.3 million persons, representing 63% of the Australian population and 100% of the New Zealand population. Data are collected using Utstein-style definitions. Information incorporated into the Epistry includes demographics, arrest features, ambulance response times, treatment and patient outcomes. The primary outcome is 'survival to hospital discharge', with 'return of spontaneous circulation' as a key secondary outcome.Ethics approval was independently sought by each of the contributing registries. Overarching ethics for the Epistry was provided by Monash University HREC (Approval No. CF12/3938-2012001888). A population-based OHCA registry capturing the majority of Australia and New Zealand will allow risk-adjusted outcomes to be determined, to enable benchmarking across ambulance providers, facilitate the identification of system-wide strategies associated with survival from OHCA, and allow monitoring of temporal trends in process and outcomes to improve patient care. Findings will be shared with participating ambulance services and the academic community.
| S-EPMC4823452 | biostudies-other
Project description:The mainstay of malaria diagnosis relies on rapid diagnostic tests (RDTs) and microscopy, both of which lack analytical sensitivity. This leads to repeat testing to rule out malaria. A prospective diagnostic trial of the Meridian illumigene Malaria assay (loop-mediated isothermal amplification [LAMP]) was conducted comparing it with reference microscopy and RDTs (BinaxNOW Malaria) in returning travelers between June 2017 and January 2018. Returning travelers with signs and symptoms of malaria were enrolled in the study. RDTs, microscopy, and LAMP assays were performed simultaneously. A total of 298 patients (50.7% male; mean age, 32.5 years) were enrolled, most visiting friends and relatives (43.3%), presenting with fever (88.9%), not taking prophylaxis (82.9%), and treated as outpatients (84.1%). In the prospective arm (n = 348), LAMP had a sensitivity of 98.1% (95% confidence interval [CI], 90.0%-100%) and a specificity of 97.6% (95% CI, 95.2%-99.1%) vs microscopy. After discrepant resolution with real-time polymerase chain reaction, LAMP had a sensitivity of 100% (95% CI, 93.7%-100%) and a specificity of 100% (95% CI, 98.7%-100%) vs microscopy. After discrepant resolution, RDTs had a sensitivity of 83.3% (95% CI, 58.6%-96.4%) and a specificity of 96.2% (95% CI, 93.2%-98.1%) vs microscopy. When including retrospective specimens (n = 377), LAMP had a sensitivity of 98.8% (95% CI, 93.2%-100%) and a specificity of 97.6% (95% CI, 95.2%-99.1%) vs microscopy, and after discrepant resolution of this set, LAMP had a sensitivity of 100% (95% CI, 95.8%-100%) and a specificity of 100% (95% CI, 98.7%-100%). A cost-benefit analysis of reagents and labor suggests savings of up to USD$13 per specimen using a novel algorithm with LAMP screening.
| S-EPMC6239078 | biostudies-literature
Project description:RNA editing, which adds sequence information to RNAs post-transcriptionally, is a widespread phenomenon throughout eukaryotes. The most complex form of this process is the uridine (U) insertion/deletion editing that occurs in the mitochondria of kinetoplastid protists. RNA editing in these flagellates is specified by trans-acting guide RNAs and entails the insertion of hundreds and deletion of dozens of U residues from mitochondrial RNAs to produce mature, translatable mRNAs. An emerging model indicates that the machinery required for trypanosome RNA editing is much more complicated than previously appreciated. A family of RNA editing core complexes (RECCs), which contain the required enzymes and several structural proteins, catalyze cycles of U insertion and deletion. A second, dynamic multiprotein complex, the Mitochondrial RNA Binding 1 (MRB1) complex, has recently come to light as another essential component of the trypanosome RNA editing machinery. MRB1 likely serves as the platform for kinetoplastid RNA editing, and plays critical roles in RNA utilization and editing processivity. MRB1 also appears to act as a hub for coordination of RNA editing with additional mitochondrial RNA processing events. This review highlights the current knowledge regarding the complex molecular machinery involved in trypanosome RNA editing. WIREs RNA 2016, 7:33-51. doi: 10.1002/wrna.1313 For further resources related to this article, please visit the WIREs website.
| S-EPMC4835692 | biostudies-literature
Project description:Most studies in the life sciences and other disciplines involve generating and analyzing numerical data of some type as the foundation for scientific findings. Working with numerical data involves multiple challenges. These include reproducible data acquisition, appropriate data storage, computationally correct data analysis, appropriate reporting and presentation of the results, and suitable data interpretation. Finding and correcting mistakes when analyzing and interpreting data can be frustrating and time-consuming. Presenting or publishing incorrect results is embarrassing but not uncommon. Particular sources of errors are inappropriate use of statistical methods and incorrect interpretation of data by software. To detect mistakes as early as possible, one should frequently check intermediate and final results for plausibility. Clearly documenting how quantities and results were obtained facilitates correcting mistakes. Properly understanding data is indispensable for reaching well-founded conclusions from experimental results. Units are needed to make sense of numbers, and uncertainty should be estimated to know how meaningful results are. Descriptive statistics and significance testing are useful tools for interpreting numerical results if applied correctly. However, blindly trusting in computed numbers can also be misleading, so it is worth thinking about how data should be summarized quantitatively to properly answer the question at hand. Finally, a suitable form of presentation is needed so that the data can properly support the interpretation and findings. By additionally sharing the relevant data, others can access, understand, and ultimately make use of the results. These quick tips are intended to provide guidelines for correctly interpreting, efficiently analyzing, and presenting numerical data in a useful way.
| S-EPMC6181270 | biostudies-literature