Medical Diagnostic Tests: A Review of Test Anatomy, Phases, and Statistical Treatment of Data.
Ontology highlight
ABSTRACT:
SUBMITTER: Bolboaca SD
PROVIDER: S-EPMC6558629 | biostudies-literature | 2019
REPOSITORIES: biostudies-literature
Publications
Medical Diagnostic Tests: A Review of Test Anatomy, Phases, and Statistical Treatment of Data.
Computational and mathematical methods in medicine 20190528
Diagnostic tests are approaches used in clinical practice to identify with high accuracy the disease of a particular patient and thus to provide early and proper treatment. Reporting high-quality results of diagnostic tests, for both basic and advanced methods, is solely the responsibility of the authors. Despite the existence of recommendation and standards regarding the content or format of statistical aspects, the quality of what and how the statistic is reported when a diagnostic test is ass ...[more]
Similar Datasets
Project description:The pathogenesis of psoriasis involves the interaction of several environmental and genetic factors. Predicting the disease risk cannot depend on individual genetic alleles. Consequently, some studies have evaluated the use of genetic risk scores that combine several psoriasis susceptibility loci to increase the accuracy of predicting/diagnosing the disease. This meta-analysis summarizes the evidence regarding using genetic risk scores (GRS) in the diagnosis or prediction of psoriasis. A search of MEDLINE/PubMed, the Latin American Caribbean Health Sciences Literature (LILACS) database, Cochrane Library, Scopus, Web of Science, and ProQuest was conducted in July 2022. The primary objective was to record the area under the curve (AUC) for GRS of psoriasis. Secondary objectives included characteristics of studies and patients. The risk of bias (ROB) was assessed using the PROBAST tool. Five studies fulfilled the eligibility criteria of this review. None of the studies described the clinical criteria (reference standard) that were employed to diagnose psoriasis. The AUCs of the 11 GRS models ranged from 0.6029-0.8583 (median: 0.75). Marked heterogeneity was detected (Cochran Q: 1250.051, p < 0.001, and I2 index: 99.2%). So, pooling of the results of the included studies was not performed. The ROB was high for all studies and clinical application was not described. Genetic risk scores are promising tools for the prediction of psoriasis with fair to good accuracy. However, further research is required to identify the most accurate combination of loci and to validate the scores in variable ethnicities.
| S-EPMC9741513 | biostudies-literature
Project description:We develop a general statistical framework for the analysis and inference of large tree-structured data, with a focus on developing asymptotic goodness-of-fit tests. We first propose a consistent statistical model for binary trees, from which we develop a class of invariant tests. Using the model for binary trees, we then construct tests for general trees by using the distributional properties of the Continuum Random Tree, which arises as the invariant limit for a broad class of models for tree-structured data based on conditioned Galton-Watson processes. The test statistics for the goodness-of-fit tests are simple to compute and are asymptotically distributed as χ 2 and F random variables. We illustrate our methods on an important application of detecting tumour heterogeneity in brain cancer. We use a novel approach with tree-based representations of magnetic resonance images and employ the developed tests to ascertain tumor heterogeneity between two groups of patients.
| S-EPMC10066867 | biostudies-literature
Project description:Clinical decision-making relies heavily on making a correct diagnosis. Clinicians have a responsibility to understand the full spectrum of the diagnostic information conveyed by a physical exam finding, laboratory test result, or imaging. Many laboratory tests, such as troponin and B-type natriuretic peptide (BNP), are continuous tests with many possible results. Yet, there is a tendency to dichotomize tests into positive and negative, and use sensitivity and specificity to describe the test characteristics. This approach can lead to waste of important diagnostic information and substandard clinical decision-making. The aim of this paper is to demonstrate the role of ROC curves in developing a more comprehensive understanding of diagnostic information portrayed by continuous tests to augment clinical decision-making.
| S-EPMC6712123 | biostudies-literature
Project description:This SuperSeries is composed of the SubSeries listed below.
2011-08-10 | GSE26736 | GEO
Project description:Microarray technology has enabled the measurement of comprehensive transcriptomic information. However, each data entry may reflect trivial individual differences among samples and also contain technical noise. Therefore, the certainty of each observed difference should be confirmed at earlier steps of the analyses, and statistical tests are frequently used for this purpose. Since a microarray measures a huge number of genes and the results are processed simultaneously, concerns regarding problems of multiplicity have been raised to the tests. To deal with these problems, several methodologies have been proposed, making the tests very conservative. Indeed, arbitrary tuning of the test threshold has also been introduced to relax the test conditions. However, the appropriateness of the multiplicity problems as well as the compensation methods has not been confirmed. The appropriateness of the compensation methods was checked by means of coincidence of the premises of the methodologies with the observed characteristics found in real data of two typical platforms of microarray analysis. Normality was observed in within-group data variations, supporting applications of parametric tests. However, genes displayed their own tendencies in the magnitude of variations, and the distributions of P-values were rather complex and varied; these characteristics are inconsistent with the premises of the compensation methodologies. Additionally, the appropriateness of the proposed multiplicities is reconsidered. When we observed differences in the transcriptome, the family-wise error rate should not be considered, since analyses at higher levels would not be influenced by a few false positives among the huge numbers of true information. Likely, concerns for a false discovery rate are not suitable for the point null hypotheses on expression levels, since the rate of true null hypotheses should be rare in contradiction to the premise of the methodology. Although compensation methods have been recommended to deal with the problem of multiplicity, the compensations are actually inappropriate for many of the applications of transcriptome analyses. Compensations are not only unnecessary, but will increase the occurrence of false negative errors, and arbitrary adjustment of the threshold damages the objectivity of the tests. Rather, the results of parametric tests should be evaluated directly. This SuperSeries is composed of the SubSeries listed below.
2010-11-17 | GSE25410 | GEO
Project description:Overall accuracy measures of medical tests are often used with unclear interpretations. To develop methods of calculating the overall accuracy of medical tests in the patient population. Algebraic equations based on Bayes' theorem. A new approach is proposed for calculating overall accuracy in the patient population. Examples and applications using published data are presented. The overall accuracy is the proportion of the correct test results. We introduce a clear distinction between the overall accuracy measures of medical tests that are aimed at the detection of a disease in a screening of populations for public health purposes in the general population and the overall accuracy measures of tests aimed at determining a diagnosis in individuals in a clinical setting. We show that the overall detection accuracy measure is obtained in a specific study that explores test accuracy among persons with known diagnoses and may be useful for public health screening tests. It is different from the overall diagnostic accuracy that could be calculated in the clinical setting for the evaluation of medical tests aimed at determining the individual patients' diagnoses. We show that the overall detection accuracy is constant and is not affected by the prevalence of the disease. In contrast, the overall diagnostic accuracy changes and is dependent on the prevalence. Moreover, it ranges according to the ratio between the sensitivity and specificity. Thus, when the sensitivity is greater than the specificity, the overall diagnostic accuracy increases with increasing prevalence, and vice versa, that is, when the sensitivity is lower than the specificity, the overall diagnostic accuracy decreases with increasing prevalence so that another test might be more useful for diagnostic procedures. Our paper suggests a new and more appropriate methodology for estimating the overall diagnostic accuracy of any medical test. This may be important for helping clinicians avoid errors.
| S-EPMC6186004 | biostudies-literature
Project description:In this paper the algorithm for ΔρDCCA statistical test (Guedes et al., 2018) [1] is presented. Our test begins with the simulation of four time series pairs, by an ARFIMA process. These time series has N=250 , 500, 1000, and 2000 points, see Guedes et al. (2018) [1]. The probability distribution function (PDF) is made available for all 10,000 samples, that start from the original time series, in supplementary material.
| S-EPMC6103976 | biostudies-literature
Project description:ImportanceSystematic reviews of medical imaging diagnostic test accuracy (DTA) studies are affected by between-study heterogeneity due to a range of factors. Failure to appropriately assess the extent and causes of heterogeneity compromises the interpretability of systematic review findings.ObjectiveTo assess how heterogeneity has been examined in medical imaging DTA studies.Evidence reviewThe PubMed database was searched for systematic reviews of medical imaging DTA studies that performed a meta-analysis. The search was limited to the 40 journals with highest impact factor in the radiology, nuclear medicine, and medical imaging category in the InCites Journal Citation Reports of 2021 to reach a sample size of 200 to 300 included studies. Descriptive analysis was performed to characterize the imaging modality, target condition, type of meta-analysis model used, strategies for evaluating heterogeneity, and sources of heterogeneity identified. Multivariable logistic regression was performed to assess whether any factors were associated with at least 1 source of heterogeneity being identified in the included meta-analyses. Methodological quality evaluation was not performed. Data analysis occurred from October to December 2022.FindingsA total of 242 meta-analyses involving a median (range) of 987 (119-441 510) patients across a diverse range of disease categories and imaging modalities were included. The extent of heterogeneity was adequately described (ie, whether it was absent, low, moderate, or high) in 220 studies (91%) and was most commonly assessed using the I2 statistic (185 studies [76%]) and forest plots (181 studies [75%]). Heterogeneity was rated as moderate to high in 191 studies (79%). Of all included meta-analyses, 122 (50%) performed subgroup analysis and 87 (36%) performed meta-regression. Of the 242 studies assessed, 189 (78%) included 10 or more primary studies. Of these 189 studies, 60 (32%) did not perform meta-regression or subgroup analysis. Reasons for being unable to investigate sources of heterogeneity included inadequate reporting of primary study characteristics and a low number of included primary studies. Use of meta-regression was associated with identification of at least 1 source of variability (odds ratio, 1.90; 95% CI, 1.11-3.23; P = .02).Conclusions and relevanceIn this systematic review of assessment of heterogeneity in medical imaging DTA meta-analyses, most meta-analyses were impacted by a moderate to high level of heterogeneity, presenting interpretive challenges. These findings suggest that, despite the development and availability of more rigorous statistical models, heterogeneity appeared to be incomplete, inconsistently evaluated, or methodologically questionable in many cases, which lessened the interpretability of the analyses performed; comprehensive heterogeneity assessment should be addressed at the author level by improving personal familiarity with appropriate statistical methodology for assessing heterogeneity and involving biostatisticians and epidemiologists in study design, as well as at the editorial level, by mandating adherence to methodologic standards in primary DTA studies and DTA meta-analyses.
| S-EPMC10905313 | biostudies-literature
Project description:Background Many microarray experiments search for genes with differential expression between a common “reference” group and multiple test groups, like in the case of time-course designs or of various treatments versus a control condition. In such cases, currently employed statistical approaches based on t-test or close derivatives have limited efficacy, mostly because estimation of noise is done on only two groups at time. Alternative approaches based on ANOVA correctly capture noise from all the groups, but then do not confront single test groups with the reference. We therefore conceived a statistical test for pairwise comparisons between the reference group and each test group that uses within-group variance calculated from all the groups. Results We implemented an R-Bioconductor package named Mulcom, with a statistical test derived from the Dunnett’s test, designed to compare multiple experimental groups against a common reference. In addition to the basic Dunnett’s t value, the package includes an optional minimal fold-change threshold, m. Thanks to automated, permutation-based estimation of False Discovery Rate (FDR), the package also permits fast optimization of the test, to obtain the maximum number of significant genes at a given FDR value. When applied on a time-course experiment profiled in parallel on two microarray platforms, and compared with currently used tests, Mulcom displayed higher concordance of significant genes in the two array platforms, and higher enrichment in functional annotation to categories related to the biology of the experiment. Conclusions The Mulcom package provides a fast and powerful tool for the identification of differentially expressed genes when several experimental conditions are compared with a common reference. We found that Mulcom leads to lists of differentially expressed genes that are particularly consistent across microarray platforms and enriched in significant classes of genes. In our opinion, the main reasons for these good performances are three: (i) within-group variability is estimated from all experimental groups even if only two of them are compared each time; (ii) the optional fold-change threshold m avoids false positives due to aberrantly low within-group variability; (iii) automated test optimization allows maximizing sensitivity without compromising specificity.
2011-08-10 | GSE26732 | GEO
Project description:Background Many microarray experiments search for genes with differential expression between a common “reference” group and multiple test groups, like in the case of time-course designs or of various treatments versus a control condition. In such cases, currently employed statistical approaches based on t-test or close derivatives have limited efficacy, mostly because estimation of noise is done on only two groups at time. Alternative approaches based on ANOVA correctly capture noise from all the groups, but then do not confront single test groups with the reference. We therefore conceived a statistical test for pairwise comparisons between the reference group and each test group that uses within-group variance calculated from all the groups. Results We implemented an R-Bioconductor package named Mulcom, with a statistical test derived from the Dunnett’s test, designed to compare multiple experimental groups against a common reference. In addition to the basic Dunnett’s t value, the package includes an optional minimal fold-change threshold, m. Thanks to automated, permutation-based estimation of False Discovery Rate (FDR), the package also permits fast optimization of the test, to obtain the maximum number of significant genes at a given FDR value. When applied on a time-course experiment profiled in parallel on two microarray platforms, and compared with currently used tests, Mulcom displayed higher concordance of significant genes in the two array platforms, and higher enrichment in functional annotation to categories related to the biology of the experiment. Conclusions The Mulcom package provides a fast and powerful tool for the identification of differentially expressed genes when several experimental conditions are compared with a common reference. We found that Mulcom leads to lists of differentially expressed genes that are particularly consistent across microarray platforms and enriched in significant classes of genes. In our opinion, the main reasons for these good performances are three: (i) within-group variability is estimated from all experimental groups even if only two of them are compared each time; (ii) the optional fold-change threshold m avoids false positives due to aberrantly low within-group variability; (iii) automated test optimization allows maximizing sensitivity without compromising specificity.
2011-08-10 | GSE26735 | GEO