A clinician-educator's roadmap to choosing and interpreting statistical tests.
Ontology highlight
ABSTRACT:
SUBMITTER: Windish DM
PROVIDER: S-EPMC1924630 | biostudies-literature | 2006 Jun
REPOSITORIES: biostudies-literature
Publications
A clinician-educator's roadmap to choosing and interpreting statistical tests.
Windish Donna M DM Diener-West Marie M
Journal of general internal medicine 20060601 6
As educators seek confirmation of successful trainee achievement, medical education must move toward a more evidence-based approach to teaching and evaluation. Although medical training often provides physicians with a general background in biostatistics, many are not prepared to apply these skills. This can hinder clinician educators as they wish to develop, analyze and disseminate their scholarly work. This paper is intended to be a concise educational tool and guide for choosing and interpret ...[more]
Similar Datasets
Project description:BackgroundCardiopulmonary exercise testing (CPET) has become an important modality for the evaluation and management of patients with a diverse array of medical problems. However, interpreting these tests is often difficult and time consuming, requiring significant expertise.MethodsWe created a computer software program (XINT) that assists in CPET interpretation. The program uses an integrative approach as recommended in the Official Statement of the American Thoracic Society/American College of Chest Physicians (ATS/ACCP) on Cardiopulmonary Exercise Testing. In this paper we discuss the principles behind the software. We also provide the detailed logic in an accompanying file (Additional File 1). The actual program and the open source code are also available free over the Internet at http://www.xint.org. For convenience, the required download files can also be accessed from this article.ResultsTo test the clinical usefulness of XINT, we present the computer generated interpretations of the case studies discussed in the ATS/ACCP document in another accompanying file (Additional File 2). We believe the interpretations are consistent with the document's criteria and the interpretations given by the expert panel.ConclusionComputers have become an integral part of modern life. Peer-reviewed scientific journals are now able to present not just medical concepts and experimental studies, but actual functioning medical interpretive software. This has enormous potential to improve medical diagnoses and patient care. We believe XINT is such a program that will give clinically useful interpretations when used by the medical community at large.
| S-EPMC2121644 | biostudies-literature
Project description:Identifying the tests/procedures ordered by neurologists that contribute most to health care expenditures is a critical step in the process of creating the neurology top 5 list for the Choosing Wisely initiative. Using data from the 2007-2010 National Ambulatory Care Medical Survey, we found that $13.3 billion (95% confidence interval = $10.1-$16.5 billion) was spent on tests ordered at neurologist visits. The tests/procedures with the highest expenditures were magnetic resonance imaging (MRI; 51% of total expenditures; $7.5 billion), electromyography (EMG; 20% of expenditures; $2.6 billion), and electroencephalography (EEG; 8% of expenditures; $1.1 billion). MRI, EMG, and EEG should receive close scrutiny in the development of the neurology top 5 list.
| S-EPMC5570467 | biostudies-literature
Project description:Network-based diffusion analysis (NBDA) is a statistical technique for detecting the social transmission of behavioural innovations in groups of animals, including humans. The strength of social transmission is inferred from the extent to which the diffusion (spread) of the innovation follows a social network. NBDA can have two goals: (a) to establish whether social transmission is occurring and how strong its effects are; and/or (b) to establish the typical pathways of information transfer. The technique has been used in a range of taxa, including primates, cetaceans, birds and fish, using a range of different types of network. Here I investigate the conceptual underpinnings of NBDA, in order to establish the meaning of results using different networks. I develop a model of the social transmission process where each individual observation of the target behaviour affects the rate at which the observer learns that behaviour. I then establish how NBDAs using different networks relate to this underlying process, and thus how we can interpret the results of each. My analysis shows that a different network or networks are appropriate depending on the specific goal or goals of the study, and establishes how the parameter estimates yielded from an NBDA can be interpreted for different networks.This article is part of the themed issue 'Process and pattern in innovations from cells to societies'.
| S-EPMC5665806 | biostudies-literature
Project description:Microarray technology has enabled the measurement of comprehensive transcriptomic information. However, each data entry may reflect trivial individual differences among samples and also contain technical noise. Therefore, the certainty of each observed difference should be confirmed at earlier steps of the analyses, and statistical tests are frequently used for this purpose. Since a microarray measures a huge number of genes and the results are processed simultaneously, concerns regarding problems of multiplicity have been raised to the tests. To deal with these problems, several methodologies have been proposed, making the tests very conservative. Indeed, arbitrary tuning of the test threshold has also been introduced to relax the test conditions. However, the appropriateness of the multiplicity problems as well as the compensation methods has not been confirmed. The appropriateness of the compensation methods was checked by means of coincidence of the premises of the methodologies with the observed characteristics found in real data of two typical platforms of microarray analysis. Normality was observed in within-group data variations, supporting applications of parametric tests. However, genes displayed their own tendencies in the magnitude of variations, and the distributions of P-values were rather complex and varied; these characteristics are inconsistent with the premises of the compensation methodologies. Additionally, the appropriateness of the proposed multiplicities is reconsidered. When we observed differences in the transcriptome, the family-wise error rate should not be considered, since analyses at higher levels would not be influenced by a few false positives among the huge numbers of true information. Likely, concerns for a false discovery rate are not suitable for the point null hypotheses on expression levels, since the rate of true null hypotheses should be rare in contradiction to the premise of the methodology. Although compensation methods have been recommended to deal with the problem of multiplicity, the compensations are actually inappropriate for many of the applications of transcriptome analyses. Compensations are not only unnecessary, but will increase the occurrence of false negative errors, and arbitrary adjustment of the threshold damages the objectivity of the tests. Rather, the results of parametric tests should be evaluated directly. This SuperSeries is composed of the SubSeries listed below.
2010-11-17 | GSE25410 | GEO
Project description: Not available
| S-EPMC1126943 | biostudies-literature
Project description:PurposeTo achieve the ultimate goal of personalized treatment of patients, accurate molecular diagnosis and precise interpretation of the impact of genetic variants on gene function is essential. With sequencing cost becoming increasingly affordable, the accurate distinguishing of benign from pathogenic variants becomes the major bottleneck. Although large normal population sequence databases have become a key resource in filtering benign variants, they are not effective at filtering extremely rare variants.MethodsTo address this challenge, we developed a novel statistical test by combining sequencing data from a patient cohort with a normal control population database. By comparing the expected and observed allele frequency in the patient cohort, variants that are likely benign can be identified.ResultsThe performance of this new method is evaluated on both simulated and real data sets coupled with experimental validation. As a result, we demonstrate this new test is well powered to identify benign variants, and is particularly effective for variants with low frequency in the normal population.ConclusionOverall, as a general test that can be applied to any type of variants in the context of all Mendelian diseases, our work provides a general framework for filtering benign variants with very low population allele frequency.
| S-EPMC7796914 | biostudies-literature
Project description:BACKGROUND: During the last 30 years, the median sample size of research studies published in high-impact medical journals has increased manyfold, while the use of non-parametric tests has increased at the expense of t-tests. This paper explores this paradoxical practice and illustrates its consequences. METHODS: A simulation study is used to compare the rejection rates of the Wilcoxon-Mann-Whitney (WMW) test and the two-sample t-test for increasing sample size. Samples are drawn from skewed distributions with equal means and medians but with a small difference in spread. A hypothetical case study is used for illustration and motivation. RESULTS: The WMW test produces, on average, smaller p-values than the t-test. This discrepancy increases with increasing sample size, skewness, and difference in spread. For heavily skewed data, the proportion of p<0.05 with the WMW test can be greater than 90% if the standard deviations differ by 10% and the number of observations is 1000 in each group. The high rejection rates of the WMW test should be interpreted as the power to detect that the probability that a random sample from one of the distributions is less than a random sample from the other distribution is greater than 50%. CONCLUSIONS: Non-parametric tests are most useful for small studies. Using non-parametric tests in large studies may provide answers to the wrong question, thus confusing readers. For studies with a large sample size, t-tests and their corresponding confidence intervals can and should be used even for heavily skewed data.
| S-EPMC3445820 | biostudies-other
Project description:BackgroundGenomics and proteomics analyses regularly involve the simultaneous test of hundreds of hypotheses, either on numerical or categorical data. To correct for the occurrence of false positives, validation tests based on multiple testing correction, such as Bonferroni and Benjamini and Hochberg, and re-sampling, such as permutation tests, are frequently used. Despite the known power of permutation-based tests, most available tools offer such tests for either t-test or ANOVA only. Less attention has been given to tests for categorical data, such as the Chi-square. This project takes a first step by developing an open-source software tool, Ptest, that addresses the need to offer public software tools incorporating these and other statistical tests with options for correcting for multiple hypotheses.ResultsThis study developed a public-domain, user-friendly software whose purpose was twofold: first, to estimate test statistics for categorical and numerical data; and second, to validate the significance of the test statistics via Bonferroni, Benjamini and Hochberg, and a permutation test of numerical and categorical data. The tool allows the calculation of Chi-square test for categorical data, and ANOVA test, Bartlett's test and t-test for paired and unpaired data. Once a test statistic is calculated, Bonferroni, Benjamini and Hochberg, and a permutation tests are implemented, independently, to control for Type I errors. An evaluation of the software using different public data sets is reported, which illustrates the power of permutation tests for multiple hypotheses assessment and for controlling the rate of Type I errors.ConclusionThe analytical options offered by the software can be applied to support a significant spectrum of hypothesis testing tasks in functional genomics, using both numerical and categorical data.
| S-EPMC2611984 | biostudies-literature
Project description:Choosing Wisely is a medical stewardship and quality-improvement initiative led by the American Board of Internal Medicine Foundation in collaboration with leading medical societies in the United States. The American Society of Hematology (ASH) has been an active participant in the Choosing Wisely project. In 2019, ASH and the American Society of Pediatric Hematology/Oncology (ASPHO) formed a joint task force to solicit, evaluate, and select items for a pediatric-focused Choosing Wisely list. By using an iterative process and an evidence-based method, the ASH-ASPHO Task Force identified 5 hematologic tests and treatments that health care providers and patients should question because they are not supported by evidence, and/or they involve risks of medical and financial costs with low likelihood of benefit. The ASH-ASPHO Choosing Wisely recommendations are as follows: (1) avoid routine preoperative hemostatic testing in an otherwise healthy child with no previous personal or family history of bleeding, (2) avoid platelet transfusion in asymptomatic children with a platelet count >10 × 103/μL unless an invasive procedure is planned, (3) avoid thrombophilia testing in children with venous access-associated thrombosis and no positive family history, (4) avoid packed red blood cells transfusion for asymptomatic children with iron deficiency anemia and no active bleeding, and (5) avoid routine administration of granulocyte colony-stimulating factor for prophylaxis of children with asymptomatic autoimmune neutropenia and no history of recurrent or severe infections. We recommend that health care providers carefully consider the anticipated risks and benefits of these identified tests and treatments before performing them.
| S-EPMC8791561 | biostudies-literature
Project description:ImportanceThe extent of clinician-level variation in the overuse of testing or treatment in older adults is not well understood.ObjectiveTo examine clinician-level variation for three new measures of potentially inappropriate use of medical services in older adults.DesignRetrospective analysis of overall means and clinician-level variation in performance on three new measures.SubjectsAdults aged 65 years and older who had office visits with outpatient primary or immediate care clinicians within a single academic medical center health system between July 1, 2016, and June 30, 2017.MeasuresTwo electronic clinical quality measures representing potentially inappropriate use of medical services in older adults: prostate-specific antigen testing against guidelines (PSA) in men aged 76 and older; urinalysis or urine culture for non-specific reasons in women aged 65 and older; and one intermediate outcome measure: hemoglobin A1c less than 7.0 in adults aged 75 and older with diabetes mellitus treated with insulin or oral hypoglycemic medication.ResultsSixty-nine clinicians and 2009 patients contributed observations to the PSA measure, 144 clinicians and 5933 patients contributed to the urinalysis/urine culture measure, and 42 clinicians and 665 patients contributed to the diabetes measure. Meaningful clinician-level performance variation was greatest for the PSA measure (intraclass correlation coefficient [ICC] = 0.27), followed by the urinalysis/urine culture measure (ICC = 0.18), and the diabetes measure (ICC = 0.024). The range of possible overuse across clinician quartiles was 8-54% for the PSA measure, 3-35% for the urinalysis/urine culture measure, and 13-49% for the diabetes measure. The odds ratios of overuse in the highest quartile compared with the lowest for the PSA, urinalysis/urine culture, and diabetes measures were 99.3 (95% CI 43 to 228), 15.7 (10 to 24), and 6.0 (3.3 to 11), respectively.ConclusionsWithin the same health system, rates of potential overuse in elderly patients varied greatly across clinicians, particularly for the process measures examined.
| S-EPMC7280408 | biostudies-literature