Does prevalence matter to physicians in estimating post-test probability of disease? A randomized trial.
Ontology highlight
ABSTRACT: Background
The probability of a disease following a diagnostic test depends on the sensitivity and specificity of the test, but also on the prevalence of the disease in the population of interest (or pre-test probability). How physicians use this information is not well known.Objective
To assess whether physicians correctly estimate post-test probability according to various levels of prevalence and explore this skill across respondent groups.Design
Randomized trial.Participants
Population-based sample of 1,361 physicians of all clinical specialties.Intervention
We described a scenario of a highly accurate screening test (sensitivity 99% and specificity 99%) in which we randomly manipulated the prevalence of the disease (1%, 2%, 10%, 25%, 95%, or no information).Main measures
We asked physicians to estimate the probability of disease following a positive test (categorized as <60%, 60-79%, 80-94%, 95-99.9%, and >99.9%). Each answer was correct for a different version of the scenario, and no answer was possible in the "no information" scenario. We estimated the proportion of physicians proficient in assessing post-test probability as the proportion of correct answers beyond the distribution of answers attributable to guessing.Key results
Most respondents in each of the six groups (67%-82%) selected a post-test probability of 95-99.9%, regardless of the prevalence of disease and even when no information on prevalence was provided. This answer was correct only for a prevalence of 25%. We estimated that 9.1% (95% CI 6.0-14.0) of respondents knew how to assess correctly the post-test probability. This proportion did not vary with clinical experience or practice setting.Conclusions
Most physicians do not take into account the prevalence of disease when interpreting a positive test result. This may cause unnecessary testing and diagnostic errors.
SUBMITTER: Agoritsas T
PROVIDER: S-EPMC3055966 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:OBJECTIVES:The distinction between overuse and appropriate use of the ICU hinges on whether a patient would benefit from ICU care. We sought to test 1) whether physicians agree about which types of patients benefit from ICU care and 2) whether estimates of ICU benefit are influenced by factors unrelated to severity of illness. DESIGN:Randomized study. SETTING:Online vignettes. SUBJECTS:U.S. critical care physicians. INTERVENTIONS:Physicians were provided with eight vignettes of hypothetical patients. Each vignette had a single patient or hospital factor randomized across participants (four factors related and four unrelated to severity of illness). MEASUREMENTS AND MAIN RESULTS:The primary outcome was the estimate of ICU benefit, assessed with a 4-point Likert-type scale. In total, 1,223 of 8,792 physicians volunteered to participate (14% recruitment rate). Physician agreement of ICU benefit was poor (mean intraclass correlation coefficient for each vignette: 0.06; range: 0-0.18). There were no vignettes in which more than two thirds of physicians agreed about the extent to which a patient would benefit from ICU care. Increasing severity of illness resulted in greater estimated benefit of ICU care. Among factors unrelated to severity of illness, physicians felt ICU care was more beneficial when told one ICU bed was available than if ICU bed availability was unmentioned. Physicians felt ICU care was less beneficial when family was present than when family presence was unmentioned. The patient's age, but not race/ethnicity, also impacted estimates of ICU benefit. CONCLUSIONS:Estimates of ICU benefit are widely dissimilar and influenced by factors unrelated to severity of illness, potentially resulting in inconsistent allocation of ICU care.
| S-EPMC6298833 | biostudies-literature
Project description:BackgroundReverse-transcription PCR (RT-PCR) assays are used to test for infection with the SARS-CoV-2 virus. RT-PCR tests are highly specific and the probability of false positives is low, but false negatives are possible depending on swab type and time since symptom onset.AimTo determine how the probability of obtaining a false-negative test in infected patients is affected by time since symptom onset and swab type.MethodsWe used generalised additive mixed models to analyse publicly available data from patients who received multiple RT-PCR tests and were identified as SARS-CoV-2 positive at least once.ResultsThe probability of a positive test decreased with time since symptom onset, with oropharyngeal (OP) samples less likely to yield a positive result than nasopharyngeal (NP) samples. The probability of incorrectly identifying an uninfected individual due to a false-negative test was considerably reduced if negative tests were repeated 24 hours later. For a small false-positive test probability (<0.5%), the true number of infected individuals was larger than the number of positive tests. For a higher false-positive test probability, the true number of infected individuals was smaller than the number of positive tests.ConclusionNP samples are more sensitive than OP samples. The later an infected individual is tested after symptom onset, the less likely they are to test positive. This has implications for identifying infected patients, contact tracing and discharging convalescing patients who are potentially still infectious.
| S-EPMC7812420 | biostudies-literature
Project description:Fay, Pfeiffer, Cronin, Le, and Feuer (Statistics in Medicine 2003; 22; 1837-1848) developed a formula to calculate the age-conditional probability of developing a disease for the first time (ACPDvD) for a hypothetical cohort. The novelty of the formula of Fay et al (2003) is that one need not know the rates of first incidence of disease per person-years alive and disease-free, but may input the rates of first incidence per person-years alive only. Similarly the formula uses rates of death from disease and death from other causes per person-years alive. The rates per person-years alive are much easier to estimate than per person-years alive and disease-free. Fay et al (2003) used simple piecewise constant models for all three rate functions which have constant rates within each age group. In this paper, we detail a method for estimating rate functions which does not have jumps at the beginning of age groupings, and need not be constant within age groupings. We call this method the mid-age group joinpoint (MAJ) model for the rates. The drawback of the MAJ model is that numerical integration must be used to estimate the resulting ACPDvD. To increase computational speed, we offer a piecewise approximation to the MAJ model, which we call the piecewise mid-age group joinpoint (PMAJ) model. The PMAJ model for the rates input into the formula for ACPDvD described in Fay et al (2003) is the current method used in the freely available DevCan software made available by the National Cancer Institute.
| S-EPMC517510 | biostudies-literature
Project description:BackgroundEstimating infectious disease parameters such as the serial interval (time between symptom onset in primary and secondary cases) and reproductive number (average number of secondary cases produced by a primary case) are important in understanding infectious disease dynamics. Many estimation methods require linking cases by direct transmission, a difficult task for most diseases.MethodsUsing a subset of cases with detailed genetic and/or contact investigation data to develop a training set of probable transmission events, we build a model to estimate the relative transmission probability for all case-pairs from demographic, spatial and clinical data. Our method is based on naive Bayes, a machine learning classification algorithm which uses the observed frequencies in the training dataset to estimate the probability that a pair is linked given a set of covariates.ResultsIn simulations, we find that the probabilities estimated using genetic distance between cases to define training transmission events are able to distinguish between truly linked and unlinked pairs with high accuracy (area under the receiver operating curve value of 95%). Additionally, only a subset of the cases, 10-50% depending on sample size, need to have detailed genetic data for our method to perform well. We show how these probabilities can be used to estimate the average effective reproductive number and apply our method to a tuberculosis outbreak in Hamburg, Germany.ConclusionsOur method is a novel way to infer transmission dynamics in any dataset when only a subset of cases has rich contact investigation and/or genetic data.
| S-EPMC7394954 | biostudies-literature
Project description:Effective surveillance on the long-term public health impact due to war and terrorist attacks remains limited. Such health issues are commonly under-reported, specifically for a large group of individuals. For this purpose, efficient estimation of the size or undercount of the population under the risk of physical and mental health hazards is of utmost necessity. A novel trivariate Bernoulli model is developed allowing heterogeneity among the individuals and dependence between the sources of information, and an estimation methodology using a Monte Carlo-based EM algorithm is proposed. Simulation results show the superiority of the performance of the proposed method over existing competitors and robustness under model mis-specifications. The method is applied to analyse two real case studies on monitoring amyotrophic lateral sclerosis (ALS) cases for the Gulf War veterans and the 9/11 terrorist attack survivors at the World Trade Center, USA. The average annual cumulative incidence rate for ALS disease increases by 33% and 16% for deployed and no-deployed military personnel, respectively, after adjusting the undercount. The number of individuals exposed to the risk of physical and mental health effects due to WTC terrorist attacks increased by 42% . These results provide interesting insights that can assist in effective decision-making and policy formulation for monitoring the health status of post-war survivors.
| S-EPMC11208173 | biostudies-literature
Project description:ObjectivesEarly retirement occurs when one's job satisfaction suffers due to employment mismatch resulting from factors such as inadequate compensation. Medical doctors report high levels of job stress and burnout relative to other professionals. These levels are highest among emergency physicians (EPs), and despite general improvements in their working conditions, early retirement continues to become more common in this population. The purpose of this study was to identify the factors influencing EPs intention to retire early and to develop a probability equation for its prediction.MethodsA secondary analysis of data from the 2015 Korean Society of Emergency Physicians Survey was performed. The variables potentially influencing early retirement were organized into personal characteristics, extrinsic factors, and intrinsic factors. Logistic regression analysis was performed to identify risk factors and to develop a probability equation; these findings were then arranged in a nomogram.ResultsOf the 377 survey respondents included in the analysis, 48.0% intended to retire early. Risk factors for early retirement included level of satisfaction with the specialty and its outlook, slanderous reviews, emergency room safety, health status, workload intensity, age, and hospital type. Intrinsic factors (i.e., slanderous reviews and satisfaction with the specialty and its outlook) had a stronger influence on early retirement than did extrinsic factors.ConclusionsTo promote career longevity among EPs, it is vital to improve emergency room safety and workload intensity, to enhance medical professionalism through a stronger vision of emergency medicine, and to strengthen the patient-doctor relationship.
| S-EPMC5996188 | biostudies-literature
Project description:BackgroundColocalization is a statistical method used in genetics to determine whether the same variant is causal for multiple phenotypes, for example, complex traits and gene expression. It provides stronger mechanistic evidence than shared significance, which can be produced through separate causal variants in linkage disequilibrium. Current colocalization methods require full summary statistics for both traits, limiting their use with the majority of reported GWAS associations (e.g. GWAS Catalog). We propose a new approximation to the popular coloc method that can be applied when limited summary statistics are available. Our method (POint EstiMation of Colocalization, POEMColoc) imputes missing summary statistics for one or both traits using LD structure in a reference panel, and performs colocalization using the imputed summary statistics.ResultsWe evaluate the performance of POEMColoc using real (UK Biobank phenotypes and GTEx eQTL) and simulated datasets. We show good correlation between posterior probabilities of colocalization computed from imputed and observed datasets and similar accuracy in simulation. We evaluate scenarios that might reduce performance and show that multiple independent causal variants in a region and imputation from a limited subset of typed variants have a larger effect while mismatched ancestry in the reference panel has a modest effect. Further, we find that POEMColoc is a better approximation of coloc when the imputed association statistics are from a well powered study (e.g., relatively larger sample size or effect size). Applying POEMColoc to estimate colocalization of GWAS Catalog entries and GTEx eQTL, we find evidence for colocalization of 150,000 trait-gene-tissue triplets.ConclusionsWe find that colocalization analysis performed with full summary statistics can be closely approximated when only the summary statistics of the top SNP are available for one or both traits. When applied to the full GWAS Catalog and GTEx eQTL, we find that colocalized trait-gene pairs are enriched in tissues relevant to disease etiology and for matches to approved drug mechanisms. POEMColoc R package is available at https://github.com/AbbVie-ComputationalGenomics/POEMColoc .
| S-EPMC8130535 | biostudies-literature
Project description:IntroductionThere is increasing concern about the effects of occupational stressors on the wellness of healthcare providers. Given high patient acuity, circadian rhythm disruption, and other workplace stressors, emergency physicians (EP) would be predicted to have high rates of occupational stress. We conducted this study to assess the prevalence of post-traumatic stress disorder (PTSD) in attending EPs practicing in the United States.MethodsA link to an electronic questionnaire was distributed through the emergency medicine-centric publication Emergency Medicine News. We compared the prevalence of PTSD in EPs to the general population using a chi-square goodness of fit test, and performed logistic regression to assess for significance of risk factors.ResultsWe received survey responses from 526 persons. In this study, EPs had a PTSD point prevalence of 15.8%. Being a victim of a prior trauma or abuse is the primary predictor of PTSD (odds ratio [OR] [95% confidence interval {CI}, 2.16 (1.21 - 3.86)], p = 0.009) and PTSD severity score (OR [95% CI, 1.16 (1.07 - 1.26)], p <0.001).ConclusionEmergency physicians have a substantial burden of PTSD, potentially jeopardizing their own health and career longevity. Future studies should focus on identifying subgroups at higher risk for PTSD and modifiable risk factors. Prevention and treatment strategies should be developed and tested in healthcare providers.
| S-EPMC6754196 | biostudies-literature
Project description:PurposeSeveral studies investigated prevalence and determinants of physicians' burnout during the peak of the COVID-19 pandemic, but only a few during the chronic phase of the pandemic. This study thus aimed to examine this topic referring to the "post-COVID-19 era", defined as a chronic and likely-to-be endemic status quo.MethodsA cross-sectional, online survey (November 2021-January 2022) was addressed to physicians in Lombardia (Northern Italy). Besides socio-demographic and COVID-19-related data, measures of personal, work- and patient-related burnout (Copenhagen Burnout Inventory; CBI), depression (Patient Health Questionnaire-8), anxiety (General Anxiety Disorder-7), and self-efficacy (General Self-Efficacy Scale) were collected. Linear/generalized linear models were run to test associations/predictions of interest.ResultsAmong the 958 respondents, burnout symptoms were clinically significant in 18.5% of them. Predictive models showed that female sex (OR = 0.73, 95% CI 0.42-1.27), younger age (OR = 0.94, 95% CI 0.59-1.48), shorter job tenure (OR = 1.01, 95% CI 0.62-1.65), trainee status (OR = 1.41, 95% CI 1.16-7.10), higher PHQ-8 (OR = 1.260, 95% CI 1.16-1.37), and GAD-7 scores (OR = 1.19, 95% CI 1.10-1.30) increased the risk to suffer from clinical burnout. COVID-19-related variables were mostly not related/associated to burnout levels.ConclusionIn Italy, physicians' burnout is moderately prevalent also in the chronic phase of the pandemic, with its determinants being more intrinsic than environmental. The development of effective interventions is needed to help physicians cope with the new challenges of their job.
| S-EPMC9638242 | biostudies-literature
Project description:ImportanceInappropriate use of antibiotics for diarrheal illness can result in adverse effects and increase in antimicrobial resistance.ObjectiveTo determine whether the diarrheal etiology prediction (DEP) algorithm, which uses patient-specific and location-specific features to estimate the probability that diarrhea etiology is exclusively viral, impacts antibiotic prescriptions in patients with acute diarrhea.Design, setting, and participantsA randomized crossover study was conducted to evaluate the DEP incorporated into a smartphone-based electronic clinical decision-support (eCDS) tool. The DEP calculated the probability of viral etiology of diarrhea, based on dynamic patient-specific and location-specific features. Physicians were randomized in the first 4-week study period to the intervention arm (eCDS with the DEP) or control arm (eCDS without the DEP), followed by a 1-week washout period before a subsequent 4-week crossover period. The study was conducted at 3 sites in Bangladesh from November 17, 2021, to January 21, 2021, and at 4 sites in Mali from January 6, 2021, to March 5, 2021. Eligible physicians were those who treated children with diarrhea. Eligible patients were children between ages 2 and 59 months with acute diarrhea and household access to a cell phone for follow-up.InterventionsUse of the eCDS with the DEP (intervention arm) vs use of the eCDS without the DEP (control arm).Main outcomes and measuresThe primary outcome was the proportion of children prescribed an antibiotic.ResultsA total of 30 physician participants and 941 patient participants (57.1% male; median [IQR] age, 12 [8-18] months) were enrolled. There was no evidence of a difference in the proportion of children prescribed antibiotics by physicians using the DEP (risk difference [RD], -4.2%; 95% CI, -10.7% to 1.0%). In a post hoc analysis that accounted for the predicted probability of a viral-only etiology, there was a statistically significant difference in risk of antibiotic prescription between the DEP and control arms (RD, -0.056; 95% CI, -0.128 to -0.01). No known adverse effects of the DEP were detected at 10-day postdischarge.Conclusions and relevanceUse of a tool that provides an estimate of etiological likelihood did not result in a significant change in overall antibiotic prescriptions. Post hoc analysis suggests that a higher predicted probability of viral etiology was linked to reductions in antibiotic use.Trial registrationClinicaltrials.gov Identifier: NCT04602676.
| S-EPMC9425282 | biostudies-literature