Dataset Information

Comparison of Bayesian and frequentist methods for prevalence estimation under misclassification.

ABSTRACT:

Background

Various methods exist for statistical inference about a prevalence that consider misclassifications due to an imperfect diagnostic test. However, traditional methods are known to suffer from truncation of the prevalence estimate and the confidence intervals constructed around the point estimate, as well as from under-performance of the confidence intervals' coverage.

Methods

In this study, we used simulated data sets to validate a Bayesian prevalence estimation method and compare its performance to frequentist methods, i.e. the Rogan-Gladen estimate for prevalence, RGE, in combination with several methods of confidence interval construction. Our performance measures are (i) error distribution of the point estimate against the simulated true prevalence and (ii) coverage and length of the confidence interval, or credible interval in the case of the Bayesian method.

Results

Across all data sets, the Bayesian point estimate and the RGE produced similar error distributions with slight advantages of the former over the latter. In addition, the Bayesian estimate did not suffer from the RGE's truncation problem at zero or unity. With respect to coverage performance of the confidence and credible intervals, all of the traditional frequentist methods exhibited strong under-coverage, whereas the Bayesian credible interval as well as a newly developed frequentist method by Lang and Reiczigel performed as desired, with the Bayesian method having a very slight advantage in terms of interval length.

Conclusion

The Bayesian prevalence estimation method should be prefered over traditional frequentist methods. An acceptable alternative is to combine the Rogan-Gladen point estimate with the Lang-Reiczigel confidence interval.

SUBMITTER: Flor M

PROVIDER: S-EPMC7370479 | biostudies-literature | 2020 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Comparison of Bayesian and frequentist methods for prevalence estimation under misclassification.

Flor Matthias M Weiß Michael M Selhorst Thomas T Müller-Graf Christine C Greiner Matthias M

BMC public health 20200720 1

<h4>Background</h4>Various methods exist for statistical inference about a prevalence that consider misclassifications due to an imperfect diagnostic test. However, traditional methods are known to suffer from truncation of the prevalence estimate and the confidence intervals constructed around the point estimate, as well as from under-performance of the confidence intervals' coverage.<h4>Methods</h4>In this study, we used simulated data sets to validate a Bayesian prevalence estimation method a ...[more]

PMID: 32689959

Similar Datasets

Project description:In order to have confidence in model-based phylogenetic methods, such as maximum likelihood (ML) and Bayesian analyses, one must use an appropriate model of molecular evolution identified using statistically rigorous criteria. Although model selection methods such as the likelihood ratio test and Akaike information criterion are widely used in the phylogenetic literature, model selection methods lack the ability to reject all models if they provide an inadequate fit to the data. There are two methods, however, that assess absolute model adequacy, the frequentist Goldman-Cox (GC) test and Bayesian posterior predictive simulations (PPSs), which are commonly used in conjunction with the multinomial log likelihood test statistic. In this study, we use empirical and simulated data to evaluate the adequacy of common substitution models using both frequentist and Bayesian methods and compare the results with those obtained with model selection methods. In addition, we investigate the relationship between model adequacy and performance in ML and Bayesian analyses in terms of topology, branch lengths, and bipartition support. We show that tests of model adequacy based on the multinomial likelihood often fail to reject simple substitution models, especially when the models incorporate among-site rate variation (ASRV), and normally fail to reject less complex models than those chosen by model selection methods. In addition, we find that PPSs often fail to reject simpler models than the GC test. Use of the simplest substitution models not rejected based on fit normally results in similar but divergent estimates of tree topology and branch lengths. In addition, use of the simplest adequate substitution models can affect estimates of bipartition support, although these differences are often small with the largest differences confined to poorly supported nodes. We also find that alternative assumptions about ASRV can affect tree topology, tree length, and bipartition support. Our results suggest that using the simplest substitution models not rejected based on fit may be a valid alternative to implementing more complex models identified by model selection methods. However, all common substitution models may fail to recover the correct topology and assign appropriate bipartition support if the true tree shape is difficult to estimate regardless of model adequacy.

Project description:Cleft lip with or without cleft palate (CL/P) and cleft palate only (CPO) are common congenital malformations. Numerous epidemiologic studies have shown an increased risk for orofacial clefts among children whose mothers smoked during early pregnancy; however, there is concern that the results of these studies may have been biased because of exposure misclassification. The purpose of this study is to use previous research on the reliability of self-reported cigarette smoking to produce corrected point estimates (and associated credible intervals) of the effect of maternal smoking on children's risk of clefts.We accounted for misclassification using 4 Bayesian models that made different assumptions about the sensitivity and specificity of self-reported maternal smoking data. We used results from previous studies to specify the prior distributions for sensitivity and specificity of reporting and used Markov chain Monte Carlo algorithms to calculate the posterior distribution of the effect of maternal smoking on children's risk for CL/P and CPO.After correcting for potential sources of misclassification in data from the National Birth Defects Prevention Study, we found an increased risk of CL/P among children born to mothers who smoked during early pregnancy (posterior odds ratio [OR] = 1.6, 95% credible interval = 1.1-2.2). The posterior effect of smoking on CPO provided less evidence of effect (posterior OR = 1.1, 95% credible interval = 0.7-1.7).Our results lend some credibility to the hypothesis that periconceptional maternal smoking increases the risk of a child being born with CL/P. The results concerning CPO provide no overall evidence of effect, although the estimates were relatively imprecise. We suggest that future research should emphasize validity studies, especially those of differential reporting, rather than replicating existing analyses of the relationship between maternal smoking and clefts. We discuss how our approach is also applicable to evaluating misclassification in a wide range of exposure-outcome scenarios.

Project description:Background/aimsRegulatory approval of a drug or device involves an assessment of not only the benefits but also the risks of adverse events associated with the therapeutic agent. Although randomized controlled trials (RCTs) are the gold standard for evaluating effectiveness, the number of treated patients in a single RCT may not be enough to detect a rare but serious side effect of the treatment. Meta-analysis plays an important role in the evaluation of the safety of medical products and has advantage over analyzing a single RCT when estimating the rate of adverse events.MethodsIn this article, we compare 15 widely used meta-analysis models under both Bayesian and frequentist frameworks when outcomes are extremely infrequent or rare. We present extensive simulation study results and then apply these methods to a real meta-analysis that considers RCTs investigating the effect of rosiglitazone on the risks of myocardial infarction and of death from cardiovascular causes.ResultsOur simulation studies suggest that the beta hyperprior method modeling treatment group-specific parameters and accounting for heterogeneity performs the best. Most models ignoring between-study heterogeneity give poor coverage probability when such heterogeneity exists. In the data analysis, different methods provide a wide range of log odds ratio estimates between rosiglitazone and control treatments with a mixed conclusion on their statistical significance based on 95% confidence (or credible) intervals.ConclusionIn the rare event setting, treatment effect estimates obtained from traditional meta-analytic methods may be biased and provide poor coverage probability. This trend worsens when the data have large between-study heterogeneity. In general, we recommend methods that first estimate the summaries of treatment-specific risks across studies and then relative treatment effects based on the summaries when appropriate. Furthermore, we recommend fitting various methods, comparing the results and model performance, and investigating any significant discrepancies among them.

Dataset Information

Comparison of Bayesian and frequentist methods for prevalence estimation under misclassification.

Background

Methods

Results

Conclusion

Publications

Comparison of Bayesian and frequentist methods for prevalence estimation under misclassification.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets