Estimating Relative Risk When Observing Zero Events-Frequentist Inference and Bayesian Credibility Intervals.
Ontology highlight
ABSTRACT:
SUBMITTER: Moller S
PROVIDER: S-EPMC8196730 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:The rapid expansion of sequence data and the development of statistical approaches that embrace varying evolutionary rates among lineages have encouraged many more investigators to use DNA and protein data to time species divergences. Here, we report results from a systematic evaluation, by means of computer simulation, of the performance of two frequently used relaxed-clock methods for estimating these times and their credibility intervals (CrIs). These relaxed-clock methods allow rates to vary in a phylogeny randomly over lineages (e.g., BEAST software) and in autocorrelated fashion (e.g., MultiDivTime software). We applied these methods for analyzing sequence data sets simulated using naturally derived parameters (evolutionary rates, sequence lengths, and base substitution patterns) and assuming that clock calibrations are known without error. We find that the estimated times are, on average, close to the true times as long as the assumed model of lineage rate changes matches the actual model. The 95% CrIs also contain the true time for >or=95% of the simulated data sets. However, the use of incorrect lineage rate model reduces this frequency to 83%, indicating that the relaxed-clock methods are not robust to the violation of underlying lineage rate model. Because these rate models are rarely known a priori and are difficult to detect empirically, we suggest building composite CrIs using CrIs produced from MultiDivTime and BEAST analysis. These composite CrIs are found to contain the true time for >or=97% data sets. Our analyses also verify the usefulness of the common practice of interpreting the congruence of times inferred from different methods as a reflection of the accuracy of time estimates. Overall, our results show that simple strategies can be used to enhance our ability to estimate times and their CrIs when using the relaxed-clock methods.
| S-EPMC2877995 | biostudies-literature
Project description:We introduce a framework for estimating causal effects of binary and continuous treatments in high dimensions. We show how posterior distributions of treatment and outcome models can be used together with doubly robust estimators. We propose an approach to uncertainty quantification for the doubly robust estimator, which utilizes posterior distributions of model parameters and (1) results in good frequentist properties in small samples, (2) is based on a single run of a Markov chain Monte Carlo (MCMC) algorithm, and (3) improves over frequentist measures of uncertainty which rely on asymptotic properties. We consider a flexible framework for modeling the treatment and outcome processes within the Bayesian paradigm that reduces model dependence, accommodates nonlinearity, and achieves dimension reduction of the covariate space. We illustrate the ability of the proposed approach to flexibly estimate causal effects in high dimensions and appropriately quantify uncertainty. We show that our proposed variance estimation strategy is consistent when both models are correctly specified, and we see empirically that it performs well in finite samples and under model misspecification. Finally, we estimate the effect of continuous environmental exposures on cholesterol and triglyceride levels.
| S-EPMC8209114 | biostudies-literature
Project description:Prevalence of disease in wildlife populations, which is necessary for developing disease models and conducting epidemiologic analyses, is often understudied. Laboratory tests used to screen for diseases in wildlife populations often are validated only for domestic animals. Consequently, the use of these tests for wildlife populations may lead to inaccurate estimates of disease prevalence. We demonstrate the use of Bayesian latent class analysis (LCA) in determining the specificity and sensitivity of a competitive enzyme-linked immunosorbent assay (cELISA; VMRD (®), Inc.) serologic test used to identify exposure to Neospora caninum (hereafter N. caninum) in three wildlife populations in southeastern Ohio, USA. True prevalence of N. caninum exposure in these populations was estimated to range from 0.1% to 3.1% in American bison (Bison bison), 51.0% to 53.8% in Père David's deer (Elaphurus davidianus), and 40.0% to 45.9% in white-tailed deer (Odocoileus virginianus). The accuracy of the cELISA in American bison and Père David's deer was estimated to be close to the 96% sensitivity and 99% specificity reported by the manufacturer. Sensitivity in white-tailed deer, however, ranged from 78.9% to 99.9%. Apparent prevalence of N. caninum from the test results is not equal to the true prevalence in white-tailed deer and Père David's deer populations. Even when these species inhabit the same community, the true prevalence in the two deer populations differed from the true prevalence in the American bison population. Variances in prevalence for some species suggest differences in the epidemiology of N. caninum for these colocated populations. Bayesian LCA methods could be used as in this example to overcome some of the constraints on validating tests in wildlife species. The ability to accurately evaluate disease status and prevalence in a population improves our understanding of the epidemiology of multihost pathogen systems at the community level.
| S-EPMC4831453 | biostudies-other
Project description:Background/aimsRegulatory approval of a drug or device involves an assessment of not only the benefits but also the risks of adverse events associated with the therapeutic agent. Although randomized controlled trials (RCTs) are the gold standard for evaluating effectiveness, the number of treated patients in a single RCT may not be enough to detect a rare but serious side effect of the treatment. Meta-analysis plays an important role in the evaluation of the safety of medical products and has advantage over analyzing a single RCT when estimating the rate of adverse events.MethodsIn this article, we compare 15 widely used meta-analysis models under both Bayesian and frequentist frameworks when outcomes are extremely infrequent or rare. We present extensive simulation study results and then apply these methods to a real meta-analysis that considers RCTs investigating the effect of rosiglitazone on the risks of myocardial infarction and of death from cardiovascular causes.ResultsOur simulation studies suggest that the beta hyperprior method modeling treatment group-specific parameters and accounting for heterogeneity performs the best. Most models ignoring between-study heterogeneity give poor coverage probability when such heterogeneity exists. In the data analysis, different methods provide a wide range of log odds ratio estimates between rosiglitazone and control treatments with a mixed conclusion on their statistical significance based on 95% confidence (or credible) intervals.ConclusionIn the rare event setting, treatment effect estimates obtained from traditional meta-analytic methods may be biased and provide poor coverage probability. This trend worsens when the data have large between-study heterogeneity. In general, we recommend methods that first estimate the summaries of treatment-specific risks across studies and then relative treatment effects based on the summaries when appropriate. Furthermore, we recommend fitting various methods, comparing the results and model performance, and investigating any significant discrepancies among them.
| S-EPMC8041270 | biostudies-literature
Project description:BackgroundThe problem of silent multiple comparisons is one of the most difficult statistical problems faced by scientists. It is a particular problem for investigating a one-off cancer cluster reported to a health department because any one of hundreds, or possibly thousands, of neighbourhoods, schools, or workplaces could have reported a cluster, which could have been for any one of several types of cancer or any one of several time periods.MethodsThis paper contrasts the frequentist approach with a Bayesian approach for dealing with silent multiple comparisons in the context of a one-off cluster reported to a health department. Two published cluster investigations were re-analysed using the Dunn-Sidak method to adjust frequentist p-values and confidence intervals for silent multiple comparisons. Bayesian methods were based on the Gamma distribution.ResultsBayesian analysis with non-informative priors produced results similar to the frequentist analysis, and suggested that both clusters represented a statistical excess. In the frequentist framework, the statistical significance of both clusters was extremely sensitive to the number of silent multiple comparisons, which can only ever be a subjective "guesstimate". The Bayesian approach is also subjective: whether there is an apparent statistical excess depends on the specified prior.ConclusionIn cluster investigations, the frequentist approach is just as subjective as the Bayesian approach, but the Bayesian approach is less ambitious in that it treats the analysis as a synthesis of data and personal judgements (possibly poor ones), rather than objective reality. Bayesian analysis is (arguably) a useful tool to support complicated decision-making, because it makes the uncertainty associated with silent multiple comparisons explicit.
| S-EPMC2694210 | biostudies-literature
Project description:Semi-continuous data characterized by an excessive proportion of zeros and right-skewed continuous positive values appear frequently in medical research. One example would be the pharmaceutical expenditure (PE) data for which a substantial proportion of subjects investigated may report zero. Two-part mixed-effects models have been developed to analyse clustered measures of semi-continuous data from multilevel studies. In this study, we propose a new flexible two-part mixed-effects model with skew distributions for nested semi-continuous cost data under the framework of a Bayesian approach. The proposed model specification consists of two mixed-effects models linked by the correlated random effects: Part I) a model on the occurrence of positive values using a generalized logistic mixed model; and Part II) a model on the magnitude of positive values using a linear mixed model where the model errors follow skew distributions including beta-prime (BP). The proposed method is illustrated with pharmaceutical expenditure data from a multilevel observational study and the analytic results are reported by comparing potential models under different skew distributions. Simulation studies are conducted to assess the performance of the proposed model. The DIC3, LPML, WAIC, and LOO as the Bayesian model selection criteria and measures of divergence used to compare the models.
| S-EPMC9628168 | biostudies-literature
Project description:Social network analysis provides a useful lens through which to view the structure of animal societies, and as a result its use is increasingly widespread. One challenge that many studies of animal social networks face is dealing with limited sample sizes, which introduces the potential for a high level of uncertainty in estimating the rates of association or interaction between individuals. We present a method based on Bayesian inference to incorporate uncertainty into network analyses. We test the reliability of this method at capturing both local and global properties of simulated networks, and compare it to a recently suggested method based on bootstrapping. Our results suggest that Bayesian inference can provide useful information about the underlying certainty in an observed network. When networks are well sampled, observed networks approach the real underlying social structure. However, when sampling is sparse, Bayesian inferred networks can provide realistic uncertainty estimates around edge weights. We also suggest a potential method for estimating the reliability of an observed network given the amount of sampling performed. This paper highlights how relatively simple procedures can be used to estimate uncertainty and reliability in studies using animal social network analysis.
| S-EPMC4593693 | biostudies-literature
Project description:The tracking of lineage frequencies via DNA barcode sequencing enables the quantification of microbial fitness. However, experimental noise coming from biotic and abiotic sources complicates the computation of a reliable inference. We present a Bayesian pipeline to infer relative microbial fitness from high-throughput lineage tracking assays. Our model accounts for multiple sources of noise and propagates uncertainties throughout all parameters in a systematic way. Furthermore, using modern variational inference methods based on automatic differentiation, we are able to scale the inference to a large number of unique barcodes. We extend this core model to analyze multi-environment assays, replicate experiments, and barcodes linked to genotypes. On simulations, our method recovers known parameters within posterior credible intervals. This work provides a generalizable Bayesian framework to analyze lineage tracking experiments. The accompanying open-source software library enables the adoption of principled statistical methods in experimental evolution.
| S-EPMC10614806 | biostudies-literature
Project description:BackgroundRapid increase in life expectancy in low- and middle-income countries including the World Health Organization's Southeast Asia Region (SEAR) has resulted in an increase in the global burden of dementia, which is expected to become a leading cause of morbidity. Accurate burden estimates are key for informing policy and planning. Given the paucity of data, estimates were developed using both a Bayesian methodology and as well as a traditional frequentist approach to gain better insights into methodological approaches for disease burden estimates.MethodsSeven databases were searched for studies published between 2010-2018 regarding dementia prevalence in SEAR, generating 8 relevant articles. A random-effects model (REM) and a Bayesian normal-normal hierarchical model (NNHM) were used to obtain the pooled prevalence estimate of dementia for people aged 60 and above in SEAR. The latter model was also developed to estimate age-specific dementia prevalence. Using UN population estimates for SEAR, total and age-specific projections of the burden of dementia in 2015, 2020 and 2030 were calculated.ResultsThe prevalence of dementia in SEAR was found to be 3% (95% confidence interval (CI) = 2-6%) in those above age 60 based on REM, and 3.1% (95% credible interval = 1.5-5.0%) based on the NNHM. The estimated prevalence varies with age, increasing from 1.6% (95% credible interval = 0.8-2.5%) in people aged 60-69 to 12.4% (95% credible interval = 5.6-20%) in people above the age of 80. The risk of developing dementia increased exponentially with age. The number of people living with dementia in SEAR in 2015 was estimated at 5.51 million (95% credible interval = 2.66-8.82), with projections of 6.66 million (95% credible interval = 3.21-10.7) in 2020 and 9.6 million (95% credible interval = 4.62-15.36) in 2030.ConclusionThe burden of dementia in SEAR is substantial and will continue to increase rapidly by 2030. The lack of research focusing on dementia in SEAR points to a significant under-recognition of this disease. The projected rise in dementia cases in the future should prompt urgent governmental response to address this growing public health issue. We also argue that given the overall paucity of data for the region, the Bayesian approach offers a promising methodology for improved estimates of disease prevalence and burden and should continue to be explored.
| S-EPMC7688200 | biostudies-literature
Project description:Our increased understanding of the mechanistic heterogeneity of diseases has pushed the development of targeted therapeutics. We do not expect all patients with a given disease to benefit from a targeted drug; only those in the target population. That is, those with sufficient dysregulation in the biomolecular pathway targeted by treatment. However, due to complexity of the pathway, and/or technical issues with our characterizing assay, it is often hard to characterize the target population until well into large-scale clinical trials. This has stimulated the development of adaptive enrichment trials; clinical trials in which the target population is adaptively learned; and enrollment criteria are adaptively updated to reflect this growing understanding. This paper proposes a framework for group-sequential adaptive enrichment trials. Building on the work of Simon & Simon (2013). Adaptive enrichment designs for clinical trials. Biostatistics 14(4), 613-625), it includes a frequentist hypothesis test at the end of the trial. However, it uses Bayesian methods to optimize the decisions required during the trial (regarding how to restrict enrollment) and Bayesian methods to estimate effect size, and characterize the target population at the end of the trial. This joint frequentist/Bayesian design combines the power of Bayesian methods for decision making with the use of a formal hypothesis test at the end of the trial to preserve the studywise probability of a type I error.
| S-EPMC6075009 | biostudies-literature