Dataset Information

Bayesian versus frequentist statistical inference for investigating a one-off cancer cluster reported to a health department.

ABSTRACT:

Background

The problem of silent multiple comparisons is one of the most difficult statistical problems faced by scientists. It is a particular problem for investigating a one-off cancer cluster reported to a health department because any one of hundreds, or possibly thousands, of neighbourhoods, schools, or workplaces could have reported a cluster, which could have been for any one of several types of cancer or any one of several time periods.

Methods

This paper contrasts the frequentist approach with a Bayesian approach for dealing with silent multiple comparisons in the context of a one-off cluster reported to a health department. Two published cluster investigations were re-analysed using the Dunn-Sidak method to adjust frequentist p-values and confidence intervals for silent multiple comparisons. Bayesian methods were based on the Gamma distribution.

Results

Bayesian analysis with non-informative priors produced results similar to the frequentist analysis, and suggested that both clusters represented a statistical excess. In the frequentist framework, the statistical significance of both clusters was extremely sensitive to the number of silent multiple comparisons, which can only ever be a subjective "guesstimate". The Bayesian approach is also subjective: whether there is an apparent statistical excess depends on the specified prior.

Conclusion

In cluster investigations, the frequentist approach is just as subjective as the Bayesian approach, but the Bayesian approach is less ambitious in that it treats the analysis as a synthesis of data and personal judgements (possibly poor ones), rather than objective reality. Bayesian analysis is (arguably) a useful tool to support complicated decision-making, because it makes the uncertainty associated with silent multiple comparisons explicit.

SUBMITTER: Coory MD

PROVIDER: S-EPMC2694210 | biostudies-literature | 2009 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Bayesian versus frequentist statistical inference for investigating a one-off cancer cluster reported to a health department.

Coory Michael D MD Wills Rachael A RA Barnett Adrian G AG

BMC medical research methodology 20090511

<h4>Background</h4>The problem of silent multiple comparisons is one of the most difficult statistical problems faced by scientists. It is a particular problem for investigating a one-off cancer cluster reported to a health department because any one of hundreds, or possibly thousands, of neighbourhoods, schools, or workplaces could have reported a cluster, which could have been for any one of several types of cancer or any one of several time periods.<h4>Methods</h4>This paper contrasts the fre ...[more]

PMID: 19426561

Similar Datasets

Project description:BackgroundRoutine influenza vaccine effectiveness (VE) surveillance networks use frequentist methods to estimate VE. With data from more than a decade of VE surveillance from diverse global populations now available, using Bayesian methods to explicitly account for this knowledge may be beneficial. This study explores differences between Bayesian vs. frequentist inference in multiple seasons with varying VE.MethodsWe used data from the United States Influenza Vaccine Effectiveness (US Flu VE) Network. Ambulatory care patients with acute respiratory illness were enrolled during seasons of varying observed VE based on traditional frequentist methods. We estimated VE against A(H1N1)pdm in 2015/16, dominated by A(H1N1)pdm; against A(H3N2) in 2017/18, dominated by A(H3N2); and compared VE for live attenuated influenza vaccine (LAIV) vs. inactivated influenza vaccine (IIV) among children aged 2-17 years in 2013/14, also dominated by A(H1N1)pdm. VE was estimated using both frequentist and Bayesian methods using the test-negative design. For the Bayesian estimates, prior VE distributions were based on data from all published test-negative studies of the same influenza type/subtype available prior to the season of interest.ResultsAcross the three seasons, 16,342 subjects were included in the analyses. For 2015/16, frequentist and Bayesian VE estimates were essentially identical (41% each). For 2017/18, frequentist and Bayesian estimates of VE against A(H3N2) viruses were also nearly identical (26% vs. 23%, respectively), even though the presence of apparent antigenic match could potentially have pulled Bayesian estimates upward. Precision of estimates was similar between methods in both seasons. Frequentist and Bayesian estimates diverged for children in 2013/14. Under the frequentist approach, LAIV effectiveness was 62 percentage points lower than IIV, while LAIV was only 27 percentage points lower than IIV under the Bayesian approach.ConclusionBayesian estimates of influenza VE can differ from frequentist estimates to a clinically meaningful degree when VE diverges substantially from previous seasons.

Project description:The stochastic behavior of single ion channels is most often described as an aggregated continuous-time Markov process with discrete states. For ligand-gated channels each state can represent a different conformation of the channel protein or a different number of bound ligands. Single-channel recordings show only whether the channel is open or shut: states of equal conductance are aggregated, so transitions between them have to be inferred indirectly. The requirement to filter noise from the raw signal further complicates the modeling process, as it limits the time resolution of the data. The consequence of the reduced bandwidth is that openings or shuttings that are shorter than the resolution cannot be observed; these are known as missed events. Postulated models fitted using filtered data must therefore explicitly account for missed events to avoid bias in the estimation of rate parameters and therefore assess parameter identifiability accurately. In this article, we present the first, to our knowledge, Bayesian modeling of ion-channels with exact missed events correction. Bayesian analysis represents uncertain knowledge of the true value of model parameters by considering these parameters as random variables. This allows us to gain a full appreciation of parameter identifiability and uncertainty when estimating values for model parameters. However, Bayesian inference is particularly challenging in this context as the correction for missed events increases the computational complexity of the model likelihood. Nonetheless, we successfully implemented a two-step Markov chain Monte Carlo method that we called "BICME", which performs Bayesian inference in models of realistic complexity. The method is demonstrated on synthetic and real single-channel data from muscle nicotinic acetylcholine channels. We show that parameter uncertainty can be characterized more accurately than with maximum-likelihood methods. Our code for performing inference in these ion channel models is publicly available.

Dataset Information

Bayesian versus frequentist statistical inference for investigating a one-off cancer cluster reported to a health department.

Background

Methods

Results

Conclusion

Publications

Bayesian versus frequentist statistical inference for investigating a one-off cancer cluster reported to a health department.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets