Dataset Information

Bayesian Methods for Calibrating Health Policy Models: A Tutorial.

ABSTRACT: Mathematical simulation models are commonly used to inform health policy decisions. These health policy models represent the social and biological mechanisms that determine health and economic outcomes, combine multiple sources of evidence about how policy alternatives will impact those outcomes, and synthesize outcomes into summary measures salient for the policy decision. Calibrating these health policy models to fit empirical data can provide face validity and improve the quality of model predictions. Bayesian methods provide powerful tools for model calibration. These methods summarize information relevant to a particular policy decision into (1) prior distributions for model parameters, (2) structural assumptions of the model, and (3) a likelihood function created from the calibration data, combining these different sources of evidence via Bayes' theorem. This article provides a tutorial on Bayesian approaches for model calibration, describing the theoretical basis for Bayesian calibration approaches as well as pragmatic considerations that arise in the tasks of creating calibration targets, estimating the posterior distribution, and obtaining results to inform the policy decision. These considerations, as well as the specific steps for implementing the calibration, are described in the context of an extended worked example about the policy choice to provide (or not provide) treatment for a hypothetical infectious disease. Given the many simplifications and subjective decisions required to create prior distributions, model structure, and likelihood, calibration should be considered an exercise in creating a reasonable model that produces valid evidence for policy, rather than as a technique for identifying a unique theoretically optimal summary of the evidence.

SUBMITTER: Menzies NA

PROVIDER: S-EPMC5448142 | biostudies-literature | 2017 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Bayesian Methods for Calibrating Health Policy Models: A Tutorial.

Menzies Nicolas A NA Soeteman Djøra I DI Pandya Ankur A Kim Jane J JJ

PharmacoEconomics 20170601 6

Mathematical simulation models are commonly used to inform health policy decisions. These health policy models represent the social and biological mechanisms that determine health and economic outcomes, combine multiple sources of evidence about how policy alternatives will impact those outcomes, and synthesize outcomes into summary measures salient for the policy decision. Calibrating these health policy models to fit empirical data can provide face validity and improve the quality of model pre ...[more]

PMID: 28247184

Similar Datasets

Project description:BackgroundFloating catchment methods have recently been applied to identify priority regions for Automated External Defibrillator (AED) deployment, to aid in improving Out of Hospital Cardiac Arrest (OHCA) survival. This approach models access as a supply-to-demand ratio for each area, targeting areas with high demand and low supply for AED placement. These methods incorporate spatial covariates on OHCA occurrence, but do not provide precise AED locations, which are critical to the initial intent of such location analysis research. Exact AED locations can be determined using optimisation methods, but they do not incorporate known spatial risk factors for OHCA, such as income and demographics. Combining these two approaches would evaluate AED placement impact, describe drivers of OHCA occurrence, and identify areas that may not be appropriately covered by AED placement strategies. There are two aims in this paper. First, to develop geospatial models of OHCA that account for and display uncertainty. Second, to evaluate the AED placement methods using geospatial models of accessibility. We first identify communities with the greatest gap between demand and supply for allocating AEDs. We then use this information to evaluate models for precise AED location deployment.MethodsCase study data set consisted of 2802 OHCA events and 719 AEDs. Spatial OHCA occurrence was described using a geospatial model, with possible spatial correlation accommodated by introducing a conditional autoregressive (CAR) prior on the municipality-level spatial random effect. This model was fit with Integrated Nested Laplacian Approximation (INLA), using covariates for population density, proportion male, proportion over 65 years, financial strength, and the proportion of land used for transport, commercial, buildings, recreation, and urban areas. Optimisation methods for AED locations were applied to find the top 100 AED placement locations. AED access was calculated for current access and 100 AED placements. Priority rankings were then given for each area based on their access score and predicted number of OHCA events.ResultsOf the 2802 OHCA events, 64.28% occurred in rural areas, and 35.72% in urban areas. Additionally, over 70% of individuals were aged over 65. Supply of AEDs was less than demand in most areas. Priority regions for AED placement were identified, and access scores were evaluated for AED placement methodology by ranking the access scores and the predicted OHCA count. AED placement methodology placed AEDs in areas with the highest priority, but placed more AEDs in areas with more predicted OHCA events in each grid cell.ConclusionThe methods in this paper incorporate OHCA spatial risk factors and OHCA coverage to identify spatial regions most in need of resources. These methods can be used to help understand how AED allocation methods affect OHCA accessibility, which is of significant practical value for communities when deciding AED placements.

Project description:ObjectiveTo illustrate the benefits of deploying individual headache forecasting models using continuous updating with Bayesian methods.BackgroundThe ability to reliably forecast headache attacks within an individual over time would enhance the study of attacks and allow preemptive treatment. However, deploying a suitable forecasting model in a clinical setting will likely involve several unique challenges related to heterogeneity in the predictor weights, limited or sparse data, and the need for a quick "warm-up." The use of Bayesian methods offers solutions to each of these specific challenges.MethodsThis was a post hoc analysis of a cohort study of individuals with episodic migraine attacks. Individuals completed daily diaries that allowed the estimation of several forecasting models, each using different types of ancillary information incorporated into formal prior probability distributions. An in silico analysis was conducted that mimicked the deployment of these models in a clinical-like setting where the parameters of the models were continuously updated and evaluated each day using root mean square error (RMSE).ResultsIndividuals (N = 95) were followed for 50 days and contributed 3359 days of nonmissing diary data. During the observation period, there were 1293/3359 (38.5%) days with a headache attack. Self-reported baseline headache frequency was associated with the corresponding predicted probability of future attacks, r = 0.15-0.39. At Day 25, the correlation between baseline information and predicted attack likelihood was r = 0.29 (95% CI: 0.09-0.47). Additionally, the use of prior probability distributions for model parameters improved the model fit, especially early in the deployment of the models (e.g., Day 5 RMSE 0.45 vs. 0.43). Models using informative prior probability distributions outperformed the models estimated without this information during the first 42 days of observation, although performance became more similar as more data were collected.ConclusionsThis analysis demonstrates the value of Bayesian methods in using additional available information to improve forecasting model performance, especially early in the deployment of a forecasting model. To obtain the full value of such models or to apply any model in clinical settings, a model with adequate discrimination and calibration will be needed.

Dataset Information

Bayesian Methods for Calibrating Health Policy Models: A Tutorial.

Publications

Bayesian Methods for Calibrating Health Policy Models: A Tutorial.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets