Communicating uncertainty in epidemic models.
Ontology highlight
ABSTRACT:
SUBMITTER: McCabe R
PROVIDER: S-EPMC8562068 | biostudies-literature | 2021 Dec
REPOSITORIES: biostudies-literature
Publications
Communicating uncertainty in epidemic models.
McCabe Ruth R Kont Mara D MD Schmit Nora N Whittaker Charles C Løchen Alessandra A Walker Patrick G T PGT Ghani Azra C AC Ferguson Neil M NM White Peter J PJ Donnelly Christl A CA Watson Oliver J OJ
Epidemics 20211102
While mathematical models of disease transmission are widely used to inform public health decision-makers globally, the uncertainty inherent in results are often poorly communicated. We outline some potential sources of uncertainty in epidemic models, present traditional methods used to illustrate uncertainty and discuss alternative presentation formats used by modelling groups throughout the COVID-19 pandemic. Then, by drawing on the experience of our own recent modelling, we seek to contribute ...[more]
Similar Datasets
Project description:All science has uncertainty. Unless that uncertainty is communicated effectively, decision makers may put too much or too little faith in it. The information that needs to be communicated depends on the decisions that people face. Are they (i) looking for a signal (e.g., whether to evacuate before a hurricane), (ii) choosing among fixed options (e.g., which medical treatment is best), or (iii) learning to create options (e.g., how to regulate nanotechnology)? We examine these three classes of decisions in terms of how to characterize, assess, and convey the uncertainties relevant to each. We then offer a protocol for summarizing the many possible sources of uncertainty in standard terms, designed to impose a minimal burden on scientists, while gradually educating those whose decisions depend on their work. Its goals are better decisions, better science, and better support for science.
| S-EPMC4183175 | biostudies-other
Project description:Uncertainty is an inherent part of knowledge, and yet in an era of contested expertise, many shy away from openly communicating their uncertainty about what they know, fearful of their audience's reaction. But what effect does communication of such epistemic uncertainty have? Empirical research is widely scattered across many disciplines. This interdisciplinary review structures and summarizes current practice and research across domains, combining a statistical and psychological perspective. This informs a framework for uncertainty communication in which we identify three objects of uncertainty-facts, numbers and science-and two levels of uncertainty: direct and indirect. An examination of current practices provides a scale of nine expressions of direct uncertainty. We discuss attempts to codify indirect uncertainty in terms of quality of the underlying evidence. We review the limited literature about the effects of communicating epistemic uncertainty on cognition, affect, trust and decision-making. While there is some evidence that communicating epistemic uncertainty does not necessarily affect audiences negatively, impact can vary between individuals and communication formats. Case studies in economic statistics and climate change illustrate our framework in action. We conclude with advice to guide both communicators and future researchers in this important but so far rather neglected field.
| S-EPMC6549952 | biostudies-literature
Project description:Mathematical models provide a quantitative framework with which scientists can assess hypotheses on the potential underlying mechanisms that explain patterns in the observed data at different spatial and temporal scales, generate estimates of key kinetic parameters, assess the impact of interventions, optimize the impact of control strategies, and generate forecasts. We review and illustrate a simple data assimilation framework for calibrating mathematical models based on ordinary differential equation models to time series data describing the temporal progression of case counts relating to population growth or infectious disease transmission dynamics. In contrast to Bayesian estimation approaches that always raise the question of how to set priors for the parameters, this frequentist approach relies on modeling the error structure in the data. We discuss issues related to parameter identifiability, uncertainty quantification and propagation as well as model performance and forecasts along examples based on phenomenological and mechanistic models parameterized using simulated and real datasets.
| S-EPMC5726591 | biostudies-literature
Project description:Stochastic transmission dynamic models are needed to quantify the uncertainty in estimates and predictions during outbreaks of infectious diseases. We previously developed a calibration method for stochastic epidemic compartmental models, called Multiple Shooting for Stochastic Systems (MSS), and demonstrated its competitive performance against a number of existing state-of-the-art calibration methods. The existing MSS method, however, lacks a mechanism against filter degeneracy, a phenomenon that results in parameter posterior distributions that are weighted heavily around a single value. As such, when filter degeneracy occurs, the posterior distributions of parameter estimates will not yield reliable credible or prediction intervals for parameter estimates and predictions. In this work, we extend the MSS method by evaluating and incorporating two resampling techniques to detect and resolve filter degeneracy. Using simulation experiments, we demonstrate that an extended MSS method produces credible and prediction intervals with desired coverage in estimating key epidemic parameters (e.g. mean duration of infectiousness and R0) and short- and long-term predictions (e.g. one and three-week forecasts, timing and number of cases at the epidemic peak, and final epidemic size). Applying the extended MSS approach to a humidity-based stochastic compartmental influenza model, we were able to accurately predict influenza-like illness activity reported by U.S. Centers for Disease Control and Prevention from 10 regions as well as city-level influenza activity using real-time, city-specific Google search query data from 119 U.S. cities between 2003 and 2014.
| S-EPMC6517086 | biostudies-literature
Project description:Across Europe, organizations in different sectors are sensitive to climate variability and change, at a range of temporal scales from the seasonal to the interannual to the multi-decadal. Climate forecast providers face the challenge of communicating the uncertainty inherent in these forecasts to these decision-makers in a way that is transparent, understandable and does not lead to a false sense of certainty. This article reports the findings of a user-needs survey, conducted with 50 representatives of organizations in Europe from a variety of sectors (e.g. water management, forestry, energy, tourism, health) interested in seasonal and interannual climate forecasts. We find that while many participating organizations perform their own 'in house' risk analysis most require some form of processing and interpretation by forecast providers. However, we also find that while users tend to perceive seasonal and interannual forecasts to be useful, they often find them difficult to understand, highlighting the need for communication formats suitable for both expert and non-expert users. In addition, our results show that people tend to prefer familiar formats for receiving information about uncertainty. The implications of these findings for both the providers and users of climate information are discussed.
| S-EPMC4608030 | biostudies-literature
Project description:In an effort to mitigate anthropogenic effects on the global climate system, industrialised countries are required to quantify and report, for various economic sectors, the annual emissions of greenhouse gases from their several sources and the absorption of the same in different sinks. These estimates are uncertain, and this uncertainty must be communicated effectively, if government bodies, research scientists or members of the public are to draw sound conclusions. Our interest is in communicating the uncertainty in estimates of greenhouse gas emissions from agriculture to those who might directly use the results from the inventory. We tested six methods of communication. These were: a verbal scale using the IPCC calibrated phrases such as 'likely' and 'very unlikely'; probabilities that emissions are within a defined range of values; confidence intervals for the expected value; histograms; box plots; and shaded arrays that depict the probability density of the uncertain quantity. In a formal trial we used these methods to communicate uncertainty about four specific inferences about greenhouse gas emissions in the UK. Sixty four individuals who use results from the greenhouse gas inventory professionally participated in the trial, and we tested how effectively the uncertainty about these inferences was communicated by means of a questionnaire. Our results showed differences in the efficacy of the methods of communication, and interactions with the nature of the target audience. We found that, although the verbal scale was thought to be a good method of communication it did not convey enough information and was open to misinterpretation. Shaded arrays were similarly criticised for being open to misinterpretation, but proved to give the best impression of uncertainty when participants were asked to interpret results from the greenhouse gas inventory. Box plots were most favoured by our participants largely because they were particularly favoured by those who worked in research or had a stronger mathematical background. We propose a combination of methods should be used to convey uncertainty in emissions and that this combination should be tailored to the professional group.
| S-EPMC4521119 | biostudies-literature
Project description:During the SARS-CoV-2 pandemic, epidemic models have been central to policy-making. Public health responses have been shaped by model-based projections and inferences, especially related to the impact of various non-pharmaceutical interventions. Accompanying this has been increased scrutiny over model performance, model assumptions, and the way that uncertainty is incorporated and presented. Here we consider a population-level model, focusing on how distributions representing host infectiousness and the infection-to-death times are modelled, and particularly on the impact of inferred epidemic characteristics if these distributions are mis-specified. We introduce an SIR-type model with the infected population structured by 'infected age', i.e. the number of days since first being infected, a formulation that enables distributions to be incorporated that are consistent with clinical data. We show that inference based on simpler models without infected age, which implicitly mis-specify these distributions, leads to substantial errors in inferred quantities relevant to policy-making, such as the reproduction number and the impact of interventions. We consider uncertainty quantification via a Bayesian approach, implementing this for both synthetic and real data focusing on UK data in the period 15 Feb-14 Jul 2020, and emphasising circumstances where it is misleading to neglect uncertainty. This manuscript was submitted as part of a theme issue on "Modelling COVID-19 and Preparedness for Future Pandemics".
| S-EPMC9637393 | biostudies-literature
Project description:BackgroundCommunicating scientific uncertainty about public health threats such as COVID-19 is an ethically desirable task endorsed by expert guidelines on crisis communication. However, the communication of scientific uncertainty is challenging because of its potential to promote ambiguity aversion-a well-described syndrome of negative psychological responses consisting of heightened risk perceptions, emotional distress, and decision avoidance. Communication strategies that can inform the public about scientific uncertainty while mitigating ambiguity aversion are a critical unmet need.ObjectiveThis study aimed to evaluate whether an "uncertainty-normalizing" communication strategy-aimed at reinforcing the expected nature of scientific uncertainty about the COVID-19 pandemic-can reduce ambiguity aversion, and to compare its effectiveness to conventional public communication strategies aimed at promoting hope and prosocial values.MethodsIn an online factorial experiment conducted from May to June 2020, a national sample of 1497 US adults read one of five versions of an informational message describing the nature, transmission, prevention, and treatment of COVID-19; the versions varied in level of expressed scientific uncertainty and supplemental focus (ie, uncertainty-normalizing, hope-promoting, and prosocial). Participants then completed measures of cognitive, emotional, and behavioral manifestations of ambiguity aversion (ie, perceived likelihood of getting COVID-19, COVID-19 worry, and intentions for COVID-19 risk-reducing behaviors and vaccination). Analyses assessed (1) the extent to which communicating uncertainty produced ambiguity-averse psychological responses; (2) the comparative effectiveness of uncertainty-normalizing, hope-promoting, and prosocial communication strategies in reducing ambiguity-averse responses; and (3) potential moderators of the effects of alternative uncertainty communication strategies.ResultsThe communication of scientific uncertainty about the COVID-19 pandemic increased perceived likelihood of getting COVID-19 and worry about COVID-19, consistent with ambiguity aversion. However, it did not affect intentions for risk-reducing behaviors or vaccination. The uncertainty-normalizing strategy reduced these aversive effects of communicating scientific uncertainty, resulting in levels of both perceived likelihood of getting COVID-19 and worry about COVID-19 that did not differ from the control message that did not communicate uncertainty. In contrast, the hope-promoting and prosocial strategies did not decrease ambiguity-averse responses to scientific uncertainty. Age and political affiliation, respectively, moderated the effects of uncertainty communication strategies on intentions for COVID-19 risk-reducing behaviors and worry about COVID-19.ConclusionsCommunicating scientific uncertainty about the COVID-19 pandemic produces ambiguity-averse cognitive and emotional, but not behavioral, responses among the general public, and an uncertainty-normalizing communication strategy reduces these responses. Normalizing uncertainty may be an effective strategy for mitigating ambiguity aversion in crisis communication efforts. More research is needed to test uncertainty-normalizing communication strategies and to elucidate the factors that moderate their effectiveness.
| S-EPMC8064708 | biostudies-literature
Project description:Uncertainty is inherent to our knowledge about the state of the world yet often not communicated alongside scientific facts and numbers. In the "posttruth" era where facts are increasingly contested, a common assumption is that communicating uncertainty will reduce public trust. However, a lack of systematic research makes it difficult to evaluate such claims. We conducted five experiments-including one preregistered replication with a national sample and one field experiment on the BBC News website (total n = 5,780)-to examine whether communicating epistemic uncertainty about facts across different topics (e.g., global warming, immigration), formats (verbal vs. numeric), and magnitudes (high vs. low) influences public trust. Results show that whereas people do perceive greater uncertainty when it is communicated, we observed only a small decrease in trust in numbers and trustworthiness of the source, and mostly for verbal uncertainty communication. These results could help reassure all communicators of facts and science that they can be more open and transparent about the limits of human knowledge.
| S-EPMC7149229 | biostudies-literature
Project description: Not available
| S-EPMC5104811 | biostudies-literature