Dataset Information

A probability model for evaluating the bias and precision of influenza vaccine effectiveness estimates from case-control studies.

ABSTRACT: As influenza vaccination is now widely recommended, randomized clinical trials are no longer ethical in many populations. Therefore, observational studies on patients seeking medical care for acute respiratory illnesses (ARIs) are a popular option for estimating influenza vaccine effectiveness (VE). We developed a probability model for evaluating and comparing bias and precision of estimates of VE against symptomatic influenza from two commonly used case-control study designs: the test-negative design and the traditional case-control design. We show that when vaccination does not affect the probability of developing non-influenza ARI then VE estimates from test-negative design studies are unbiased even if vaccinees and non-vaccinees have different probabilities of seeking medical care against ARI, as long as the ratio of these probabilities is the same for illnesses resulting from influenza and non-influenza infections. Our numerical results suggest that in general, estimates from the test-negative design have smaller bias compared to estimates from the traditional case-control design as long as the probability of non-influenza ARI is similar among vaccinated and unvaccinated individuals. We did not find consistent differences between the standard errors of the estimates from the two study designs.

SUBMITTER: Haber M

PROVIDER: S-EPMC4336850 | biostudies-literature | 2015 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A probability model for evaluating the bias and precision of influenza vaccine effectiveness estimates from case-control studies.

Haber M M An Q Q Foppa I M IM Shay D K DK Ferdinands J M JM Orenstein W A WA

Epidemiology and infection 20140822 7

As influenza vaccination is now widely recommended, randomized clinical trials are no longer ethical in many populations. Therefore, observational studies on patients seeking medical care for acute respiratory illnesses (ARIs) are a popular option for estimating influenza vaccine effectiveness (VE). We developed a probability model for evaluating and comparing bias and precision of estimates of VE against symptomatic influenza from two commonly used case-control study designs: the test-negative ...[more]

PMID: 25147970

Similar Datasets

Project description:BACKGROUND: A multicentre case-control study based on sentinel practitioner surveillance networks from seven European countries was undertaken to estimate the effectiveness of 2009-2010 pandemic and seasonal influenza vaccines against medically attended influenza-like illness (ILI) laboratory-confirmed as pandemic influenza A (H1N1) (pH1N1). METHODS AND FINDINGS: Sentinel practitioners swabbed ILI patients using systematic sampling. We included in the study patients meeting the European ILI case definition with onset of symptoms >14 days after the start of national pandemic vaccination campaigns. We compared pH1N1 cases to influenza laboratory-negative controls. A valid vaccination corresponded to >14 days between receiving a dose of vaccine and symptom onset. We estimated pooled vaccine effectiveness (VE) as 1 minus the odds ratio with the study site as a fixed effect. Using logistic regression, we adjusted VE for potential confounding factors (age group, sex, month of onset, chronic diseases and related hospitalizations, smoking history, seasonal influenza vaccinations, practitioner visits in previous year). We conducted a complete case analysis excluding individuals with missing values and a multiple multivariate imputation to estimate missing values. The multivariate imputation (n?=?2902) adjusted pandemic VE (PIVE) estimates were 71.9% (95% confidence interval [CI] 45.6-85.5) overall; 78.4% (95% CI 54.4-89.8) in patients <65 years; and 72.9% (95% CI 39.8-87.8) in individuals without chronic disease. The complete case (n?=?1,502) adjusted PIVE were 66.0% (95% CI 23.9-84.8), 71.3% (95% CI 29.1-88.4), and 70.2% (95% CI 19.4-89.0), respectively. The adjusted PIVE was 66.0% (95% CI -69.9 to 93.2) if vaccinated 8-14 days before ILI onset. The adjusted 2009-2010 seasonal influenza VE was 9.9% (95% CI -65.2 to 50.9). CONCLUSIONS: Our results suggest good protection of the pandemic monovalent vaccine against medically attended pH1N1 and no effect of the 2009-2010 seasonal influenza vaccine. However, the late availability of the pandemic vaccine and subsequent limited coverage with this vaccine hampered our ability to study vaccine benefits during the outbreak period. Future studies should include estimation of the effectiveness of the new trivalent vaccine in the upcoming 2010-2011 season, when vaccination will occur before the influenza season starts.

Project description:Spatial capture-recapture (SCR) models are powerful analytical tools that have become the standard for estimating abundance and density of wild animal populations. When sampling populations to implement SCR, the number of unique individuals detected, total recaptures, and unique spatial relocations can be highly variable. These sample sizes influence the precision and accuracy of model parameter estimates. Testing the performance of SCR models with sparse empirical data sets typical of low-density, wide-ranging species can inform the threshold at which a more integrated modeling approach with additional data sources or additional years of monitoring may be required to achieve reliable, precise parameter estimates. Using a multi-site, multi-year Utah black bear (Ursus americanus) capture-recapture data set, we evaluated factors influencing the uncertainty of SCR structural parameter estimates, specifically density, detection, and the spatial scale parameter, sigma. We also provided some of the first SCR density estimates for Utah black bear populations, which ranged from 3.85 to 74.33 bears/100 km2 . Increasing total detections decreased the uncertainty of density estimates, whereas an increasing number of total recaptures and individuals with recaptures decreased the uncertainty of detection and sigma estimates, respectively. In most cases, multiple years of data were required for precise density estimates (<0.2 coefficient of variation [CV]). Across study areas there was an average decline in CV of 0.07 with the addition of another year of data. One sampled population with very high estimated bear density had an atypically low number of spatial recaptures relative to total recaptures, apparently inflating density estimates. A complementary simulation study used to assess estimate bias suggested that when <30% of recaptured individuals were spatially recaptured, density estimates were unreliable and ranged widely, in some cases to >3 times the simulated density. Additional research could evaluate these requirements for other density scenarios. Large numbers of individuals detected, numbers of spatial recaptures, and precision alone may not be sufficient indicators of parameter estimate reliability. We provide an evaluation of simple summary statistics of capture-recapture data sets that can provide an early signal of the need to alter sampling design or collect auxiliary data before model implementation to improve estimate precision and accuracy.

Dataset Information

A probability model for evaluating the bias and precision of influenza vaccine effectiveness estimates from case-control studies.

Publications

A probability model for evaluating the bias and precision of influenza vaccine effectiveness estimates from case-control studies.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure