Browse
Submit Data
Databases
API
Help

Dataset Information

44 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Bias correction methods for test-negative designs in the presence of misclassification.

ABSTRACT: The test-negative design (TND) has become a standard approach for vaccine effectiveness (VE) studies. However, previous studies suggested that it may be more vulnerable than other designs to misclassification of disease outcome caused by imperfect diagnostic tests. This could be a particular limitation in VE studies where simple tests (e.g. rapid influenza diagnostic tests) are used for logistical convenience. To address this issue, we derived a mathematical representation of the TND with imperfect tests, then developed a bias correction framework for possible misclassification. TND studies usually include multiple covariates other than vaccine history to adjust for potential confounders; our methods can also address multivariate analyses and be easily coupled with existing estimation tools. We validated the performance of these methods using simulations of common scenarios for vaccine efficacy and were able to obtain unbiased estimates in a variety of parameter settings.

SUBMITTER: Endo A

PROVIDER: S-EPMC7522852 | biostudies-literature | 2020 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Bias correction methods for test-negative designs in the presence of misclassification.

Endo A A Funk S S Kucharski A J AJ

Epidemiology and infection 20200908

The test-negative design (TND) has become a standard approach for vaccine effectiveness (VE) studies. However, previous studies suggested that it may be more vulnerable than other designs to misclassification of disease outcome caused by imperfect diagnostic tests. This could be a particular limitation in VE studies where simple tests (e.g. rapid influenza diagnostic tests) are used for logistical convenience. To address this issue, we derived a mathematical representation of the TND with imperf ...[more]

PMID: 32895088

Similar Datasets

Analysis of cluster-randomized test-negative designs: cluster-level methods.

Project description:Intervention trials of vector control methods often require community level randomization with appropriate inferential methods. For many interventions, the possibility of confounding due to the effects of health-care seeking behavior on disease ascertainment remains a concern. The test-negative design, a variant of the case-control method, was introduced to mitigate this issue in the assessment of the efficacy of influenza vaccination (measured at an individual level) on influenza infection. Here, we introduce a cluster-randomized test-negative design that includes randomization of the intervention at a group level. We propose several methods for estimation and inference regarding the relative risk (RR). The inferential methods considered are based on the randomization distribution induced by permuting intervention assignment across two sets of randomly selected clusters. The motivating example is a current study of the efficacy of randomized releases of Wolbachia-infected Aedes aegypti mosquitoes to reduce the incidence of dengue in Yogyakarta City, Indonesia. Estimation and inference techniques are assessed through a simulation study.

| S-EPMC7967700 | biostudies-literature

Immune correlates analysis using vaccinees from test negative designs.

Project description:Determining the effect of vaccine-induced immune response on disease risk is an important goal of vaccinology. Typically, immune correlates analyses are conducted prospectively with immune response measured shortly after vaccination and subsequent disease status regressed on immune response. In outbreaks and rare disease settings, collecting samples from all vaccinees is not feasible. The test negative design is a retrospective design used to measure vaccine efficacy where symptomatic individuals who present at a clinic are assessed for relevant disease (cases) or some other disease (controls) and vaccination status ascertained. This article proposes that test negative vaccinees have immune response to vaccine assessed both for relevant (e.g., Ebola) and irrelevant (e.g., vector) proteins. If the latter immune response is unaffected by active (Ebola) infection, and is correlated with the relevant immune response, it can serve as a proxy for the immune response of interest proximal to infection. We show that logistic regression using imputed immune response as the covariate and case disease as outcome can estimate the prospective immune response slope and detail the assumptions needed for unbiased inference. The method is evaluated by simulation under various scenarios including constant and decaying immune response. A simulated dataset motivated by ring vaccination for an ongoing Ebola outbreak is analyzed.

| S-EPMC9216615 | biostudies-literature

Analysis of counts for cluster randomized trials: Negative controls and test-negative designs.

Project description:In cluster randomized trials (CRTs), the outcome of interest is often a count at the cluster level. This occurs, for example, in evaluating an intervention with the outcome being the number of infections of a disease such as HIV or dengue or the number of hospitalizations in the cluster. Standard practice analyzes these counts through cluster outcome rates using an appropriate denominator (eg, population size). However, such denominators are sometimes unknown, particularly when the counts depend on a passive community surveillance system. We consider direct comparison of the counts without knowledge of denominators, relying on randomization to balance denominators. We also focus on permutation tests to allow for small numbers of randomized clusters. However, such approaches are subject to bias when there is differential ascertainment of counts across arms, a situation that may occur in CRTs that cannot implement blinded interventions. We suggest the use of negative control counts as a method to remove, or reduce, this bias, discussing the key properties necessary for an effective negative control. A current example of such a design is the recent extension of test-negative designs to CRTs testing community-level interventions. Via simulation, we compare the performance of new and standard estimators based on CRTs with negative controls to approaches that only use the original counts. When there is no differential ascertainment by intervention arm, the count-only approaches perform comparably to those using debiasing negative controls. However, under even modest differential ascertainment, the count-only estimators are no longer reliable.

| S-EPMC7448573 | biostudies-literature

Transcription profiling of yeast and analysis of results using gene-specific dye bias correction methods

Project description:The raw and derived data of the hybridizations in the slide-dependent factor set, estimation set and validation set as described in the paper

2009-03-29 | E-TABM-462 | biostudies-arrayexpress

Effects of Confounding Bias in COVID-19 and Influenza Vaccine Effectiveness Test-Negative Designs Due to Correlated Influenza and COVID-19 Vaccination Behaviors.

Project description:The test-negative design is commonly used to estimate influenza and COVID-19 vaccine effectiveness (VE). In these studies, correlated COVID-19 and influenza vaccine behaviors may introduce a confounding bias where controls are included with the other vaccine-preventable acute respiratory illness (ARI). We quantified the impact of this bias on VE estimates in studies where this bias is not addressed. We simulated study populations under varying vaccination probabilities, COVID-19 VE, influenza VE, and proportions of controls included with the other vaccine-preventable ARI. Mean bias was calculated as the difference between estimated and true VE. Absolute mean bias in VE estimates was classified as low (<10%), moderate (10% to <20%), and high (≥20%). Where vaccination probabilities are positively correlated, COVID-19 and influenza VE test-negative studies with influenza and SARS-CoV-2 ARI controls, respectively, underestimate VE. For COVID-19 VE studies, mean bias was low for all scenarios where influenza represented ≤25% of controls. For influenza VE studies, mean bias was low for all scenarios where SARS-CoV-2 represented ≤10% of controls. Although bias was driven by the conditional probability of vaccination, low VE of the vaccine of interest and high VE of the confounding vaccine increase its magnitude. Where a low percentage of controls are included with the other vaccine-preventable ARI, bias in COVID-19 and influenza VE estimates is low. However, influenza VE estimates are likely more susceptible to bias. Researchers should consider potential bias and its implications in their respective study settings to make informed methodological decisions in test-negative VE studies.

| S-EPMC9129127 | biostudies-literature

Universal correction of enzymatic sequence bias

Project description:Coupling molecular biology to high throughput sequencing has revolutionized the study of biology. Molecular genomics techniques are continually refined to provide higher resolution mapping of nucleic acid interactions and nucleic acid structure. These assays are converging on single-nucleotide resolution measurements, but the sequence preferences of molecular biology enzymes can interfere with the accurate interpretation of the data. Enzymatic sequence preferences manifest more prominently as the resolution of these assays increase. We developed seqOutBias to seek out enzymatic sequence bias from experimental data and scale individual sequence reads to correct the bias. We show that this software efficiently and successfully corrects the sequence bias resulting from DNase-seq, TACh-seq, ATAC-seq, MNase-seq, and PRO-seq data.

2016-12-21 | GSE92674 | GEO

Bias assessment and correction for Levin's population attributable fraction in the presence of confounding.

Project description:In 1953, Morton Levin introduced a simple approach to estimating population attributable fractions (PAF) depending only on risk factor prevalence and relative risk. This formula and its extensions are still in widespread use today, particularly to estimate PAF in populations where individual data is unavailable. Unfortunately, Levin's approach is known to be asymptotically biased for the PAF when the risk factor-disease relationship is confounded even if relative risks that are correctly adjusted for confounding are used in the estimator. Here we describe a simple re-expression of Miettinen's estimand that depends on the causal relative risk, the unadjusted relative risk and the population risk factor prevalence. While this re-expression is not new, it has been underappreciated in the literature, and the associated estimator may be useful in estimating PAF in populations when individual data is unavailable provided estimated adjusted and unadjusted relative risks can be transported to the population of interest. Using the re-expressed estimand, we develop novel analytic formulae for the relative and absolute asymptotic bias in Levin's formula, solidifying earlier work by Darrow and Steenland that used simulations to investigate this bias. We extend all results to settings with non-binary valued risk factors and continuous exposures and discuss the utility of these results in estimating PAF in practice.

| S-EPMC10904572 | biostudies-literature

Potential effect of virus interference on influenza vaccine effectiveness estimates in test-negative designs.

Project description:A hypothetical influenza infection-induced non-specific immunity may reduce the risk of subsequent non-influenza respiratory virus (NIRV) infection and bias the influenza vaccine effectiveness (VE) estimates in test-negative designs (TNDs). We conducted a simulation study using a simple TND model and explored the degree of bias in the VE estimates. The bias was marginal during the usual seasons and most of the time during pandemics; the bias only became large when the influenza infection attack rate increased to pandemic levels (>50%), the true VE was low to moderate, and the non-specific immunity almost completely protected from NIRV infections and lasted at least half the influenza season.

| S-EPMC9151296 | biostudies-literature

Bias from outcome misclassification in immunization schedule safety research.

Project description:PurposeThe Institute of Medicine recommended conducting observational studies of childhood immunization schedule safety. Such studies could be biased by outcome misclassification, leading to incorrect inferences. Using simulations, we evaluated (1) outcome positive predictive values (PPVs) as indicators of bias of an exposure-outcome association, and (2) quantitative bias analyses (QBA) for bias correction.MethodsSimulations were conducted based on proposed or ongoing Vaccine Safety Datalink studies. We simulated 4 studies of 2 exposure groups (children with no vaccines or on alternative schedules) and 2 baseline outcome levels (100 and 1000/100 000 person-years), with 3 relative risk (RR) levels (RR = 0.50, 1.00, and 2.00), across 1000 replications using probabilistic modeling. We quantified bias from non-differential and differential outcome misclassification, based on levels previously measured in database research (sensitivity > 95%; specificity > 99%). We calculated median outcome PPVs, median observed RRs, Type 1 error, and bias-corrected RRs following QBA.ResultsWe observed PPVs from 34% to 98%. With non-differential misclassification and true RR = 2.00, median bias was toward the null, with severe bias (median observed RR = 1.33) with PPV = 34% and modest bias (median observed RR = 1.83) with PPV = 83%. With differential misclassification, PPVs did not reflect median bias, and there was Type 1 error of 100% with PPV = 90%. QBA was generally effective in correcting misclassification bias.ConclusionsIn immunization schedule studies, outcome misclassification may be non-differential or differential to exposure. Overall outcome PPVs do not reflect the distribution of false positives by exposure and are poor indicators of bias in individual studies. Our results support QBA for immunization schedule safety research.

| S-EPMC5800415 | biostudies-literature

Correction of vaccine effectiveness derived from test-negative case-control studies.

Project description:BackgroundDetermining the vaccine effectiveness (VE) is an important part of studying every new vaccine. Test-negative case-control (TNCC) studies have recently been used to determine the VE. However, the estimated VE derived from a TNCC design depends on the test sensitivity and specificity. Herein, a method for correction of the value of VE derived from a TNCC study is presented.MethodsAn analytical method is presented to compute the corrected VE based on the sensitivity and specificity of the diagnostic test utilized. To show the application of the method proposed, a hypothetical TNCC study is presented. In this in silico study, 100 000 individuals referring to a healthcare system for COVID-19-like illness were tested with diagnostic tests with sensitivities of 0.6, 0.8, and 1.0, and specificities ranging from 0.85 to 1.00. A vaccination coverage of 60%, an attack rate of 0.05 for COVID-19 in unvaccinated group, and a true VE of 0.70, were assumed. In this simulation, a COVID-19-like illness with an attack rate of 0.30 could also affect all the studied population regardless of their vaccination status.ResultsThe observed VE ranged from 0.11 (computed for a test sensitivity of 0.60 and specificity of 0.85) to 0.71 (computed for a test sensitivity and specificity of 1.0). The mean computed corrected VE derived from the proposed method was 0.71 (the standard deviation of 0.02).ConclusionsThe observed VE derived from TNCC studies can be corrected easily. An acceptable estimate for VE can be computed regardless of the diagnostic test sensitivity and specificity used in the study.

| S-EPMC10257167 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data