Dataset Information

Confidence interval methods for antimicrobial resistance surveillance data.

ABSTRACT:

Background

Antimicrobial resistance (AMR) is one of the greatest global health challenges today, but burden assessment is hindered by uncertainty of AMR prevalence estimates. Geographical representation of AMR estimates typically pools data collected from several laboratories; however, these aggregations may introduce bias by not accounting for the heterogeneity of the population that each laboratory represents.

Methods

We used AMR data from up to 381 laboratories in the United States from The Surveillance Network to evaluate methods for estimating uncertainty of AMR prevalence estimates. We constructed confidence intervals for the proportion of resistant isolates using (1) methods that account for the clustered structure of the data, and (2) standard methods that assume data independence. Using samples of the full dataset with increasing facility coverage levels, we examined how likely the estimated confidence intervals were to include the population mean.

Results

Methods constructing 95% confidence intervals while accounting for possible within-cluster correlations (Survey and standard methods adjusted to employ cluster-robust errors), were more likely to include the sample mean than standard methods (Logit, Wilson score and Jeffreys interval) operating under the assumption of independence. While increased geographical coverage improved the probability of encompassing the mean for all methods, large samples still did not compensate for the bias introduced from the violation of the data independence assumption.

Conclusion

General methods for estimating the confidence intervals of AMR rates that assume data are independent, are likely to produce biased results. When feasible, the clustered structure of the data and any possible intra-cluster variation should be accounted for when calculating confidence intervals around AMR estimates, in order to better capture the uncertainty of prevalence estimates.

SUBMITTER: Kalanxhi E

PROVIDER: S-EPMC8191092 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThe intraclass correlation coefficient (ICC) is widely used in biomedical research to assess the reproducibility of measurements between raters, labs, technicians, or devices. For example, in an inter-rater reliability study, a high ICC value means that noise variability (between-raters and within-raters) is small relative to variability from patient to patient. A confidence interval or Bayesian credible interval for the ICC is a commonly reported summary. Such intervals can be constructed employing either frequentist or Bayesian methodologies.MethodsThis study examines the performance of three different methods for constructing an interval in a two-way, crossed, random effects model without interaction: the Generalized Confidence Interval method (GCI), the Modified Large Sample method (MLS), and a Bayesian method based on a noninformative prior distribution (NIB). Guidance is provided on interval construction method selection based on study design, sample size, and normality of the data. We compare the coverage probabilities and widths of the different interval methods.ResultsWe show that, for the two-way, crossed, random effects model without interaction, care is needed in interval method selection because the interval estimates do not always have properties that the user expects. While different methods generally perform well when there are a large number of levels of each factor, large differences between the methods emerge when the number of one or more factors is limited. In addition, all methods are shown to lack robustness to certain hard-to-detect violations of normality when the sample size is limited.ConclusionsDecision rules and software programs for interval construction are provided for practical implementation in the two-way, crossed, random effects model without interaction. All interval methods perform similarly when the data are normal and there are sufficient numbers of levels of each factor. The MLS and GCI methods outperform the NIB when one of the factors has a limited number of levels and the data are normally distributed or nearly normally distributed. None of the methods work well if the number of levels of a factor are limited and data are markedly non-normal. The software programs are implemented in the popular R language.

Project description:BackgroundThe World Health Organization recommends changing the first-line antimicrobial treatment for gonorrhoea when ≥ 5% of Neisseria gonorrhoeae cases fail treatment or are resistant. Susceptibility to ceftriaxone, the last remaining treatment option has been decreasing in many countries. We used antimicrobial resistance surveillance data and developed mathematical models to project the time to reach the 5% threshold for resistance to first-line antimicrobials used for N. gonorrhoeae.MethodsWe used data from the Gonococcal Resistance to Antimicrobials Surveillance Programme (GRASP) in England and Wales from 2000-2018 about minimum inhibitory concentrations (MIC) for ciprofloxacin, azithromycin, cefixime and ceftriaxone and antimicrobial treatment in two groups, heterosexual men and women (HMW) and men who have sex with men (MSM). We developed two susceptible-infected-susceptible models to fit these data and produce projections of the proportion of resistance until 2030. The single-step model represents the situation in which a single mutation results in antimicrobial resistance. In the multi-step model, the sequential accumulation of resistance mutations is reflected by changes in the MIC distribution.ResultsThe single-step model described resistance to ciprofloxacin well. Both single-step and multi-step models could describe azithromycin and cefixime resistance, with projected resistance levels higher with the multi-step than the single step model. For ceftriaxone, with very few observed cases of full resistance, the multi-step model was needed to describe long-term dynamics of resistance. Extrapolating from the observed upward drift in MIC values, the multi-step model projected ≥ 5% resistance to ceftriaxone could be reached by 2030, based on treatment pressure alone. Ceftriaxone resistance was projected to rise to 13.2% (95% credible interval [CrI]: 0.7-44.8%) among HMW and 19.6% (95%CrI: 2.6-54.4%) among MSM by 2030.ConclusionsNew first-line antimicrobials for gonorrhoea treatment are needed. In the meantime, public health authorities should strengthen surveillance for AMR in N. gonorrhoeae and implement strategies for continued antimicrobial stewardship. Our models show the utility of long-term representative surveillance of gonococcal antimicrobial susceptibility data and can be adapted for use in, and for comparison with, other countries.

Project description:When data is derived under a single or multiple lower limits of quantification (LLOQ), estimation of distribution parameters as well as precision of these estimates appear to be challenging, as the way to account for unquantifiable observations due to LLOQs needs particular attention. The aim of this investigation is to characterize the precision of censored sample maximum likelihood estimates of the mean for normal, exponential and Poisson distribution affected by one or two LLOQs using confidence intervals (CI). In a simulation study, asymptotic and bias-corrected accelerated bootstrap CIs for the location parameter mean are compared with respect to coverage proportion and interval width. To enable this examination, we derived analytical expressions of the maximum likelihood location parameter estimate for the assumption of exponentially and Poisson distributed data, where the censored sample method and simple imputation method are used to account for LLOQs. Additionally, we vary the proportion of observations below the LLOQs. When based on the censored sample estimate, the bootstrap CI led to higher coverage proportions and narrower interval width than the asymptotic CI. The results differed by underlying distribution. Under the assumption of normality, the CI's coverage proportion and width suffered most from high proportions of unquantifiable observations. For exponentially and Poisson distributed data, both CI approaches delivered similar results. To derive the CIs, the point estimates from the censored sample method are preferable, because the point estimate of the simple imputation method leads to higher bias for all investigated distributions. This biased simple imputation estimate impairs the coverage proportion of the respective CI. The bootstrap CI surpassed the asymptotic CIs with respect to coverage proportion for the investigated choice of distributional assumptions. The variety of distributions for which the methods are suitable gives the applicant a widely usable tool to handle LLOQ affected data with appropriate approaches.