Dataset Information

Design characteristics and statistical methods used in interrupted time series studies evaluating public health interventions: protocol for a review.

ABSTRACT: INTRODUCTION:An interrupted time series (ITS) design is an important observational design used to examine the effects of an intervention or exposure. This design has particular utility in public health where it may be impracticable or infeasible to use a randomised trial to evaluate health system-wide policies, or examine the impact of exposures (such as earthquakes). There have been relatively few studies examining the design characteristics and statistical methods used to analyse ITS designs. Further, there is a lack of guidance to inform the design and analysis of ITS studies.This is the first study in a larger project that aims to provide tools and guidance for researchers in the design and analysis of ITS studies. The objectives of this study are to (1) examine and report the design characteristics and statistical methods used in a random sample of contemporary ITS studies examining public health interventions or exposures that impact on health-related outcomes, and (2) create a repository of time series data extracted from ITS studies. Results from this study will inform the remainder of the project which will investigate the performance of a range of commonly used statistical methods, and create a repository of input parameters required for sample size calculation. METHODS AND ANALYSIS:We will collate 200 ITS studies evaluating public health interventions or the impact of exposures. ITS studies will be identified from a search of the bibliometric database PubMed between the years 2013 and 2017, combined with stratified random sampling. From eligible studies, we will extract study characteristics, details of the statistical models and estimation methods, effect metrics and parameter estimates. Further, we will extract the time series data when available. We will use systematic review methods in the screening, application of inclusion and exclusion criteria, and extraction of data. Descriptive statistics will be used to summarise the data. ETHICS AND DISSEMINATION:Ethics approval is not required since information will only be extracted from published studies. Dissemination of the results will be through peer-reviewed publications and presentations at conferences. A repository of data extracted from the published ITS studies will be made publicly available.

SUBMITTER: Turner SL

PROVIDER: S-EPMC6352832 | biostudies-literature | 2019 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Design characteristics and statistical methods used in interrupted time series studies evaluating public health interventions: protocol for a review.

Turner Simon L SL Karahalios Amalia A Forbes Andrew B AB Taljaard Monica M Grimshaw Jeremy M JM Cheng Allen C AC Bero Lisa L McKenzie Joanne E JE

BMJ open 20190128 1

<h4>Introduction</h4>An interrupted time series (ITS) design is an important observational design used to examine the effects of an intervention or exposure. This design has particular utility in public health where it may be impracticable or infeasible to use a randomised trial to evaluate health system-wide policies, or examine the impact of exposures (such as earthquakes). There have been relatively few studies examining the design characteristics and statistical methods used to analyse ITS d ...[more]

PMID: 30696676

Similar Datasets

Project description:BackgroundThe Interrupted Time Series (ITS) is a robust design for evaluating public health and policy interventions or exposures when randomisation may be infeasible. Several statistical methods are available for the analysis and meta-analysis of ITS studies. We sought to empirically compare available methods when applied to real-world ITS data.MethodsWe sourced ITS data from published meta-analyses to create an online data repository. Each dataset was re-analysed using two ITS estimation methods. The level- and slope-change effect estimates (and standard errors) were calculated and combined using fixed-effect and four random-effects meta-analysis methods. We examined differences in meta-analytic level- and slope-change estimates, their 95% confidence intervals, p-values, and estimates of heterogeneity across the statistical methods.ResultsOf 40 eligible meta-analyses, data from 17 meta-analyses including 282 ITS studies were obtained (predominantly investigating the effects of public health interruptions (88%)) and analysed. We found that on average, the meta-analytic effect estimates, their standard errors and between-study variances were not sensitive to meta-analysis method choice, irrespective of the ITS analysis method. However, across ITS analysis methods, for any given meta-analysis, there could be small to moderate differences in meta-analytic effect estimates, and important differences in the meta-analytic standard errors. Furthermore, the confidence interval widths and p-values for the meta-analytic effect estimates varied depending on the choice of confidence interval method and ITS analysis method.ConclusionsOur empirical study showed that meta-analysis effect estimates, their standard errors, confidence interval widths and p-values can be affected by statistical method choice. These differences may importantly impact interpretations and conclusions of a meta-analysis and suggest that the statistical methods are not interchangeable in practice.

Project description:BackgroundThe long-term impact of COVID-19-associated public health interventions on zoonotic and vector-borne infectious diseases (ZVBs) remains uncertain. This study sought to examine the changes in ZVBs in China during the COVID-19 pandemic and predict their future trends.MethodsMonthly incidents of seven ZVBs (Hemorrhagic fever with renal syndrome [HFRS], Rabies, Dengue fever [DF], Human brucellosis [HB], Leptospirosis, Malaria, and Schistosomiasis) were gathered from January 2004 to July 2023. An autoregressive fractionally integrated moving average (ARFIMA) by incorporating the COVID-19-associated public health intervention variables was developed to evaluate the long-term effectiveness of interventions and forecast ZVBs epidemics from August 2023 to December 2025.ResultsOver the study period, there were 1,599,647 ZVBs incidents. HFRS and rabies exhibited declining trends, HB showed an upward trajectory, while the others remained relatively stable. The ARFIMA, incorporating a pulse pattern, estimated the average monthly number of changes of - 83 (95% confidence interval [CI] - 353-189) cases, - 3 (95% CI - 33-29) cases, - 468 (95% CI - 1531-597) cases, 2191 (95% CI 1056-3326) cases, 7 (95% CI - 24-38) cases, - 84 (95% CI - 222-55) cases, and - 214 (95% CI - 1036-608) cases for HFRS, rabies, DF, HB, leptospirosis, malaria, and schistosomiasis, respectively, although these changes were not statistically significant besides HB. ARFIMA predicted a decrease in HB cases between August 2023 and December 2025, while indicating a relative plateau for the others.ConclusionsChina's dynamic zero COVID-19 strategy may have exerted a lasting influence on HFRS, rabies, DF, malaria, and schistosomiasis, beyond immediate consequences, but not affect HB and leptospirosis. ARFIMA emerges as a potent tool for intervention analysis, providing valuable insights into the sustained effectiveness of interventions. Consequently, the application of ARFIMA contributes to informed decision-making, the design of effective interventions, and advancements across various fields.

Dataset Information

Design characteristics and statistical methods used in interrupted time series studies evaluating public health interventions: protocol for a review.

Publications

Design characteristics and statistical methods used in interrupted time series studies evaluating public health interventions: protocol for a review.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets