Dataset Information

Changes in incidence rates of outcomes of interest in vaccine safety studies during the COVID-19 pandemic.

ABSTRACT:

Background

The COVID-19 pandemic caused an abrupt drop in in-person health care (inpatient, Emergency Department, outpatient) and an increase in telehealth care, which poses challenges in vaccine safety studies that identify outcomes from in-person encounters. We examined the changes in incidence rates of selected encounter-based outcomes during the COVID-19 pandemic.

Methods

We assembled a cohort of members from 8 Vaccine Safety Datalink sites from January 1, 2017 through December 31, 2020. Using ICD-10 diagnosis codes or laboratory criteria, we identified 21 incident outcomes in traditional in-person settings and all settings. We defined 4 periods in 2020: January-February (pre-pandemic), April-June (early pandemic), July-September (middle pandemic), and October-December (late pandemic). We defined four corresponding periods in each year during 2017-2019. We calculated incidence rates, conducted difference in difference (DiD) analyses, and reported ratios of incidence rate ratios (RRR) to examine changes in rates from pre-pandemic to early, middle, and late pandemic in 2020, after adjusting for changes across similar periods in 2017-2019.

Results

Among > 10 million members, regardless of setting and after adjusting for changes during 2017-2019, we found that incidence rates of acute disseminated encephalomyelitis, encephalitis/myelitis/encephalomyelitis/meningoencephalitis, and thrombotic thrombocytopenic purpura did not significantly change from the pre-pandemic to early, middle or late pandemic periods (p-values ≥ 0.05). Incidence rates decreased from the pre-pandemic to early pandemic period during 2020 for acute myocardial infarction, anaphylaxis, appendicitis, Bell's palsy, convulsions/seizures, Guillain-Barré syndrome, immune thrombocytopenia (ITP), narcolepsy/cataplexy, hemorrhagic stroke, ischemic stroke, and venous thromboembolism (p-values < 0.05). Incidence rates of Bell's palsy, ITP, and narcolepsy/cataplexy were higher in all settings than in traditional in-person settings during the three pandemic periods (p-values < 0.05).

Conclusion

Rates of some clinical outcomes during the pandemic changed and should not be used as historical background rates in vaccine safety studies. Inclusion of telehealth visits should be considered for vaccine studies involving Bell's palsy, ITP, and narcolepsy/cataplexy.

SUBMITTER: Xu S

PROVIDER: S-EPMC9013605 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ObjectiveTo evaluate background incidence rates of 59 health outcomes of interest (HOI) in a diverse population, including important subpopulations, during the pre-COVID-19 era (1 January 2017-31 December 2019) and the COVID-19 era (1 March 2020-31 December 2020), before the introduction of COVID-19 vaccines.DesignObservational retrospective cohort study. Annual incidence rates and 95% confidence intervals (CIs) of HOIs were estimated for each population of interest, stratified by: age, sex, age and sex and seasonality.Data sourceOptum's de-identified Clinformatics Data Mart Database (CDM).ParticipantsIndividuals from the US general population and four subgroups of interest: influenza-vaccinated, paediatric (<18 years of age), elderly (≥65 years of age) and pregnant women.ResultsDuring the COVID-19 era, the incidence of several cardiac conditions, coagulation disorders and acute liver injury increased across all populations assessed while the rates of some dermatological and neurological HOIs decreased relative to the pre-COVID-19 era. The incidence of acute respiratory distress syndrome (ARDS) varied considerably by subgroup: among the elderly, it decreased annually during the pre-COVID-19 era but peaked during the COVID-19 era; among pregnant women, it slightly increased annually during the pre-COVID-19 era and substantially increased during the COVID-19 era; among paediatrics, it decreased annually over the entire study. The incidence of the majority of HOIs increased with age, but were generally comparable between sexes with few exceptions. Cardiac, gastrointestinal, neurological and haematological HOIs, along with acute kidney injury and ARDS, were more common in males, whereas several immunological HOIs and chilblain-like lesions were more common in females. Pregnancy-related HOIs did not increase during the COVID-19 era, except for spontaneous abortions which increased annually over the entire study.ConclusionThese observations help contextualise fluctuations in background rates of adverse events noted during the COVID-19 era, and provide insight on how their use may impact safety surveillance for other vaccines.

Project description:BackgroundDetermining background rates of medical conditions identified as adverse events of special interest (AESI) that may occur following COVID-19 vaccination is important for contextualising and investigating potential vaccine safety signals.MethodsWe conducted a retrospective population-based cohort study using linked emergency department, hospitalisation and death data for 2017 and 2018 from Australia's most populous state, New South Wales. Incident cases of select neurological conditions, arterial or venous thromboembolic conditions, secondary thrombocytopenia, myocarditis/pericarditis, and unique events of anaphylaxis and generalised convulsions were identified using internationally agreed upon diagnostic (ICD-10) codes. State-specific rates per 100,000 person-years were calculated, with further stratification by age group and sex where clinically relevant to the condition, and the number of expected cases nationally in one and 6 weeks was estimated.ResultsBackground rates of selected neurological conditions were low with the exception of generalised convulsions for which 1,599-1,872 cases were estimated nationally in a 1-week period in the absence of vaccination. Using a narrow case definition, rates of Guillain-Barré Syndrome (3.9 per 100,000 person-years) were higher than international rates reported elsewhere. Thromboembolic and cerebral venous sinus thrombosis event rates increased with age. Myocarditis occurred more commonly in males, and was highest in males aged 18-24 years, with an estimated 1-4 cases expected nationally in a 1-week period.ConclusionsUsing routinely collected linked healthcare data provides localised estimates of background rates of new onset or periodic AESI which enables rapid estimation of observed-versus-expected rates of events reported following COVID-19 vaccination. This Australian-specific analysis contributes AESI background rates which can be compared with those from other countries to enhance understanding of geographic variability in the frequency of specific AESI in the absence of vaccination, and can be utilised for signal detection during program implementation.

Project description:IntroductionAdverse events following immunization (AEFIs) are unwanted or unexpected health outcomes following vaccination, which may or may not be causally-linked to vaccines. AEFI reporting is important to post-marketing vaccine safety surveillance and has the potential to identify new or rare AEFIs, show increases in known AEFIs, and help to maintain public confidence in vaccine programs. Knowledge of the expected incidence (i.e. background rate) of a possible AEFI is essential to the investigation of vaccine safety signals. We selected three rarely reported AEFIs representing the spectrum of causal association with vaccines, from proven (immune thrombocytopenia [ITP]) to questioned (Kawasaki disease [KD]) to unsubstantiated (multiple sclerosis [MS]) and determined their background rates.MethodsWe extracted data on hospitalizations (CIHI Discharge Abstract Database) for ITP, KD, and MS among Ontario children for the period 2005 to 2014 from IntelliHEALTH. As ITP can be managed without hospitalization, we also extracted emergency department (ED) visits from the CIHI National Ambulatory Care Reporting System. For all conditions, we only counted the first visit and if the same child had both an ED visit and a hospitalization for ITP, only the hospitalization was included. We calculated rates by year, age group and sex using population estimates from 2005-2014, focusing on age groups within the Ontario immunization schedule around vaccine(s) of interest.ResultsPer 100,000 population, annual age-specific incidence of ITP in children age 1 to 7 years ranged from 8.9 to 12.2 and annual incidence of KD in children less than 5 years ranged from 19.1 to 32.1. Average annualized incidence of adolescent (11-17 years) MS across the study period was 0.8 per 100,000.DiscussionDespite limitations, including lack of clinical validation, this study provides an example of how health administrative data can be used to determine background rates which may assist with interpretation of passive vaccine safety surveillance.

Project description:BackgroundThe U.S. Food and Drug Administration (FDA) Biologics Effectiveness and Safety (BEST) Initiative conducts active surveillance of adverse events of special interest (AESI) after COVID-19 vaccination. Historical incidence rates (IRs) of AESI are comparators to evaluate safety.MethodsWe estimated IRs of 17 AESI in six administrative claims databases from January 1, 2019, to December 11, 2020: Medicare claims for adults ≥ 65 years and commercial claims (Blue Health Intelligence®, CVS Health, HealthCore Integrated Research Database, IBM® MarketScan® Commercial Database, Optum pre-adjudicated claims) for adults < 65 years. IRs were estimated by sex, age, race/ethnicity (Medicare), and nursing home residency (Medicare) in 2019 and for specific periods in 2020.ResultsThe study included >100 million enrollees annually. In 2019, rates of most AESI increased with age. However, compared with commercially insured adults, Medicare enrollees had lower IRs of anaphylaxis (11 vs 12-19 per 100,000 person-years), appendicitis (80 vs 117-155), and narcolepsy (38 vs 41-53). Rates were higher in males than females for most AESI across databases and varied by race/ethnicity and nursing home status (Medicare). Acute myocardial infarction (Medicare) and anaphylaxis (all databases) IRs varied by season. IRs of most AESI were lower during March-May 2020 compared with March-May 2019 but returned to pre-pandemic levels after May 2020. However, rates of Bell's palsy, Guillain-Barré syndrome, narcolepsy, and hemorrhagic/non-hemorrhagic stroke remained lower in multiple databases after May 2020, whereas some AESI (e.g., disseminated intravascular coagulation) exhibited higher rates after May 2020 compared with 2019.ConclusionAESI background rates varied by database and demographics and fluctuated in March-December 2020, but most returned to pre-pandemic levels after May 2020. It is critical to standardize demographics and consider seasonal and other trends when comparing historical rates with post-vaccination AESI rates in the same database to evaluate COVID-19 vaccine safety.

Project description:ImportanceSchool closures because of COVID-19 have left 1.6 billion students around the world without in-person classes for a prolonged period. To our knowledge, no study has documented whether reopening schools in low- and middle-income countries during the pandemic was associated with increased aggregate COVID-19 incidence and mortality with appropriate counterfactuals.ObjectiveTo test whether reopening schools under appropriate protocols during the COVID-19 pandemic was associated with increased municipal-level COVID-19 cases and deaths in São Paulo State, Brazil.Design setting and participantsThis observational study of municipalities in São Paulo State, Brazil, uses a difference-in-differences analysis to examine the association between municipal decisions to reopen schools during the COVID-19 pandemic and municipal-level COVID-19 case and death rates between October and December 2020. The study compared 129 municipalities that reopened schools in 2020 with 514 that did not and excluded data for 2 municipalities that reopened schools and closed then again.Main outcomes and measuresNew COVID-19 cases and deaths per 10 000 inhabitants up to 12 weeks after school reopenings and municipal-level aggregate mobility for a subset of municipalities.ResultsThere were 8764 schools in the 129 municipalities that reopened schools compared with 9997 in the control group of 514 municipalities that did not reopen schools. The municipalities that reopened schools had a cumulative COVID-19 incidence of 20 cases per 1000 inhabitants and mortality of 0.5 deaths per 1000 inhabitants in September 2020 (the baseline period) compared with an incidence of 18 cases per 1000 inhabitants and mortality of 0.45 deaths per 1000 inhabitants during the baseline period in the comparison group. The findings indicated that there were no statistically significant differences between municipalities that authorized schools to reopen and those that did not for (1) weekly new cases (difference-in-differences, -0.03; 95% CI, -0.09 to 0.03) and (2) weekly new deaths (difference-in-differences, -0.003; 95% CI, -0.011 to 0.004) before and after October 2020. Reopening schools was not associated with higher disease activity, even in relatively vulnerable municipalities, nor aggregate mobility.Conclusions and relevanceThe findings from this study suggest that keeping schools open during the COVID-19 pandemic did not contribute to the aggregate disease activity.