Dataset Information

Validation of syndromic surveillance for respiratory pathogen activity.

ABSTRACT: Syndromic surveillance is increasingly used to signal unusual illness events. To validate data-source selection, we retrospectively investigated the extent to which 6 respiratory syndromes (based on different medical registries) reflected respiratory pathogen activity. These syndromes showed higher levels in winter, which corresponded with higher laboratory counts of Streptococcus pneumoniae, respiratory syncytial virus, and influenza virus. Multiple linear regression models indicated that most syndrome variations (up to 86%) can be explained by counts of respiratory pathogens. Absenteeism and pharmacy syndromes might reflect nonrespiratory conditions as well. We also observed systematic syndrome elevations in the fall, which were unexplained by pathogen counts but likely reflected rhinovirus activity. Earliest syndrome elevations were observed in absenteeism data, followed by hospital data (+1 week), pharmacy/general practitioner consultations (+2 weeks), and deaths/laboratory submissions (test requests) (+3 weeks). We conclude that these syndromes can be used for respiratory syndromic surveillance, since they reflect patterns in respiratory pathogen activity.

SUBMITTER: van den Wijngaard C

PROVIDER: S-EPMC2600280 | biostudies-literature | 2008 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Validation of syndromic surveillance for respiratory pathogen activity.

van den Wijngaard Cees C van Asten Liselotte L van Pelt Wilfrid W Nagelkerke Nico J D NJ Verheij Robert R de Neeling Albert J AJ Dekkers Arnold A van der Sande Marianne A B MA van Vliet Hans H Koopmans Marion P G MP

Emerging infectious diseases 20080601 6

Syndromic surveillance is increasingly used to signal unusual illness events. To validate data-source selection, we retrospectively investigated the extent to which 6 respiratory syndromes (based on different medical registries) reflected respiratory pathogen activity. These syndromes showed higher levels in winter, which corresponded with higher laboratory counts of Streptococcus pneumoniae, respiratory syncytial virus, and influenza virus. Multiple linear regression models indicated that most ...[more]

PMID: 18507902

Similar Datasets

Project description:BackgroundAlthough syndromic surveillance is increasingly used to detect unusual illness, there is a debate whether it is useful for detecting local outbreaks. We evaluated whether syndromic surveillance detects local outbreaks of lower-respiratory infections (LRIs) without swamping true signals by false alarms.Methods and findingsUsing retrospective hospitalization data, we simulated prospective surveillance for LRI-elevations. Between 1999-2006, a total of 290762 LRIs were included by date of hospitalization and patients place of residence (>80% coverage, 16 million population). Two large outbreaks of Legionnaires disease in the Netherlands were used as positive controls to test whether these outbreaks could have been detected as local LRI elevations. We used a space-time permutation scan statistic to detect LRI clusters. We evaluated how many LRI-clusters were detected in 1999-2006 and assessed likely causes for the cluster-signals by looking for significantly higher proportions of specific hospital discharge diagnoses (e.g. Legionnaires disease) and overlap with regional influenza elevations. We also evaluated whether the number of space-time signals can be reduced by restricting the scan statistic in space or time. In 1999-2006 the scan-statistic detected 35 local LRI clusters, representing on average 5 clusters per year. The known Legionnaires' disease outbreaks in 1999 and 2006 were detected as LRI-clusters, since cluster-signals were generated with an increased proportion of Legionnaires disease patients (p:<0.0001). 21 other clusters coincided with local influenza and/or respiratory syncytial virus activity, and 1 cluster appeared to be a data artifact. For 11 clusters no likely cause was defined, some possibly representing as yet undetected LRI-outbreaks. With restrictions on time and spatial windows the scan statistic still detected the Legionnaires' disease outbreaks, without loss of timeliness and with less signals generated in time (up to 42% decline).ConclusionsTo our knowledge this is the first study that systematically evaluates the performance of space-time syndromic surveillance with nationwide high coverage data over a longer period. The results show that syndromic surveillance can detect local LRI-outbreaks in a timely manner, independent of laboratory-based outbreak detection. Furthermore, since comparatively few new clusters per year were observed that would prompt investigation, syndromic hospital-surveillance could be a valuable tool for detection of local LRI-outbreaks.

Project description:BackgroundInternet data can be used to improve infectious disease models. However, the representativeness and individual-level validity of internet-derived measures are largely unexplored as this requires ground truth data for study.ObjectiveThis study sought to identify relationships between Web-based behaviors and/or conversation topics and health status using a ground truth, survey-based dataset.MethodsThis study leveraged a unique dataset of self-reported surveys, microbiological laboratory tests, and social media data from the same individuals toward understanding the validity of individual-level constructs pertaining to influenza-like illness in social media data. Logistic regression models were used to identify illness in Twitter posts using user posting behaviors and topic model features extracted from users' tweets.ResultsOf 396 original study participants, only 81 met the inclusion criteria for this study. Of these participants' tweets, we identified only two instances that were related to health and occurred within 2 weeks (before or after) of a survey indicating symptoms. It was not possible to predict when participants reported symptoms using features derived from topic models (area under the curve [AUC]=0.51; P=.38), though it was possible using behavior features, albeit with a very small effect size (AUC=0.53; P≤.001). Individual symptoms were also generally not predictable either. The study sample and a random sample from Twitter are predictably different on held-out data (AUC=0.67; P≤.001), meaning that the content posted by people who participated in this study was predictably different from that posted by random Twitter users. Individuals in the random sample and the GoViral sample used Twitter with similar frequencies (similar @ mentions, number of tweets, and number of retweets; AUC=0.50; P=.19).ConclusionsTo our knowledge, this is the first instance of an attempt to use a ground truth dataset to validate infectious disease observations in social media data. The lack of signal, the lack of predictability among behaviors or topics, and the demonstrated volunteer bias in the study population are important findings for the large and growing body of disease surveillance using internet-sourced data.

Project description:BackgroundAs next generation sequence technology has advanced, there have been parallel advances in genome-scale analysis programs for determining evolutionary relationships as proxies for epidemiological relationship in public health. Most new programs skip traditional steps of ortholog determination and multi-gene alignment, instead identifying variants across a set of genomes, then summarizing results in a matrix of single-nucleotide polymorphisms or alleles for standard phylogenetic analysis. However, public health authorities need to document the performance of these methods with appropriate and comprehensive datasets so they can be validated for specific purposes, e.g., outbreak surveillance. Here we propose a set of benchmark datasets to be used for comparison and validation of phylogenomic pipelines.MethodsWe identified four well-documented foodborne pathogen events in which the epidemiology was concordant with routine phylogenomic analyses (reference-based SNP and wgMLST approaches). These are ideal benchmark datasets, as the trees, WGS data, and epidemiological data for each are all in agreement. We have placed these sequence data, sample metadata, and "known" phylogenetic trees in publicly-accessible databases and developed a standard descriptive spreadsheet format describing each dataset. To facilitate easy downloading of these benchmarks, we developed an automated script that uses the standard descriptive spreadsheet format.ResultsOur "outbreak" benchmark datasets represent the four major foodborne bacterial pathogens (Listeria monocytogenes, Salmonella enterica, Escherichia coli, and Campylobacter jejuni) and one simulated dataset where the "known tree" can be accurately called the "true tree". The downloading script and associated table files are available on GitHub: https://github.com/WGS-standards-and-analysis/datasets.DiscussionThese five benchmark datasets will help standardize comparison of current and future phylogenomic pipelines, and facilitate important cross-institutional collaborations. Our work is part of a global effort to provide collaborative infrastructure for sequence data and analytic tools-we welcome additional benchmark datasets in our recommended format, and, if relevant, we will add these on our GitHub site. Together, these datasets, dataset format, and the underlying GitHub infrastructure present a recommended path for worldwide standardization of phylogenomic pipelines.

Project description:Mass gatherings frequently include close, prolonged interactions between people, which presents opportunities for infectious disease transmission. Over 20,000 pilgrims gathered at Namugongo Catholic and Protestant shrines to commemorate 2022 Uganda Martyr's Day. We described syndromes suggestive of key priority diseases particularly COVID-19 and viral hemorrhagic fever (VHF) among visiting pilgrims during May 25-June 5, 2022. We conducted a survey among pilgrims at the catholic and protestant shrines based on signs and symptoms for key priority diseases: COVID-19 and VHF. A suspected COVID-19 case was defined as acute respiratory illness (temperature greater 37.5°C and at least one sign/symptom of respiratory infection such as cough or shortness of breath) whereas a suspected VHF case was defined as fever >37.5°C and unexplained bleeding among pilgrims who visited Namugongo Catholic and Protestant shrines from May 25 to June 5, 2022. Pilgrims were sampled systematically at entrances and demarcated zonal areas to participate in the survey. Additionally, we extracted secondary data on pilgrims who sought emergency medical services from Health Management Information System registers. Descriptive analysis was conducted to identify syndromes suggestive of key priority diseases. Among 1,350 pilgrims interviewed, 767 (57%) were female. The mean age was 37.9 (±17.9) years. Nearly all pilgrims 1,331 (98.6%) were Ugandans. A total of 236 (18%) reported ≥1 case definition symptom and 42 (3%) reported ≥2 symptoms. Thirty-nine (2.9%) were suspected COVID-19 cases and three (0.2%) were suspected VHF cases from different regions of Uganda. Among 5,582 pilgrims who sought medical care from tents, 628 (11.3%) had suspected COVID-19 and one had suspected VHF. Almost one in fifty pilgrims at the 2022 Uganda Martyrs' commemoration had at least one symptom of COVID-19 or VHF. Intensified syndromic surveillance and planned laboratory testing capacity at mass gatherings is important for early detection of public health emergencies that could stem from such events.

Project description:BackgroundSymptomatic patients who test negative for common viruses are an important possible source of unrecognised or emerging pathogens, but metagenomic sequencing of all samples is inefficient because of the low likelihood of finding a pathogen in any given sample. We aimed to determine whether nasopharyngeal CXCL10 screening could be used as a strategy to enrich for samples containing undiagnosed viruses.MethodsIn this pathogen surveillance and detection study, we measured CXCL10 concentrations from nasopharyngeal swabs from patients in the Yale New Haven health-care system, which had been tested at the Yale New Haven Hospital Clinical Virology Laboratory (New Haven, CT, USA). Patients who tested negative for a panel of respiratory viruses using multiplex PCR during Jan 23-29, 2017, or March 3-14, 2020, were included. We performed host and pathogen RNA sequencing (RNA-Seq) and analysis for viral reads on samples with CXCL10 higher than 1 ng/mL or CXCL10 testing and quantitative RT-PCR (RT-qPCR) for SARS-CoV-2. We used RNA-Seq and cytokine profiling to compare the host response to infection in samples that were virus positive (rhinovirus, seasonal coronavirus CoV-NL63, or SARS-CoV-2) and virus negative (controls).FindingsDuring Jan 23-29, 2017, 359 samples were tested for ten viruses on the multiplex PCR respiratory virus panel (RVP). 251 (70%) were RVP negative. 60 (24%) of 251 samples had CXCL10 higher than 150 pg/mL and were identified for further analysis. 28 (47%) of 60 CXCL10-high samples were positive for seasonal coronaviruses. 223 (89%) of 251 samples were PCR negative for 15 viruses and, of these, CXCL10-based screening identified 32 (13%) samples for further analysis. Of these 32 samples, eight (25%) with CXCL10 concentrations higher than 1 ng/mL and sufficient RNA were selected for RNA-Seq. Microbial RNA analysis showed the presence of influenza C virus in one sample and revealed RNA reads from bacterial pathobionts in four (50%) of eight samples. Between March 3 and March 14, 2020, 375 (59%) of 641 samples tested negative for 15 viruses on the RVP. 32 (9%) of 375 samples had CXCL10 concentrations ranging from 100 pg/mL to 1000 pg/mL and four of those were positive for SARS-CoV-2. CXCL10 elevation was statistically significant, and a distinguishing feature was found in 28 (8%) of 375 SARS-CoV-2-negative samples versus all four SARS-CoV-2-positive samples (p=4·4 × 10-5). Transcriptomic signatures showed an interferon response in virus-positive samples and an additional neutrophil-high hyperinflammatory signature in samples with high amounts of bacterial pathobionts. The CXCL10 cutoff for detecting a virus was 166·5 pg/mL for optimal sensitivity and 1091·0 pg/mL for specificity using a clinic-ready automated microfluidics-based immunoassay.InterpretationThese results confirm CXCL10 as a robust nasopharyngeal biomarker of viral respiratory infection and support host response-based screening followed by metagenomic sequencing of CXCL10-high samples as a practical approach to incorporate clinical samples into pathogen discovery and surveillance efforts.FundingNational Institutes of Health, the Hartwell Foundation, the Gruber Foundation, Fast Grants for COVID-19 research from the Mercatus Center, and the Huffman Family Donor Advised Fund.

Dataset Information

Validation of syndromic surveillance for respiratory pathogen activity.

Publications

Validation of syndromic surveillance for respiratory pathogen activity.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets