Outlier Detection in Urban Air Quality Sensor Networks.
Ontology highlight
ABSTRACT:
SUBMITTER: van Zoest VM
PROVIDER: S-EPMC5843703 | biostudies-literature | 2018
REPOSITORIES: biostudies-literature
Publications
Outlier Detection in Urban Air Quality Sensor Networks.
van Zoest V M VM Stein A A Hoek G G
Water, air, and soil pollution 20180308 4
Low-cost urban air quality sensor networks are increasingly used to study the spatio-temporal variability in air pollutant concentrations. Recently installed low-cost urban sensors, however, are more prone to result in erroneous data than conventional monitors, e.g., leading to outliers. Commonly applied outlier detection methods are unsuitable for air pollutant measurements that have large spatial and temporal variations as occur in urban areas. We present a novel outlier detection method based ...[more]
Similar Datasets
Project description:Sensor networks in real-world environments, such as smart cities or ambient intelligent platforms, provide applications with large and heterogeneous sets of data streams. Outliers-observations that do not conform to an expected behavior-has then turned into a crucial task to establish and maintain secure and reliable databases in this kind of platforms. However, the procedures to obtain accurate models for erratic observations have to operate with low complexity in terms of storage and computational time, in order to attend the limited processing and storage capabilities of the sensor nodes in these environments. In this work, we analyze three binary classifiers based on three statistical prediction models-ARIMA (Auto-Regressive Integrated Moving Average), GAM (Generalized Additive Model), and LOESS (LOcal RegrESSion)-for outlier detection with low memory consumption and computational time rates. As a result, we provide (1) the best classifier and settings to detect outliers, based on the ARIMA model, and (2) two real-world classified datasets as ground truths for future research.
| S-EPMC7436267 | biostudies-literature
Project description:In this paper, we study the air quality monitoring and improvement system based on wireless sensor and actuator network using LoRa communication. The proposed system is divided into two parts, indoor cluster and outdoor cluster, managed by a Dragino LoRa gateway. Each indoor sensor node can receive information about the temperature, humidity, air quality, dust concentration in the air and transmit them to the gateway. The outdoor sensor nodes have the same functionality, add the ability to use solar power, and are waterproof. The full-duplex relay LoRa modules which are embedded FreeRTOS are arranged to forward information from the nodes they manage to the gateway via uplink LoRa. The gateway collects and processes all of the system information and makes decisions to control the actuator to improve the air quality through the downlink LoRa. We build data management and analysis online software based on The Things Network and TagoIO platform. The system can operate with a coverage of 8.5 km, where optimal distances are established between sensor nodes and relay nodes and between relay nodes and gateways at 4.5 km and 4 km, respectively. Experimental results observed that the packet loss rate in real-time is less than 0.1% prove the effectiveness of the proposed system.
| S-EPMC8459792 | biostudies-literature
Project description:Analyses of the relationships between climate, air substances and health usually concentrate on urban environments because of increased urban temperatures, high levels of air pollution and the exposure of a large number of people compared to rural environments. Ongoing urbanization, demographic ageing and climate change lead to an increased vulnerability with respect to climate-related extremes and air pollution. However, systematic analyses of the specific local-scale characteristics of health-relevant atmospheric conditions and compositions in urban environments are still scarce because of the lack of high-resolution monitoring networks. In recent years, low-cost sensors (LCS) became available, which potentially provide the opportunity to monitor atmospheric conditions with a high spatial resolution and which allow monitoring directly at vulnerable people. In this study, we present the atmospheric exposure low-cost monitoring (AELCM) system for several air substances like ozone, nitrogen dioxide, carbon monoxide and particulate matter, as well as meteorological variables developed by our research group. The measurement equipment is calibrated using multiple linear regression and extensively tested based on a field evaluation approach at an urban background site using the high-quality measurement unit, the atmospheric exposure monitoring station (AEMS) for meteorology and air substances, of our research group. The field evaluation took place over a time span of 4 to 8 months. The electrochemical ozone sensors (SPEC DGS-O3: R2: 0.71-0.95, RMSE: 3.31-7.79 ppb) and particulate matter sensors (SPS30 PM1/PM2.5: R2: 0.96-0.97/0.90-0.94, RMSE: 0.77-1.07 µg/m3/1.27-1.96 µg/m3) showed the best performances at the urban background site, while the other sensors underperformed tremendously (SPEC DGS-NO2, SPEC DGS-CO, MQ131, MiCS-2714 and MiCS-4514). The results of our study show that meaningful local-scale measurements are possible with the former sensors deployed in an AELCM unit.
| S-EPMC9144299 | biostudies-literature
Project description:Urban environments represent the most intense human-environment interaction. This interaction can result in negative outcomes like air pollution and its health implications. There is a significant data deficit in air quality monitoring across many developing nations, which prevents effective policies and measures from being taken to promote the accomplishment of sustainable development. Around the world, lichens have been used to track environmental changes due to their sensitivity to changes and concentration of atmospheric pollutants. This study investigated the relationships between lichen and air quality across some Nigerian cities. Lichen surveys were conducted in four cities. At various periods during the day, NO2, SO2, PM2.5, and PM10 levels were measured. Association rule mining was carried out to investigate the relationship between lichen found and air quality categories. Results showed that the most prevalent lichen Genera are Pyxine in Abuja and Kano, Diorygma in Lagos, and Dirinaria in Port Harcourt. Out of the 40 rules found from the rule mining, 17 are important (lift values ≥ 1.1), capturing six of the fourteen lichen genera identified in the field. The findings indicated that there are important relationships between lichens and air quality indices, suggesting that some lichen species in Nigeria may serve as indicators of long-term air quality. To develop a network of urban environmental quality bioindicators across Nigerian cities, surveying and transplanting are advised. The use of lichen for air quality monitoring can provide information for sustainable management of air quality and environmental quality in Nigeria.
| S-EPMC9898642 | biostudies-literature
Project description:Wireless sensor networks (WSNs) are ubiquitous and pervasive, and therefore; highly susceptible to a number of security attacks. Denial of Service (DoS) attack is considered the most dominant and a major threat to WSNs. Moreover, the wormhole attack represents one of the potential forms of the Denial of Service (DoS) attack. Besides, crafting the wormhole attack is comparatively simple; though, its detection is nontrivial. On the contrary, the extant wormhole defense methods need both specialized hardware and strong assumptions to defend against static and dynamic wormhole attack. The ensuing paper introduces a novel scheme to detect wormhole attacks in a geographic routing protocol (DWGRP). The main contribution of this paper is to detect malicious nodes and select the best and the most reliable neighbors based on pairwise key pre-distribution technique and the beacon packet. Moreover, this novel technique is not subject to any specific assumption, requirement, or specialized hardware, such as a precise synchronized clock. The proposed detection method is validated by comparisons with several related techniques in the literature, such as Received Signal Strength (RSS), Authentication of Nodes Scheme (ANS), Wormhole Detection uses Hound Packet (WHOP), and Wormhole Detection with Neighborhood Information (WDI) using the NS-2 simulator. The analysis of the simulations shows promising results with low False Detection Rate (FDR) in the geographic routing protocols.
| S-EPMC4300191 | biostudies-literature
Project description:Air quality in European cities is still a challenge, with various urban areas frequently exceeding the PM2.5 and NO2 concentration levels allowed by the European Union Air Quality Standards. This is a problem both in terms of legislation compliance, but also in terms of health of citizens, as it has been recently estimated that 400 to 450 thousand people die prematurely every year due to poor air quality. Air quality in cities can be improved with a number of interventions, at different sectoral (industry, traffic, residential, etc …) and geographical (international, European, national, local, etc.) levels. In this paper we explore the potential of city level plans to improve mobility and air quality (excluding electro-mobility options, not considered in this study). We applied the "Sustainable Urban Mobility Plans" (SUMPs) framework to 642 cities in Europe and modelled how the measures they include may impact at first on mobility and emissions at urban level, and then on urban background concentrations of PM2.5 and NO2. Results show that annual averages moderately improve for both pollutants, with reductions of urban background concentrations up to 2% for PM2.5 and close to 4% for NO2. The impact on NO2 at street level (that will be higher than on urban background) is not evaluated in this work. The air quality improvement of the simulated SUMP would only partially alleviate air quality problems in urban areas, but such a reduction in the emissions of air pollutants should still be considered as a positive result of SUMPs, given that they correspond to a set of low-cost measures that can be implemented at local level. Furthermore, the introduction of electro-mobility options (not considered here) would increase the impact on air quality. Other types of benefits, such as reduced fuel consumption, greenhouse gas emissions, higher impact at street level or accident rates reduction further add to the overall positive impact.
| S-EPMC6331659 | biostudies-literature
Project description:Bioacoustic sensors, sometimes known as autonomous recording units (ARUs), can record sounds of wildlife over long periods of time in scalable and minimally invasive ways. Deriving per-species abundance estimates from these sensors requires detection, classification, and quantification of animal vocalizations as individual acoustic events. Yet, variability in ambient noise, both over time and across sensors, hinders the reliability of current automated systems for sound event detection (SED), such as convolutional neural networks (CNN) in the time-frequency domain. In this article, we develop, benchmark, and combine several machine listening techniques to improve the generalizability of SED models across heterogeneous acoustic environments. As a case study, we consider the problem of detecting avian flight calls from a ten-hour recording of nocturnal bird migration, recorded by a network of six ARUs in the presence of heterogeneous background noise. Starting from a CNN yielding state-of-the-art accuracy on this task, we introduce two noise adaptation techniques, respectively integrating short-term (60 ms) and long-term (30 min) context. First, we apply per-channel energy normalization (PCEN) in the time-frequency domain, which applies short-term automatic gain control to every subband in the mel-frequency spectrogram. Secondly, we replace the last dense layer in the network by a context-adaptive neural network (CA-NN) layer, i.e. an affine layer whose weights are dynamically adapted at prediction time by an auxiliary network taking long-term summary statistics of spectrotemporal features as input. We show that PCEN reduces temporal overfitting across dawn vs. dusk audio clips whereas context adaptation on PCEN-based summary statistics reduces spatial overfitting across sensor locations. Moreover, combining them yields state-of-the-art results that are unmatched by artificial data augmentation alone. We release a pre-trained version of our best performing system under the name of BirdVoxDetect, a ready-to-use detector of avian flight calls in field recordings.
| S-EPMC6812790 | biostudies-other
Project description:Atmospheric particulate matter (PM) is a recognized risk factor for the global burden of disease in human populations. We are presenting here the application of toxicogenomics in the evaluation of the toxic effects of organic content of atmospheric particle matter (PM), from urban and rural environments (city of Barcelona and village of La Pobla, NE Spain), using the developing zebrafish embryo. The main goal is to identify the metabolic pathways involved in the adverse effects observed in zebrafish embryos exposed to PM organic content from urban and rural environments, also allowing the selection of genes of interest that are differentially expressed. The relevance of particle size to the PM toxicity is also addressed. Indeed, the zebrafish embryos were exposed to PM of aerodynamic diameter larger than 7.2 μm and smaller than 0.5 μm (PM10 and PM0.5, respectively). PM0.5 concentrated biological and toxic activities linked to organic substances. Transcriptomic analyses showed strong induction of the AhR signalling pathway (a.k.a. dioxin-like activity) for embryos exposed to both rural and urban extracts, correlating with the concentrations of PAHs. Urban extracts, with strong contribution of traffic emissions, specifically de-regulated oxidative stress-related genes, as well as pancreatic and eye-lens specific genes, two organs known to be affected by air pollution in humans. Exposure to rural extracts, with high contribution of wood burning emissions, affected genes implicated in basic cellular functions, in agreement with their strong embryotoxicity. Extracts from rural and urban samples elicited both common and specific transcriptome responses, suggesting different potentially adverse outcomes depending on PM source and composition. The authors thank the financial support of the Spanish Ministry (project TEA-PARTICLE, grant number CGL2011-29621) and the Portuguese Foundation for Science and Technology for the doctoral grant of Sofia R. Mesquita (SFRH/BD/80710/2011) funded by the Program POPH-QREN through the Portuguese Ministry of Education and Science and the European Social Fund, and support through project PEst-C/MAR/LA0015/2013.
2015-10-26 | GSE53522 | GEO
Project description:BackgroundOutliers, data points that significantly deviate from the norm, can have a substantial impact on statistical inference and provide valuable insights in data analysis. Multiple methods have been developed for outlier detection, however, almost all available approaches fail to consider the spatial dependence and heterogeneity in spatial data. Spatial data has diverse formats and semantics, requiring specialized outlier detection methodology to handle these unique properties. For now, there is limited research exists on robust spatial outlier detection methods designed specifically under the spatial error model (SEM) structure.MethodWe propose the Spatial-Θ-Iterative Procedure for Outlier Detection (Spatial-Θ-IPOD), which utilizes a mean-shift vector to identify outliers within the SEM. Our method enables an effective detection of spatial outliers while also providing robust coefficient estimates. To assess the performance of our approach, we conducted extensive simulations and applied it to a real-world empirical study using life expectancy data from multiple countries.ResultsSimulation results showed that the masking and JD (Joint Detection) indicators of our Spatial-Θ-IPOD method outperformed several commonly used methods, even in high-dimensional scenarios, demonstrating stable performance. Conversely, the Θ-IPOD method proved to be ineffective in detecting outliers when spatial correlation was present. Moreover, our model successfully provided reliable coefficient estimation alongside outlier detection. The proposed method consistently outperformed other models (both robust and non-robust) in most cases. In the empirical study, our proposed model successfully detected outliers and provided valuable insights in the modeling process.ConclusionsOur proposed Spatial-Θ-IPOD offers an effective solution for detecting spatial outliers for SEM while providing robust coefficient estimates. Notably, our approach showcases its relative superiority even in the presence of high leverage points. By successfully identifying outliers, our method enhances the overall understanding of the data and provides valuable insights for further analysis.
| S-EPMC11323683 | biostudies-literature
Project description:Atmospheric particulate matter (PM) is a recognized risk factor for the global burden of disease in human populations. We are presenting here the application of toxicogenomics in the evaluation of the toxic effects of organic content of atmospheric particle matter (PM), from urban and rural environments (city of Barcelona and village of La Pobla, NE Spain), using the developing zebrafish embryo. The main goal is to identify the metabolic pathways involved in the adverse effects observed in zebrafish embryos exposed to PM organic content from urban and rural environments, also allowing the selection of genes of interest that are differentially expressed. The relevance of particle size to the PM toxicity is also addressed. Indeed, the zebrafish embryos were exposed to PM of aerodynamic diameter larger than 7.2 μm and smaller than 0.5 μm (PM10 and PM0.5, respectively). PM0.5 concentrated biological and toxic activities linked to organic substances. Transcriptomic analyses showed strong induction of the AhR signalling pathway (a.k.a. dioxin-like activity) for embryos exposed to both rural and urban extracts, correlating with the concentrations of PAHs. Urban extracts, with strong contribution of traffic emissions, specifically de-regulated oxidative stress-related genes, as well as pancreatic and eye-lens specific genes, two organs known to be affected by air pollution in humans. Exposure to rural extracts, with high contribution of wood burning emissions, affected genes implicated in basic cellular functions, in agreement with their strong embryotoxicity. Extracts from rural and urban samples elicited both common and specific transcriptome responses, suggesting different potentially adverse outcomes depending on PM source and composition. The authors thank the financial support of the Spanish Ministry (project TEA-PARTICLE, grant number CGL2011-29621) and the Portuguese Foundation for Science and Technology for the doctoral grant of Sofia R. Mesquita (SFRH/BD/80710/2011) funded by the Program POPH-QREN through the Portuguese Ministry of Education and Science and the European Social Fund, and support through project PEst-C/MAR/LA0015/2013. The PM filter samples used in the present study were PM10 and PM0.5 from the urban site - total of 4 samples from 2 sampling months; and PM0.5 from the rural site - total of 2 samples from 2 sampling months (PM10 samples from the rural site were not tested due to their very low concentration in organic compounds, and insignificant biological activity, previously measured). Sampling occurred during the cold periods of the year 2012/2013. The organic fraction of PM samples was extracted by sonication using a mixture of dichloromethane:methanol. Then, the extracts were filtered, evaporated and re-dissolved in Dimethyl sulfoxide (DMSO). Zebrafish fertilized eggs were exposed to PM organic extracts (0.2% DMSO) from the urban and rural sites from 24 to 120h post-fertilization. Total RNA was isolated from whole embryos (pools of 20 individuals), using Trizol reagent protocol (Invitrogen Life Technologies, Carlsberg, CA). The microarray study was performed using the Agilent Two-colour D. rerio Oligo Microarray v3 platform, following the Agilent Microarray â?? Based Gene Expression Analysis protocol. Three biological replicates were performed for each PM sample and controls. Biological replicates, a technical replicate and a self-to-self, were simultaneously amplified and labelled using Cyanine 3 (Cy3) and Cyanine 5 (Cy5) dye. After cRNA purification (RNeasy Kit, Quiagen GmbH, Hilden, Germany), the cRNA concentration and labelling were quantified in the NanoDrop spectrophotometer, obtaining incorporation rates in the range of 15-20pmol of cyanide dye/µl cRNA and yield values > 0.825ug, as recommended. cRNA was fragmented and hybridized in 4x44K arrays, for 17h at 65oC. After the hybridization the array slides were washed, and immediately scanned using Microarray Scanner Agilent G2505C system. Data was extracted using Agilent Feature Extraction Software v10.5.1.1, and the quality of microarray data was evaluated using the Quality Control report provided by Agilent Software. Based on the microarray data analysis, 22 primers were selected and designed using Primer Express 2.0 software (Applied Biosystems, Foster City, CA). Genes were quantified by real-time PCR to validate the microarray data, and a subset of 13 genes were further selected by their robust behaviour in the validation assays, allowing to differentiate the toxic potential of PM from urban and rural sources.
2015-10-26 | E-GEOD-53522 | biostudies-arrayexpress