Dataset Information

Preparing GIS data for analysis of stream monitoring data: The R package openSTARS.

ABSTRACT: Stream monitoring data provides insights into the biological, chemical and physical status of running waters. Additionally, it can be used to identify drivers of chemical or ecological water quality, to inform related management actions, and to forecast future conditions under land use and global change scenarios. Measurements from sites along the same stream may not be statistically independent, and the R package SSN provides a way to describe spatial autocorrelation when modelling relationships between measured variables and potential drivers. However, SSN requires the user to provide the stream network and sampling locations in a certain format. Likewise, other applications require catchment delineation and intersection of different spatial data. We developed the R package openSTARS that provides the functionality to derive stream networks from a digital elevation model, delineate stream catchments and intersect them with land use or other GIS data as potential predictors. Additionally, locations for model predictions can be generated automatically along the stream network. We present an example workflow of all data preparation steps. In a case study using data from water monitoring sites in Southern Germany, the resulting stream network and derived site characteristics matched those constructed using STARS, an ArcGIS custom toolbox. An advantage of openSTARS is that it relies on free and open-source GRASS GIS and R functions, unlike the original STARS toolbox which depends on proprietary ArcGIS. openSTARS also comes without a graphical user interface, to enhance reproducibility and reusability of the workflow, thereby harmonizing and simplifying the data pre-processing prior to statistical modelling. Overall, openSTARS facilitates the use of spatial regression and other applications on stream networks and contributes to reproducible science with applications in hydrology, environmental sciences and ecology.

SUBMITTER: Kattwinkel M

PROVIDER: S-EPMC7498020 | biostudies-literature | 2020

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Preparing GIS data for analysis of stream monitoring data: The R package openSTARS.

Kattwinkel Mira M Szöcs Eduard E Peterson Erin E Schäfer Ralf B RB

PloS one 20200917 9

Stream monitoring data provides insights into the biological, chemical and physical status of running waters. Additionally, it can be used to identify drivers of chemical or ecological water quality, to inform related management actions, and to forecast future conditions under land use and global change scenarios. Measurements from sites along the same stream may not be statistically independent, and the R package SSN provides a way to describe spatial autocorrelation when modelling relationship ...[more]

PMID: 32941523

Similar Datasets

Project description:In recent years, the application and wide adoption of Internet of Things (IoT)-based technologies have increased the proliferation of monitoring systems, which has consequently exponentially increased the amounts of heterogeneous data generated. Processing and analysing the massive amount of data produced is cumbersome and gradually moving from classical 'batch' processing-extract, transform, load (ETL) technique to real-time processing. For instance, in environmental monitoring and management domain, time-series data and historical dataset are crucial for prediction models. However, the environmental monitoring domain still utilises legacy systems, which complicates the real-time analysis of the essential data, integration with big data platforms and reliance on batch processing. Herein, as a solution, a distributed stream processing middleware framework for real-time analysis of heterogeneous environmental monitoring and management data is presented and tested on a cluster using open source technologies in a big data environment. The system ingests datasets from legacy systems and sensor data from heterogeneous automated weather systems irrespective of the data types to Apache Kafka topics using Kafka Connect APIs for processing by the Kafka streaming processing engine. The stream processing engine executes the predictive numerical models and algorithms represented in event processing (EP) languages for real-time analysis of the data streams. To prove the feasibility of the proposed framework, we implemented the system using a case study scenario of drought prediction and forecasting based on the Effective Drought Index (EDI) model. Firstly, we transform the predictive model into a form that could be executed by the streaming engine for real-time computing. Secondly, the model is applied to the ingested data streams and datasets to predict drought through persistent querying of the infinite streams to detect anomalies. As a conclusion of this study, a performance evaluation of the distributed stream processing middleware infrastructure is calculated to determine the real-time effectiveness of the framework.

Dataset Information

Preparing GIS data for analysis of stream monitoring data: The R package openSTARS.

Publications

Preparing GIS data for analysis of stream monitoring data: The R package openSTARS.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets