Browse
Submit Data
Databases
API
Help

Dataset Information

13 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Reconstructing Missing and Anomalous Data Collected from High-Frequency In-Situ Sensors in Fresh Waters.

ABSTRACT: In situ sensors that collect high-frequency data are used increasingly to monitor aquatic environments. These sensors are prone to technical errors, resulting in unrecorded observations and/or anomalous values that are subsequently removed and create gaps in time series data. We present a framework based on generalized additive and auto-regressive models to recover these missing data. To mimic sporadically missing (i) single observations and (ii) periods of contiguous observations, we randomly removed (i) point data and (ii) day- and week-long sequences of data from a two-year time series of nitrate concentration data collected from Arikaree River, USA, where synoptically collected water temperature, turbidity, conductance, elevation, and dissolved oxygen data were available. In 72% of cases with missing point data, predicted values were within the sensor precision interval of the original value, although predictive ability declined when sequences of missing data occurred. Precision also depended on the availability of other water quality covariates. When covariates were available, even a sudden, event-based peak in nitrate concentration was reconstructed well. By providing a promising method for accurate prediction of missing data, the utility and confidence in summary statistics and statistical trends will increase, thereby assisting the effective monitoring and management of fresh waters and other at-risk ecosystems.

SUBMITTER: Kermorvant C

PROVIDER: S-EPMC8657025 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

A dynamic approach for reconstructing missing longitudinal data using the linear increments model.

Project description:Missing observations are commonplace in longitudinal data. We discuss how to model and analyze such data in a dynamic framework, that is, taking into consideration the time structure of the process and the influence of the past on the present and future responses. An autoregressive model is used as a special case of the linear increments model defined by Farewell (2006. Linear models for censored data, [PhD Thesis]. Lancaster University) and Diggle and others (2007. Analysis of longitudinal data with drop-out: objectives, assumptions and a proposal. Journal of the Royal Statistical Society, Series C (Applied Statistics, 56, 499-550). We wish to reconstruct responses for missing data and discuss the required assumptions needed for both monotone and nonmonotone missingness. The computational procedures suggested are very simple and easily applicable. They can also be used to estimate causal effects in the presence of time-dependent confounding. There are also connections to methods from survival analysis: The Aalen-Johansen estimator for the transition matrix of a Markov chain turns out to be a special case. Analysis of quality of life data from a cancer clinical trial is analyzed and presented. Some simulations are given in the supplementary material available at Biostatistics online.

| S-EPMC3293429 | biostudies-literature

Sharing Data Collected with Smartphone Sensors: Willingness, Participation, and Nonparticipation Bias.

Project description:Smartphone sensors allow measurement of phenomena that are difficult or impossible to capture via self-report (e.g., geographical movement, physical activity). Sensors can reduce respondent burden by eliminating survey questions and improve measurement accuracy by replacing/augmenting self-reports. However, if respondents who are not willing to collect sensor data differ on critical attributes from those who are, the results can be biased. Research on the mechanisms of willingness to collect sensor data mostly comes from (nonprobability) online panels and is hypothetical (i.e., asks participants about the likelihood of participation in a sensor-based study). In a cross-sectional general population randomized experiment, we investigate how features of the request and respondent characteristics influence willingness to share (WTS) and actually sharing smartphone-sensor data. We manipulate the request to either mention or not mention (1) how participation will benefit the participant, (2) participants' autonomy over data collection, and (3) that data will be kept confidential. We assess nonparticipation bias using the administrative records. WTS and actually sharing varies by sensor task, participants' autonomy over data sharing, their smartphone skills, level of privacy concerns, and attitudes toward surveys. Fewer people agree to share photos and a video than geolocation, but all who agreed to share photos or a video actually did. Some nonresponse and nonparticipation biases are substantial and make each other worse, but others jointly reduce the overall bias. Our findings suggest that sensor-data-sharing decisions depend on sample members' situation when asked to share and the nature of the sensor task rather than the sensor type.

| S-EPMC8483283 | biostudies-literature

Reconstructing missing complex networks against adversarial interventions.

Project description:Interactions within complex network components define their operational modes, collective behaviors and global functionality. Understanding the role of these interactions is limited by either sensing methodologies or intentional adversarial efforts that sabotage the network structure. To overcome the partial observability and infer with good fidelity the unobserved network structures (latent subnetworks that are not random samples of the full network), we propose a general causal inference framework for reconstructing network structures under unknown adversarial interventions. We explore its applicability in both biological and social systems to recover the latent structures of human protein complex interactions and brain connectomes, as well as to infer the camouflaged social network structure in a simulated removal process. The demonstrated effectiveness establishes its good potential for capturing hidden information in much broader research domains.

| S-EPMC6465316 | biostudies-literature

Long-term, high frequency in situ measurements of intertidal mussel bed temperatures using biomimetic sensors.

Project description:At a proximal level, the physiological impacts of global climate change on ectothermic organisms are manifest as changes in body temperatures. Especially for plants and animals exposed to direct solar radiation, body temperatures can be substantially different from air temperatures. We deployed biomimetic sensors that approximate the thermal characteristics of intertidal mussels at 71 sites worldwide, from 1998-present. Loggers recorded temperatures at 10-30 min intervals nearly continuously at multiple intertidal elevations. Comparisons against direct measurements of mussel tissue temperature indicated errors of ~2.0-2.5 °C, during daily fluctuations that often exceeded 15°-20 °C. Geographic patterns in thermal stress based on biomimetic logger measurements were generally far more complex than anticipated based only on 'habitat-level' measurements of air or sea surface temperature. This unique data set provides an opportunity to link physiological measurements with spatially- and temporally-explicit field observations of body temperature.

| S-EPMC5058338 | biostudies-literature

Limb and trunk accelerometer data collected with wearable sensors from subjects with Parkinson's disease.

Project description:Parkinson's disease (PD) is a neurodegenerative disorder characterized by motor and non-motor symptoms. Dyskinesia and motor fluctuations are complications of PD medications. An objective measure of on/off time with/without dyskinesia has been sought for some time because it would facilitate the titration of medications. The objective of the dataset herein presented is to assess if wearable sensor data can be used to generate accurate estimates of limb-specific symptom severity. Nineteen subjects with PD experiencing motor fluctuations were asked to wear a total of five wearable sensors on both forearms and shanks, as well as on the lower back. Accelerometer data was collected for four days, including two laboratory visits lasting 3 to 4 hours each while the remainder of the time was spent at home and in the community. During the laboratory visits, subjects performed a battery of motor tasks while clinicians rated limb-specific symptom severity. At home, subjects were instructed to use a smartphone app that guided the periodic performance of a set of motor tasks.

| S-EPMC7864964 | biostudies-literature

Accelerometer data collected with a minimum set of wearable sensors from subjects with Parkinson's disease.

Project description:Parkinson's disease (PD) is a neurodegenerative disorder associated with motor and non-motor symptoms. Current treatments primarily focus on managing motor symptom severity such as tremor, bradykinesia, and rigidity. However, as the disease progresses, treatment side-effects can emerge such as on/off periods and dyskinesia. The objective of the Levodopa Response Study was to identify whether wearable sensor data can be used to objectively quantify symptom severity in individuals with PD exhibiting motor fluctuations. Thirty-one subjects with PD were recruited from 2 sites to participate in a 4-day study. Data was collected using 2 wrist-worn accelerometers and a waist-worn smartphone. During Days 1 and 4, a portion of the data was collected in the laboratory while subjects performed a battery of motor tasks as clinicians rated symptom severity. The remaining of the recordings were performed in the home and community settings. To our knowledge, this is the first dataset collected using wearable accelerometers with specific focus on individuals with PD experiencing motor fluctuations that is made available via an open data repository.

| S-EPMC7865022 | biostudies-literature

Soft Radio-Frequency Identification Sensors: Wireless Long-Range Strain Sensors Using Radio-Frequency Identification.

Project description:Increasing amounts of attention are being paid to the study of Soft Sensors and Soft Systems. Soft Robotic Systems require input from advances in the field of Soft Sensors. Soft sensors can help a soft robot to perceive and to act upon its immediate environment. The concept of integrating sensing capabilities into soft robotic systems is becoming increasingly important. One challenge is that most of the existing soft sensors have a requirement to be hardwired to power supplies or external data processing equipment. This requirement hinders the ability of a system designer to integrate soft sensors into soft robotic systems. In this article, we design, fabricate, and characterize a new soft sensor, which benefits from a combination of radio-frequency identification (RFID) tag design and microfluidic sensor fabrication technologies. We designed this sensor using the working principle of an RFID transporter antenna, but one whose resonant frequency changes in response to an applied strain. This new microfluidic sensor is intrinsically stretchable and can be reversibly strained. This sensor is a passive and wireless device, and as such, it does not require a power supply and is capable of transporting data without a wired connection. This strain sensor is best understood as an RFID tag antenna; it shows a resonant frequency change from approximately 860 to 800 MHz upon an applied strain change from 0% to 50%. Within the operating frequency, the sensor shows a standoff reading range of >7.5 m (at the resonant frequency). We characterize, experimentally, the electrical performance and the reliability of the fabrication process. We demonstrate a pneumatic soft robot that has four microfluidic sensors embedded in four of its legs, and we describe the implementation circuit to show that we can obtain movement information from the soft robot using our wireless soft sensors.

| S-EPMC6386780 | biostudies-literature

Raw data collected from NO 2 , O 3 and NO air pollution electrochemical low-cost sensors.

Project description:Recently, the monitoring of air pollution by means of low-cost sensors has become a growing research field due to the study of techniques based on machine learning to improve the sensors' data quality. For this purpose, sensors undergo a calibration process, where these are placed in-situ nearby a regulatory reference station. The data set explained in this paper contains data from two self-built low-cost air pollution nodes deployed for four months, from January 16, 2021 to May 15, 2021, at an official air quality reference station in Barcelona, Spain. The goal of the deployment was to have five electrochemical sensors at a high sampling rate of 0.5 Hz; two NO 2 sensors, two O 3 sensors, and one NO sensor. It should be noted that the reference stations publish air pollution data every hour, thus at a rate of 2.7×10-4 Hz. In addition, the nodes have also captured temperature and relative humidity data, which are typically used as correctors in the calibration of low-cost sensors. The availability of the sensors' time series at this high resolution is important in order to be able to carry out analysis from the signal processing perspective, allowing the study of sensor sampling strategies, sensor signal filtering, and the calibration of low-cost sensors among others.

| S-EPMC9508507 | biostudies-literature

Assessing Evidence of Phosphorus Concentration Trends in North American Fresh Waters.

Project description:The U.S. EPA's National Aquatic Resource Surveys (NARS) documented evidence of widespread, unexplained total phosphorus (TP) concentration increases in lakes and streams across the United States during the 2000 - 2012 time period. To examine the robustness of evidence for this trend, we used additional monitoring datasets to calculate rates of TP change in thousands of individual waterbodies across the U.S. during the same time frame, and compared them against TP change rates calculated in the same manner for waterbodies that were resurveyed under NARS in different years. For the additional datasets, median rates of TP change were substantially lower than median rates calculated using NARS data. To further examine differences between NARS and non-NARS results in specific waterbodies, we assembled composite datasets for 52 predominantly northern lakes that by chance had been sampled under both NARS and other sampling programs during the same time frame. Using only NARS data, the median calculated TP change rate for this set of lakes was positive, and similar to that for the larger set of 401 resurveyed NARS lakes. However, when additional sample data were included, the median calculated TP change rate for these lakes was much lower. Results suggest that increasing TP concentrations in waterbodies may not have been as ubiquitous as suggested. They also illustrate a need to supplement randomized continental-scale monitoring with detailed, site-focused investigations.

| S-EPMC10031499 | biostudies-literature

Chromosome3D: reconstructing three-dimensional chromosomal structures from Hi-C interaction frequency data using distance geometry simulated annealing.

Project description:Reconstructing three-dimensional structures of chromosomes is useful for visualizing their shapes in a cell and interpreting their function. In this work, we reconstruct chromosomal structures from Hi-C data by translating contact counts in Hi-C data into Euclidean distances between chromosomal regions and then satisfying these distances using a structure reconstruction method rigorously tested in the field of protein structure determination.We first evaluate the robustness of the overall reconstruction algorithm on noisy simulated data at various levels of noise by comparing with some of the state-of-the-art reconstruction methods. Then, using simulated data, we validate that Spearman's rank correlation coefficient between pairwise distances in the reconstructed chromosomal structures and the experimental chromosomal contact counts can be used to find optimum conversion rules for transforming interaction frequencies to wish distances. This strategy is then applied to real Hi-C data at chromosome level for optimal transformation of interaction frequencies to wish distances and for ranking and selecting structures. The chromosomal structures reconstructed from a real-world human Hi-C dataset by our method were validated by the known two-compartment feature of the human chromosome organization. We also show that our method is robust with respect to the change of the granularity of Hi-C data, and consistently produces similar structures at different chromosomal resolutions.Chromosome3D is a robust method of reconstructing chromosome three-dimensional models using distance restraints obtained from Hi-C interaction frequency data. It is available as a web application and as an open source tool at http://sysbio.rnet.missouri.edu/chromosome3d/ .

| S-EPMC5100196 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data