Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Data-driven analysis and forecasting of highway traffic dynamics.

ABSTRACT: The unpredictable elements involved in a vehicular traffic system, like human interaction and weather, lead to a very complicated, high-dimensional, nonlinear dynamical system. Therefore, it is difficult to develop a mathematical or artificial intelligence model that describes the time evolution of traffic systems. All the while, the ever-increasing demands on transportation systems has left traffic agencies in dire need of a robust method for analyzing and forecasting traffic. Here we demonstrate how the Koopman mode decomposition can offer a model-free, data-driven approach for analyzing and forecasting traffic dynamics. By obtaining a decomposition of data sets collected by the Federal Highway Administration and the California Department of Transportation, we are able to reconstruct observed data, distinguish any growing or decaying patterns, and obtain a hierarchy of previously identified and never before identified spatiotemporal patterns. Furthermore, it is demonstrated how this methodology can be utilized to forecast highway network conditions.

SUBMITTER: Avila AM

PROVIDER: S-EPMC7190853 | biostudies-literature | 2020 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Data-driven analysis and forecasting of highway traffic dynamics.

Avila A M AM Mezić I I

Nature communications 20200429 1

The unpredictable elements involved in a vehicular traffic system, like human interaction and weather, lead to a very complicated, high-dimensional, nonlinear dynamical system. Therefore, it is difficult to develop a mathematical or artificial intelligence model that describes the time evolution of traffic systems. All the while, the ever-increasing demands on transportation systems has left traffic agencies in dire need of a robust method for analyzing and forecasting traffic. Here we demonstra ...[more]

PMID: 32350245

Similar Datasets

Forecasting Covid-19 Dynamics in Brazil: A Data Driven Approach.

Project description:The contribution of this paper is twofold. First, a new data driven approach for predicting the Covid-19 pandemic dynamics is introduced. The second contribution consists in reporting and discussing the results that were obtained with this approach for the Brazilian states, with predictions starting as of 4 May 2020. As a preliminary study, we first used an Long Short Term Memory for Data Training-SAE (LSTM-SAE) network model. Although this first approach led to somewhat disappointing results, it served as a good baseline for testing other ANN types. Subsequently, in order to identify relevant countries and regions to be used for training ANN models, we conduct a clustering of the world's regions where the pandemic is at an advanced stage. This clustering is based on manually engineered features representing a country's response to the early spread of the pandemic, and the different clusters obtained are used to select the relevant countries for training the models. The final models retained are Modified Auto-Encoder networks, that are trained on these clusters and learn to predict future data for Brazilian states. These predictions are used to estimate important statistics about the disease, such as peaks and number of confirmed cases. Finally, curve fitting is carried out to find the distribution that best fits the outputs of the MAE, and to refine the estimates of the peaks of the pandemic. Predicted numbers reach a total of more than one million infected Brazilians, distributed among the different states, with São Paulo leading with about 150 thousand confirmed cases predicted. The results indicate that the pandemic is still growing in Brazil, with most states peaks of infection estimated in the second half of May 2020. The estimated end of the pandemics (97% of cases reaching an outcome) spread between June and the end of August 2020, depending on the states.

| S-EPMC7400194 | biostudies-literature

Forecasting success via early adoptions analysis: A data-driven study.

Project description:Innovations are continuously launched over markets, such as new products over the retail market or new artists over the music scene. Some innovations become a success; others don't. Forecasting which innovations will succeed at the beginning of their lifecycle is hard. In this paper, we provide a data-driven, large-scale account of the existence of a special niche among early adopters, individuals that consistently tend to adopt successful innovations before they reach success: we will call them Hit-Savvy. Hit-Savvy can be discovered in very different markets and retain over time their ability to anticipate the success of innovations. As our second contribution, we devise a predictive analytical process, exploiting Hit-Savvy as signals, which achieves high accuracy in the early-stage prediction of successful innovations, far beyond the reach of state-of-the-art time series forecasting models. Indeed, our findings and predictive model can be fruitfully used to support marketing strategies and product placement.

| S-EPMC5720712 | biostudies-literature

Forecasting short-term data center network traffic load with convolutional neural networks.

Project description:Efficient resource management in data centers is of central importance to content service providers as 90 percent of the network traffic is expected to go through them in the coming years. In this context we propose the use of convolutional neural networks (CNNs) to forecast short-term changes in the amount of traffic crossing a data center network. This value is an indicator of virtual machine activity and can be utilized to shape the data center infrastructure accordingly. The behaviour of network traffic at the seconds scale is highly chaotic and therefore traditional time-series-analysis approaches such as ARIMA fail to obtain accurate forecasts. We show that our convolutional neural network approach can exploit the non-linear regularities of network traffic, providing significant improvements with respect to the mean absolute and standard deviation of the data, and outperforming ARIMA by an increasingly significant margin as the forecasting granularity is above the 16-second resolution. In order to increase the accuracy of the forecasting model, we exploit the architecture of the CNNs using multiresolution input distributed among separate channels of the first convolutional layer. We validate our approach with an extensive set of experiments using a data set collected at the core network of an Internet Service Provider over a period of 5 months, totalling 70 days of traffic at the one-second resolution.

| S-EPMC5800645 | biostudies-literature

Assessing the impact of data-driven limitations on tracing and forecasting the outbreak dynamics of COVID-19.

Project description:The availability of the epidemiological data strongly affects the reliability of several mathematical models in tracing and forecasting COVID-19 pandemic, hampering a fair assessment of their relative performance. The marked difference between the lethality of the virus when comparing the first and second waves is an evident sign of the poor reliability of the data, also related to the variability over time in the number of performed swabs. During the early epidemic stage, swabs were made only to patients with severe symptoms taken to hospital or intensive care unit. Thus, asymptomatic people, not seeking medical assistance, remained undetected. Conversely, during the second wave of infection, total infectives included also a percentage of detected asymptomatic infectives, being tested due to close contacts with swab positives and thus registered by the health system. Here, we compared the outcomes of two SIR-type models (the standard SIR model and the A-SIR model that explicitly considers asymptomatic infectives) in reproducing the COVID-19 epidemic dynamic in Italy, Spain, Germany, and France during the first two infection waves, simulated separately. We found that the A-SIR model overcame the SIR model in simulating the first wave, whereas these discrepancies are reduced in simulating the second wave, when the accuracy of the epidemiological data is considerably higher. These results indicate that increasing the complexity of the model is useless and unnecessarily wasteful if not supported by an increased quality of the available data.

| S-EPMC8285363 | biostudies-literature

Data-driven outbreak forecasting with a simple nonlinear growth model.

Project description:Recent events have thrown the spotlight on infectious disease outbreak response. We developed a data-driven method, EpiGro, which can be applied to cumulative case reports to estimate the order of magnitude of the duration, peak and ultimate size of an ongoing outbreak. It is based on a surprisingly simple mathematical property of many epidemiological data sets, does not require knowledge or estimation of disease transmission parameters, is robust to noise and to small data sets, and runs quickly due to its mathematical simplicity. Using data from historic and ongoing epidemics, we present the model. We also provide modeling considerations that justify this approach and discuss its limitations. In the absence of other information or in conjunction with other models, EpiGro may be useful to public health responders.

| S-EPMC5159251 | biostudies-literature

Forecasting of COVID-19 onset cases: a data-driven analysis in the early stage of delay.

Project description:The outbreak of COVID-19 has become a global public health event. Many researchers have proposed many epidemiological models to predict the outbreak trend of COVID-19, but all use confirmed cases to predict "onset cases." In this article, a total of 5434 cases were collected from National Health Commission and other provincial Health Commission in China, spanning from 1 December 2019 to 23 February 2020. We studied the delayed distribution of patients from onset to be confirmed. The delay is divided into two stages, which takes about 15 days or even longer. Therefore, considering the right truncation of the data, we proposed a "predict-in-advance" method, used the number of "visiting hospital cases" to predict the number of "onset cases." The results not only show that our prediction shortens the delay of the second stage, but also the predicted value of onset cases is quite close to the real value of onset cases, which can effectively predict the epidemic trend of sudden infectious diseases, and provide an important reference for the government to formulate control measures in advance.

| S-EPMC7786867 | biostudies-literature

Using data-driven agent-based models for forecasting emerging infectious diseases.

Project description:Producing timely, well-informed and reliable forecasts for an ongoing epidemic of an emerging infectious disease is a huge challenge. Epidemiologists and policy makers have to deal with poor data quality, limited understanding of the disease dynamics, rapidly changing social environment and the uncertainty on effects of various interventions in place. Under this setting, detailed computational models provide a comprehensive framework for integrating diverse data sources into a well-defined model of disease dynamics and social behavior, potentially leading to better understanding and actions. In this paper, we describe one such agent-based model framework developed for forecasting the 2014-2015 Ebola epidemic in Liberia, and subsequently used during the Ebola forecasting challenge. We describe the various components of the model, the calibration process and summarize the forecast performance across scenarios of the challenge. We conclude by highlighting how such a data-driven approach can be refined and adapted for future epidemics, and share the lessons learned over the course of the challenge.

| S-EPMC5568513 | biostudies-literature

A highway crash risk assessment method based on traffic safety state division.

Project description:In order to quantitatively analyze the influence of different traffic conditions on highway crash risk, a method of crash risk assessment based on traffic safety state division is proposed in this paper. Firstly, the highway crash data and corresponding traffic data of upstream and downstream are extracted and processed by using the matched case-control method to exclude the influence of other factors on the model. Secondly, considering the weight of traffic volume, speed and occupancy, a multi-parameter fusion cluster method is applied to divide traffic safety state. In addition, the quantitative relationship between different traffic states and highway crash risk is analyzed by using Bayesian conditional logistic regression model. Finally, the results of case study show that different traffic safety conditions are in different crash risk levels. The highway traffic management department can improve the safety risk management level by focusing on the prevention and control of high-risk traffic safety conditions.

| S-EPMC6959613 | biostudies-literature

Improving Road Traffic Forecasting Using Air Pollution and Atmospheric Data: Experiments Based on LSTM Recurrent Neural Networks.

Project description:Traffic flow forecasting is one of the most important use cases related to smart cities. In addition to assisting traffic management authorities, traffic forecasting can help drivers to choose the best path to their destinations. Accurate traffic forecasting is a basic requirement for traffic management. We propose a traffic forecasting approach that utilizes air pollution and atmospheric parameters. Air pollution levels are often associated with traffic intensity, and much work is already available in which air pollution has been predicted using road traffic. However, to the best of our knowledge, an attempt to improve forecasting road traffic using air pollution and atmospheric parameters is not yet available in the literature. In our preliminary experiments, we found out the relation between traffic intensity, air pollution, and atmospheric parameters. Therefore, we believe that addition of air pollutants and atmospheric parameters can improve the traffic forecasting. Our method uses air pollution gases, including C O , N O , N O 2 , N O x , and O 3 . We chose these gases because they are associated with road traffic. Some atmospheric parameters, including pressure, temperature, wind direction, and wind speed have also been considered, as these parameters can play an important role in the dispersion of the above-mentioned gases. Data related to traffic flow, air pollution, and the atmosphere were collected from the open data portal of Madrid, Spain. The long short-term memory (LSTM) recurrent neural network (RNN) was used in this paper to perform traffic forecasting.

| S-EPMC7374312 | biostudies-literature

Impacts of traffic data on short-term residential load forecasting before and during the COVID-19 pandemic

Project description:Accurate load forecasting is essential for power-sector planning and management. This applies during normal situations as well as phase changes such as the Coronavirus (COVID-19) pandemic due to variations in electricity consumption that made it difficult for system operators to forecast load accurately. So far, few studies have used traffic data to improve load prediction accuracy. This paper aims to investigate the influence of traffic data in combination with other commonly used features (historical load, weather, and time) – to better predict short-term residential electricity consumption. Based on data from two selected distribution grid areas in Switzerland and random forest as a forecasting technique, the findings suggest that the impact of traffic data on load forecasts is much smaller than the impact of time variables. However, traffic data could improve load forecasting where information on historical load is not available. Another benefit of using traffic data is that it might explain the phenomenon of interest better than historical electricity demand. Some of our findings vary greatly between the two datasets, indicating the importance of studies based on larger numbers of datasets, features, and forecasting approaches.

| S-EPMC9283696 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data