Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Deep Q-network-based traffic signal control models.

ABSTRACT: Traffic congestion has become common in urban areas worldwide. To solve this problem, the method of searching a solution using artificial intelligence has recently attracted widespread attention because it can solve complex problems such as traffic signal control. This study developed two traffic signal control models using reinforcement learning and a microscopic simulation-based evaluation for an isolated intersection and two coordinated intersections. To develop these models, a deep Q-network (DQN) was used, which is a promising reinforcement learning algorithm. The performance was evaluated by comparing the developed traffic signal control models in this research with the fixed-time signal optimized by Synchro model, which is a traffic signal optimization model. The evaluation showed that the developed traffic signal control model of the isolated intersection was validated, and the coordination of intersections was superior to that of the fixed-time signal control method.

SUBMITTER: Park S

PROVIDER: S-EPMC8412290 | biostudies-literature | 2021

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Deep Q-network-based traffic signal control models.

Park Sangmin S Han Eum E Park Sungho S Jeong Harim H Yun Ilsoo I

PloS one 20210902 9

Traffic congestion has become common in urban areas worldwide. To solve this problem, the method of searching a solution using artificial intelligence has recently attracted widespread attention because it can solve complex problems such as traffic signal control. This study developed two traffic signal control models using reinforcement learning and a microscopic simulation-based evaluation for an isolated intersection and two coordinated intersections. To develop these models, a deep Q-network ...[more]

PMID: 34473716

Similar Datasets

A simple crowdsourced delay-based traffic signal control.

Project description:Current transportation management systems rely on physical sensors that use traffic volume and queue-lengths. These physical sensors incur significant capital and maintenance costs. The ubiquity of mobile devices has made possible access to accurate and cheap traffic delay data. However, current traffic signal control algorithms do not accommodate the use of such data. In this paper, we propose a novel parsimonious model to utilize real-time crowdsourced delay data for traffic signal management. We demonstrate the versatility and effectiveness of the data and the proposed model on seven different intersections across three cities and two countries. This signal system provides an opportunity to leapfrog from physical sensors to low-cost, reliable crowdsourced data.

| S-EPMC7138299 | biostudies-literature

Traffic signal coordination control along oversaturated two-way arterials.

Project description:As an effective method to alleviate traffic congestion, traffic signal coordination control has been applied in many cities to manage queues and to regulate traffic flow under oversaturated traffic condition. However, the previous methods are usually based on two hypotheses. One is that traffic demand is constant. The other assumes that the velocity of vehicle is immutable when entering the downstream section. In the paper, we develop a novel traffic coordination control method to control the traffic flow along oversaturated two-way arterials without both these hypotheses. The method includes two modules: intersection coordination control and arterial coordination control. The green time plan for all intersections can be obtained by the module of intersection coordination control. The module of arterial coordination control can optimize offset plan for all intersections along oversaturated two-way arterials. The experiment results verify that the proposed method can effectively control the queue length under the oversaturated traffic state. In addition, the delay in this method can be decreased by 5.4% compared with the existing delay minimization method and 13.6% compared with the traffic coordination control method without offset optimization. Finally, the proposed method can balance the delay level of different links along oversaturated arterial, which can directly reflect the efficiency of the proposed method on the traffic coordination control under oversaturated traffic condition.

| S-EPMC7924511 | biostudies-literature

Traffic signal active control method for short-distance intersections.

Project description:Aiming at the existing problems about the overflow prevention goal and the overall traffic efficiency guarantee being difficult to optimize at the same time in the signal control process of short-distance intersections scenario, this paper proposes a traffic signal active control method based on key state prediction. In order to construct the key state evolution trend of short-distance intersection scenarios, this paper proposes the concept of overflow index for short-distance road sections and designs the prediction method of overflow index. In order to perform fast computation and solution for the active control scheme, this paper builds a solution algorithm based on deep reinforcement learning and optimizes the problem of reward sparsity in the algorithm, which improves the ability of active control in terms of state space and reward function. The experimental results show that this method can not only ensure the overall traffic efficiency of short-distance intersections and reduce the travel delay but also can actively sense the change of overflow state, improve the overflow prevention and control ability of the target scenario, and reduce the overflow risk.

| S-EPMC11908704 | biostudies-literature

A novel traffic optimization method using GRU based deep neural network for the IoV system.

Project description:At present, China is moving towards the direction of "Industry 4.0". The development of the automobile industry, especially intelligent automobiles, is in full swing, which brings great convenience to people's life and travel. However, at the same time, urban traffic pressure is also increasingly prominent, and the situation of traffic congestion and traffic safety is not optimistic. In this context, the Internet of Vehicles (also known as "IoV") opens up a new way to relieve urban traffic pressure. Therefore, in order to further optimize the road network traffic conditions in the IoV environment, this research focuses on the traffic flow prediction algorithm on the basis of deep learning to enhance traffic efficiency and safety. First, the study investigates the short-time traffic flow prediction by combining the characteristics of the IoV environment. To address the issues that existing algorithms cannot automatically extract data features and the model expression capability is weak, the study chooses to build a deep neural network using GRU model in deep learning for short-time traffic flow prediction, thereby improving the prediction accuracy of algorithm. Secondly, a fine-grained traffic flow statistics approach suitable for the IoV situation is suggested in accordance with the deep learning model that was built. The algorithm sends the vehicle characteristic data obtained through GRU model training into the fine-grained traffic flow statistics algorithm, so as to realize the statistics of traffic information of various types of vehicles. The advantage of this algorithm is that it can well count the traffic flow of multiple lanes, so as to better predict the current traffic status and achieve traffic optimization. Finally, the IoV environment is constructed to confirm the effectiveness of the prediction model. The prediction results prove that the new algorithm has good performance in traffic flow statistics in different scenarios.

| S-EPMC10280423 | biostudies-literature

Network topology facilitates internet traffic control in autocracies

Project description: Not available

| S-EPMC10904286 | biostudies-literature

Big-data empowered traffic signal control could reduce urban carbon emission.

Project description:Urban congestion is a pressing challenge, driving up emissions and compromising transport efficiency. Advances in big-data collection and processing now enable adaptive traffic signals, offering a promising strategy for congestion mitigation. In our study of China's 100 most congested cities, big-data empowered adaptive traffic signals reduced peak-hour trip times by 11% and off-peak by 8%, yielding an estimated annual CO₂ reduction of 31.73 million tonnes. Despite an annual implementation cost of US$1.48 billion, societal benefits-including CO₂ reduction, time savings, and fuel efficiency-amount to US$31.82 billion. Widespread adoption will require enhanced data collection and processing systems, underscoring the need for policy and technological development. Our findings highlight the transformative potential of big-data-driven adaptive systems to alleviate congestion and promote urban sustainability.

| S-EPMC11868367 | biostudies-literature

Supervised learning from human performance at the computationally hard problem of optimal traffic signal control on a network of junctions.

Project description:Optimal switching of traffic lights on a network of junctions is a computationally intractable problem. In this research, road traffic networks containing signallized junctions are simulated. A computer game interface is used to enable a human 'player' to control the traffic light settings on the junctions within the simulation. A supervised learning approach, based on simple neural network classifiers can be used to capture human player's strategies in the game and thus develop a human-trained machine control (HuTMaC) system that approaches human levels of performance. Experiments conducted within the simulation compare the performance of HuTMaC to two well-established traffic-responsive control systems that are widely deployed in the developed world and also to a temporal difference learning-based control method. In all experiments, HuTMaC outperforms the other control methods in terms of average delay and variance over delay. The conclusion is that these results add weight to the suggestion that HuTMaC may be a viable alternative, or supplemental method, to approximate optimization for some practical engineering control problems where the optimal strategy is computationally intractable.

| S-EPMC4448775 | biostudies-literature

Design of reinforcement learning for perimeter control using network transmission model based macroscopic traffic simulation.

Project description:Perimeter control is an emerging alternative for traffic signal control, which regulates the traffic flows on the periphery of a road network. Some model-based approaches have been suggested earlier for the optimization of perimeter control based on macroscopic fundamental diagrams (MFDs). However, there are several limitations when considering their application to a large-scale urban area because the model-based approaches may not be scalable to multiple regions and inappropriate for handling various effects caused by the shape change of MFDs. Therefore, we propose a model-free and data-driven approach that combines reinforcement learning (RL) with the macroscopic traffic simulation based on the recently developed network transmission model. First, we design four perimeter control models with different macroscopic traffic variables and parametrizations. Then, we validate the proposed models by evaluating their performances with the test demand scenarios at different levels. The validation results show that the model containing travel demand information adapts to a new demand scenario better than the model containing only density-related factors.

| S-EPMC7392337 | biostudies-literature

From Cellular Attractor Selection to Adaptive Signal Control for Traffic Networks.

Project description:The management of varying traffic flows essentially depends on signal controls at intersections. However, design an optimal control that considers the dynamic nature of a traffic network and coordinates all intersections simultaneously in a centralized manner is computationally challenging. Inspired by the stable gene expressions of Escherichia coli in response to environmental changes, we explore the robustness and adaptability performance of signalized intersections by incorporating a biological mechanism in their control policies, specifically, the evolution of each intersection is induced by the dynamics governing an adaptive attractor selection in cells. We employ a mathematical model to capture such biological attractor selection and derive a generic, adaptive and distributed control algorithm which is capable of dynamically adapting signal operations for the entire dynamical traffic network. We show that the proposed scheme based on attractor selection can not only promote the balance of traffic loads on each link of the network but also allows the global network to accommodate dynamical traffic demands. Our work demonstrates the potential of bio-inspired intelligence emerging from cells and provides a deep understanding of adaptive attractor selection-based control formation that is useful to support the designs of adaptive optimization and control in other domains.

| S-EPMC4789751 | biostudies-other

A dynamic traffic signal scheduling system based on improved greedy algorithm.

Project description:Urbanization has led to accelerated traffic congestion, posing a significant obstacle to urban development. Traditional traffic signal scheduling methods are often inefficient and cumbersome, resulting in unnecessary waiting times for vehicles and pedestrians, exacerbating the traffic situation. To address this issue, this article proposes a dynamic traffic signal scheduling system based on an improved greedy algorithm. Unlike conventional approaches, we introduce a reward function and a cost model to ensure fair scheduling plans. A constraint function is also established, and the traffic signal scheduling is iterated through the feasible matrix using the greedy algorithm to simplify the decision-making process and enhance solution efficiency. Moreover, an emergency module is integrated to prioritize special emergency vehicles, reducing their response time during emergencies. To validate the effectiveness of our dynamic traffic signal scheduling system, we conducted simulation experiments using the Simulation of Urban Mobility (SUMO) traffic simulation suite and the SUMO traffic control interface Traci. The results indicate that our system significantly improves intersection throughput and adapts well to various traffic conditions, effectively resolving urban traffic congestion while ensuring fair scheduling plans.

| S-EPMC10942090 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data