A modified reinforcement learning algorithm for solving coordinated signalized networks
This study proposes Reinforcement Learning (RL) based algorithm for finding optimum signal timings in Coordinated Signalized Networks (CSN) for fixed set of link flows. For this purpose, MOdified REinforcement Learning algorithm with TRANSYT-7F (MORELTRANS) model is proposed by way of combining RL algorithm and TRANSYT-7F. The modified RL differs from other RL algorithms since it takes advantage of the best solution obtained from the previous learning episode by generating a sub-environment at each learning episode as the same size of original environment. On the other hand, TRANSYT-7F traffic model is used in order to determine network performance index, namely disutility index. Numerical application is conducted on medium sized coordinated signalized road network. Results indicated that the MORELTRANS produced slightly better results than the GA in signal timing optimization in terms of objective function value while it outperformed than the HC. In order to show the capability of the proposed model for heavy demand condition, two cases in which link flows are increased by 20% and 50% with respect to the base case are considered. It is found that the MORELTRANS is able to reach good solutions for signal timing optimization even if demand became increased.
- Record URL:
- Record URL:
-
Availability:
- Find a library where document is available. Order URL: http://worldcat.org/issn/0968090X
-
Supplemental Notes:
- Abstract reprinted with permission of Elsevier.
-
Authors:
- Ozan, Cenk
- Baskan, Ozgur
- Haldenbilen, Soner
- Ceylan, Halim
- Publication Date: 2015-5
Language
- English
Media Info
- Media Type: Digital/other
- Features: Figures; References; Tables;
- Pagination: pp 40-55
-
Serial:
- Transportation Research Part C: Emerging Technologies
- Volume: 54
- Issue Number: 0
- Publisher: Elsevier
- ISSN: 0968-090X
- Serial URL: http://www.sciencedirect.com/science/journal/0968090X
Subject/Index Terms
- TRT Terms: Algorithms; Machine learning; Optimization; Traffic signal control systems; Traffic signal timing
- Identifier Terms: TRANSYT-7F (Computer program)
- Subject Areas: Highways; Operations and Traffic Management; I73: Traffic Control;
Filing Info
- Accession Number: 01560590
- Record Type: Publication
- Files: TRIS
- Created Date: Apr 17 2015 1:56PM