Multi-Agent Reinforcement Learning for Integrated Network of Adaptive Traffic Signal Controllers (MARLIN-ATSC)

Traffic congestion in Greater Toronto Area costs Canada $6 billion/year and is expected to grow up to $15 billion/year in the next few decades. Adaptive Traffic Signal Control (ATSC) is a promising technique to alleviate traffic congestion. For medium-large transportation networks, coordinated ATSC is becoming a challenging problem because the number of system states and actions grows exponentially as the number of networked intersections grows. Efficient and robust controllers can be designed using a multi-agent reinforcement learning (MARL) approach in which each controller (agent) is responsible for the control of traffic lights around a single traffic junction. This paper presents a novel, decentralized and coordinated adaptive real-time traffic signal control system using Multi-Agent Reinforcement Learning for Integrated Network of Adaptive Traffic Signal Controllers (MARLINATSC) that aims to minimize the total vehicle delay in the traffic network. The system is tested using microscopic traffic simulation software (PARAMICS) on a network of 5 signalized intersections in Downtown Toronto. The performance of MARLIN-ATSC is compared against two approaches: the conventional pretimed signal control (B1) and independent RL-based control agents (B2), i.e. with no coordination. The results show that network-wide average delay savings range from 32% to 63% relative to B1 and from 7% to 12% relative to B2 under different demand levels and arrival profiles.

• Record URL:
  https://doi.org/10.1109/ITSC.2012.6338707
• Availability:
  • Find a library where document is available. Order URL: http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=6328848
• Supplemental Notes:
  • Abstract reprinted with permission of IEEE.
• Corporate Authors:

  Institute of Electrical and Electronics Engineers (IEEE)

  3 Park Avenue, 17th Floor
  New York, NY  United States  10016-5997
• Authors:
  • El-Tantawy, S
  • Abdulhai, B
• Conference:
  • 15th International IEEE Conference on Intelligent Transportation Systems (ITSC2012)
  • Location: Anchorage Alaska, United States
  • Date: 2012-9-16 to 2012-9-19
• Publication Date: 2012-9

Language

• English

Media Info

• Media Type: Web
• Features: References;
• Pagination: pp 319-326
• Monograph Title: 15th International IEEE Conference on Intelligent Transportation Systems (ITSC 2012)

Subject/Index Terms

• TRT Terms: Multi-agent systems; Real time control; Traffic congestion; Traffic delays; Traffic signal controllers; Traffic simulation
• Identifier Terms: Paramics (Computer program)
• Geographic Terms: Toronto (Canada)
• Subject Areas: Highways; Operations and Traffic Management; I73: Traffic Control;

Filing Info

• Accession Number: 01568018
• Record Type: Publication
• ISBN: 9781467330640
• Files: TRIS
• Created Date: Jun 26 2015 5:12PM