Evaluating Green-Extension Policies with Reinforcement Learning and Markovian Traffic State Estimation
Several protection algorithms strive to reduce the number of vehicles trapped in the dilemma zone. These algorithms use some arbitrary policies such as terminating the green when only one vehicle is present in the dilemma zone and the dilemma zone has not cleared after a certain period of time. The research proposes a control agent that is able to develop and adapt an optimal policy by learning from the environment. The agent incorporates a Markovian traffic state estimation into its learning process. A novel approach is presented for controlling traffic signals so that the number of vehicles trapped in the dilemma zone is reduced in an optimal fashion according to changes in traffic states. A comparison between the proposed optimal policy and the emerging detection-control system two-stage policy was conducted, and it was found that the policy based on reinforcement learning reduced the number of vehicles caught in the dilemma zone by up to 32%.
- Record URL:
- Summary URL:
-
Availability:
- Find a library where document is available. Order URL: http://worldcat.org/isbn/9780309142601
-
Authors:
- Adam, Zain M
- Abbas, Montasir M
- Li, Pengfei
- Publication Date: 2009
Language
- English
Media Info
- Media Type: Print
- Features: Figures; References; Tables;
- Pagination: pp 217-225
- Monograph Title: Traffic Signal Systems 2009
-
Serial:
- Transportation Research Record: Journal of the Transportation Research Board
- Issue Number: 2128
- Publisher: Transportation Research Board
- ISSN: 0361-1981
Subject/Index Terms
- TRT Terms: Dilemma zone; Green interval (Traffic signal cycle); Highway traffic control; Markov processes; Traffic estimation; Traffic signal control systems
- Uncontrolled Terms: Detection control system; Reinforcement learning
- Subject Areas: Highways; Operations and Traffic Management; I73: Traffic Control;
Filing Info
- Accession Number: 01126645
- Record Type: Publication
- ISBN: 9780309142601
- Report/Paper Numbers: 09-3734
- Files: TRIS, TRB, ATRI
- Created Date: Apr 17 2009 9:56AM