A Study of Using a Reinforcement Learning Method to Improve Fuel Consumption of a Connected Vehicle with Signal Phase and Timing Data
Connected and automated vehicles (CAVs) promise to reshape two areas of the mobility industry: the transportation and driving experience. The connected feature of the vehicle uses communication protocols to provide awareness of the surrounding world while the automated feature uses technology to minimize driver dependency. Constituting a subset of connected technologies, vehicle-to-infrastructure (V2I) technologies provide vehicles with real-time traffic light information, or Signal Phase and Timing (SPaT) data. In this paper, the vehicle and SPaT data are combined with a reinforcement learning (RL) method as an effort to minimize the vehicle’s energy consumption. Specifically, this paper explores the implementation of the deep deterministic policy gradient (DDPG) algorithm. As an off-policy approach, DDPG utilizes the maximum Q-value for the state regardless of the previous action performed. In this research, the SPaT data collected from dedicated short-range communication (DSRC) hardware installed at 16 real traffic lights is utilized in a simulated road modeled after a road in Tuscaloosa, Alabama. The vehicle is trained using DDPG with the SPaT data which then determines the optimal action to take in order to minimize the energy consumption at each traffic light.
- Record URL:
-
Availability:
- Find a library where document is available. Order URL: http://worldcat.org/issn/01487191
-
Supplemental Notes:
- Abstract reprinted with permission of SAE International.
-
Authors:
- Phan, Ashley
- Yoon, Hwan-Sik
-
Conference:
- WCX SAE World Congress Experience
- Location: Detroit Michigan, United States
- Date: 2020-4-21 to 2020-4-23
- Publication Date: 2020-4-14
Language
- English
Media Info
- Media Type: Web
- Features: References;
-
Serial:
- SAE Technical Paper
- Publisher: Society of Automotive Engineers (SAE)
- ISSN: 0148-7191
- EISSN: 2688-3627
- Serial URL: http://papers.sae.org/
Subject/Index Terms
- TRT Terms: Algorithms; Connected vehicles; Dedicated short range communications; Energy consumption; Fuel consumption; Machine learning; Offsets (Traffic signal timing); Optimization; Traffic signal phases; Vehicle to infrastructure communications
- Geographic Terms: Tuscaloosa (Alabama)
- Subject Areas: Data and Information Technology; Energy; Highways; Operations and Traffic Management; Vehicles and Equipment;
Filing Info
- Accession Number: 01739538
- Record Type: Publication
- Source Agency: SAE International
- Report/Paper Numbers: 2020-01-0888
- Files: TRIS, SAE
- Created Date: May 19 2020 9:16AM