A Markov Decision Process framework to incorporate network-level data in motion planning for connected and automated vehicles

Autonomy and connectivity are expected to enhance safety and improve fuel efficiency in transportation systems. While connected vehicle-enabled technologies, such as coordinated cruise control, can improve vehicle motion planning by incorporating information beyond the line of sight of vehicles, their benefits are limited by the current short-sighted planning strategies that only utilize local information. In this paper, the authors propose a framework that devises vehicle trajectories by coupling a locally-optimal motion planner with a Markov decision process (MDP) model that can capture network-level information. The authors' proposed framework can guarantee safety while minimizing a trip’s generalized cost, which comprises of its fuel and time costs. To showcase the benefits of incorporating network-level data when devising vehicle trajectories, the authors conduct a comprehensive simulation study in three experimental settings, namely a circular track, a highway with on- and off-ramps, and a small urban network. The simulation results indicate that statistically significant efficiency can be obtained for the subject vehicle and its surrounding vehicles in different traffic states under all experimental settings. This paper serves as a proof-of-concept to showcase how connectivity and autonomy can be leveraged to incorporate network-level information into motion planning.

• Record URL:
  https://doi.org/10.1016/j.trc.2021.103550
• Record URL:
  http://www.sciencedirect.com/science/article/pii/S0968090X21005325
• Availability:
  • Find a library where document is available. Order URL: http://worldcat.org/issn/0968090X
• Supplemental Notes:
  • © 2022 Elsevier Ltd. All rights reserved. Abstract reprinted with permission of Elsevier.
• Authors:
  • Liu, Xiangguo
  • 0000-0002-1944-3923
  • Masoud, Neda
  • Zhu, Qi
  • Khojandi, Anahita
  • 0000-0001-6818-2048
• Publication Date: 2022-3

Language

• English

Media Info

• Media Type: Web
• Features: Appendices; Figures; References; Tables;
• Pagination: 103550
• Serial:
  • Transportation Research Part C: Emerging Technologies
  • Volume: 136
  • Issue Number: 0
  • Publisher: Elsevier
  • ISSN: 0968-090X
  • Serial URL: http://www.sciencedirect.com/science/journal/0968090X

Subject/Index Terms

• TRT Terms: Autonomous vehicles; Connected vehicles; Markov processes; Trajectory control
• Subject Areas: Data and Information Technology; Highways; Operations and Traffic Management; Vehicles and Equipment;

Filing Info

• Accession Number: 01835941
• Record Type: Publication
• Files: TRIS
• Created Date: Feb 15 2022 9:49AM