Tactical driving decisions of unmanned ground vehicles in complex highway environments: A deep reinforcement learning approach

In this study, a deep reinforcement learning approach is proposed to handle tactical driving in complex highway traffic environments for unmanned ground vehicles. Tactical driving is a challenging topic for unmanned ground vehicles because of its interplay with routing decisions as well as real-time traffic dynamics. The core of the authors' deep reinforcement learning approach is a deep Q-network that takes dynamic traffic information as input and outputs typical tactical driving decisions as action. The reward is designed with the consideration of successful highway exit, average traveling speed, and driving safety and comfort. In order to endow an unmanned ground vehicle with situational traffic information that is critical for tactical driving, the vehicle’s sensor information such as vehicle position and velocity are further augmented through the assessment of the ego-vehicle’s collision risk, potential field, and kinematics and used as input for the deep Q-network model. A convolutional neural network is built and fine-tuned to extract traffic features which facilitate the decision-making process of Q-learning. For model training and testing, a highway simulation platform is constructed with realistic parameter settings obtained from a real-world highway traffic dataset. The performance of the deep Q-network model is validated with extensive simulation experiments under different parameter settings such as traffic density and risk level. The results exhibit the important potentials of the authors' deep Q-network model in learning challenging tactical driving decisions given multiple objectives and complex traffic environment.

• Record URL:
  https://doi.org/10.1177/0954407019898009
• Availability:
  • Find a library where document is available. Order URL: http://worldcat.org/issn/09544070
• Supplemental Notes:
  • © IMechE 2020.
• Authors:
  • Wang, Huanjie
  • 0000-0003-2851-1147
  • Yuan, Shihua
  • Guo, Mengyu
  • Chan, Ching-Yao
  • Li, Xueyuan
  • Lan, Wei
• Publication Date: 2021-3

Language

• English

Media Info

• Media Type: Web
• Features: References;
• Pagination: pp 1113-1127
• Serial:
  • Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering
  • Volume: 235
  • Issue Number: 4
  • Publisher: Sage Publications Limited
  • ISSN: 0954-4070
  • EISSN: 2041-2991
  • Serial URL: http://pid.sagepub.com/content/current

Subject/Index Terms

• TRT Terms: Autonomous vehicles; Decision support systems; Driving; Intelligent vehicles; Machine learning
• Subject Areas: Highways; Vehicles and Equipment;

Filing Info

• Accession Number: 01765277
• Record Type: Publication
• Files: TRIS
• Created Date: Feb 22 2021 10:20AM