Autonomous navigation at unsignalized intersections: A coupled reinforcement learning and model predictive control approach
This paper develops an integrated safety-enhanced reinforcement learning (RL) and model predictive control (MPC) framework for autonomous vehicles (AVs) to navigate unsignalized intersections. Researchers have extensively studied how AVs drive along highways. Nonetheless, how AVs navigate intersections in urban environments remains a challenging task due to the constant presence of moving road users, including turning vehicles, crossing or jaywalking pedestrians, and cyclists. AVs are thus required to learn and adapt to a dynamically evolving urban traffic environment. This paper proposes a design benchmark that allows AVs to sense the real-time traffic environment and perform path planning. The agent dynamically generates curves for feasible paths. The ego vehicle attempts to follow these paths under specific constraints. RL and MPC navigation algorithms run in parallel and are suitably selected to enhance ego vehicle safety. The ego AV is modeled with lateral and longitudinal dynamics and trained in a T-intersection using the Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm under various traffic scenarios. It is then tested on a straight road and a single or multi-lane intersections. All these experiments achieve desirable outcomes in terms of crash avoidance, driving efficiency, comfort, and tracking accuracy. The developed AV navigation system provides a design benchmark for an adaptive AV that can navigate unsignalized intersections.
- Record URL:
- Record URL:
-
Availability:
- Find a library where document is available. Order URL: http://worldcat.org/issn/0968090X
-
Supplemental Notes:
- © 2022 Elsevier Ltd. All rights reserved. Abstract reprinted with permission of Elsevier.
-
Authors:
- Bautista-Montesano, Rolando
-
0000-0002-0723-5799
- Galluzzi, Renato
-
0000-0001-6125-8222
- Ruan, Kangrui
- Fu, Yongjie
- Di, Xuan
-
0000-0003-2925-7697
- Publication Date: 2022-6
Language
- English
Media Info
- Media Type: Web
- Features: Appendices; Figures; References; Tables;
- Pagination: 103662
-
Serial:
- Transportation Research Part C: Emerging Technologies
- Volume: 139
- Issue Number: 0
- Publisher: Elsevier
- ISSN: 0968-090X
- Serial URL: http://www.sciencedirect.com/science/journal/0968090X
Subject/Index Terms
- TRT Terms: Autonomous vehicles; Machine learning; Process control; Trajectory control; Unsignalized intersections
- Subject Areas: Highways; Operations and Traffic Management; Vehicles and Equipment;
Filing Info
- Accession Number: 01845030
- Record Type: Publication
- Files: TRIS
- Created Date: May 10 2022 2:35PM