Policy Iteration Based Approximate Dynamic Programming Toward Autonomous Driving in Constrained Dynamic Environment

In the area of autonomous driving, it typically brings great difficulty in solving the motion planning problem since the vehicle model is nonlinear and the driving scenarios are complex. Particularly, most of the existing methods cannot be generalized to dynamically changing scenarios with varying surrounding vehicles. To address this problem, this development here investigates the framework of integrated decision and control. As part of the modules, static path planning determines the reference candidates ahead, and then the optimal path-tracking controller realizes the specific autonomous driving task. An innovative and effective constrained finite-horizon approximate dynamic programming (ADP) algorithm is herein presented to generate the desired control policy for effective path tracking. With the generalized policy neural network that maps from the state to the control input, the proposed algorithm preserves the high effectiveness for the motion planning problem towards changing driving environments with varying surrounding vehicles. Moreover, the algorithm attains the noteworthy advantage of alleviating the typically heavy computational loads with the mode of offline training and online execution. As a result of the utilization of multi-layer neural networks in conjunction with the actor-critic framework, the constrained ADP method is capable of handling complex and multidimensional scenarios. Finally, various simulations have been carried out to show that the constrained ADP algorithm is effective.

• Record URL:
  http://dx.doi.org/10.1109/TITS.2023.3237568
• Availability:
  • Find a library where document is available. Order URL: http://worldcat.org/oclc/41297384
• Supplemental Notes:
  • Copyright © 2023, IEEE.
• Authors:
  • Lin, Ziyu
  • Duan, Jiongqiang
  • Ma, Jun
  • Ma, Jingliang
  • Li, Shengbo Eben
  • Ma, Haitong
  • Cheng, Bo
  • Lee, Tong Heng
• Publication Date: 2023-5

Language

• English

Media Info

• Media Type: Web
• Features: References;
• Pagination: pp 5003-5013
• Serial:
  • IEEE Transactions on Intelligent Transportation Systems
  • Volume: 24
  • Issue Number: 5
  • Publisher: Institute of Electrical and Electronics Engineers (IEEE)
  • ISSN: 1524-9050
  • Serial URL: http://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=6979

Subject/Index Terms

• TRT Terms: Algorithms; Autonomous vehicles; Machine learning; Neural networks; Trajectory control
• Subject Areas: Data and Information Technology; Highways; Vehicles and Equipment;

Filing Info

• Accession Number: 01893846
• Record Type: Publication
• Files: TRIS
• Created Date: Sep 21 2023 11:06AM