Continuous decision-making for autonomous driving at intersections using deep deterministic policy gradient

Intersections have been identified as the most complex and accident-prone traffic scenarios on road. Making appropriate decisions at intersections for driving safety, efficiency, and comfort become a challenging task for autonomous vehicles (AVs). The existing research on AV decision-making at intersections either considers a single scenario only with discrete behaviour outputs or ignores the requirements for driving efficiency and comfort. To address these problems, this study proposed a deep reinforcement learning based continuous decision-making method to make AVs drive through intersections. The proposed method establishes an end-to-end decision-making framework by using a convolutional neural network to map the relationship between traffic images and vehicle operations. The interaction between the AV and other vehicles was modelled as a Markov decision process (MDP), and a deep deterministic policy gradient algorithm was employed to solve the MDP problem and obtain the optimal driving policy. The top three accident-prone crossing path crash scenarios at intersections were realized in CARLA to verify the effectiveness of the proposed method. The experimental results demonstrated that the developed method could provide effective policies to ensure driving safety and efficiency while considering driving comfort for autonomous driving at intersections in all the examined scenarios.

• Record URL:
  http://dx.doi.org/10.1049/itr2.12107
• Availability:
  • Find a library where document is available. Order URL: http://worldcat.org/issn/1751956X
• Supplemental Notes:
  • Abstract reprinted with permission of the Institution of Engineering and Technology.
• Authors:
  • Li, Guofa
  • Li, Shenglong
  • Li, Shen
  • Qu, Xingda
• Publication Date: 2022-12

Language

• English

Media Info

• Media Type: Web
• Features: Figures; References; Tables;
• Pagination: pp 1669-1681
• Serial:
  • IET Intelligent Transport Systems
  • Volume: 16
  • Issue Number: 12
  • Publisher: Institution of Engineering and Technology (IET)
  • ISSN: 1751-956X
  • EISSN: 1751-9578
  • Serial URL: https://ietresearch.onlinelibrary.wiley.com/journal/17519578
• Publication flags:

  Open Access (libre)

Subject/Index Terms

• TRT Terms: Autonomous vehicles; Decision making; Highway safety; Intersections; Machine learning; Markov processes
• Subject Areas: Highways; Operations and Traffic Management; Safety and Human Factors; Vehicles and Equipment;

Filing Info

• Accession Number: 01864944
• Record Type: Publication
• Files: TRIS
• Created Date: Nov 23 2022 1:33PM