Integrating big data analytics in autonomous driving: An unsupervised hierarchical reinforcement learning approach

In the realm of autonomous vehicular systems, there has been a notable increase in end-to-end algorithms designed for complete self-navigation. Researchers are increasingly applying hierarchical reinforcement learning to autonomous driving tasks to address the rising challenges. This study proposes a novel hierarchical reinforcement learning approach that facilitates the training of sub-networks without the need for manual reward design. First, unsupervised reinforcement learning is used to train skills without predefined rewards. These skills are subsequently integrated as sub-policies in the hierarchical reinforcement learning framework to train the meta-controller, which synthesizes these skills to autonomously execute driving tasks in complex scenarios. This training strategy encapsulates the accumulated knowledge into skills, enhancing the transferability and efficiency of learning for similar tasks compared to traditional reinforcement learning methods. Additionally, compared with general hierarchical reinforcement learning, this method does not need to design rewards for each sub-policy, allowing for an indefinite expansion of diverse sub-strategies, which may potentially yield superior performance in a range of tasks.

• Record URL:
  https://doi.org/10.1016/j.trc.2024.104606
• Record URL:
  http://www.sciencedirect.com/science/article/pii/S0968090X2400127X
• Availability:
  • Find a library where document is available. Order URL: http://worldcat.org/issn/0968090X
• Supplemental Notes:
  • © 2024 Elsevier Ltd. All rights reserved. Abstract reprinted with permission of Elsevier.
• Authors:
  • Mao, Zhiqi
  • 0009-0003-9432-8655
  • Liu, Yang
  • Qu, Xiaobo
• Publication Date: 2024-5

Language

• English

Media Info

• Media Type: Web
• Features: Figures; References;
• Pagination: 104606
• Serial:
  • Transportation Research Part C: Emerging Technologies
  • Volume: 162
  • Issue Number: 0
  • Publisher: Elsevier
  • ISSN: 0968-090X
  • Serial URL: http://www.sciencedirect.com/science/journal/0968090X

Subject/Index Terms

• TRT Terms: Automated vehicle control; Autonomous vehicles; Decision making; Machine learning
• Subject Areas: Data and Information Technology; Highways; Vehicles and Equipment;

Filing Info

• Accession Number: 01916995
• Record Type: Publication
• Files: TRIS
• Created Date: Apr 29 2024 10:31AM