Deep reinforcement learning with dynamic window approach based collision avoidance path planning for maritime autonomous surface ships

Automatic obstacle avoidance technology is one of the key technologies for ship intelligence. The purpose of this paper is to investigate the obstacle avoidance problem of maritime autonomous surface ships(MASS) in a complex offshore environment, and an obstacle avoidance strategy based on deep reinforcement learning and a dynamic window algorithm was proposed. To solve the collision avoidance problems that may occur during intelligent ship navigation, the action space of the proximal policy optimization (PPO) algorithm is defined according to the description of ship motion by linear and angular velocity in the dynamic window approach (DWA). The maximum detection distance of the MASS is utilized to construct the ship safety domain, which determines the state space containing the information of this ship and the nearest obstacle. To solve the problem of sparse reward, the reward function of the PPO is improved by combining the evaluation functions for distance, velocity and heading in the DWA. To verify the effectiveness of the algorithm, simulation experiments are performed in various situations. It is also shown that the improved algorithm can make the optimal collision avoidance decision from the complex environment and can effectively realize autonomous collision avoidance path planning for the MASS.

• Record URL:
  • https://doi.org/10.1016/j.oceaneng.2023.115208
• Record URL:
  • http://www.sciencedirect.com/science/article/pii/S0029801823015925
• Availability:
  • Find a library where document is available. Order URL: http://worldcat.org/issn/00298018
• Supplemental Notes:
  • © 2023 Published by Elsevier Ltd. Abstract reprinted with permission of Elsevier.
• Authors:
  • Wu, Chuanbo
  • Yu, Wangneng
  • Li, Guangze
  • 0000-0003-1011-0089
  • Liao, Weiqiang
• Publication Date: 2023-9-15

Language

• English

Media Info

• Media Type: Web
• Features: Figures; References; Tables;
• Pagination: 115208
• Serial:
  • Ocean Engineering
  • Volume: 284
  • Issue Number: 0
  • Publisher: Pergamon
  • ISSN: 0029-8018
  • EISSN: 1873-5258
  • Serial URL: http://www.sciencedirect.com/science/journal/00298018

Subject/Index Terms

• TRT Terms: Autonomous vehicles; Crash avoidance systems; Machine learning; Ships; Trajectory control
• Subject Areas: Marine Transportation; Safety and Human Factors; Vehicles and Equipment;

Filing Info

• Accession Number: 01890484
• Record Type: Publication
• Files: TRIS
• Created Date: Aug 23 2023 10:14AM