Path Planning for Automatic Berthing Using Ship-Maneuvering Simulation-Based Deep Reinforcement Learning

被引:7
|
作者
Vo, Anh Khoa [1 ]
Mai, Thi Loan [2 ]
Yoon, Hyeon Kyu [2 ]
机构
[1] Changwon Natl Univ, Dept Smart Environm Energy Engn, Chang Won 51140, South Korea
[2] Changwon Natl Univ, Dept Naval Architecture & Marine Engn, Chang Won 51140, South Korea
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 23期
关键词
path planning; deep reinforcement learning; TD3; maneuvering simulation; automatic berthing;
D O I
10.3390/app132312731
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Despite receiving much attention from researchers in the field of naval architecture and marine engineering since the early stages of modern shipbuilding, the berthing phase is still one of the biggest challenges in ship maneuvering due to the potential risks involved. Many algorithms have been proposed to solve this problem. This paper proposes a new approach with a path-planning algorithm for automatic berthing tasks using deep reinforcement learning (RL) based on a maneuvering simulation. Unlike the conventional path-planning algorithm using the control theory or an advanced algorithm using deep learning, a state-of-the-art path-planning algorithm based on reinforcement learning automatically learns, explores, and optimizes the path for berthing performance through trial and error. The results of performing the twin delayed deep deterministic policy gradient (TD3) combined with the maneuvering simulation show that the approach can be used to propose a feasible and safe path for high-performing automatic berthing tasks.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] A spacecraft attitude maneuvering path planning method based on PIO-improved reinforcement learning
    Hua B.
    Sun S.
    Wu Y.
    Chen Z.
    Zhongguo Kexue Jishu Kexue/Scientia Sinica Technologica, 2023, 53 (02): : 200 - 209
  • [22] Multi-objective path planning based on deep reinforcement learning
    Xu, Jian
    Huang, Fei
    Cui, Yunfei
    Du, Xue
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 3273 - 3279
  • [23] Dynamic Scene Path Planning of UAVs Based on Deep Reinforcement Learning
    Tang, Jin
    Liang, Yangang
    Li, Kebo
    DRONES, 2024, 8 (02)
  • [24] Improved Robot Path Planning Method Based on Deep Reinforcement Learning
    Han, Huiyan
    Wang, Jiaqi
    Kuang, Liqun
    Han, Xie
    Xue, Hongxin
    SENSORS, 2023, 23 (12)
  • [25] AUV path planning based on improved IFDS and deep reinforcement learning
    Fan, Yiqun
    Li, Hongna
    Xie, Jiaqi
    Zhou, Yunfu
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2024, 21 (06):
  • [26] Path planning of robotic arm based on deep reinforcement learning algorithm
    Al-Gabalawy M.
    Advanced Control for Applications: Engineering and Industrial Systems, 2022, 4 (01):
  • [27] Robot Patrol Path Planning Based on Combined Deep Reinforcement Learning
    Li, Wenqi
    Chen, Dehua
    Le, Jiajin
    2018 IEEE INT CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, UBIQUITOUS COMPUTING & COMMUNICATIONS, BIG DATA & CLOUD COMPUTING, SOCIAL COMPUTING & NETWORKING, SUSTAINABLE COMPUTING & COMMUNICATIONS, 2018, : 659 - 666
  • [28] Path planning of manipulator based on deep reinforcement learning and screw method
    Wang Y.
    Wang Y.-H.
    Yin Z.-Z.
    Wan P.
    Kongzhi Lilun Yu Yingyong/Control Theory and Applications, 2023, 40 (03): : 516 - 524
  • [29] A path planning method based on deep reinforcement learning for crowd evacuation
    Meng X.
    Liu H.
    Li W.
    Journal of Ambient Intelligence and Humanized Computing, 2024, 15 (6) : 2925 - 2939
  • [30] UAV online path planning technology based on deep reinforcement learning
    Fan, Jiaxuan
    Wang, Zhenya
    Ren, Jinlei
    Lu, Ying
    Liu, Yiheng
    2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 5382 - 5386