Path Planning for Automatic Berthing Using Ship-Maneuvering Simulation-Based Deep Reinforcement Learning

被引:7
|
作者
Vo, Anh Khoa [1 ]
Mai, Thi Loan [2 ]
Yoon, Hyeon Kyu [2 ]
机构
[1] Changwon Natl Univ, Dept Smart Environm Energy Engn, Chang Won 51140, South Korea
[2] Changwon Natl Univ, Dept Naval Architecture & Marine Engn, Chang Won 51140, South Korea
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 23期
关键词
path planning; deep reinforcement learning; TD3; maneuvering simulation; automatic berthing;
D O I
10.3390/app132312731
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Despite receiving much attention from researchers in the field of naval architecture and marine engineering since the early stages of modern shipbuilding, the berthing phase is still one of the biggest challenges in ship maneuvering due to the potential risks involved. Many algorithms have been proposed to solve this problem. This paper proposes a new approach with a path-planning algorithm for automatic berthing tasks using deep reinforcement learning (RL) based on a maneuvering simulation. Unlike the conventional path-planning algorithm using the control theory or an advanced algorithm using deep learning, a state-of-the-art path-planning algorithm based on reinforcement learning automatically learns, explores, and optimizes the path for berthing performance through trial and error. The results of performing the twin delayed deep deterministic policy gradient (TD3) combined with the maneuvering simulation show that the approach can be used to propose a feasible and safe path for high-performing automatic berthing tasks.
引用
收藏
页数:16
相关论文
共 50 条
  • [31] System parameter exploration of ship maneuvering model for automatic docking/berthing using CMA-ES
    Yoshiki Miyauchi
    Atsuo Maki
    Naoya Umeda
    Dimas M. Rachman
    Youhei Akimoto
    Journal of Marine Science and Technology, 2022, 27 : 1065 - 1083
  • [32] Dynamic Path Planning of Unknown Environment Based on Deep Reinforcement Learning
    Lei, Xiaoyun
    Zhang, Zhian
    Dong, Peifang
    JOURNAL OF ROBOTICS, 2018, 2018
  • [33] Crowd evacuation path planning and simulation method based on deep reinforcement learning and repulsive force field
    Wang, Hongyue
    Liu, Hong
    Li, Wenhao
    APPLIED INTELLIGENCE, 2025, 55 (04)
  • [34] DEEP REINFORCEMENT LEARNING FOR SHIP COLLISION AVOIDANCE AND PATH TRACKING
    Singht, Amar Nath
    Vijayakumar, Akash
    Balasubramaniyam, Shankruth
    Somayajula, Abhilash
    PROCEEDINGS OF ASME 2024 43RD INTERNATIONAL CONFERENCE ON OCEAN, OFFSHORE AND ARCTIC ENGINEERING, OMAE2024, VOL 5B, 2024,
  • [35] Efficient Deep Reinforcement Learning for Optimal Path Planning
    Ren, Jing
    Huang, Xishi
    Huang, Raymond N.
    ELECTRONICS, 2022, 11 (21)
  • [36] SIMULATION-BASED ESTIMATION OF COLLISION RISK DURING SHIP MANEUVERING IN TWO-LANE CANAL USING MATHEMATICAL MANEUVERING GROUP MODEL AND AUTOMATIC IDENTIFICATION SYSTEM DATA
    Asmara, I. Putu Sindhu
    Kobayashi, Eiichi
    Artana, Ketut Buda
    Masroeri, Agoes A.
    Wakabayashi, Nobukazu
    33RD INTERNATIONAL CONFERENCE ON OCEAN, OFFSHORE AND ARCTIC ENGINEERING, 2014, VOL 4A, 2014,
  • [37] On the performance of different Deep Reinforcement Learning based controllers for the path-following of a ship
    Sivaraj, Sivaraman
    Dubey, Awanish
    Rajendran, Suresh
    OCEAN ENGINEERING, 2023, 286
  • [38] Coverage Path Planning Using Actor-Critic Deep Reinforcement Learning
    Garrido-Castaneda, Sergio Isahi
    Vasquez, Juan Irving
    Antonio-Cruz, Mayra
    SENSORS, 2025, 25 (05)
  • [39] Path Planning Method of Mobile Robot Using Improved Deep Reinforcement Learning
    Wang, Wei
    Wu, Zhenkui
    Luo, Huafu
    Zhang, Bin
    JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING, 2022, 2022
  • [40] A Mapless Local Path Planning Approach Using Deep Reinforcement Learning Framework
    Yin, Yan
    Chen, Zhiyu
    Liu, Gang
    Guo, Jianwei
    SENSORS, 2023, 23 (04)