DIGITAL TWIN OF AUTONOMOUS SURFACE VESSELS FOR SAFE MARITIME NAVIGATION ENABLED THROUGH PREDICTIVE MODELING AND REINFORCEMENT LEARNING

被引:0
|
作者
Menges, Daniel [1 ]
Von Brandis, Andreas [1 ]
Rasheed, Adil [1 ,2 ]
机构
[1] Norwegian Univ Sci & Technol, Trondheim, Norway
[2] SINTEF Digital, Dept Math & Cybernet, Trondheim, Norway
来源
PROCEEDINGS OF ASME 2024 43RD INTERNATIONAL CONFERENCE ON OCEAN, OFFSHORE AND ARCTIC ENGINEERING, OMAE2024, VOL 5B | 2024年
关键词
Digital Twin; Autonomous Surface Vessel; Situational Awareness; Target Tracking; Predictive Safety Filter; Reinforcement Learning; COLLISION-AVOIDANCE; VEHICLE;
D O I
暂无
中图分类号
U6 [水路运输]; P75 [海洋工程];
学科分类号
0814 ; 081505 ; 0824 ; 082401 ;
摘要
Autonomous surface vessels (ASVs) play an increasingly important role in the safety and sustainability of open sea operations. Since most maritime accidents are related to human failure, intelligent algorithms for autonomous collision avoidance and path following can drastically reduce the risk in the maritime sector. A DT is a virtual representative of a real physical system and can enhance the situational awareness (SITAW) of such an ASV to generate optimal decisions. This work builds on an existing DT framework for ASVs and demonstrates foundations for enabling predictive, prescriptive, and autonomous capabilities. In this context, sophisticated target tracking approaches are crucial for estimating and predicting the position and motion of other dynamic objects. The applied tracking method is enabled by real-time automatic identification system (AIS) data and synthetic light detection and ranging (LiDAR) measurements. To guarantee safety during autonomous operations, we applied a predictive safety filter to correct inputs from a reinforcement learning-based controller. The approaches are implemented into a DT built with the Unity game engine. As a result, this work demonstrates the potential of a DT capable of making predictions, playing through various what-if scenarios, and providing optimal control decisions according to its enhanced SITAW.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Digital twin syncing for autonomous surface vessels using reinforcement learning and nonlinear model predictive control
    Berg, Henrik Stokland
    Menges, Daniel
    Tengesdal, Trym
    Rasheed, Adil
    SCIENTIFIC REPORTS, 2025, 15 (01):
  • [2] Predictive digital twins for autonomous surface vessels
    Hasan, Agus
    Widyotriatmo, Augie
    Fagerhaug, Eirik
    Osen, Ottar
    OCEAN ENGINEERING, 2023, 288
  • [3] Autonomous Predictive Modeling via Reinforcement Learning
    Khurana, Udayan
    Samulowitz, Horst
    CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, 2020, : 3285 - 3288
  • [4] Decision-Making for the Autonomous Navigation of Maritime Autonomous Surface Ships Based on Scene Division and Deep Reinforcement Learning
    Zhang, Xinyu
    Wang, Chengbo
    Liu, Yuanchang
    Chen, Xiang
    SENSORS, 2019, 19 (18)
  • [5] DIGITAL TWIN FOR AUTONOMOUS SURFACE VESSELS TO GENERATE SITUATIONAL AWARENESS
    Menges, Daniel
    Saetre, Simon Mork
    Rasheed, Adil
    PROCEEDINGS OF ASME 2023 42ND INTERNATIONAL CONFERENCE ON OCEAN, OFFSHORE & ARCTIC ENGINEERING, OMAE2023, VOL 5, 2023,
  • [6] Safe Reinforcement Learning for Autonomous Navigation of a Driveable Vertical Mast Lift
    Brescia, Walter
    Maci, Antonio
    Mascolo, Saverio
    De Cicco, Luca
    IFAC PAPERSONLINE, 2023, 56 (02): : 9068 - 9073
  • [7] Nonlinear Model Predictive Control for Enhanced Navigation of Autonomous Surface Vessels
    Menges, Daniel
    Tengesdal, Trym
    Rasheed, Adil
    IFAC PAPERSONLINE, 2024, 58 (18): : 296 - 302
  • [8] A safe reinforcement learning approach for autonomous navigation of mobile robots in dynamic environments
    Zhou, Zhiqian
    Ren, Junkai
    Zeng, Zhiwen
    Xiao, Junhao
    Zhang, Xinglong
    Guo, Xian
    Zhou, Zongtan
    Lu, Huimin
    CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2023,
  • [9] Navigation Support for an Autonomous Ferry Using Deep Reinforcement Learning in Simulated Maritime Environments
    Smirnov, Nikita
    Tomforde, Sven
    2022 IEEE CONFERENCE ON COGNITIVE AND COMPUTATIONAL ASPECTS OF SITUATION MANAGEMENT, COGSIMA, 2022, : 142 - 149
  • [10] Goal-Guided Transformer-Enabled Reinforcement Learning for Efficient Autonomous Navigation
    Huang, Wenhui
    Zhou, Yanxin
    He, Xiangkun
    Lv, Chen
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (02) : 1832 - 1845