Adaptive Sampling Path Planning for a 3D Marine Observation Platform Based on Evolutionary Deep Reinforcement Learning

被引:4
作者
Zhang, Jingjing [1 ]
Liu, Yanlong [1 ]
Zhou, Weidong [1 ]
机构
[1] Harbin Engn Univ, Coll Intelligent Syst Sci & Engn, Harbin 150001, Peoples R China
关键词
marine environment observation; evolutionary learning; reinforcement learning; path planning; deep learning; AUV;
D O I
10.3390/jmse11122313
中图分类号
U6 [水路运输]; P75 [海洋工程];
学科分类号
0814 ; 081505 ; 0824 ; 082401 ;
摘要
Adaptive sampling of the marine environment may improve the accuracy of marine numerical prediction models. This study considered adaptive sampling path optimization for a three-dimensional (3D) marine observation platform, leading to a path-planning strategy based on evolutionary deep reinforcement learning. The low sampling efficiency of the reinforcement learning algorithm is improved by evolutionary learning. The combination of these two components as a new algorithm has become a current research trend. We first combined the evolutionary algorithm with different reinforcement learning algorithms to verify the effectiveness of the combination of algorithms with different strategies. Experimental results indicate that the fusion of the two algorithms based on a maximum-entropy strategy is more effective for adaptive sampling using a 3D marine observation platform. Data assimilation experiments indicate that adaptive sampling data from a 3D mobile observation platform based on evolutionary deep reinforcement learning improves the accuracy of marine environment numerical prediction systems.
引用
收藏
页数:23
相关论文
共 60 条
[1]   Adaptive Sampling of Ocean Processes Using an AUV with a Gaussian Proxy Model [J].
Berget, Gunhild Elisabeth ;
Fossum, Trygve Olav ;
Johansen, Tor Arne ;
Eidsvik, Jo ;
Rajan, Kanna .
IFAC PAPERSONLINE, 2018, 51 (29) :238-243
[2]  
Bin Zhang, 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566), P1115
[3]   AUV Global Security Path Planning Based on a Potential Field Bio-Inspired Neural Network in Underwater Environment [J].
Cao, Xiang ;
Chen, Ling ;
Guo, Liqiang ;
Han, Wei .
INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2021, 27 (02) :391-407
[4]  
Cetinkaya M., 2021, arXiv
[5]   Machine Learning With Data Assimilation and Uncertainty Quantification for Dynamical Systems: A Review [J].
Cheng, Sibo ;
Quilodran-Casas, Cesar ;
Ouala, Said ;
Farchi, Alban ;
Liu, Che ;
Tandeo, Pierre ;
Fablet, Ronan ;
Lucor, Didier ;
Iooss, Bertrand ;
Brajard, Julien ;
Xiao, Dunhui ;
Janjic, Tijana ;
Ding, Weiping ;
Guo, Yike ;
Carrassi, Alberto ;
Bocquet, Marc ;
Arcucci, Rossella .
IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2023, 10 (06) :1361-1387
[6]   Data-driven surrogate model with latent data assimilation: Application to wildfire forecasting [J].
Cheng, Sibo ;
Prentice, I. Colin ;
Huang, Yuhan ;
Jin, Yufang ;
Guo, Yi-Ke ;
Arcucci, Rossella .
JOURNAL OF COMPUTATIONAL PHYSICS, 2022, 464
[7]   Dynamic Path Planning Based on Neural Networks for Aerial Inspection [J].
de Castro, Gabriel G. R. ;
Pinto, Milena F. ;
Biundini, Iago Z. ;
Melo, Aurelio G. ;
Marcato, Andre L. M. ;
Haddad, Diego B. .
JOURNAL OF CONTROL AUTOMATION AND ELECTRICAL SYSTEMS, 2023, 34 (01) :85-105
[8]   Using machine learning to correct model error in data assimilation and forecast applications [J].
Farchi, Alban ;
Laloyaux, Patrick ;
Bonavita, Massimo ;
Bocquet, Marc .
QUARTERLY JOURNAL OF THE ROYAL METEOROLOGICAL SOCIETY, 2021, 147 (739) :3067-3084
[9]  
Fossum T.O., 2019, Ph.D. Thesis
[10]   A Bioinspired Neural Network-Based Approach for Cooperative Coverage Planning of UAVs [J].
Godio, Simone ;
Primatesta, Stefano ;
Guglieri, Giorgio ;
Dovis, Fabio .
INFORMATION, 2021, 12 (02) :1-17