Target Following for an Autonomous Underwater Vehicle Using Regularized ELM-based Reinforcement Learning

被引:0
|
作者
Sun, Tingting [1 ]
He, Bo [1 ]
Nian, Rui [1 ]
Yan, Tianhong [2 ]
机构
[1] Ocean Univ China, Sch Informat Sci & Engn, Qingdao, Peoples R China
[2] China Jiliang Univ, Sch Mechatron Engn, Hangzhou, Zhejiang, Peoples R China
来源
OCEANS 2015 - MTS/IEEE WASHINGTON | 2015年
关键词
reinforcement learning; extreme learning machine; autonomous underwater vehicle; target following; machine learning; MACHINE; REGRESSION;
D O I
暂无
中图分类号
U6 [水路运输]; P75 [海洋工程];
学科分类号
0814 ; 081505 ; 0824 ; 082401 ;
摘要
In order to achieve autonomy and intelligence of autonomous underwater vehicle (AUV), dynamic target following in the unknown environment is one of the important problems to solve. Reinforcement learning (RL) offers the possibility of learning a policy to solve a particular task without manual intervention and previous experience. However, RL algorithms are not competent for continuous space problems existing universally in underwater environment. In this paper, the method of an AUV using regularized extreme learning machine (RELM) based RL is proposed for following the moving target. The most typical and common method of RL used in applications is Q learning, which can generate the proper policy for AUV control. And RELM is proposed as a modification of ELM, which can guarantee the generalization performance and work with continuous states and actions. The simulation results have shown that AUV successfully tracks and follows the moving target by the proposed method.
引用
收藏
页数:5
相关论文
共 50 条
  • [21] Underwater Dynamic Target Tracking of Autonomous Underwater Vehicle Based on MPC Algorithm
    Wei, Yali
    Zhu, Daqi
    Chu, Zhenzhong
    2018 IEEE 8TH INTERNATIONAL CONFERENCE ON UNDERWATER SYSTEM TECHNOLOGY: THEORY AND APPLICATIONS (USYS), 2018,
  • [22] Research on decision-making of autonomous vehicle following based on reinforcement learning method
    Gao, Hongbo
    Shi, Guanya
    Wang, Kelong
    Xie, Guotao
    Liu, Yuchao
    INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2019, 46 (03): : 444 - 452
  • [23] Autonomous vehicle navigation using evolutionary reinforcement learning
    Stafylopatis, A
    Blekas, K
    EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 1998, 108 (02) : 306 - 318
  • [24] Three-Dimensional Path Tracking Control of Autonomous Underwater Vehicle Based on Deep Reinforcement Learning
    Sun, Yushan
    Zhang, Chenming
    Zhang, Guocheng
    Xu, Hao
    Ran, Xiangrui
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2019, 7 (12)
  • [25] A novel reinforcement learning based tuna swarm optimization algorithm for autonomous underwater vehicle path planning
    Yan, Zheping
    Yan, Jinyu
    Wu, Yifan
    Cai, Sijia
    Wang, Hongxing
    MATHEMATICS AND COMPUTERS IN SIMULATION, 2023, 209 : 55 - 86
  • [26] Adversarial deep reinforcement learning based robust depth tracking control for underactuated autonomous underwater vehicle
    Wang, Zhao
    Xiang, Xianbo
    Duan, Yu
    Yang, Shaolong
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 130
  • [27] Target-Following Control of a Biomimetic Autonomous System Based on Predictive Reinforcement Learning
    Wang, Yu
    Wang, Jian
    Kang, Song
    Yu, Junzhi
    BIOMIMETICS, 2024, 9 (01)
  • [28] ELM-Based Shape Adaptive DCT Compression Technique for Underwater Image Compression
    Jamuna Rani M.
    Vasanthanayaki C.
    Computer Systems Science and Engineering, 2023, 45 (02): : 1953 - 1970
  • [29] Target Tracking Control of a Biomimetic Underwater Vehicle Through Deep Reinforcement Learning
    Wang, Yu
    Tang, Chong
    Wang, Shuo
    Cheng, Long
    Wang, Rui
    Tan, Min
    Hou, Zengguang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (08) : 3741 - 3752
  • [30] Taming an Autonomous Surface Vehicle for Path Following and Collision Avoidance Using Deep Reinforcement Learning
    Meyer, Eivind
    Robinson, Haakon
    Rasheed, Adil
    San, Omer
    IEEE ACCESS, 2020, 8 : 41466 - 41481