Target Following for an Autonomous Underwater Vehicle Using Regularized ELM-based Reinforcement Learning

被引:0
|
作者
Sun, Tingting [1 ]
He, Bo [1 ]
Nian, Rui [1 ]
Yan, Tianhong [2 ]
机构
[1] Ocean Univ China, Sch Informat Sci & Engn, Qingdao, Peoples R China
[2] China Jiliang Univ, Sch Mechatron Engn, Hangzhou, Zhejiang, Peoples R China
来源
OCEANS 2015 - MTS/IEEE WASHINGTON | 2015年
关键词
reinforcement learning; extreme learning machine; autonomous underwater vehicle; target following; machine learning; MACHINE; REGRESSION;
D O I
暂无
中图分类号
U6 [水路运输]; P75 [海洋工程];
学科分类号
0814 ; 081505 ; 0824 ; 082401 ;
摘要
In order to achieve autonomy and intelligence of autonomous underwater vehicle (AUV), dynamic target following in the unknown environment is one of the important problems to solve. Reinforcement learning (RL) offers the possibility of learning a policy to solve a particular task without manual intervention and previous experience. However, RL algorithms are not competent for continuous space problems existing universally in underwater environment. In this paper, the method of an AUV using regularized extreme learning machine (RELM) based RL is proposed for following the moving target. The most typical and common method of RL used in applications is Q learning, which can generate the proper policy for AUV control. And RELM is proposed as a modification of ELM, which can guarantee the generalization performance and work with continuous states and actions. The simulation results have shown that AUV successfully tracks and follows the moving target by the proposed method.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Heading Control for an Autonomous Underwater Vehicle Using ELM-based Q-Learning
    Wang, Dianrui
    Shen, Yue
    Sha, Qixin
    Li, Guangliang
    Jiang, Jingtao
    Yan, Tianhong
    Wan, Junhe
    He, Bo
    2017 IEEE UNDERWATER TECHNOLOGY (UT), 2017,
  • [2] Controller Design of an Autonomous Underwater Vehicle Using ELM-based Sliding Mode Control
    Wang, Dianrui
    Shen, Yue
    Sha, Qixin
    Li, Guangliang
    Jiang, Jingtao
    He, Bo
    Yan, Tianhong
    OCEANS 2017 - ANCHORAGE, 2017,
  • [3] Dynamic Target Tracking of Autonomous Underwater Vehicle Based on Deep Reinforcement Learning
    Shi, Jiaxiang
    Fang, Jianer
    Zhang, Qizhong
    Wu, Qiuxuan
    Zhang, Botao
    Gao, Farong
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2022, 10 (10)
  • [4] Reinforcement Learning Based Obstacle Avoidance for Autonomous Underwater Vehicle
    Prashant Bhopale
    Faruk Kazi
    Navdeep Singh
    Journal of Marine Science and Application, 2019, 18 : 228 - 238
  • [5] Reinforcement Learning Based Obstacle Avoidance for Autonomous Underwater Vehicle
    Bhopale, Prashant
    Kazi, Faruk
    Singh, Navdeep
    JOURNAL OF MARINE SCIENCE AND APPLICATION, 2019, 18 (02) : 228 - 238
  • [6] Docking Control of an Autonomous Underwater Vehicle Using Reinforcement Learning
    Anderlini, Enrico
    Parker, Gordon G.
    Thomas, Giles
    APPLIED SCIENCES-BASEL, 2019, 9 (17):
  • [7] Deep Interactive Reinforcement Learning for Path Following of Autonomous Underwater Vehicle
    Zhang, Qilei
    Lin, Jinying
    Sha, Qixin
    He, Bo
    Li, Guangliang
    IEEE ACCESS, 2020, 8 : 24258 - 24268
  • [8] An obstacle avoiding method of autonomous underwater vehicle based on the reinforcement learning
    Li, Wenbiao
    Yang, Xian
    Yan, Jing
    Luo, Xiaoyuan
    PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 4538 - 4543
  • [9] Research on autonomous underwater vehicle wall following based on reinforcement learning and multi-sonar weighted round robin mode
    Wang, Xiangbin
    Zhang, Guocheng
    Sun, Yushan
    Wan, Lei
    Cao, Jian
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2020, 17 (03)
  • [10] Autonomous underwater vehicle precise motion control for target following with model uncertainty
    Huang Hai
    Zhang Guocheng
    Qing Hongde
    Zhou Zexing
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2017, 14 (04): : 1 - 11