A Multi-Objective Reinforcement Learning Based Controller for Autonomous Navigation in Challenging Environments

被引:12
|
作者
Dooraki, Amir Ramezani [1 ]
Lee, Deok-Jin [1 ]
机构
[1] Jeonbuk Natl Univ, Sch Mech Design Engn, Jeonju 54896, South Korea
基金
新加坡国家研究基金会;
关键词
reinforcement learning; autonomous navigation; obstacle avoidance; deep learning; multi-objective; ALGORITHM;
D O I
10.3390/machines10070500
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, we introduce a self-trained controller for autonomous navigation in static and dynamic (with moving walls and nets) challenging environments (including trees, nets, windows, and pipe) using deep reinforcement learning, simultaneously trained using multiple rewards. We train our RL algorithm in a multi-objective way. Our algorithm learns to generate continuous action for controlling the UAV. Our algorithm aims to generate waypoints for the UAV in such a way as to reach a goal area (shown by an RGB image) while avoiding static and dynamic obstacles. In this text, we use the RGB-D image as the input for the algorithm, and it learns to control the UAV in 3-DoF (x, y, and z). We train our robot in environments simulated by Gazebo sim. For communication between our algorithm and the simulated environments, we use the robot operating system. Finally, we visualize the trajectories generated by our trained algorithms using several methods and illustrate our results that clearly show our algorithm's capability in learning to maximize the defined multi-objective reward.
引用
收藏
页数:25
相关论文
共 50 条
  • [31] Geomagnetic Navigation of Autonomous Underwater Vehicle Based on Multi-objective Evolutionary Algorithm
    Li, Hong
    Liu, Mingyong
    Zhang, Feihu
    FRONTIERS IN NEUROROBOTICS, 2017, 11
  • [32] Meta-Learning for Multi-objective Reinforcement Learning
    Chen, Xi
    Ghadirzadeh, Ali
    Bjorkman, Marten
    Jensfelt, Patric
    2019 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2019, : 977 - 983
  • [33] Towards Energy-Efficient Autonomous Driving: A Multi-Objective Reinforcement Learning Approach
    He, Xiangkun
    Lv, Chen
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2023, 10 (05) : 1329 - 1331
  • [34] Towards Energy-Efficient Autonomous Driving: A Multi-Objective Reinforcement Learning Approach
    Xiangkun He
    Chen Lv
    IEEE/CAAJournalofAutomaticaSinica, 2023, 10 (05) : 1329 - 1331
  • [35] Deep Reinforcement Learning for Autonomous Drone Navigation in Cluttered Environments
    Solaimalai, Gautam
    Prakash, Kode Jaya
    Kumar, Sampath S.
    Bhagyalakshmi, A.
    Siddharthan, P.
    Kumar, Senthil K. R.
    2024 INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATION AND APPLIED INFORMATICS, ACCAI 2024, 2024,
  • [36] Navigation of autonomous vehicles in unknown environments using reinforcement learning
    Martinez-Marin, Tomas
    Rodriguez, Rafael
    2007 IEEE INTELLIGENT VEHICLES SYMPOSIUM, VOLS 1-3, 2007, : 964 - +
  • [37] Multi-objective Reinforcement Learning for Responsive Grids
    Perez, Julien
    Germain-Renaud, Cecile
    Kegl, Balazs
    Loomis, Charles
    JOURNAL OF GRID COMPUTING, 2010, 8 (03) : 473 - 492
  • [38] Special issue on multi-objective reinforcement learning
    Drugan, Madalina
    Wiering, Marco
    Vamplew, Peter
    Chetty, Madhu
    NEUROCOMPUTING, 2017, 263 : 1 - 2
  • [39] A multi-objective deep reinforcement learning framework
    Thanh Thi Nguyen
    Ngoc Duy Nguyen
    Vamplew, Peter
    Nahavandi, Saeid
    Dazeley, Richard
    Lim, Chee Peng
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2020, 96
  • [40] A Constrained Multi-Objective Reinforcement Learning Framework
    Huang, Sandy H.
    Abdolmaleki, Abbas
    Vezzani, Giulia
    Brakel, Philemon
    Mankowitz, Daniel J.
    Neunert, Michael
    Bohez, Steven
    Tassa, Yuval
    Heess, Nicolas
    Riedmiller, Martin
    Hadsell, Raia
    CONFERENCE ON ROBOT LEARNING, VOL 164, 2021, 164 : 883 - 893