A Multi-Objective Reinforcement Learning Based Controller for Autonomous Navigation in Challenging Environments

被引:12
|
作者
Dooraki, Amir Ramezani [1 ]
Lee, Deok-Jin [1 ]
机构
[1] Jeonbuk Natl Univ, Sch Mech Design Engn, Jeonju 54896, South Korea
基金
新加坡国家研究基金会;
关键词
reinforcement learning; autonomous navigation; obstacle avoidance; deep learning; multi-objective; ALGORITHM;
D O I
10.3390/machines10070500
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, we introduce a self-trained controller for autonomous navigation in static and dynamic (with moving walls and nets) challenging environments (including trees, nets, windows, and pipe) using deep reinforcement learning, simultaneously trained using multiple rewards. We train our RL algorithm in a multi-objective way. Our algorithm learns to generate continuous action for controlling the UAV. Our algorithm aims to generate waypoints for the UAV in such a way as to reach a goal area (shown by an RGB image) while avoiding static and dynamic obstacles. In this text, we use the RGB-D image as the input for the algorithm, and it learns to control the UAV in 3-DoF (x, y, and z). We train our robot in environments simulated by Gazebo sim. For communication between our algorithm and the simulated environments, we use the robot operating system. Finally, we visualize the trajectories generated by our trained algorithms using several methods and illustrate our results that clearly show our algorithm's capability in learning to maximize the defined multi-objective reward.
引用
收藏
页数:25
相关论文
共 50 条
  • [1] Multi-Objective Reinforcement Learning for Autonomous Drone Navigation in Urban Area
    Wu, Jiahao
    Ye, Yang
    Du, Jing
    CONSTRUCTION RESEARCH CONGRESS 2024: ADVANCED TECHNOLOGIES, AUTOMATION, AND COMPUTER APPLICATIONS IN CONSTRUCTION, 2024, : 707 - 716
  • [2] Evolutionary Multi-Objective Deep Reinforcement Learning for Autonomous UAV Navigation in Large-Scale Complex Environments
    An, Guangyan
    Wu, Ziyu
    Shen, Zhilong
    Shang, Ke
    Ishibuchi, Hisao
    PROCEEDINGS OF THE 2023 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, GECCO 2023, 2023, : 633 - 641
  • [3] Multi-objective reinforcement learning for autonomous drone navigation in urban areas with wind zones
    Wu, Jiahao
    Ye, Yang
    Du, Jing
    AUTOMATION IN CONSTRUCTION, 2024, 158
  • [4] Navigation in Urban Environments amongst pedestrians using Multi-Objective Deep Reinforcement Learning
    Deshpande, Niranjan
    Vaufreydaz, Dominique
    Spalanzani, Anne
    2021 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2021, : 923 - 928
  • [5] Hybrid Reinforcement Learning based controller for autonomous navigation
    Joglekar, Ajinkya
    Krovi, Venkat
    Brudnak, Mark
    Smereka, Jonathon M.
    2022 IEEE 95TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2022-SPRING), 2022,
  • [6] Multi-Objective Reinforcement Learning for Designing Ethical Environments
    Rodriguez-Soto, Manel
    Lopez-Sanchez, Maite
    Rodriguez-Aguilar, Juan A.
    PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 545 - 551
  • [7] Balancing Learning and Engagement in Game-Based Learning Environments with Multi-objective Reinforcement Learning
    Sawyer, Robert
    Rowe, Jonathan
    Lester, James
    ARTIFICIAL INTELLIGENCE IN EDUCATION, AIED 2017, 2017, 10331 : 323 - 334
  • [8] Multi-objective safe reinforcement learning: the relationship between multi-objective reinforcement learning and safe reinforcement learning
    Horie, Naoto
    Matsui, Tohgoroh
    Moriyama, Koichi
    Mutoh, Atsuko
    Inuzuka, Nobuhiro
    ARTIFICIAL LIFE AND ROBOTICS, 2019, 24 (03) : 352 - 359
  • [9] Multi-objective safe reinforcement learning: the relationship between multi-objective reinforcement learning and safe reinforcement learning
    Naoto Horie
    Tohgoroh Matsui
    Koichi Moriyama
    Atsuko Mutoh
    Nobuhiro Inuzuka
    Artificial Life and Robotics, 2019, 24 : 352 - 359
  • [10] Multi-objective reinforcement learning for designing ethical multi-agent environments
    Rodriguez-Soto, Manel
    Lopez-Sanchez, Maite
    Rodriguez-Aguilar, Juan A.
    NEURAL COMPUTING & APPLICATIONS, 2023,