Improving Autonomous Robotic Navigation Using Imitation Learning

被引:5
作者
Cesar-Tondreau, Brian [1 ,2 ]
Warnell, Garrett [2 ]
Stump, Ethan [2 ]
Kochersberger, Kevin [1 ]
Waytowich, Nicholas R. [2 ]
机构
[1] Virginia Polytech Inst & State Univ, Unmanned Syst Lab, Mech Engn, Blacksburg, VA 24061 USA
[2] Army Res Lab, Adelphi, MD 20783 USA
来源
FRONTIERS IN ROBOTICS AND AI | 2021年 / 8卷
关键词
autonomous navigation; learning from demonstration; imitation learning; human in the loop; robot learning and behavior adaptation;
D O I
10.3389/frobt.2021.627730
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Autonomous navigation to a specified waypoint is traditionally accomplished with a layered stack of global path planning and local motion planning modules that generate feasible and obstacle-free trajectories. While these modules can be modified to meet task-specific constraints and user preferences, current modification procedures require substantial effort on the part of an expert roboticist with a great deal of technical training. In this paper, we simplify this process by inserting a Machine Learning module between the global path planning and local motion planning modules of an off-the shelf navigation stack. This model can be trained with human demonstrations of the preferred navigation behavior, using a training procedure based on Behavioral Cloning, allowing for an intuitive modification of the navigation policy by non-technical users to suit task-specific constraints. We find that our approach can successfully adapt a robot's navigation behavior to become more like that of a demonstrator. Moreover, for a fixed amount of demonstration data, we find that the proposed technique compares favorably to recent baselines with respect to both navigation success rate and trajectory similarity to the demonstrator.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] Autonomous Navigation via Deep Reinforcement Learning for Resource Constraint Edge Nodes Using Transfer Learning
    Anwar, Aqeel
    Raychowdhury, Arijit
    IEEE ACCESS, 2020, 8 : 26549 - 26560
  • [42] Unmanned surface vehicle navigation through generative adversarial imitation learning
    Chaysri, Piyabhum
    Spatharis, Christos
    Blekas, Konstantinos
    Vlachos, Kostas
    OCEAN ENGINEERING, 2023, 282
  • [43] Imitation Learning of Compression Pattern in Robotic-Assisted Ultrasound Examination Using Kernelized Movement Primitives
    Dall'Alba, Diego
    Busellato, Lorenzo
    Savarimuthu, Thiusius Rajeeth
    Cheng, Zhuoqi
    Iturrate, Inigo
    IEEE TRANSACTIONS ON MEDICAL ROBOTICS AND BIONICS, 2024, 6 (04): : 1567 - 1580
  • [44] Robotic Mapping Using Autonomous Vehicle
    Mahadevaswamy U.B.
    Keshava V.
    Lamani A.C.R.
    Abbur L.P.
    Mahadeva S.
    SN Computer Science, 2020, 1 (3)
  • [45] Integrated autonomous optical navigation using Q-Learning extended Kalman filter
    Xiong, Kai
    Wei, Chunling
    Zhou, Peng
    AIRCRAFT ENGINEERING AND AEROSPACE TECHNOLOGY, 2022, 94 (06) : 848 - 861
  • [46] iCurb: Imitation Learning-Based Detection of Road Curbs Using Aerial Images for Autonomous Driving
    Xu, Zhenhua
    Sun, Yuxiang
    Liu, Ming
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (02) : 1097 - 1104
  • [47] Autonomous Navigation of Wheelchairs in Indoor Environments using Deep Reinforcement Learning and Computer Vision
    Afonso, Paulo de Almeida
    Ferreira, Paulo Roberto, Jr.
    2023 LATIN AMERICAN ROBOTICS SYMPOSIUM, LARS, 2023 BRAZILIAN SYMPOSIUM ON ROBOTICS, SBR, AND 2023 WORKSHOP ON ROBOTICS IN EDUCATION, WRE, 2023, : 260 - 265
  • [48] Addressing Limitations of State-Aware Imitation Learning for Autonomous Driving
    Cultrera, Luca
    Becattini, Federico
    Seidenari, Lorenzo
    Pala, Pietro
    Del Bimbo, Alberto
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2024, 9 (01): : 2946 - 2955
  • [49] Imitation Learning Decision with Driving Style Tuning for Personalized Autonomous Driving
    Hui, Rui
    Wang, Yuze
    Zeng, Ximu
    Liu, Shuncheng
    Yu, Quanlin
    Wu, Peicong
    Zhang, Zhengzhuo
    Su, Han
    Zheng, Kai
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, PT VII, DASFAA 2024, 2024, 14856 : 220 - 231
  • [50] A Computational Framework for Integrating Robotic Exploration and Human Demonstration in Imitation Learning
    Tan, Huan
    Kawamura, Kazuhiko
    2011 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2011, : 2501 - 2506