Improving Autonomous Robotic Navigation Using Imitation Learning

被引:5
作者
Cesar-Tondreau, Brian [1 ,2 ]
Warnell, Garrett [2 ]
Stump, Ethan [2 ]
Kochersberger, Kevin [1 ]
Waytowich, Nicholas R. [2 ]
机构
[1] Virginia Polytech Inst & State Univ, Unmanned Syst Lab, Mech Engn, Blacksburg, VA 24061 USA
[2] Army Res Lab, Adelphi, MD 20783 USA
来源
FRONTIERS IN ROBOTICS AND AI | 2021年 / 8卷
关键词
autonomous navigation; learning from demonstration; imitation learning; human in the loop; robot learning and behavior adaptation;
D O I
10.3389/frobt.2021.627730
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Autonomous navigation to a specified waypoint is traditionally accomplished with a layered stack of global path planning and local motion planning modules that generate feasible and obstacle-free trajectories. While these modules can be modified to meet task-specific constraints and user preferences, current modification procedures require substantial effort on the part of an expert roboticist with a great deal of technical training. In this paper, we simplify this process by inserting a Machine Learning module between the global path planning and local motion planning modules of an off-the shelf navigation stack. This model can be trained with human demonstrations of the preferred navigation behavior, using a training procedure based on Behavioral Cloning, allowing for an intuitive modification of the navigation policy by non-technical users to suit task-specific constraints. We find that our approach can successfully adapt a robot's navigation behavior to become more like that of a demonstrator. Moreover, for a fixed amount of demonstration data, we find that the proposed technique compares favorably to recent baselines with respect to both navigation success rate and trajectory similarity to the demonstrator.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] Improving Obstacle Avoidance Strategies in Autonomous Navigation of a Sailboat
    Paiva, Pedro
    Gomes, Luis
    2023 IEEE 2ND INDUSTRIAL ELECTRONICS SOCIETY ANNUAL ON-LINE CONFERENCE, ONCON, 2023,
  • [32] Robotic Writing based on Trust Region Optimization and Imitation Learning
    Yang, Min-Gyu
    Ahn, Kuk-Hyun
    Song, Jae-Bok
    2020 20TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS), 2020, : 132 - 136
  • [33] Autonomous navigation of an over-actuated marine platform using reinforcement learning
    Tziortziotis, Konstantinos
    Tziortziotis, Nikolaos
    Vlachos, Kostas
    Blekas, Konstantinos
    9TH HELLENIC CONFERENCE ON ARTIFICIAL INTELLIGENCE (SETN 2016), 2016,
  • [34] Learning the Dynamics of Human Patterns for Autonomous Navigation
    Raj, Ravi
    Kos, Andrzej
    18TH INTERNATIONAL CONFERENCE ON COMPATIBILITY, POWER ELECTRONICS AND POWER ENGINEERING, CPE-POWERENG 2024, 2024,
  • [35] Nanosatellite Autonomous Navigation via Extreme Learning Machine Using Magnetometer Measurements
    Goracci, Gilberto
    Curti, Fabio
    de Guzman, Mark Anthony
    AEROSPACE, 2025, 12 (02)
  • [36] Collective Transport Behavior in a Robotic Swarm with Hierarchical Imitation Learning
    Han, Ziyao
    Yi, Fan
    Ohkura, Kazuhiro
    JOURNAL OF ROBOTICS AND MECHATRONICS, 2024, 36 (03) : 538 - 545
  • [37] Comparison of Control Methods Based on Imitation Learning for Autonomous Driving
    Gao, Yinfeng
    Liu, Yuqi
    Zhang, Qichao
    Wang, Yu
    Zhao, Dongbin
    Ding, Dawei
    Pang, Zhonghua
    Zhang, Yueming
    2019 TENTH INTERNATIONAL CONFERENCE ON INTELLIGENT CONTROL AND INFORMATION PROCESSING (ICICIP), 2019, : 274 - 281
  • [38] Autonomous navigation of catheters and guidewires in mechanical thrombectomy using inverse reinforcement learning
    Robertshaw, Harry
    Karstensen, Lennart
    Jackson, Benjamin
    Granados, Alejandro
    Booth, Thomas C.
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2024, 19 (08) : 1569 - 1578
  • [39] Learning dynamic cognitive map with autonomous navigation
    de Tinguy, Daria
    Verbelen, Tim
    Dhoedt, Bart
    Frontiers in Computational Neuroscience, 2024, 18
  • [40] A Comparison of Various Robotic Control Architectures for Autonomous Navigation of Mobile Robots
    Sheikh, Usman Ayub
    Jamil, Mohsin
    Ayaz, Yasar
    2014 INTERNATIONAL CONFERENCE ON ROBOTICS AND EMERGING ALLIED TECHNOLOGIES IN ENGINEERING (ICREATE), 2014, : 239 - 243