Continual learning from demonstration of robotics skills

被引:8
|
作者
Auddy, Sayantan [1 ]
Hollenstein, Jakob [1 ]
Saveriano, Matteo [2 ]
Rodriguez-Sanchez, Antonio [1 ]
Piater, Justus [1 ,3 ]
机构
[1] Univ Innsbruck, Dept Comp Sci, Innsbruck, Austria
[2] Univ Trento, Dept Ind Engn, Trento, Italy
[3] Univ Innsbruck, Digital Sci Ctr DiSC, Innsbruck, Austria
关键词
Learning from demonstration; Continual learning; Hypernetwork; Neural ordinary differential equation solver; MANIPULATION; STABILITY; IMITATION; ENSURE;
D O I
10.1016/j.robot.2023.104427
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Methods for teaching motion skills to robots focus on training for a single skill at a time. Robots capable of learning from demonstration can considerably benefit from the added ability to learn new movement skills without forgetting what was learned in the past. To this end, we propose an approach for continual learning from demonstration using hypernetworks and neural ordinary differential equation solvers. We empirically demonstrate the effectiveness of this approach in remembering long sequences of trajectory learning tasks without the need to store any data from past demonstrations. Our results show that hypernetworks outperform other state-of-the-art continual learning approaches for learning from demonstration. In our experiments, we use the popular LASA benchmark, and two new datasets of kinesthetic demonstrations collected with a real robot that we introduce in this paper called the HelloWorld and RoboTasks datasets. We evaluate our approach on a physical robot and demonstrate its effectiveness in learning real-world robotic tasks involving changing positions as well as orientations. We report both trajectory error metrics and continual learning metrics, and we propose two new continual learning metrics. Our code, along with the newly collected datasets, is available at https://github.com/sayantanauddy/clfd. (c) 2023 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
引用
收藏
页数:21
相关论文
共 50 条
  • [21] Predictive Learning from Demonstration
    Billing, Erik A.
    Hellstrom, Thomas
    Janlert, Lars-Erik
    AGENTS AND ARTIFICIAL INTELLIGENCE, 2011, 129 : 186 - 200
  • [22] Heterogeneous Learning from Demonstration
    Paleja, Rohan
    Gombolay, Matthew
    HRI '19: 2019 14TH ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION, 2019, : 730 - 732
  • [23] A Formalism for Learning from Demonstration*
    Billing E.A.
    Hellström T.
    Paladyn, 2010, 1 (01): : 1 - 13
  • [24] From MNIST to ImageNet and back: benchmarking continual curriculum learning
    Faber, Kamil
    Zurek, Dominik
    Pietron, Marcin
    Japkowicz, Nathalie
    Vergari, Antonio
    Corizzo, Roberto
    MACHINE LEARNING, 2024, 113 (10) : 8137 - 8164
  • [25] Beyond Prompt Learning: Continual Adapter for Efficient Rehearsal-Free Continual Learning
    Gao, Xinyuan
    Dong, Songlin
    He, Yuhang
    Wang, Qiang
    Gong, Yihong
    COMPUTER VISION - ECCV 2024, PT LXXXV, 2025, 15143 : 89 - 106
  • [26] A survey of demonstration learning
    Correia, Andre
    Alexandre, Luis A.
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2024, 182
  • [27] Continual Learning for Fake News Detection from Social Media
    Han, Yi
    Karunasekera, Shanika
    Leckie, Christopher
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2021, PT II, 2021, 12892 : 372 - 384
  • [28] Keyframe-based Learning from Demonstration Method and Evaluation
    Akgun, Baris
    Cakmak, Maya
    Jiang, Karl
    Thomaz, Andrea L.
    INTERNATIONAL JOURNAL OF SOCIAL ROBOTICS, 2012, 4 (04) : 343 - 355
  • [29] Memory Bounds for Continual Learning
    Chen, Xi
    Papadimitriou, Christos
    Peng, Binghui
    2022 IEEE 63RD ANNUAL SYMPOSIUM ON FOUNDATIONS OF COMPUTER SCIENCE (FOCS), 2022, : 519 - 530
  • [30] Reinforced Continual Learning for Graphs
    Rakaraddi, Appan
    Kei, Lam Siew
    Pratama, Mahardhika
    de Carvalho, Marcus
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 1666 - 1674