Continual learning from demonstration of robotics skills

被引:8
|
作者
Auddy, Sayantan [1 ]
Hollenstein, Jakob [1 ]
Saveriano, Matteo [2 ]
Rodriguez-Sanchez, Antonio [1 ]
Piater, Justus [1 ,3 ]
机构
[1] Univ Innsbruck, Dept Comp Sci, Innsbruck, Austria
[2] Univ Trento, Dept Ind Engn, Trento, Italy
[3] Univ Innsbruck, Digital Sci Ctr DiSC, Innsbruck, Austria
关键词
Learning from demonstration; Continual learning; Hypernetwork; Neural ordinary differential equation solver; MANIPULATION; STABILITY; IMITATION; ENSURE;
D O I
10.1016/j.robot.2023.104427
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Methods for teaching motion skills to robots focus on training for a single skill at a time. Robots capable of learning from demonstration can considerably benefit from the added ability to learn new movement skills without forgetting what was learned in the past. To this end, we propose an approach for continual learning from demonstration using hypernetworks and neural ordinary differential equation solvers. We empirically demonstrate the effectiveness of this approach in remembering long sequences of trajectory learning tasks without the need to store any data from past demonstrations. Our results show that hypernetworks outperform other state-of-the-art continual learning approaches for learning from demonstration. In our experiments, we use the popular LASA benchmark, and two new datasets of kinesthetic demonstrations collected with a real robot that we introduce in this paper called the HelloWorld and RoboTasks datasets. We evaluate our approach on a physical robot and demonstrate its effectiveness in learning real-world robotic tasks involving changing positions as well as orientations. We report both trajectory error metrics and continual learning metrics, and we propose two new continual learning metrics. Our code, along with the newly collected datasets, is available at https://github.com/sayantanauddy/clfd. (c) 2023 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
引用
收藏
页数:21
相关论文
共 50 条
  • [41] Large-scale comparison and demonstration of continual learning for adaptive data-driven building energy prediction
    Li, Ao
    Zhang, Chong
    Xiao, Fu
    Fan, Cheng
    Deng, Yang
    Wang, Dan
    APPLIED ENERGY, 2023, 347
  • [42] Poster: Continual Network Learning
    Di Cicco, Nicola
    Al Sadi, Amir
    Grasselli, Chiara
    Melis, Andrea
    Antichi, Gianni
    Tornatore, Massimo
    PROCEEDINGS OF THE 2023 ACM SIGCOMM 2023 CONFERENCE, SIGCOMM 2023, 2023, : 1096 - 1098
  • [43] Continual Learning with Dual Regularizations
    Han, Xuejun
    Guo, Yuhong
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, 2021, 12975 : 619 - 634
  • [44] Drifting explanations in continual learning
    Cossu, Andrea
    Spinnato, Francesco
    Guidotti, Riccardo
    Bacciu, Davide
    NEUROCOMPUTING, 2024, 597
  • [45] Learning behavior fusion from demonstration
    Nicolescu, Monica
    Jenkins, Odest Chadwicke
    Olenderski, Adam
    Fritzinger, Eric
    INTERACTION STUDIES, 2008, 9 (02) : 319 - 352
  • [46] Learning motion primitives from demonstration
    Chi, Mingshan
    Yao, Yufeng
    Liu, Yaxin
    Teng, Yiqian
    Zhong, Ming
    ADVANCES IN MECHANICAL ENGINEERING, 2017, 9 (12)
  • [47] Learning generalizable behaviors from demonstration
    Rivera, Corban
    Popek, Katie M.
    Ashcraft, Chace
    Staley, Edward W.
    Katyal, Kapil D.
    Paulhamus, Bart L.
    FRONTIERS IN NEUROROBOTICS, 2022, 16
  • [48] Policy Transformation for Learning from Demonstration
    Suay, Halit Bener
    Chernova, Sonia
    HRI'12: PROCEEDINGS OF THE SEVENTH ANNUAL ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION, 2012, : 245 - 246
  • [49] Continual Representation Learning for Images with Variational Continual Auto-Encoder
    Jeon, Ik Hwan
    Shin, Soo Young
    PROCEEDINGS OF THE 11TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE (ICAART), VOL 2, 2019, : 367 - 373
  • [50] ConCS: A Continual Classifier System for Continual Learning of Multiple Boolean Problems
    Nguyen, Trung B.
    Browne, Will N.
    Zhang, Mengjie
    IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2023, 27 (04) : 1057 - 1071