A Probabilistic Framework for Model-Based Imitation Learning

被引:0
|
作者
Shon, Aaron P. [1 ]
Grimes, David B. [1 ]
Baker, Chris L. [1 ]
Rao, Rajesh P. N. [1 ]
机构
[1] Univ Washington, CSE Dept, Seattle, WA 98195 USA
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Humans and animals use imitation as a mechanism for acquiring knowledge. Recently, several algorithms and models have been proposed for imitation learning in robots and humans. However, few proposals offer a framework for imitation learning in a stochastic environment where the imitator must learn and act under real-time performance constraints. We present a probabilistic framework for imitation learning in stochastic environments with unreliable sensors. We develop Bayesian algorithms, based on Meltzo and Moore's AIM hypothesis for infant imitation, that implement the core of an imitation learning framework, and sketch basic proposals for the other components. Our algorithms are computationally efficient, allowing real-time learning and imitation in an active stereo vision robotic head. We present results of both software simulations and our algorithms running on the head, demonstrating the validity of our approach.
引用
收藏
页码:1237 / 1242
页数:6
相关论文
共 50 条
  • [1] Probabilistic model-based imitation learning
    Englert, Peter
    Paraschos, Alexandros
    Deisenroth, Marc Peter
    Peters, Jan
    ADAPTIVE BEHAVIOR, 2013, 21 (05) : 388 - 403
  • [2] Model-based Imitation Learning by Probabilistic Trajectory Matching
    Englert, Peter
    Paraschos, Alexandros
    Peters, Jan
    Deisenroth, Marc Peter
    2013 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2013, : 1922 - 1927
  • [3] GeoGail: A Model-Based Imitation Learning Framework for Human Trajectory Synthesizing
    Wu, Yuchen
    Wang, Huandong
    Gao, Changzheng
    Jin, Depeng
    Li, Yong
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2025, 19 (01)
  • [4] Model-Based Imitation Learning for Urban Driving
    Hu, Anthony
    Corrado, Gianluca
    Griffiths, Nicolas
    Murez, Zak
    Gurau, Corina
    Yeo, Hudson
    Kendall, Alex
    Cipolla, Roberto
    Shotton, Jamie
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [5] Imitation Game: A Model-based and Imitation Learning Deep Reinforcement Learning Hybrid
    Veith, Eric Msp
    Logemann, Torben
    Berezin, Aleksandr
    Wellssow, Arlena
    Balduin, Stephan
    2024 12TH WORKSHOP ON MODELING AND SIMULATION OF CYBER-PHYSICAL ENERGY SYSTEMS, MSCPES, 2024,
  • [6] A Model-Based Framework for Probabilistic Simulation of Legal Policies
    Soltana, Ghanem
    Sannier, Nicolas
    Sabetzadeh, Mehrdad
    Briand, Lionel C.
    2015 ACM/IEEE 18TH INTERNATIONAL CONFERENCE ON MODEL DRIVEN ENGINEERING LANGUAGES AND SYSTEMS (MODELS), 2015, : 70 - 79
  • [7] A framework for probabilistic model-based engineering and data synthesis
    Ray, Douglas
    Ramirez-Marquez, Jose
    RELIABILITY ENGINEERING & SYSTEM SAFETY, 2020, 193
  • [8] Model-Based Imitation Learning Using Entropy Regularization of Model and Policy
    Uchibe, Eiji
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (04) : 10922 - 10929
  • [9] MobILE: Model-Based Imitation Learning From Observation Alone
    Kidambi, Rahul
    Chang, Jonathan D.
    Sun, Wen
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [10] Hierarchical Model-Based Imitation Learning for Planning in Autonomous Driving
    Bronstein, Eli
    Palatucci, Mark
    Notz, Dominik
    White, Brandyn
    Kuefler, Alex
    Lu, Yiren
    Paul, Supratik
    Nikdel, Payam
    Mougin, Paul
    Chen, Hongge
    Fu, Justin
    Abrams, Austin
    Shah, Punit
    Racah, Evan
    Frenkel, Benjamin
    Whiteson, Shimon
    Anguelov, Dragomir
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 8652 - 8659