Autonomous Knowledge Representation for Efficient Skill Learning in Cognitive Robots

被引:2
作者
Romero, Alejandro [1 ]
Meden, Blaz [2 ]
Bellas, Francisco [1 ]
Duro, Richard J. [1 ]
机构
[1] Univ A Coruna, Integrated Grp Engn Res, La Coruna, Spain
[2] Univ Ljubljana, Comp Vis Lab, Ljubljana, Slovenia
来源
BIO-INSPIRED SYSTEMS AND APPLICATIONS: FROM ROBOTICS TO AMBIENT INTELLIGENCE, PT II | 2022年 / 13259卷
关键词
Knowledge representation; Robotics; Action selection;
D O I
10.1007/978-3-031-06527-9_25
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This work explores the effects of the introduction of variational autoencoder based representation learning, and of its resulting latent spaces, within a robotic cognitive architecture to be able to efficiently learn models and policies when raw perceptual dimensionality is very high. The main focus of the paper is on the decision processes of the robots used for action selection. To this end we propose a procedure to obtain from autonomously produced latent state spaces the world and utility models necessary for deliberative operation as a first type of decision process. Additionally, we present a neuroevolutionary based approach to generate policies, for reactive operation, based on the information of the latent state space and using the previously obtained world and utility models to permit offline learning. A set of experiments over a real robot using vision, with the consequent high dimensional raw perceptual space, are carried out in order to validate the proposal.
引用
收藏
页码:253 / 263
页数:11
相关论文
共 14 条
  • [1] Alvernaz Samuel, 2017, 2017 IEEE Conference on Computational Intelligence and Games (CIG), P1, DOI 10.1109/CIG.2017.8080408
  • [2] Multilevel Darwinist Brain (MDB): Artificial Evolution in a Cognitive Architecture for Real Robots
    Bellas, Francisco
    Duro, Richard J.
    Faina, Andres
    Souto, Daniel
    [J]. IEEE TRANSACTIONS ON AUTONOMOUS MENTAL DEVELOPMENT, 2010, 2 (04) : 340 - 354
  • [3] Deisenroth M. P., 2013, Found. Trends Robot, V2, P1
  • [4] Open-Ended Learning: A Conceptual Framework Based on Representational Redescription
    Doncieux, Stephane
    Filliat, David
    Diaz-Rodriguez, Natalia
    Hospedales, Timothy
    Duro, Richard
    Coninx, Alexandre
    Roijers, Diederik M.
    Girard, Benoit
    Perrin, Nicolas
    Sigaud, Olivier
    [J]. FRONTIERS IN NEUROROBOTICS, 2018, 12
  • [5] A Survey of Actor-Critic Reinforcement Learning: Standard and Natural Policy Gradients
    Grondman, Ivo
    Busoniu, Lucian
    Lopes, Gabriel A. D.
    Babuska, Robert
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS, 2012, 42 (06): : 1291 - 1307
  • [6] Karl M, 2017, Arxiv, DOI arXiv:1605.06432
  • [7] From exploration to control: Learning object manipulation skills through novelty search and local adaptation
    Kim, Seungsu
    Coninx, Alexandre
    Doncieux, Stephane
    [J]. ROBOTICS AND AUTONOMOUS SYSTEMS, 2021, 136
  • [8] Kotseruba I, 2018, Arxiv, DOI [arXiv:1610.08602, 10.48550/arXiv.1610.08602, DOI 10.48550/ARXIV.1610.08602]
  • [9] State representation learning for control: An overview
    Lesort, Timothee
    Diaz-Rodriguez, Natalia
    Goudou, Jean-Franois
    Filliat, David
    [J]. NEURAL NETWORKS, 2018, 108 : 379 - 392
  • [10] First Steps Towards State Representation Learning for Cognitive Robotics
    Meden, Blaz
    Prieto, Abraham
    Peer, Peter
    Bellas, Francisco
    [J]. HYBRID ARTIFICIAL INTELLIGENT SYSTEMS, HAIS 2020, 2020, 12344 : 499 - 510