Goal-oriented robot navigation learning using a multi-scale space representation

被引:23
|
作者
Llofriu, M. [1 ,3 ]
Tejera, G. [3 ]
Contreras, M. [2 ]
Pelc, T. [2 ]
Fellous, J. M. [2 ]
Weitzenfeld, A. [1 ]
机构
[1] Univ S Florida, Tampa, FL 33620 USA
[2] Univ Arizona, Tucson, AZ 85721 USA
[3] Univ Republica, Montevideo, Uruguay
基金
美国国家科学基金会;
关键词
Place cells; Hippocampus; Spatial cognition model; Multiscale spatial representation; Reinforcement learning; HIPPOCAMPAL PLACE CELLS; HEAD DIRECTION CELLS; POSITION RECONSTRUCTION; SPATIAL REPRESENTATION; MODEL; DORSAL; MAPS; LOCALIZATION; INFORMATION; SEQUENCES;
D O I
10.1016/j.neunet.2015.09.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
There has been extensive research in recent years on the multi-scale nature of hippocampal place cells and entorhinal grid cells encoding which led to many speculations on their role in spatial cognition. In this paper we focus on the multi-scale nature of place cells and how they contribute to faster learning during goal-oriented navigation when compared to a spatial cognition system composed of single scale place cells. The task consists of a circular arena with a fixed goal location, in which a robot is trained to find the shortest path to the goal after a number of learning trials. Synaptic connections are modified using a reinforcement learning paradigm adapted to the place cells multi-scale architecture. The model is evaluated in both simulation and physical robots. We find that larger scale and combined multi-scale representations favor goal-oriented navigation task learning. (C) 2015 Elsevier Ltd. All rights reserved.
引用
收藏
页码:62 / 74
页数:13
相关论文
共 50 条
  • [1] Supervised Learning of Internal Models for Autonomous Goal-Oriented Robot Navigation using Reservoir Computing
    Antonelo, Eric A.
    Schrauwen, Benjamin
    2010 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2010, : 2959 - 2964
  • [2] Multi-scale goal-oriented adaptive modeling of random heterogeneous materials
    Romkes, A
    Oden, JT
    Vemaganti, K
    MECHANICS OF MATERIALS, 2006, 38 (8-10) : 859 - 872
  • [3] A Brain-Inspired Goal-Oriented Robot Navigation System
    Chen, Qiuying
    Mo, Hongwei
    APPLIED SCIENCES-BASEL, 2019, 9 (22):
  • [4] Object Goal Navigation using Goal-Oriented Semantic Exploration
    Chaplot, Devendra Singh
    Gandhi, Dhiraj
    Gupta, Abhinav
    Salakhutdinov, Ruslan
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [5] Goal-Oriented Navigation with Avoiding Obstacle based on Deep Reinforcement Learning in Continuous Action Space
    Hien, Pham Xuan
    Kim, Gon-Woo
    2021 21ST INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS 2021), 2021, : 8 - 11
  • [6] Cue combination in goal-oriented navigation
    Qi, Yafei
    Mou, Weimin
    Lei, Xuehui
    QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 2021, 74 (11): : 1981 - 2001
  • [7] Local Goal-Oriented Estimation of Modeling Error for Multi-Scale Modeling of Heterogeneous Elastic Materials
    Romkes, Albert
    Moody, Tristan C.
    INTERNATIONAL JOURNAL FOR COMPUTATIONAL METHODS IN ENGINEERING SCIENCE & MECHANICS, 2007, 8 (04): : 201 - 209
  • [8] Behavior-based blind goal-oriented robot navigation by fuzzy logic
    Wang, M
    Liu, JNK
    KNOWLEDGE-BASED INTELLIGENT INFORMATION AND ENGINEERING SYSTEMS, PT 1, PROCEEDINGS, 2005, 3681 : 686 - 692
  • [9] A layered goal-oriented fuzzy motion planning strategy for mobile robot navigation
    Yang, XY
    Moallem, M
    Patel, RV
    IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2005, 35 (06): : 1214 - 1224
  • [10] A Goal-Oriented Fuzzy Reactive Control Method for Mobile Robot Navigation in Unknown Environment
    Liu, Honglin
    Hu, Peng
    Luo, Yangyu
    Li, Chengrong
    ISIE: 2009 IEEE INTERNATIONAL SYMPOSIUM ON INDUSTRIAL ELECTRONICS, 2009, : 1933 - 1938