Goal-oriented robot navigation learning using a multi-scale space representation

被引:23
作者
Llofriu, M. [1 ,3 ]
Tejera, G. [3 ]
Contreras, M. [2 ]
Pelc, T. [2 ]
Fellous, J. M. [2 ]
Weitzenfeld, A. [1 ]
机构
[1] Univ S Florida, Tampa, FL 33620 USA
[2] Univ Arizona, Tucson, AZ 85721 USA
[3] Univ Republica, Montevideo, Uruguay
基金
美国国家科学基金会;
关键词
Place cells; Hippocampus; Spatial cognition model; Multiscale spatial representation; Reinforcement learning; HIPPOCAMPAL PLACE CELLS; HEAD DIRECTION CELLS; POSITION RECONSTRUCTION; SPATIAL REPRESENTATION; MODEL; DORSAL; MAPS; LOCALIZATION; INFORMATION; SEQUENCES;
D O I
10.1016/j.neunet.2015.09.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
There has been extensive research in recent years on the multi-scale nature of hippocampal place cells and entorhinal grid cells encoding which led to many speculations on their role in spatial cognition. In this paper we focus on the multi-scale nature of place cells and how they contribute to faster learning during goal-oriented navigation when compared to a spatial cognition system composed of single scale place cells. The task consists of a circular arena with a fixed goal location, in which a robot is trained to find the shortest path to the goal after a number of learning trials. Synaptic connections are modified using a reinforcement learning paradigm adapted to the place cells multi-scale architecture. The model is evaluated in both simulation and physical robots. We find that larger scale and combined multi-scale representations favor goal-oriented navigation task learning. (C) 2015 Elsevier Ltd. All rights reserved.
引用
收藏
页码:62 / 74
页数:13
相关论文
共 50 条
  • [21] Multi-scale Q-Learning of A Mobile Robot in Dynamic Environments
    Takase, Noriko
    Kubota, Naoyuki
    Baba, Norio
    [J]. 6TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND INTELLIGENT SYSTEMS, AND THE 13TH INTERNATIONAL SYMPOSIUM ON ADVANCED INTELLIGENT SYSTEMS, 2012, : 1248 - 1252
  • [22] Navigation in Multi Robot System using Cooperative Learning : A Survey
    Singh, Priyanka
    Tiwari, Ritu
    Bhattacharya, Mahua
    [J]. 2016 INTERNATIONAL CONFERENCE ON COMPUTATIONAL TECHNIQUES IN INFORMATION AND COMMUNICATION TECHNOLOGIES (ICCTICT), 2016,
  • [23] Vasoactive Intestinal Polypeptide-Expressing Interneurons in the Hippocampus Support Goal-Oriented Spatial Learning
    Turi, Gergely Farkas
    Li, Wen-Ke
    Chavlis, Spyridon
    Pandi, Ioanna
    O'Hare, Justin
    Priestley, James Benjamin
    Grosmark, Andres Daniel
    Liao, Zhenrui
    Ladow, Max
    Zhang, Jeff Fang
    Zemelman, Boris Valery
    Poirazi, Panayiota
    Losonczy, Attila
    [J]. NEURON, 2019, 101 (06) : 1150 - +
  • [24] Goal-Based Decision Making Using Goal-Oriented Problem Structuring and Evaluation Visualization for Multi Criteria Decision Analysis
    Ma, Qin
    de Kinderen, Sybren
    [J]. REQUIREMENTS ENGINEERING: FOUNDATION FOR SOFTWARE QUALITY, REFSQ 2016, 2016, 9619 : 19 - 35
  • [25] Biological Inspired Goal-oriented Navigation Model Based on Spatial Exploration and Construction of Cognitive Map
    Zhou, Yang
    Wu, Dewei
    Song, Yi
    Dai, Chuanjin
    [J]. JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2023, 45 (05) : 1817 - 1823
  • [26] Goal-oriented Remote Tracking of an Unobservable Multi-state Markov Source
    Zakeri, Abolfazl
    Moltafet, Mohammad
    Codreanu, Marian
    [J]. 2024 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC 2024, 2024,
  • [27] Structural Optimization for Asymmetrical Inline Topology Filter With Transmission Zeros Using Goal-Oriented Reinforcement Learning
    Leong, Kiet Yew
    Soeung, Socheatra
    Cheab, Sovuthy
    Lu, Cheng-Kai
    [J]. IEEE ACCESS, 2024, 12 : 111386 - 111399
  • [28] Dynamic texture representation using a deep multi-scale convolutional network
    Arashloo, Shervin Rahimzadeh
    Amirani, Mehdi Chehel
    Noroozi, Ardeshir
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2017, 43 : 89 - 97
  • [29] Grid codes vs. multi-scale, multi-field place codes for space
    Dietrich, Robin
    Waniek, Nicolai
    Stemmler, Martin
    Knoll, Alois
    [J]. FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2024, 18
  • [30] Quantification of model uncertainty on path-space via goal-oriented relative entropy
    Birrell, Jeremiah
    Katsoulakis, Markos A.
    Rey-Bellet, Luc
    [J]. ESAIM-MATHEMATICAL MODELLING AND NUMERICAL ANALYSIS, 2021, 55 (01) : 131 - 169