Rapid learning of spatial representations for goal-directed navigation based on a novel model of hippocampal place fields

被引:2
作者
Alabi, Adedapo [1 ]
Vanderelst, Dieter [1 ]
Minai, Ali A. [1 ]
机构
[1] Univ Cincinnati, Dept Elect & Comp Engn, Cincinnati, OH 45221 USA
关键词
Spatial cognition; Robotics; Reinforcement learning; Hippocampus; Computational neuroscience; MORRIS WATER MAZE; FIBER SYNAPTIC-TRANSMISSION; VECTOR CELL MODEL; GRID CELLS; PATH-INTEGRATION; VICARIOUS TRIAL; CHOLINERGIC SUPPRESSION; SELECTIVE SUPPRESSION; NETWORK ACTIVITY; MEMORY;
D O I
10.1016/j.neunet.2023.01.010
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The discovery of place cells and other spatially modulated neurons in the hippocampal complex of rodents has been crucial to elucidating the neural basis of spatial cognition. More recently, the replay of neural sequences encoding previously experienced trajectories has been observed during consummatory behavior-potentially with implications for rapid learning, quick memory consolidation, and behavioral planning. Several promising models for robotic navigation and reinforcement learning have been proposed based on these and previous findings. Most of these models, however, use carefully engineered neural networks, and sometimes require long learning periods. In this paper, we present a self-organizing model incorporating place cells and replay, and demonstrate its utility for rapid one-shot learning in non-trivial environments with obstacles. (c) 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页码:116 / 128
页数:13
相关论文
共 82 条
  • [1] SurvSHAP: A Proxy-Based Algorithm for Explaining Survival Models with SHAP
    Alabdallah, Abdallah
    Pashami, Sepideh
    Rögnvaldsson, Thorsteinn
    Ohlsson, Mattias
    [J]. 2022 IEEE 9TH INTERNATIONAL CONFERENCE ON DATA SCIENCE AND ADVANCED ANALYTICS (DSAA), 2022, : 917 - 926
  • [2] Alabi A., 2020, 2020 INT JOINT C NEU, P1
  • [3] Reciprocal interactions between CA3 network activity and strength of recurrent collateral synapses
    Bains, JS
    Longacher, JM
    Staley, KJ
    [J]. NATURE NEUROSCIENCE, 1999, 2 (08) : 720 - 726
  • [4] Barry C, 2006, REV NEUROSCIENCE, V17, P71
  • [5] Berkvens Rafael, 2015, 2015 IEEE Sensors. Proceedings, P1, DOI 10.1109/ICSENS.2015.7370552
  • [6] Structured Dendritic Inhibition Supports Branch-Selective Integration in CA1 Pyramidal Cells
    Bloss, Erik B.
    Cembrowski, Mark S.
    Karsh, Bill
    Colonell, Jennifer
    Fetter, Richard D.
    Spruston, Nelson
    [J]. NEURON, 2016, 89 (05) : 1016 - 1030
  • [7] Presynaptic GABAB receptors functionally uncouple somatostatin interneurons from the active hippocampal network
    Booker, Sam A.
    Harada, Harumi
    Elgueta, Claudio
    Bank, Julia
    Bartos, Marlene
    Kulik, Akos
    Vida, Imre
    [J]. ELIFE, 2020, 9
  • [8] THE USE OF THE MORRIS WATER MAZE IN THE STUDY OF MEMORY AND LEARNING
    BRANDEIS, R
    BRANDYS, Y
    YEHUDA, S
    [J]. INTERNATIONAL JOURNAL OF NEUROSCIENCE, 1989, 48 (1-2) : 29 - 69
  • [9] Burgess N, 1996, HIPPOCAMPUS, V6, P749
  • [10] Using Grid Cells for Navigation
    Bush, Daniel
    Barry, Caswell
    Manson, Daniel
    Burgess, Neil
    [J]. NEURON, 2015, 87 (03) : 507 - 520