The hippocampal formation as a hierarchical generative model supporting generative replay and continual learning

被引:26
|
作者
Stoianov, Ivilin [1 ]
Maisto, Domenico [1 ]
Pezzulo, Giovanni [1 ,2 ]
机构
[1] CNR, Inst Cognit Sci & Technol, Rome, Italy
[2] CNR, Inst Cognit Sci & Technol, Via S Martino Battaglia, Rome, Italy
基金
欧洲研究理事会;
关键词
Hippocampus; Generative model; Generative replay; Cognitive map; Sequence generation; continual learning; PLACE CELLS; COGNITIVE MAP; ACTIVE INFERENCE; EPISODIC MEMORY; REVERSE REPLAY; SEQUENCES; CONTEXT; FUTURE; DECISION; SYSTEMS;
D O I
10.1016/j.pneurobio.2022.102329
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
We advance a novel computational theory of the hippocampal formation as a hierarchical generative model that organizes sequential experiences, such as rodent trajectories during spatial navigation, into coherent spatio-temporal contexts. We propose that the hippocampal generative model is endowed with inductive biases to identify individual items of experience (first hierarchical layer), organize them into sequences (second layer) and cluster them into maps (third layer). This theory entails a novel characterization of hippocampal reactivations as generative replay: the offline resampling of fictive sequences from the generative model, which supports the continual learning of multiple sequential experiences. We show that the model learns and efficiently retains multiple spatial navigation trajectories, by organizing them into spatial maps. Furthermore, the model reproduces flexible and prospective aspects of hippocampal dynamics that are challenging to explain within existing frameworks. This theory reconciles multiple roles of the hippocampal formation in map-based navigation, episodic memory and imagination.
引用
收藏
页数:20
相关论文
共 50 条
  • [11] Generative appearance replay for continual unsupervised domain adaptation
    Chen, Boqi
    Thandiackal, Kevin
    Pati, Pushpak
    Goksel, Orcun
    MEDICAL IMAGE ANALYSIS, 2023, 89
  • [12] Continual Learning with Diffusion-based Generative Replay for Industrial Streaming Data
    He, Jiayi
    Chen, Jiao
    Liu, Qianmiao
    Dai, Suyan
    Tang, Jianhua
    Liu, Dongpo
    2024 IEEE/CIC INTERNATIONAL CONFERENCE ON COMMUNICATIONS IN CHINA, ICCC, 2024,
  • [13] Generative Continual Concept Learning
    Rostami, Mohammad
    Kolouri, Soheil
    McClelland, James
    Pilly, Praveen
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 5545 - 5552
  • [14] Deep Generative Replay With Denoising Diffusion Probabilistic Models for Continual Learning in Audio Classification
    Lee, Hyeon-Ju
    Buu, Seok-Jun
    IEEE ACCESS, 2024, 12 : 134714 - 134727
  • [15] Unified Probabilistic Deep Continual Learning through Generative Replay and Open Set Recognition
    Mundt, Martin
    Pliushch, Iuliia
    Majumder, Sagnik
    Hong, Yongwon
    Ramesh, Visvanathan
    JOURNAL OF IMAGING, 2022, 8 (04)
  • [16] TactCLNet: Tactile Continual Learning Network Based on Generative Replay for Object Hardness Recognition
    Liu, Yiwen
    Yi, Zhengkun
    Fang, Senlin
    Zhang, Yupo
    Wan, Feng
    Yang, Zhi-Xin
    Lu, Xu
    Wu, Xinyu
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2024,
  • [17] Hierarchical Correlations Replay for Continual Learning
    Wang, Qiang
    Liu, Jiayi
    Ji, Zhong
    Pang, Yanwei
    Zhang, Zhongfei
    KNOWLEDGE-BASED SYSTEMS, 2022, 250
  • [18] Continual learning with invertible generative models
    Pomponi, Jary
    Scardapane, Simone
    Uncini, Aurelio
    NEURAL NETWORKS, 2023, 164 : 606 - 616
  • [19] UNSUPERVISED GENERATIVE VARIATIONAL CONTINUAL LEARNING
    Liu Guimeng
    Yang, Guo
    Yin, Cheryl Wong Sze
    Suganathan, Ponnuthurai Nagartnam
    Savitha, Ramasamy
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 4028 - 4032
  • [20] Generative Negative Text Replay for Continual Vision-Language Pretraining
    Yan, Shipeng
    Hong, Lanqing
    Xu, Hang
    Han, Jianhua
    Tuytelaars, Tinne
    Li, Zhenguo
    He, Xuming
    COMPUTER VISION, ECCV 2022, PT XXXVI, 2022, 13696 : 22 - 38