Different eigenvalue distributions encode the same temporal tasks in recurrent neural networks

被引:3
|
作者
Jarne, Cecilia [1 ]
机构
[1] Univ Nacl Quilmes, CONICET, Dept Ciencia & Tecnol, Bernal, Buenos Aires, Argentina
关键词
Dynamics; Recurrent neural networks; Eigenvalue spectrum; DYNAMICS; NEUROSCIENCE; COMPUTATION; CIRCUITS;
D O I
10.1007/s11571-022-09802-5
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Different brain areas, such as the cortex and, more specifically, the prefrontal cortex, show great recurrence in their connections, even in early sensory areas. Several approaches and methods based on trained networks have been proposed to model and describe these regions. It is essential to understand the dynamics behind the models because they are used to build different hypotheses about the functioning of brain areas and to explain experimental results. The main contribution here is the description of the dynamics through the classification and interpretation carried out with a set of numerical simulations. This study sheds light on the multiplicity of solutions obtained for the same tasks and shows the link between the spectra of linearized trained networks and the dynamics of the counterparts. The patterns in the distribution of the eigenvalues of the recurrent weight matrix were studied and properly related to the dynamics in each task.
引用
收藏
页码:257 / 275
页数:19
相关论文
共 41 条
  • [1] Different eigenvalue distributions encode the same temporal tasks in recurrent neural networks
    Cecilia Jarne
    Cognitive Neurodynamics, 2023, 17 : 257 - 275
  • [2] Exploring weight initialization, diversity of solutions, and degradation in recurrent neural networks trained for temporal and decision-making tasks
    Jarne, Cecilia
    Laje, Rodrigo
    JOURNAL OF COMPUTATIONAL NEUROSCIENCE, 2023, 51 (04) : 407 - 431
  • [3] Optimizing Recurrent Spiking Neural Networks with Small Time Constants for Temporal Tasks
    Zeng, Yuan
    Jeffs, Edward
    Stewart, Terrence C.
    Berdichevsky, Yevgeny
    Guo, Xiaochen
    PROCEEDINGS OF INTERNATIONAL CONFERENCE ON NEUROMORPHIC SYSTEMS 2022, ICONS 2022, 2022,
  • [4] Emergence of prefrontal neuron maturation properties by training recurrent neural networks in cognitive tasks
    Liu, Yichen Henry
    Zhu, Junda
    Constantinidis, Christos
    Zhou, Xin
    ISCIENCE, 2021, 24 (10)
  • [5] Training biologically plausible recurrent neural networks on cognitive tasks with long-term dependencies
    Soo, Wayne W. M.
    Goudar, Vishwa
    Wang, Xiao-Jing
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [6] Temporal-Kernel Recurrent Neural Networks
    Sutskever, Ilya
    Hinton, Geoffrey
    NEURAL NETWORKS, 2010, 23 (02) : 239 - 243
  • [7] Training spatially homogeneous fully recurrent neural networks in eigenvalue space
    Perfetti, R
    Massarelli, E
    NEURAL NETWORKS, 1997, 10 (01) : 125 - 137
  • [8] Partially recurrent neural networks for production of temporal sequence
    Araujo, AFR
    D'Arbo, H
    IEEE WORLD CONGRESS ON COMPUTATIONAL INTELLIGENCE, 1998, : 474 - 479
  • [9] Exploring weight initialization, diversity of solutions, and degradation in recurrent neural networks trained for temporal and decision-making tasks
    Cecilia Jarne
    Rodrigo Laje
    Journal of Computational Neuroscience, 2023, 51 : 407 - 431
  • [10] Training Excitatory-Inhibitory Recurrent Neural Networks for Cognitive Tasks: A Simple and Flexible Framework
    Song, H. Francis
    Yang, Guangyu R.
    Wang, Xiao-Jing
    PLOS COMPUTATIONAL BIOLOGY, 2016, 12 (02)