Different eigenvalue distributions encode the same temporal tasks in recurrent neural networks

被引:0
|
作者
Cecilia Jarne
机构
[1] Departmento de Ciencia y Tecnología de la Universidad Nacional de Quilmes - CONICET,
来源
Cognitive Neurodynamics | 2023年 / 17卷
关键词
Dynamics; Recurrent neural networks; Eigenvalue spectrum;
D O I
暂无
中图分类号
学科分类号
摘要
Different brain areas, such as the cortex and, more specifically, the prefrontal cortex, show great recurrence in their connections, even in early sensory areas. Several approaches and methods based on trained networks have been proposed to model and describe these regions. It is essential to understand the dynamics behind the models because they are used to build different hypotheses about the functioning of brain areas and to explain experimental results. The main contribution here is the description of the dynamics through the classification and interpretation carried out with a set of numerical simulations. This study sheds light on the multiplicity of solutions obtained for the same tasks and shows the link between the spectra of linearized trained networks and the dynamics of the counterparts. The patterns in the distribution of the eigenvalues of the recurrent weight matrix were studied and properly related to the dynamics in each task.
引用
收藏
页码:257 / 275
页数:18
相关论文
共 39 条
  • [21] Temporal prediction of suicidal ideation in an ecological momentary assessment study with recurrent neural networks
    Choo, Tse-Hwei
    Wall, Melanie
    Brodsky, Beth S.
    Herzog, Sarah
    Mann, J. John
    Stanley, Barbara
    Galfalvy, Hanga
    JOURNAL OF AFFECTIVE DISORDERS, 2024, 360 : 268 - 275
  • [22] Universal Analysis Method for Stability of Recurrent Neural Networks with Different Multiple Delays
    Wang, Zhanshan
    Zhang, Enlin
    Yun, Kuo
    Zhang, Huaguang
    ADVANCES IN NEURAL NETWORKS - ISNN 2011, PT I, 2011, 6675 : 148 - 157
  • [23] Extraction of Saline Soil Distributions Using Different Salinity Indices and Deep Neural Networks
    Gu, Qianyi
    Han, Yang
    Xu, Yaping
    Ge, Huitian
    Li, Xiaojie
    REMOTE SENSING, 2022, 14 (18)
  • [24] Recurrent neural networks with long term temporal dependencies in machine tool wear diagnosis and prognosis
    Zhang, Jianlei
    Zeng, Yukun
    Starly, Binil
    SN APPLIED SCIENCES, 2021, 3 (04):
  • [25] Spatio Temporal Modelling of Repeat Crimes and Hotspots Prediction Using Recurrent Deep Neural Networks
    Sundharakumar, K. B.
    Bhalaji, N.
    Palaniappan, Muthu M.
    2024 5TH INTERNATIONAL CONFERENCE ON INNOVATIVE TRENDS IN INFORMATION TECHNOLOGY, ICITIIT 2024, 2024,
  • [26] Identification of Temporal Transition of Functional States Using Recurrent Neural Networks from Functional MRI
    Li, Hongming
    Fan, Yong
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, PT III, 2018, 11072 : 232 - 239
  • [27] Improving Temporal Stability and Accuracy for Endoscopic Video Tissue Classification Using Recurrent Neural Networks
    Boers, Tim
    van der Putten, Joost
    Struyvenberg, Maarten
    Fockens, Kiki
    Jukema, Jelmer
    Schoon, Erik
    van der Sommen, Fons
    Bergman, Jacques
    de With, Peter
    SENSORS, 2020, 20 (15) : 1 - 11
  • [28] Potentiation decay of synapses and length distributions of synfire chains self-organized in recurrent neural networks
    Miller, Aaron
    Jin, Dezhe Z.
    PHYSICAL REVIEW E, 2013, 88 (06)
  • [29] Sequential Learning Network With Residual Blocks: Incorporating Temporal Convolutional Information Into Recurrent Neural Networks
    Shan, Dongjing
    Yao, Kun
    Zhang, Xiongwei
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2024, 16 (01) : 396 - 401
  • [30] Recurrent neural networks with long term temporal dependencies in machine tool wear diagnosis and prognosis
    Jianlei Zhang
    Yukun Zeng
    Binil Starly
    SN Applied Sciences, 2021, 3