Tipping prediction of a class of large-scale radial-ring neural networks

被引:0
作者
Lu, Yunxiang [1 ]
Xiao, Min [1 ]
Wu, Xiaoqun [2 ]
Karimi, Hamid Reza [3 ]
Xie, Xiangpeng [4 ]
Cao, Jinde [5 ]
Zheng, Wei Xing [6 ]
机构
[1] Nanjing Univ Posts & Telecommun, Coll Automat & Coll Artificial Intelligence, Nanjing 210023, Peoples R China
[2] Shen Zhen Univ, Coll Comp Sci & Software Engn, Shen Zhen 518060, Peoples R China
[3] Politecn Milan, Dept Mech Engn, I-20159 Milan, Italy
[4] Nanjing Univ Posts & Telecommun, Inst Adv Technol, Nanjing 210023, Peoples R China
[5] Southeast Univ, Sch Math, Nanjing 210096, Peoples R China
[6] Western Sydney Univ, Sch Comp Data & Math Sci, Sydney, NSW 2751, Australia
基金
中国国家自然科学基金;
关键词
Neural networks; Tipping; Hopf bifurcation; Large-scale; Coates' flow graph; BIFURCATION-ANALYSIS; STABILITY; DYNAMICS; ELEMENTS;
D O I
10.1016/j.neunet.2024.106820
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Understanding the emergence and evolution of collective dynamics in large-scale neural networks remains a complex challenge. This paper seeks to address this gap by applying dynamical systems theory, with a particular focus on tipping mechanisms. First, we introduce a novel ( n + mn )-scale radial-ring neural network and employ Coates' flow graph topological approach to derive the characteristic equation of the linearized network. Second, through deriving stability conditions and predicting the tipping point using an algebraic approach based on the integral element concept, we identify critical factors such as the synaptic transmission delay, the self-feedback coefficient, and the network topology. Finally, we validate the methodology's effectiveness in predicting the tipping point. The findings reveal that increased synaptic transmission delay can induce and amplify periodic oscillations. Additionally, the self-feedback coefficient and the network topology influence the onset of tipping points. Moreover, the selection of activation function impacts both the number of equilibrium solutions and the convergence speed of the neural network. Lastly, we demonstrate that the proposed large-scale radial-ring neural network exhibits stronger robustness compared to lower-scale networks with a single topology. The results provide a comprehensive depiction of the dynamics observed in large-scale neural networks under the influence of various factor combinations.
引用
收藏
页数:16
相关论文
共 56 条
[1]   Tipping in complex systems: theory, methods and applications [J].
Ambika, G. ;
Kurths, Juergen .
EUROPEAN PHYSICAL JOURNAL-SPECIAL TOPICS, 2021, 230 (16-17) :3177-3179
[2]   Critical transition influenced by dynamic quorum sensing in nonlinear oscillators [J].
Asir, M. Paul ;
Dixit, Shiva ;
Shrimali, Manish Dev .
EUROPEAN PHYSICAL JOURNAL-SPECIAL TOPICS, 2021, 230 (16-17) :3211-3219
[3]   Dynamic models of large-scale brain activity [J].
Breakspear, Michael .
NATURE NEUROSCIENCE, 2017, 20 (03) :340-352
[4]   A Concealed Information Test System Based on Functional Brain Connectivity and Signal Entropy of Audio-Visual ERP [J].
Chang, Wenwen ;
Wang, Hong ;
Lu, Zhiguo ;
Liu, Chong .
IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2020, 12 (02) :361-370
[5]   Dynamical Bifurcation for a Class of Large-Scale Fractional Delayed Neural Networks With Complex Ring-Hub Structure and Hybrid Coupling [J].
Chen, Jing ;
Xiao, Min ;
Wan, Youhong ;
Huang, Chengdai ;
Xu, Fengyu .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (05) :2659-2669
[6]  
Coates C., 1959, IRE T CIRCUIT THEORY, V6, P170, DOI [DOI 10.1109/TCT.1959.1086537, 10.1109/TCT.1959.1086537]
[7]   THE OPTIMUM FORMULA FOR THE GAIN OF A FLOW GRAPH OR A SIMPLE DERIVATION OF COATES FORMULA [J].
DESOER, CA .
PROCEEDINGS OF THE INSTITUTE OF RADIO ENGINEERS, 1960, 48 (05) :883-889
[8]   Activation functions in deep learning: A comprehensive survey and benchmark [J].
Dubey, Shiv Ram ;
Singh, Satish Kumar ;
Chaudhuri, Bidyut Baran .
NEUROCOMPUTING, 2022, 503 :92-108
[9]   Inhibitory stabilized network behaviour in a balanced neural mass model of a cortical column [J].
Eskikand, Parvin Zarei ;
Soto-Breceda, Artemio ;
Cook, Mark J. ;
Burkitt, Anthony N. ;
Grayden, David B. .
NEURAL NETWORKS, 2023, 166 :296-312
[10]   Evidence for Quasicritical Brain Dynamics [J].
Fosque, Leandro J. ;
Williams-Garcia, Rashid, V ;
Beggs, John M. ;
Ortiz, Gerardo .
PHYSICAL REVIEW LETTERS, 2021, 126 (09)