Dynamics of heterogeneous Hopfield neural network with adaptive activation function based on memristor

被引:70
作者
Wang, Chunhua [1 ,2 ]
Liang, Junhui [1 ]
Deng, Quanli [1 ]
机构
[1] Hunan Univ, Coll Comp Sci & Elect Engn, Changsha 410082, Peoples R China
[2] Hunan Univ, Greater Bay Area Inst Innovat, Guangzhou 511300, Peoples R China
基金
中国国家自然科学基金;
关键词
Key & Oslash; rds; Hopfield neural network; Hopfield Heterogeneous structure; Heterogeneous Memristor; Adaptive activation function; ATTRACTORS;
D O I
10.1016/j.neunet.2024.106408
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Memristor and activation function are two important nonlinear factors of the memristive Hopfield neural network. The effects of different memristors on the dynamics of Hopfield neural networks have been studied by many researchers. However, less attention has been paid to the activation function. In this paper, we present a heterogeneous memristive Hopfield neural network with neurons using different activation functions. The activation functions include fixed activation functions and an adaptive activation function, where the adaptive activation function is based on a memristor. The theoretical and experimental study of the neural network's dynamics has been conducted using phase portraits, bifurcation diagrams, and Lyapunov exponents spectras. Numerical results show that complex dynamical behaviors such as multi-scroll chaos, transient chaos, state jumps and multi -type coexisting attractors can be observed in the heterogeneous memristive Hopfield neural network. In addition, the hardware implementation of memristive Hopfield neural network with adaptive activation function is designed and verified. The experimental results are in good agreement with those obtained using numerical simulations.
引用
收藏
页数:9
相关论文
共 51 条
[1]   Memristive-cyclic Hopfield neural network: spatial multi-scroll chaotic attractors and spatial initial-offset coexisting behaviors [J].
Bao, Han ;
Chen, Zhuguan ;
Chen, Mo ;
Xu, Quan ;
Bao, Bocheng .
NONLINEAR DYNAMICS, 2023, 111 (24) :22535-22550
[2]   Offset-Control Plane Coexisting Behaviors in Two-Memristor-Based Hopfield Neural Network [J].
Bao, Han ;
Hua, Mengjie ;
Ma, Jun ;
Chen, Mo ;
Bao, Bocheng .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2023, 70 (10) :10526-10535
[3]   Discovering Parametric Activation Functions [J].
Bingham, Garrett ;
Miikkulainen, Risto .
NEURAL NETWORKS, 2022, 148 :48-65
[4]   ReLU-type Hopfield neural network with analog hardware implementation [J].
Chen, Chengjie ;
Min, Fuhong ;
Zhang, Yunzhen ;
Bao, Han .
CHAOS SOLITONS & FRACTALS, 2023, 167
[5]   Memristive electromagnetic induction effects on Hopfield neural network [J].
Chen, Chengjie ;
Min, Fuhong ;
Zhang, Yunzhen ;
Bao, Bocheng .
NONLINEAR DYNAMICS, 2021, 106 (03) :2559-2576
[6]   Everything You Wish to Know About Memristors But Are Afraid to Ask [J].
Chua, Leon .
RADIOENGINEERING, 2015, 24 (02) :319-368
[7]   MEMRISTOR - MISSING CIRCUIT ELEMENT [J].
CHUA, LO .
IEEE TRANSACTIONS ON CIRCUIT THEORY, 1971, CT18 (05) :507-+
[8]   Hidden transient chaotic attractors of Rabinovich-Fabrikant system [J].
Danca, Marius-F. .
NONLINEAR DYNAMICS, 2016, 86 (02) :1263-1270
[9]   Chaotic dynamical system of Hopfield neural network influenced by neuron activation threshold and its image encryption [J].
Deng, Quanli ;
Wang, Chunhua ;
Lin, Hairong .
NONLINEAR DYNAMICS, 2024, 112 (08) :6629-6646
[10]   Memristive Hopfield neural network dynamics with heterogeneous activation functions and its application [J].
Deng, Quanli ;
Wang, Chunhua ;
Lin, Hairong .
CHAOS SOLITONS & FRACTALS, 2024, 178