Fully Complex-valued Dendritic Neuron Model

被引:54
作者
Gao, Shangce [1 ]
Zhou, MengChu [2 ]
Wang, Ziqian [1 ]
Sugiyama, Daiki [3 ]
Cheng, Jiujun [4 ]
Wang, Jiahai [5 ]
Todo, Yuki [6 ]
机构
[1] Univ Toyama, Fac Engn, Toyama 9308555, Japan
[2] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
[3] NEC Solut Innovators Ltd, Tokyo 1368627, Japan
[4] Tongji Univ, Dept Comp Sci & Technol, Key Lab Embedded Syst & Serv Comp, Minist Educ, Shanghai 200092, Peoples R China
[5] Sun Yat Sen Univ, Sch Comp Sci & Engn, Guangzhou 510275, Peoples R China
[6] Kanazawa Univ, Fac Elect Informat & Commun Engn, Kanazawa, Ishikawa 9201192, Japan
基金
中国国家自然科学基金;
关键词
Neurons; Biological neural networks; Task analysis; Convergence; Dendrites (neurons); Computer architecture; Computational modeling; Activation functions; complex back-propagation (BP); complex domain; complex-valued neural networks; dendritic neuron model (DNM); elementary transcendental functions; McCulloch-Pitts neuron; LEARNING ALGORITHM; BACKPROPAGATION ALGORITHM; MULTILAYER PERCEPTRON; SEARCH ALGORITHM; SINGLE-NEURON; NETWORK; SYNCHRONIZATION; OPTIMIZATION; INPUTS; PHASE;
D O I
10.1109/TNNLS.2021.3105901
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A single dendritic neuron model (DNM) that owns the nonlinear information processing ability of dendrites has been widely used for classification and prediction. Complex-valued neural networks that consist of a number of multiple/deep-layer McCulloch-Pitts neurons have achieved great successes so far since neural computing was utilized for signal processing. Yet no complex value representations appear in single neuron architectures. In this article, we first extend DNM from a real-value domain to a complex-valued one. Performance of complex-valued DNM (CDNM) is evaluated through a complex xor problem, a non-minimum phase equalization problem, and a real-world wind prediction task. Also, a comparative analysis on a set of elementary transcendental functions as an activation function is implemented and preparatory experiments are carried out for determining hyperparameters. The experimental results indicate that the proposed CDNM significantly outperforms real-valued DNM, complex-valued multi-layer perceptron, and other complex-valued neuron models.
引用
收藏
页码:2105 / 2118
页数:14
相关论文
共 92 条
[1]   The role of dendrites in auditory coincidence detection [J].
Agmon-Snir, H ;
Carr, CE ;
Rinzel, J .
NATURE, 1998, 393 (6682) :268-272
[2]   Artificial neural networks in medical diagnosis [J].
Amato, Filippo ;
Lopez, Alberto ;
Pena-Mendez, Eladia Maria ;
Vanhara, Petr ;
Hampl, Ales ;
Havel, Josef .
JOURNAL OF APPLIED BIOMEDICINE, 2013, 11 (02) :47-58
[3]   Orthogonal least squares based complex-valued functional link network [J].
Amin, Md. Faijul ;
Savitha, Ramasamy ;
Amin, Muhammad Ilias ;
Murase, Kazuyuki .
NEURAL NETWORKS, 2012, 32 :257-266
[4]   Millimeter-Wave Coherent Imaging of Moving Targets by Using Complex-Valued Self-Organizing Map and Auto-Encoder [J].
Arima, Yuya ;
Hirose, Akira .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 :1784-1797
[5]   Memory analysis for memristors and memristive recurrent neural networks [J].
Bao, Gang ;
Zhang, Yide ;
Zeng, Zhigang .
IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2020, 7 (01) :96-105
[6]   ON THE COMPLEX BACKPROPAGATION ALGORITHM [J].
BENVENUTO, N ;
PIAZZA, F .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 1992, 40 (04) :967-968
[7]   Comprehensive Learning Particle Swarm Optimization Algorithm With Local Search for Multimodal Functions [J].
Cao, Yulian ;
Zhang, Han ;
Li, Wenfeng ;
Zhou, Mengchu ;
Zhang, Yu ;
Chaovalitwongse, Wanpracha Art .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2019, 23 (04) :718-731
[8]   CHANNEL EQUALIZATION USING ADAPTIVE COMPLEX RADIAL BASIS FUNCTION NETWORKS [J].
CHA, I ;
KASSAM, SA .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 1995, 13 (01) :122-131
[9]   Global Asymptotic Stability and Adaptive Ultimate Mittag-Leffler Synchronization for a Fractional-Order Complex-Valued Memristive Neural Networks With Delays [J].
Chen, Jiejie ;
Chen, Boshan ;
Zeng, Zhigang .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2019, 49 (12) :2519-2535
[10]   A modified error backpropagation algorithm for complex-value neural networks [J].
Chen, XM ;
Tang, Z ;
Variappan, C ;
Li, SS ;
Okada, T .
INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2005, 15 (06) :435-443