Fully Complex-valued Dendritic Neuron Model

被引:59
作者
Gao, Shangce [1 ]
Zhou, MengChu [2 ]
Wang, Ziqian [1 ]
Sugiyama, Daiki [3 ]
Cheng, Jiujun [4 ]
Wang, Jiahai [5 ]
Todo, Yuki [6 ]
机构
[1] Univ Toyama, Fac Engn, Toyama 9308555, Japan
[2] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
[3] NEC Solut Innovators Ltd, Tokyo 1368627, Japan
[4] Tongji Univ, Dept Comp Sci & Technol, Key Lab Embedded Syst & Serv Comp, Minist Educ, Shanghai 200092, Peoples R China
[5] Sun Yat Sen Univ, Sch Comp Sci & Engn, Guangzhou 510275, Peoples R China
[6] Kanazawa Univ, Fac Elect Informat & Commun Engn, Kanazawa, Ishikawa 9201192, Japan
基金
中国国家自然科学基金;
关键词
Neurons; Biological neural networks; Task analysis; Convergence; Dendrites (neurons); Computer architecture; Computational modeling; Activation functions; complex back-propagation (BP); complex domain; complex-valued neural networks; dendritic neuron model (DNM); elementary transcendental functions; McCulloch-Pitts neuron; LEARNING ALGORITHM; BACKPROPAGATION ALGORITHM; MULTILAYER PERCEPTRON; SEARCH ALGORITHM; SINGLE-NEURON; NETWORKS; SYNCHRONIZATION; OPTIMIZATION; INPUTS; PHASE;
D O I
10.1109/TNNLS.2021.3105901
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A single dendritic neuron model (DNM) that owns the nonlinear information processing ability of dendrites has been widely used for classification and prediction. Complex-valued neural networks that consist of a number of multiple/deep-layer McCulloch-Pitts neurons have achieved great successes so far since neural computing was utilized for signal processing. Yet no complex value representations appear in single neuron architectures. In this article, we first extend DNM from a real-value domain to a complex-valued one. Performance of complex-valued DNM (CDNM) is evaluated through a complex xor problem, a non-minimum phase equalization problem, and a real-world wind prediction task. Also, a comparative analysis on a set of elementary transcendental functions as an activation function is implemented and preparatory experiments are carried out for determining hyperparameters. The experimental results indicate that the proposed CDNM significantly outperforms real-valued DNM, complex-valued multi-layer perceptron, and other complex-valued neuron models.
引用
收藏
页码:2105 / 2118
页数:14
相关论文
共 92 条
[71]   A Mathematical Motivation for Complex-Valued Convolutional Networks [J].
Tygert, Mark ;
Bruna, Joan ;
Chintala, Soumith ;
LeCun, Yann ;
Piantino, Serkan ;
Szlam, Arthur .
NEURAL COMPUTATION, 2016, 28 (05) :815-825
[72]   Dendritic Computation in a Point Neuron Model [J].
Vandesompele, Alexander ;
Wyffels, Francis ;
Dambre, Joni .
ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2020, PT II, 2020, 12397 :599-609
[73]  
Vasudeva, 2020, ARXIV200210523
[74]   CSR-Net: A Novel Complex-Valued Network for Fast and Precise 3-D Microwave Sparse Reconstruction [J].
Wang, Mou ;
Wei, Shunjun ;
Shi, Jun ;
Wu, Yue ;
Qu, Qizhe ;
Zhou, Yuanyuan ;
Zeng, Xiangfeng ;
Tian, Bokun .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 :4476-4492
[75]   Stabilization of Stochastic Uncertain Complex-Valued Delayed Networks via Aperiodically Intermittent Nonlinear Control [J].
Wang, Pengfei ;
Zhang, Biguang ;
Su, Huan .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2019, 49 (03) :649-662
[76]   DeepcomplexMRI: Exploiting deep residual network for fast parallel MR imaging with complex convolution [J].
Wang, Shanshan ;
Cheng, Huitao ;
Ying, Leslie ;
Xiao, Taohui ;
Ke, Ziwen ;
Zheng, Hairong ;
Liang, Dong .
MAGNETIC RESONANCE IMAGING, 2020, 68 :136-147
[77]   A multi-layered gravitational search algorithm for function optimization and real-world problems [J].
Wang, Yirui ;
Gao, Shangce ;
Zhou, Mengchu ;
Yu, Yang .
IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2021, 8 (01) :94-109
[78]   A review of applications of artificial intelligent algorithms in wind farms [J].
Wang, Yirui ;
Yu, Yang ;
Cao, Shuyang ;
Zhang, Xingyi ;
Gao, Shangce .
ARTIFICIAL INTELLIGENCE REVIEW, 2020, 53 (05) :3447-3500
[79]   A Hybrid Probabilistic Multiobjective Evolutionary Algorithm for Commercial Recommendation Systems [J].
Wei, Guoshuai ;
Wu, Quanwang ;
Zhou, Mengchu .
IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2021, 8 (03) :589-598
[80]  
Wolter M, 2018, ADV NEUR IN, V31