Sensitivity analysis of the split-complex valued multilayer perceptron due to the errors of the i.i.d. inputs and weights

被引:24
作者
Yang, Sheng-Sung [1 ]
Ho, Chia-Lu
Siu, Sammy
机构
[1] Natl Cent Univ, Inst Elect Engn, Chungli 32054, Taiwan
[2] Natl Cent Univ, Inst Commun Engn, Chungli 32054, Taiwan
[3] Chunghwa Telecommun Co Ltd, Telecommun Labs, Tao Yuan 326, Taiwan
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2007年 / 18卷 / 05期
关键词
central limit theorem (CLT); multilayer perceptron (MLP); sensitivity; split-complex MLP (split-CMLP);
D O I
10.1109/TNN.2007.894038
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we analyze the sensitivity of a split-complex multilayer perceptron (split-CMLP) due to the errors of the inputs and the connection weights between neurons. For simplicity, all the inputs and weights studied here are independent and identically distributed (i.i.d.). To develop an algorithm to estimate the sensitivity of the entire split-CMLP, we compute statistically the sensitivity by using the central limit theorem (CLT). The results show that the sensitivity is affected by the number of the layers and the number of the neurons adopted in each layer. We derive a theoretical estimation of the sensitivity. Several numerical results of the sensitivity for the split-CMLP are presented, and they match the theoretical ones. The agreement between the theoretical results and experimental results verifies the feasibility of the proposed algorithm. Thus, we not only analyze the sensitivity of the split-CMLP due to the errors of the i.i.d. inputs and weights, but also develop an efficient algorithm to estimate the sensitivity.
引用
收藏
页码:1280 / 1293
页数:14
相关论文
共 18 条
[1]   ON THE COMPLEX BACKPROPAGATION ALGORITHM [J].
BENVENUTO, N ;
PIAZZA, F .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 1992, 40 (04) :967-968
[2]  
Chang CH, 1997, ISCAS '97 - PROCEEDINGS OF 1997 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOLS I - IV, P589, DOI 10.1109/ISCAS.1997.608827
[3]   Sensitivity analysis of neocognitron [J].
Cheng, AY ;
Yeung, DS .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS, 1999, 29 (02) :238-249
[4]  
Engelbrecht Andries P., 1999, P INT JOINT C NEUR N, P1829
[5]  
Engelbrecht AP, 1996, IEEE IJCNN, P1274, DOI 10.1109/ICNN.1996.549081
[6]  
FU L, 1993, 1993 IEEE INTERNATIONAL CONFERENCE ON NEURAL NETWORKS, VOLS 1-3, P215, DOI 10.1109/ICNN.1993.298559
[7]  
HASHEM S, 1992, P 1992 INT JOINT C N, V1, P419
[8]   SENSITIVITY ANALYSIS OF MULTILAYER PERCEPTRON WITH DIFFERENTIABLE ACTIVATION FUNCTIONS [J].
JIN, YC ;
CHOI, CH .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1992, 3 (01) :101-107
[9]  
Kim T, 2000, NEURAL NETWORKS FOR SIGNAL PROCESSING X, VOLS 1 AND 2, PROCEEDINGS, P231, DOI 10.1109/NNSP.2000.889414
[10]  
KIM T, 2001, P IEEE WORKSH NONL S, P141