Solving Large N-Bit Parity Problems with the Evolutionary ANN Ensemble

被引:0
作者
Tseng, Lin-Yu [1 ,2 ]
Chen, Wen-Ching [2 ,3 ]
机构
[1] Natl Chung Hsing Univ, Inst Networking & Multimedia, Taichung 402, Taiwan
[2] Natl Chung Hsing Univ, Dept Comp Sci & Engn, Taichung 402, Taiwan
[3] Hsiuping Inst Technol, Dept Informat Network Technol, Taichung 412, Taiwan
来源
ADVANCES IN NEURAL NETWORKS - ISNN 2010, PT 1, PROCEEDINGS | 2010年 / 6063卷
关键词
Artificial neural networks; orthogonal array; ensemble; n-bit parity problems; NEURAL-NETWORK;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Artificial neural networks (ANNs) have been successfully applied to many areas due to its powerful ability both or classification and regression problems. For some difficult problems. ANN ensemble classifiers are considered, instead of a single ANN classifier. In the previous study, the authors presented the systematic trajectory search algorithm (STSA) to train the ANN. The STSA utilizes the orthogonal array (OA) to uniformly generate the initial population to globally explore the solution space, and then applies a novel trajectory search method to exploit the promising areas thoroughly. In this paper, an evolutionary constructing algorithm, called the ESTSA, of the ANN ensemble is proposed. Based on the STSA, the authors introduce a penalty term to the error function in order to guarantee the diversity of ensemble members. The performance of the proposed algorithm is evaluated by applying it to train a class of feedforward neural networks to solve the large n-bit parity problems. By comparing with the previous studies, the experimental results revealed that the neural network ensemble classifiers trained by the ESTSA have very good classification ability.
引用
收藏
页码:389 / +
页数:2
相关论文
共 14 条
[1]  
Brown G., 2005, Information Fusion, V6, P5, DOI 10.1016/j.inffus.2004.04.004
[2]   NEURAL NETWORK ENSEMBLES [J].
HANSEN, LK ;
SALAMON, P .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1990, 12 (10) :993-1001
[3]   Solving the N-bit parity problem using neural networks [J].
Hohil, ME ;
Liu, DR ;
Smith, SH .
NEURAL NETWORKS, 1999, 12 (09) :1321-1323
[4]   Ensemble learning via negative correlation [J].
Liu, Y ;
Yao, X .
NEURAL NETWORKS, 1999, 12 (10) :1399-1404
[5]  
Liu Y, 2000, IEEE T EVOLUT COMPUT, V4, P380, DOI 10.1109/4235.887237
[6]   Particle swarms for feedforward neural network training [J].
Mendes, R ;
Cortez, P ;
Rocha, M ;
Neves, J .
PROCEEDING OF THE 2002 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-3, 2002, :1895-1899
[7]   Learning polynomial feedforward neural networks by genetic programming and backpropagation [J].
Nikolaev, NY ;
Iba, H .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2003, 14 (02) :337-350
[8]   Evolving artificial neural network ensembles [J].
Reynolds, Robert G. ;
Ali, Mostafa ;
Yao, Xin ;
Islam, Md. Monirul .
IEEE COMPUTATIONAL INTELLIGENCE MAGAZINE, 2008, 3 (01) :31-42
[9]  
Sharkey A.J. C., 1996, CONNECT SCI, V8, P299, DOI DOI 10.1080/095400996116785
[10]   HOW TO SOLVE THE N-BIT PARITY PROBLEM WITH 2 HIDDEN UNITS [J].
STORK, DG ;
ALLEN, JD .
NEURAL NETWORKS, 1992, 5 (06) :923-926