Probabilistic ensemble Fuzzy ARTMAP optimization using hierarchical parallel genetic algorithms

被引:8
作者
Loo, Chu Kiong [1 ]
Liew, Wei Shiung [1 ]
Seera, Manjeevan [1 ]
Lim, Einly [2 ]
机构
[1] Univ Malaya, Fac Comp Sci & Informat Technol, Kuala Lumpur, Malaysia
[2] Univ Malaya, Fac Biomed Engn, Kuala Lumpur, Malaysia
关键词
Ensembles; Fuzzy ARTMAP; Plurality voting; Parallel genetic algorithm; Feature selection; PARTICLE SWARM OPTIMIZATION; NEURAL-NETWORK; GAUSSIAN ARTMAP; DIAGNOSIS;
D O I
10.1007/s00521-014-1632-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this study, a comprehensive methodology for overcoming the design problem of the Fuzzy ARTMAP neural network is proposed. The issues addressed are the sequence of training data for supervised learning and optimum parameter tuning for parameters such as baseline vigilance. A genetic algorithm search heuristic was chosen to solve this multi-objective optimization problem. To further augment the ARTMAP's pattern classification ability, multiple ARTMAPs were optimized via genetic algorithm and assembled into a classifier ensemble. An optimal ensemble was realized by the inter-classifier diversity of its constituents. This was achieved by mitigating convergence in the genetic algorithms by employing a hierarchical parallel architecture. The best-performing classifiers were then combined in an ensemble, using probabilistic voting for decision combination. This study also integrated the disparate methods to operate within a single framework, which is the proposed novel method for creating an optimum classifier ensemble configuration with minimum user intervention. The methodology was benchmarked using popular data sets from UCI machine learning repository.
引用
收藏
页码:263 / 276
页数:14
相关论文
共 46 条
[1]   GFAM: A genetic algorithm optimization of Fuzzy ARTMAP [J].
Al-Daraiseh, A. ;
Georgiopoulos, M. ;
Anagnostopoulos, G. ;
Wu, A. S. ;
Mollaghasemi, M. .
2006 IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS, VOLS 1-5, 2006, :315-+
[2]  
[Anonymous], 2010, UCI Machine Learning Repository
[3]  
Canuto Anne M. P., 2011, International Journal of Computer Information Systems and Industrial Management Applications, V3, P324
[4]   FUZZY ARTMAP - A NEURAL NETWORK ARCHITECTURE FOR INCREMENTAL SUPERVISED LEARNING OF ANALOG MULTIDIMENSIONAL MAPS [J].
CARPENTER, GA ;
GROSSBERG, S ;
MARKUZON, N ;
REYNOLDS, JH ;
ROSEN, DB .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1992, 3 (05) :698-713
[5]   Biased ART: A neural architecture that shifts attention toward previously disregarded features following an incorrect prediction [J].
Carpenter, Gail A. ;
Gaddam, Sai Chaitanya .
NEURAL NETWORKS, 2010, 23 (03) :435-451
[6]  
Cervantes L, 2007, LECT NOTES ARTIF INT, V4496, P805
[7]   Evolution of heterogeneous ensembles through dynamic particle swarm optimization for video-based face recognition [J].
Connolly, Jean-Francois ;
Granger, Eric ;
Sabourin, Robert .
PATTERN RECOGNITION, 2012, 45 (07) :2460-2477
[8]  
Cunningham P, 2000, TCDCS200007, P1
[9]   An ordering algorithm for pattern presentation in fuzzy ARTMAP that tends to improve generalization performance [J].
Dagher, I ;
Georgiopoulos, M ;
Heileman, GL ;
Bebis, G .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1999, 10 (04) :768-778
[10]   Overfitting cautious selection of classifier ensembles with genetic algorithms [J].
Dos Santos, Eulanda M. ;
Sabourin, Robert ;
Maupin, Patrick .
INFORMATION FUSION, 2009, 10 (02) :150-162