A multi-objective evolutionary algorithm-based ensemble optimizer for feature selection and classification with neural network models

被引:64
作者
Tan, Choo Jun [1 ]
Lim, Chee Peng [2 ]
Cheah, Yu-N [1 ]
机构
[1] Univ Sains Malaysia, Sch Comp Sci, George Town, Malaysia
[2] Deakin Univ, Ctr Intelligent Syst Res, Geelong, Vic 3217, Australia
关键词
Multi-objective optimization; Evolutionary algorithm; Feature selection; Neural network classifiers; Ensemble models; RANDOM SUBSPACE ENSEMBLES; ACTIVITY RECOGNITION; GENETIC ALGORITHM; CLASSIFIERS; FUSION;
D O I
10.1016/j.neucom.2012.12.057
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a new multi-objective evolutionary algorithm-based ensemble optimizer coupled with neural network models for undertaking feature selection and classification problems. Specifically, the Modified micro Genetic Algorithm (MmGA) is used to form the ensemble optimizer. The aim of the MmGA-based ensemble optimizer is two-fold, i.e. to select a small number of input features for classification and to improve the classification performances of neural network models. To evaluate the effectiveness of the proposed system, a number of benchmark problems are first used, and the results are compared with those from other methods. The applicability of the proposed system to a human motion detection and classification task is then evaluated. The outcome positively demonstrates that the proposed MmGA-based ensemble optimizer is able to improve the classification performances of neural network models with a smaller number of input features. (C) 2013 Elsevier B.V. All rights reserved.
引用
收藏
页码:217 / 228
页数:12
相关论文
共 67 条
[1]   ENSEMBLES OF NEURAL NETWORKS BASED ON THE ALTERATION OF INPUT FEATURE VALUES [J].
Akhand, M. A. H. ;
Murase, K. .
INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2012, 22 (01) :77-87
[2]  
[Anonymous], 1993, An introduction to the bootstrap
[3]  
[Anonymous], 1988, Reinforcement learning
[4]  
[Anonymous], 2011, Statistical Pattern Recognition
[5]   Activity recognition from user-annotated acceleration data [J].
Bao, L ;
Intille, SS .
PERVASIVE COMPUTING, PROCEEDINGS, 2004, 3001 :1-17
[6]   Bio-molecular cancer prediction with random subspace ensembles of support vector machines [J].
Bertoni, A ;
Folgieri, R ;
Valentini, G .
NEUROCOMPUTING, 2005, 63 :535-539
[7]  
Breiman L, 1996, MACH LEARN, V24, P123, DOI 10.1023/A:1018054314350
[8]   Generalized center method for multiobjective engineering optimization [J].
Cheng, FY ;
Li, XS .
ENGINEERING OPTIMIZATION, 1999, 31 (05) :641-661
[9]   Multiobjective structural optimization using a microgenetic algorithm [J].
Coello, CAC ;
Pulido, GT .
STRUCTURAL AND MULTIDISCIPLINARY OPTIMIZATION, 2005, 30 (05) :388-403
[10]   Evolutionary multi-objective optimization: A historical view of the field [J].
Coello Coello, Carlos A. .
IEEE COMPUTATIONAL INTELLIGENCE MAGAZINE, 2006, 1 (01) :28-36