Hybrid genetic algorithms for feature selection

被引:634
作者
Oh, IS [1 ]
Lee, JS
Moon, BR
机构
[1] Chonbuk Natl Univ, Div Elect & Comp Engn, Jeonju 561756, Chonbuk, South Korea
[2] Woosuk Univ, Dept Comp Engn, Samrye 565701, Chonbuk, South Korea
[3] Seoul Natl Univ, Sch Comp Sci & Engn, Seoul 151742, South Korea
关键词
feature selection; hybrid genetic algorithm; sequential search algorithm; local search operation; atomic operation; multistart algorithm;
D O I
10.1109/TPAMI.2004.105
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a novel hybrid genetic algorithm for feature selection. Local search operations are devised and embedded in hybrid GAs to fine-tune the search. The operations are parameterized in terms of their fine-tuning power, and their effectiveness and timing requirements are analyzed and compared. The hybridization technique produces two desirable effects: a significant improvement in the final performance and the acquisition of subset-size control. The hybrid GAs showed better convergence properties compared to the classical GAs. A method of performing rigorous timing analysis was developed, in order to compare the timing requirement of the conventional and the proposed algorithms. Experiments performed with various standard data sets revealed that the proposed hybrid GA is superior to both a simple GA and sequential search algorithms.
引用
收藏
页码:1424 / 1437
页数:14
相关论文
共 32 条
[21]   Analysis of class separation and combination of class-dependent features for handwriting recognition [J].
Oh, IS ;
Lee, JS ;
Suen, CY .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1999, 21 (10) :1089-1094
[22]  
OH IS, 2002, P INT C PATT REC
[23]  
Piramuthu S, 1998, P ANN HICSS, P294, DOI 10.1109/HICSS.1998.648324
[24]   FLOATING SEARCH METHODS IN FEATURE-SELECTION [J].
PUDIL, P ;
NOVOVICOVA, J ;
KITTLER, J .
PATTERN RECOGNITION LETTERS, 1994, 15 (11) :1119-1125
[25]   Advanced local feature selection in medical diagnostics [J].
Puuronen, S ;
Tsymbal, A ;
Skrypnyk, I .
13TH IEEE SYMPOSIUM ON COMPUTER-BASED MEDICAL SYSTEMS (CBMS 2000), PROCEEDINGS, 2000, :25-30
[26]   Dimensionality reduction using genetic algorithms [J].
Raymer, ML ;
Punch, WE ;
Goodman, ED ;
Kuhn, LA ;
Jain, AK .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2000, 4 (02) :164-171
[27]  
Siedlecki W., 1988, International Journal of Pattern Recognition and Artificial Intelligence, V2, P197, DOI 10.1142/S0218001488000145
[28]   A NOTE ON GENETIC ALGORITHMS FOR LARGE-SCALE FEATURE-SELECTION [J].
SIEDLECKI, W ;
SKLANSKY, J .
PATTERN RECOGNITION LETTERS, 1989, 10 (05) :335-347
[29]   Feature subset selection using a genetic algorithm [J].
Yang, JH ;
Honavar, V .
IEEE INTELLIGENT SYSTEMS & THEIR APPLICATIONS, 1998, 13 (02) :44-49
[30]   A MORE EFFICIENT BRANCH-AND-BOUND ALGORITHM FOR FEATURE-SELECTION [J].
YU, B ;
YUAN, BZ .
PATTERN RECOGNITION, 1993, 26 (06) :883-889