Hybrid genetic algorithms for feature selection

被引:631
作者
Oh, IS [1 ]
Lee, JS
Moon, BR
机构
[1] Chonbuk Natl Univ, Div Elect & Comp Engn, Jeonju 561756, Chonbuk, South Korea
[2] Woosuk Univ, Dept Comp Engn, Samrye 565701, Chonbuk, South Korea
[3] Seoul Natl Univ, Sch Comp Sci & Engn, Seoul 151742, South Korea
关键词
feature selection; hybrid genetic algorithm; sequential search algorithm; local search operation; atomic operation; multistart algorithm;
D O I
10.1109/TPAMI.2004.105
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a novel hybrid genetic algorithm for feature selection. Local search operations are devised and embedded in hybrid GAs to fine-tune the search. The operations are parameterized in terms of their fine-tuning power, and their effectiveness and timing requirements are analyzed and compared. The hybridization technique produces two desirable effects: a significant improvement in the final performance and the acquisition of subset-size control. The hybrid GAs showed better convergence properties compared to the classical GAs. A method of performing rigorous timing analysis was developed, in order to compare the timing requirement of the conventional and the proposed algorithms. Experiments performed with various standard data sets revealed that the proposed hybrid GA is superior to both a simple GA and sequential search algorithms.
引用
收藏
页码:1424 / 1437
页数:14
相关论文
共 32 条
[1]  
[Anonymous], 1991, Handbook of genetic algorithms
[2]   FAST GENETIC SELECTION OF FEATURES FOR NEURAL NETWORK CLASSIFIERS [J].
BRILL, FZ ;
BROWN, DE ;
MARTIN, WN .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1992, 3 (02) :324-328
[3]  
Bui TN, 1996, IEEE T COMPUT, V45, P841, DOI 10.1109/12.508322
[4]  
Dash M., 1997, Intelligent Data Analysis, V1
[5]  
FERRI FJ, 1994, MACH INTELL PATT REC, V16, P403
[6]  
Holland JH., 1992, ADAPTATION NATURE AR, DOI 10.7551/mitpress/1090.001.0001
[7]  
HUNG C, 1997, P IEEE INT C SYST MA, P2444
[8]  
Ishikawa H., 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149), P132, DOI 10.1109/CVPR.1999.786929
[9]   Feature selection: Evaluation, application, and small sample performance [J].
Jain, A ;
Zongker, D .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1997, 19 (02) :153-158
[10]  
JOG P, 1989, PROCEEDINGS OF THE THIRD INTERNATIONAL CONFERENCE ON GENETIC ALGORITHMS, P110