Genetic algorithm for feature selection with mutual information

被引:4
作者
Ge, Hong [1 ]
Hu, Tianliang [1 ]
机构
[1] South China Normal Univ, Sch Comp Sci, Guangzhou, Guangdong, Peoples R China
来源
2014 SEVENTH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID 2014), VOL 1 | 2014年
关键词
feature selection; mutual information; genetic algorithm; generalization;
D O I
10.1109/ISCID.2014.122
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A feature selection approach combining genetic algorithm(GA) with mutual information (FSGM) is proposed. In fact, FSGM is a genetic algorithm applied to feature selection. For feature selection task, an individual of GA represents a feature subset, and the fitness function is the evaluation of the feature subset. With elaborating design, the global searching and completely evaluation can be realized in FSGM. The experimental results confirm the effectiveness of the proposed algorithm in improving the generalization and reducing the overfitting of selected feature subset.
引用
收藏
页码:116 / 119
页数:4
相关论文
共 12 条
[1]  
Brown Gavin, P 12 INT C ART INT S, V5
[2]  
El Akadi A, 2008, INT J COMPUT SCI NET, V8, P116
[3]   Normalized Mutual Information Feature Selection [J].
Estevez, Pablo. A. ;
Tesmer, Michel ;
Perez, Claudio A. ;
Zurada, Jacek A. .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2009, 20 (02) :189-201
[4]  
Guyon I., 2003, Journal of Machine Learning Research, V3, P1157, DOI 10.1162/153244303322753616
[5]  
Jakulin Aleks, 2008, THESIS
[6]  
Marinoiu Elisabeta, 2011, THESIS
[7]   Information-Theoretic Feature Selection in Microarray Data Using Variable Complementarity [J].
Meyer, Patrick Emmanuel ;
Schretter, Colas ;
Bontempi, Gianluca .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2008, 2 (03) :261-274
[8]   Feature selection based on inference correlation [J].
Mo, Dengyao ;
Huang, Samuel H. .
INTELLIGENT DATA ANALYSIS, 2011, 15 (03) :375-398
[9]   A Fast Clustering-Based Feature Subset Selection Algorithm for High-Dimensional Data [J].
Song, Qinbao ;
Ni, Jingjie ;
Wang, Guangtao .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2013, 25 (01) :1-14
[10]  
Tuv E, 2009, J MACH LEARN RES, V10, P1341