An Adaptive Multiple Feature Subset Method for Feature Ranking and Selection

被引:4
作者
Chang, Fu [1 ]
Chen, Jen-Cheng [1 ]
机构
[1] Acad Sinica, Inst Informat Sci, Taipei, Taiwan
来源
INTERNATIONAL CONFERENCE ON TECHNOLOGIES AND APPLICATIONS OF ARTIFICIAL INTELLIGENCE (TAAI 2010) | 2010年
关键词
AMFES; CORR; curse of dimensionality; embedded method; feature ranking; feature selection; filter; RFE; wrapper; RANDOM SUBSPACE METHOD; BOUND ALGORITHM; CLASSIFICATION; INFORMATION; BRANCH;
D O I
10.1109/TAAI.2010.50
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a new feature evaluation method that forms the basis for feature ranking and selection. The method starts by generating a number of feature subsets in a random fashion and evaluates features based on the derived subsets. It then proceeds in a number of stages. In each stage, it inputs the features whose ranks in the previous stage were above the median rank and re-evaluates those features in the same fashion as it did in the first stage. When the number of features is high, the method has a computational advantage over recursive feature elimination (RFE), a state-of-art method that ranks features by identifying the least valuable feature in each stage. It also achieves better results than RFE in terms of classification accuracy and some other measures introduced in this paper, especially when the size of the training data is small or the number of irrelevant features is large.
引用
收藏
页码:255 / 262
页数:8
相关论文
共 51 条
[11]   ORTHOGONAL LEAST-SQUARES METHODS AND THEIR APPLICATION TO NON-LINEAR SYSTEM-IDENTIFICATION [J].
CHEN, S ;
BILLINGS, SA ;
LUO, W .
INTERNATIONAL JOURNAL OF CONTROL, 1989, 50 (05) :1873-1896
[12]  
Fan RE, 2005, J MACH LEARN RES, V6, P1889
[13]  
Fan RE, 2008, J MACH LEARN RES, V9, P1871
[14]  
Forman G., 2003, Journal of Machine Learning Research, V3, P1289, DOI 10.1162/153244303322753670
[15]  
Gentile C, 2004, ADV NEUR IN, V16, P121
[16]  
Grandvalet Y., 2002, NEURAL INFORM PROCES
[17]   Gene selection for cancer classification using support vector machines [J].
Guyon, I ;
Weston, J ;
Barnhill, S ;
Vapnik, V .
MACHINE LEARNING, 2002, 46 (1-3) :389-422
[18]  
Guyon I., 2003, Journal of Machine Learning Research, V3, P1157, DOI 10.1162/153244303322753616
[19]  
Guyon I., 2003, J MACH LEARN RES, V3, P1157
[20]  
Hall Mark A., 2000, P 17 INT C MACH LEAR, P359