Adaptive feature selection via a new version of support vector machine

被引:25
作者
Tan, Junyan [1 ]
Zhang, Zhiqiang [2 ]
Zhen, Ling [1 ]
Zhang, Chunhua [3 ]
Deng, Naiyang [1 ]
机构
[1] China Agr Univ, Coll Sci, Beijing 100083, Peoples R China
[2] Beijing Inst Technol, Sch Mech & Vehicular Engn, Beijing 100081, Peoples R China
[3] Renmin Univ China, Informat Sch, Dept Math, Beijing 100872, Peoples R China
基金
中国国家自然科学基金;
关键词
Support vector machine; Feature selection; p-norm; GENE SELECTION; CANCER; CLASSIFICATION;
D O I
10.1007/s00521-012-1018-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper focuses on feature selection in classification. A new version of support vector machine (SVM) named p-norm support vector machine () is proposed. Different from the standard SVM, the p-norm of the normal vector of the decision plane is used which leads to more sparse solution. Our new model can not only select less features but also improve the classification accuracy by adjusting the parameter p. The numerical experiments results show that our p-norm SVM is more effective than some usual methods in feature selection.
引用
收藏
页码:937 / 945
页数:9
相关论文
共 18 条
[1]  
[Anonymous], 2009, DANISH POWER SYSTEM
[2]  
Blake C. L., 1998, Uci repository of machine learning databases
[3]  
Bradley P. S., 1998, INFORMS Journal on Computing, V10, P209, DOI 10.1287/ijoc.10.2.209
[4]  
Bradley P. S., 1998, Machine Learning. Proceedings of the Fifteenth International Conference (ICML'98), P82
[5]   From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images [J].
Bruckstein, Alfred M. ;
Donoho, David L. ;
Elad, Michael .
SIAM REVIEW, 2009, 51 (01) :34-81
[6]   Lp-norm proximal support vector machine and its applications [J].
Chen, Wen Jing ;
Tian, Ying Jie .
ICCS 2010 - INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE, PROCEEDINGS, 2010, 1 (01) :2411-2417
[7]   LOWER BOUND THEORY OF NONZERO ENTRIES IN SOLUTIONS OF l2-lp MINIMIZATION [J].
Chen, Xiaojun ;
Xu, Fengmin ;
Ye, Yinyu .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2010, 32 (05) :2832-2852
[8]   Variable selection via nonconcave penalized likelihood and its oracle properties [J].
Fan, JQ ;
Li, RZ .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2001, 96 (456) :1348-1360
[9]   Molecular classification of cancer: Class discovery and class prediction by gene expression monitoring [J].
Golub, TR ;
Slonim, DK ;
Tamayo, P ;
Huard, C ;
Gaasenbeek, M ;
Mesirov, JP ;
Coller, H ;
Loh, ML ;
Downing, JR ;
Caligiuri, MA ;
Bloomfield, CD ;
Lander, ES .
SCIENCE, 1999, 286 (5439) :531-537
[10]   Gene selection for cancer classification using support vector machines [J].
Guyon, I ;
Weston, J ;
Barnhill, S ;
Vapnik, V .
MACHINE LEARNING, 2002, 46 (1-3) :389-422