An Interior Point Method for L1/2-SVM and Application to Feature Selection in Classification

被引:6
作者
Yao, Lan [1 ]
Zhang, Xiongji [2 ]
Li, Dong-Hui [2 ]
Zeng, Feng [3 ]
Chen, Haowen [1 ]
机构
[1] Hunan Univ, Coll Math & Econometr, Changsha 410082, Hunan, Peoples R China
[2] S China Normal Univ, Sch Math Sci, Guangzhou 510631, Guangdong, Peoples R China
[3] Cent S Univ, Sch Software, Changsha 410083, Hunan, Peoples R China
基金
美国国家科学基金会;
关键词
SUPPORT VECTOR MACHINES; GENE SELECTION; REGULARIZATION; PENALTY;
D O I
10.1155/2014/942520
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
This paper studies feature selection for support vector machine (SVM). By the use of the L-1/2 regularization technique, we propose a new model L-1/2-SVM. To solve this nonconvex and non-Lipschitz optimization problem, we first transform it into an equivalent quadratic constrained optimization model with linear objective function and then develop an interior point algorithm. We establish the convergence of the proposed algorithm. Our experiments with artificial data and real data demonstrate that the L-1/2-SVM model works well and the proposed algorithm is more effective than some popular methods in selecting relevant features and improving classification performance.
引用
收藏
页数:16
相关论文
共 36 条
[1]  
[Anonymous], 2006, FEATURE EXTRACTION F
[2]  
[Anonymous], 1997, ICML
[4]  
Bradley P. S., 1998, Machine Learning. Proceedings of the Fifteenth International Conference (ICML'98), P82
[5]  
Chan A. B., 2007, Proc. 24th Int'l Conf. Machine Learning, P145
[6]  
Chartrand R, 2007, IEEE IMAGE PROC, P293
[7]   Exact reconstruction of sparse signals via nonconvex minimization [J].
Chartrand, Rick .
IEEE SIGNAL PROCESSING LETTERS, 2007, 14 (10) :707-710
[8]   Lp-norm proximal support vector machine and its applications [J].
Chen, Wen Jing ;
Tian, Ying Jie .
ICCS 2010 - INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE, PROCEEDINGS, 2010, 1 (01) :2411-2417
[9]   Nonconcave penalized likelihood with a diverging number of parameters [J].
Fan, JQ ;
Peng, H .
ANNALS OF STATISTICS, 2004, 32 (03) :928-961
[10]  
Forman G., 2003, Journal of Machine Learning Research, V3, P1289, DOI 10.1162/153244303322753670