On robust twin support vector regression in primal using squared pinball loss

被引:9
作者
Anagha, P. [1 ]
Balasundaram, S. [1 ]
Meena, Yogendra [1 ]
机构
[1] Jawaharlal Nehru Univ, Sch Comp & Syst Sci, New Delhi 110067, India
关键词
Kernel methods; pinball loss; robust support vector regression; MACHINE; CLASSIFICATION;
D O I
10.3233/JIFS-169807
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Construction of robust regression learning models to fit training data corrupted by noise is an important and challenging research problem in machine learning. It is well-known that loss functions play an important role in reducing the effect of noise present in the input data. With the objective of obtaining a robust regression model, motivated by the link between the pinball loss and quantile regression, a novel squared pinball loss twin support vector machine for regression (SPTSVR) is proposed in this work. Further with the introduction of a regularization term, our proposed model solves a pair of strongly convex minimization problems having unique solutions by simple functional iterative method. Experiments were performed on synthetic datasets with different noise models and on real world datasets and those results were compared with support vector regression (SVR), least squares support vector regression (LS-SVR) and twin support vector regression (TSVR) methods. The comparative results clearly show that our proposed SPTSVR is an effective and a useful addition in the machine learning literature.
引用
收藏
页码:5231 / 5239
页数:9
相关论文
共 19 条
[1]  
[Anonymous], 2000, NATURE STAT LEARNING, DOI DOI 10.1007/978-1-4757-3264-1
[2]  
[Anonymous], 2000, An Introduction to support vector machines and other kernel-based learning methods
[3]  
Demsar J, 2006, J MACH LEARN RES, V7, P1
[4]  
Gretton A, 2001, P 11 IEEE WORKSH STA
[5]   Gene selection for cancer classification using support vector machines [J].
Guyon, I ;
Weston, J ;
Barnhill, S ;
Vapnik, V .
MACHINE LEARNING, 2002, 46 (1-3) :389-422
[6]   Asymmetric ν-tube support vector regression [J].
Huang, Xiaolin ;
Shi, Lei ;
Pelckmans, Kristiaan ;
Suykens, Johan A. K. .
COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2014, 77 :371-382
[7]   Support Vector Machine Classifier with Pinball Loss [J].
Huang, Xiaolin ;
Shi, Lei ;
Suykens, Johan A. K. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2014, 36 (05) :984-997
[8]   Twin support vector machines for pattern classification [J].
Jayadeva ;
Khemchandani, R. ;
Chandra, Suresh .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2007, 29 (05) :905-910
[9]   Least squares twin support vector machines for pattern classification [J].
Kumar, M. Arun ;
Gopal, M. .
EXPERT SYSTEMS WITH APPLICATIONS, 2009, 36 (04) :7535-7543
[10]  
Leng Q., 2017, ADV INTELLIGENT SYST, P323