Robust Online Support Vector Regression with Truncated ε-Insensitive Pinball Loss

被引:4
作者
Shan, Xian [1 ]
Zhang, Zheshuo [1 ]
Li, Xiaoying [1 ]
Xie, Yu [1 ]
You, Jinyu [1 ]
机构
[1] China Univ Petr, Coll Sci, Qingdao 266580, Peoples R China
基金
中国国家自然科学基金;
关键词
regression; data stream; non-convex loss function; noise-resilient; online-learning; MACHINE;
D O I
10.3390/math11030709
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Advances in information technology have led to the proliferation of data in the fields of finance, energy, and economics. Unforeseen elements can cause data to be contaminated by noise and outliers. In this study, a robust online support vector regression algorithm based on a non-convex asymmetric loss function is developed to handle the regression of noisy dynamic data streams. Inspired by pinball loss, a truncated epsilon-insensitive pinball loss (TIPL) is proposed to solve the problems caused by heavy noise and outliers. A TIPL-based online support vector regression algorithm (TIPOSVR) is constructed under the regularization framework, and the online gradient descent algorithm is implemented to execute it. Experiments are performed using synthetic datasets, UCI datasets, and real datasets. The results of the investigation show that in the majority of cases, the proposed algorithm is comparable, or even superior, to the comparison algorithms in terms of accuracy and robustness on datasets with different types of noise.
引用
收藏
页数:22
相关论文
共 37 条
[1]  
Anand P., 2022, ACM T INTEL SYST TEC, P113, DOI [10.37256/rrcs.1220221662, DOI 10.37256/RRCS.1220221662]
[2]  
Awad M., 2015, Neural Information Processing: Letters and Reviews, P67
[3]   On pairing Huber support vector regression [J].
Balasundaram, S. ;
Prasad, Subhash Chandra .
APPLIED SOFT COMPUTING, 2020, 97
[4]   Robust Support Vector Regression in Primal with Asymmetric Huber Loss [J].
Balasundaram, S. ;
Meena, Yogendra .
NEURAL PROCESSING LETTERS, 2019, 49 (03) :1399-1431
[5]   Robust large-scale online kernel learning [J].
Chen, Lei ;
Zhang, Jiaming ;
Ning, Hanwen .
NEURAL COMPUTING & APPLICATIONS, 2022, 34 (17) :15053-15073
[6]   Short-Term Wind Speed or Power Forecasting With Heteroscedastic Support Vector Regression [J].
Hu, Qinghua ;
Zhang, Shiguang ;
Yu, Man ;
Xie, Zongxia .
IEEE TRANSACTIONS ON SUSTAINABLE ENERGY, 2016, 7 (01) :241-249
[7]   Noise model based v-support vector regression with its application to short-term wind speed forecasting [J].
Hu, Qinghua ;
Zhang, Shiguang ;
Xie, Zongxia ;
Mi, Jusheng ;
Wan, Jie .
NEURAL NETWORKS, 2014, 57 :1-11
[8]   Asymmetric ν-tube support vector regression [J].
Huang, Xiaolin ;
Shi, Lei ;
Pelckmans, Kristiaan ;
Suykens, Johan A. K. .
COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2014, 77 :371-382
[9]   A Noise-Resilient Online Learning Algorithm for Scene Classification [J].
Jian, Ling ;
Gao, Fuhao ;
Ren, Peng ;
Song, Yunquan ;
Luo, Shihua .
REMOTE SENSING, 2018, 10 (11)
[10]   Maximum likelihood optimal and robust Support Vector Regression with lncosh loss function [J].
Karal, Omer .
NEURAL NETWORKS, 2017, 94 :1-12