Twin proximal least squares support vector regression machine based on heteroscedastic Gaussian noise

被引:5
作者
Zhang, Shiguang [1 ,2 ]
Yuan, Qiuyun [2 ]
Yuan, Feng [1 ]
Liu, Shiqin [3 ]
机构
[1] Shandong Management Univ, Sch Informat Engn, Jinan, Peoples R China
[2] Henan Normal Univ, Coll Comp & Informat Engn, Xinxiang, Henan, Peoples R China
[3] Hengshui Univ, Coll Math & Comp Sci, Hengshui, Hebei, Peoples R China
关键词
Least squares support vector regression; twin proximal support vector regression; heteroscedastic Gaussian noise; short-term wind-speed forecasting; equality constraint;
D O I
10.3233/JIFS-211631
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Twin proximal support vector regression is a new regression machine designed by using twin support vector machine and proximal support vector regression. In this paper, we use the above models framework to build a new regression model, called the twin proximal least squares support vector regression model based on heteroscedastic Gaussian noise (TPLSSVR-HGN). The least square method is introduced and the regularization terms b(1)(2) and b(2)(2) are added respectively. It transforms an inequality constraint problem into two simpler equality constraint problems, which not only improves the training speed and generalization ability, but also effectively improves the forecasting accuracy. In order to solve the parameter selection problem of model TPLSSVR-HGN, the particle swarm optimization algorithm with fast convergence speed and good robustness is selected to optimize its parameters. In order to verify the forecasting performance of TPLSSVR-HGN, it is compared with the classical regression models on the artificial data set, UCI data set and wind-speed data set. The experimental results show that TPLSSVR-HGN has better forecasting effect than the classical regression models.
引用
收藏
页码:1727 / 1741
页数:15
相关论文
共 24 条
[11]   DC programming for sparse proximal support vector machines [J].
Li, Guoquan ;
Yang, Linxi ;
Wu, Zhiyou ;
Wu, Changzhi .
INFORMATION SCIENCES, 2021, 547 :187-201
[12]   PTSVRs: Regression models via projection twin support vector machine [J].
Peng, Xinjun ;
Chen, De .
INFORMATION SCIENCES, 2018, 435 :1-14
[13]   TSVR: An efficient Twin Support Vector Machine for regression [J].
Peng Xinjun .
NEURAL NETWORKS, 2010, 23 (03) :365-372
[14]   Simulated annealing least squares twin support vector machine (SA-LSTSVM) for pattern classification [J].
Sartakhti, Javad Salimi ;
Afrabandey, Homayun ;
Saraee, Mohamad .
SOFT COMPUTING, 2017, 21 (15) :4361-4373
[15]   Feature Selection With Missing Labels Using Multilabel Fuzzy Neighborhood Rough Sets and Maximum Relevance Minimum Redundancy [J].
Sun, Lin ;
Yin, Tengyu ;
Ding, Weiping ;
Qian, Yuhua ;
Xu, Jiucheng .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2022, 30 (05) :1197-1211
[16]   Feature Selection Using Fuzzy Neighborhood Entropy-Based Uncertainty Measures for Fuzzy Neighborhood Multigranulation Rough Sets [J].
Sun, Lin ;
Wang, Lanying ;
Ding, Weiping ;
Qian, Yuhua ;
Xu, Jiucheng .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2021, 29 (01) :19-33
[17]   Least squares support vector machine classifiers [J].
Suykens, JAK ;
Vandewalle, J .
NEURAL PROCESSING LETTERS, 1999, 9 (03) :293-300
[18]   Weighted least squares support vector machines: robustness and sparse approximation [J].
Suykens, JAK ;
De Brabanter, J ;
Lukas, L ;
Vandewalle, J .
NEUROCOMPUTING, 2002, 48 :85-105
[19]  
Tian Zhongda, 2015, J ELECTROTECHNICS, V30, P112
[20]  
Vapnik VN., 2000, NATURE STAT LEARNING, P1, DOI [10.1007/978-1-4757-3264-1, DOI 10.1007/978-1-4757-3264-1]