Global Nonlinear Kernel Prediction for Large Data Set With a Particle Swarm-Optimized Interval Support Vector Regression

被引:25
作者
Ding, Yongsheng [1 ,2 ]
Cheng, Lijun [1 ,2 ,3 ,4 ]
Pedrycz, Witold [5 ,6 ,7 ]
Hao, Kuangrong [1 ,2 ]
机构
[1] Minist Educ, Engn Res Ctr Digitized Text & Apparel Technol, Shanghai 201620, Peoples R China
[2] Donghua Univ, Coll Informat Sci & Technol, Shanghai 201620, Peoples R China
[3] Indiana Univ, Ctr Computat Biol, Indianapolis, IN 46202 USA
[4] Indiana Univ, Ctr Bioinformat, Dept Med & Mol Genet, Sch Med, Indianapolis, IN 46202 USA
[5] Univ Alberta, Dept Elect & Comp Engn, Edmonton, AB T6G 2R3, Canada
[6] King Abdulaziz Univ, Dept Elect & Comp Engn, Fac Engn, Jeddah 21589, Saudi Arabia
[7] Polish Acad Sci, Syst Res Inst, PL-00656 Warsaw, Poland
关键词
Global nonlinear predictor; interval support vector regression (ISVR); kernel function; large data; particle swarm optimization (PSO); sliding adaptive model; SELECTION; PARAMETERS; ALGORITHM; NETWORK; INPUT;
D O I
10.1109/TNNLS.2015.2426182
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A new global nonlinear predictor with a particle swarm-optimized interval support vector regression (PSO-ISVR) is proposed to address three issues (viz., kernel selection, model optimization, kernel method speed) encountered when applying SVR in the presence of large data sets. The novel prediction model can reduce the SVR computing overhead by dividing input space and adaptively selecting the optimized kernel functions to obtain optimal SVR parameter by PSO. To quantify the quality of the predictor, its generalization performance and execution speed are investigated based on statistical learning theory. In addition, experiments using synthetic data as well as the stock volume weighted average price are reported to demonstrate the effectiveness of the developed models. The experimental results show that the proposed PSO-ISVR predictor can improve the computational efficiency and the overall prediction accuracy compared with the results produced by the SVR and other regression methods. The proposed PSO-ISVR provides an important tool for nonlinear regression analysis of big data.
引用
收藏
页码:2521 / 2534
页数:14
相关论文
共 33 条
[1]   Radial Basis Function Network Training Using a Nonsymmetric Partition of the Input Space and Particle Swarm Optimization [J].
Alexandridis, Alex ;
Chondrodima, Eva ;
Sarimveis, Haralambos .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2013, 24 (02) :219-230
[2]   Finding optimal model parameters by deterministic and annealed focused grid search [J].
Barbero Jimenez, Alvaro ;
Lopez Lazaro, Jorge ;
Dorronsoro, Jose R. .
NEUROCOMPUTING, 2009, 72 (13-15) :2824-2832
[3]   Hierarchical Approach for Multiscale Support Vector Regression [J].
Bellocchio, Francesco ;
Ferrari, Stefano ;
Piuri, Vincenzo ;
Borghese, Nunzio Alberto .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2012, 23 (09) :1448-1460
[4]   LIBSVM: A Library for Support Vector Machines [J].
Chang, Chih-Chung ;
Lin, Chih-Jen .
ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2011, 2 (03)
[5]   Support vector regression based on optimal training subset and adaptive particle swarm optimization algorithm [J].
Che, JinXing .
APPLIED SOFT COMPUTING, 2013, 13 (08) :3473-3481
[6]   Optimizing the data-dependent kernel under a unified kernel optimization framework [J].
Chen, Bo ;
Liu, Hongwei ;
Bao, Zheng .
PATTERN RECOGNITION, 2008, 41 (06) :2107-2119
[7]  
Cherkassky V, 1997, IEEE Trans Neural Netw, V8, P1564, DOI 10.1109/TNN.1997.641482
[8]  
Eberhart R. C., 2001, MORGAN KAUFMANN SERI, P369
[9]  
Green P. J., 1993, Nonparametric Regression and Generalized Linear Models: A Roughness Penalty Approach, DOI 10.1201/b15710
[10]   Probability-Confidence-Kernel-Based Localized Multiple Kernel Learning With lp Norm [J].
Han, Yina ;
Liu, Guizhong .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2012, 42 (03) :827-837