Multiple kernel learning LSSVR algorithm based on lp-norm constraint

被引：0
|
作者：
The Liaoning Key Lab of Advanced Control Systems for Industry Equipments,, Dalian University of Technology,, Dalian [1 ]
116024, China
机构：
[1] The Liaoning Key Lab of Advanced Control Systems for Industry Equipments,, Dalian University of Technology,, Dalian
来源：
Kongzhi yu Juece Control Decis | / 9卷 / 1603-1608期
关键词：
Generalization performance; l[!sub]p[!/sub]-norm constraint; Least squares support vector machine; Multiple kernel learning;
D O I：
10.13195/j.kzyjc.2014.0867
中图分类号：
学科分类号：
摘要：
In order to improve generalization performance of learning least squares support vector machines regression(LSSVR), a novel multiple kernel learning least squares support vector machines regression algorithm based on lp-Norm constraint is proposed. Two wrapper methods are provided to solve the proposed algorithm, and both the training method are two-step methods. The inner loop is used to update the combination function parameters while fixing the least squares support vector machine (LSSVM) parameters, the outside loop is used to update the parameters of LSSVM while fixing the combination function parameters, and these two steps are repeated until convergence. The simulation on the one-variable function and multivariable function shows that the proposed algorithm is useful and outperforms the traditional LSSVR algorithm for generalization performance. ©, 2015, Northeast University. All right reserved.
引用
收藏
页码：1603 / 1608
页数：5
相关论文
共 13 条
  • [1] Wang H.Q., Sun F.C., Cai Y.N., Et al., On multiple kernel learning methods, Acta Automatica Sinica, 36, 8, pp. 1037-1050, (2010)
  • [2] Cristianino N., Shawe-Taylor J., An Introduction to Support Vector Machines and Other Kernel-based Learning Methods, pp. 45-78, (2000)
  • [3] Lanckriet G., Cristianint N., Bartlett P., Et al., Learning the kernel matrix with semi-definite programming, The J of Machine Learning Research, 5, 1, pp. 27-72, (2004)
  • [4] Jian L., Xia Z., Liang X., Et al., Design of a multiple kernel learning algorithm for LS-SVM by convex programming, Neural Networks, 24, 5, pp. 476-483, (2011)
  • [5] Chen X., Guo N., Ma Y., Et al., More efficient sparse multi-kernel based least square support vector machine, Communications and Information Processing, pp. 70-78, (2012)
  • [6] Kloft M., Brefeld U., Sonnenburg S., Et al., Lp-norm multiple kernel learning, The J of Machine Learning Research, 12, 3, pp. 953-997, (2011)
  • [7] Yan F., Kittler J., Mikolajczyk K., Et al., Non-sparse multiple kernel fisher discriminant analysis, The J of Machine Learning Research, 13, 3, pp. 607-642, (2012)
  • [8] Sun T., Jiao L., Liu F., Et al., Selective multiple kernel learning for classification with ensemble strategy, Pattern Recognition, 46, 11, pp. 3081-3090, (2013)
  • [9] Ivanov V.K., Vasin V.V., Tanana V.P., Theory of Linear Ill-posed Problems and Its Applications, pp. 124-199, (2002)
  • [10] Tikhonov A.N., Arsenin V.I.A., John F., Solutions of Ill-posed Problems, pp. 191-222, (1977)
12