Kernel-based sparse regression with the correntropy-induced loss

被引:29
作者
Chen, Hong [1 ]
Wang, Yulong [2 ]
机构
[1] Huazhong Agr Univ, Inst Appl Math, Coll Sci, Wuhan 430070, Hubei, Peoples R China
[2] Univ Macau, Fac Sci & Technol, Macau 999078, Peoples R China
关键词
Learning theory; Kernel-based regression; Correntropy-induced loss; Sparsity; Learning rate; SIGNAL;
D O I
10.1016/j.acha.2016.04.004
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
The correntropy-induced loss (C-loss) has been employed in learning algorithms to improve their robustness to non-Gaussian noise and outliers recently. Despite its success on robust learning, only little work has been done to study the generalization performance of regularized regression with the C-loss. To enrich this theme, this paper investigates a kernel-based regression algorithm with the C-loss and l(1)-regularizer in data dependent hypothesis spaces. The asymptotic learning rate is established for the proposed algorithm in terms of novel error decomposition and capacity-based analysis technique. The sparsity characterization of the derived predictor is studied theoretically. Empirical evaluations demonstrate its advantages over the related approaches. (C) 2016 Elsevier Inc. All rights reserved.
引用
收藏
页码:144 / 164
页数:21
相关论文
共 37 条
[1]  
Boyd L., 2004, CONVEX OPTIMIZATION
[2]  
Chen DR, 2004, J MACH LEARN RES, V5, P1143
[3]   Convergence rate of the semi-supervised greedy algorithm [J].
Chen, Hong ;
Zhou, Yicong ;
Tang, Yuan Yan ;
Li, Luoqing ;
Pan, Zhibin .
NEURAL NETWORKS, 2013, 44 :44-50
[4]   Error Analysis of Coefficient-Based Regularized Algorithm for Density-Level Detection [J].
Chen, Hong ;
Pan, Zhibin ;
Li, Luoqing ;
Tang, Yuanyan .
NEURAL COMPUTATION, 2013, 25 (04) :1107-1121
[5]  
Cucker F, 2007, C MO AP C M, P1, DOI 10.1017/CBO9780511618796
[6]   Least angle regression - Rejoinder [J].
Efron, B ;
Hastie, T ;
Johnstone, I ;
Tibshirani, R .
ANNALS OF STATISTICS, 2004, 32 (02) :494-499
[7]   Regularization networks and support vector machines [J].
Evgeniou, T ;
Pontil, M ;
Poggio, T .
ADVANCES IN COMPUTATIONAL MATHEMATICS, 2000, 13 (01) :1-50
[8]   Consistency analysis of an empirical minimum error entropy algorithm [J].
Fan, Jun ;
Hu, Ting ;
Wu, Qiang ;
Zhou, Ding-Xuan .
APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2016, 41 (01) :164-189
[9]  
Feng Y., 2014, 14158 ESATSISTA KU L
[10]  
Feng Y., 2016, NEURAL COMPUT, V28, P1