Mixture correntropy for robust learning

被引:144
作者
Chen, Badong [1 ]
Wang, Xin [1 ]
Lu, Na [1 ]
Wang, Shiyuan [2 ]
Cao, Jiuwen [3 ]
Qin, Jing [4 ]
机构
[1] Xi An Jiao Tong Univ, Sch Elect & Informat Engn, Xian 710049, Shaanxi, Peoples R China
[2] Southwest Univ, Coll Elect & Informat Engn, Chongqing 400715, Peoples R China
[3] Hangzhou Dianzi Univ, Inst Informat & Control, Hangzhou 310018, Zhejiang, Peoples R China
[4] Hong Kong Polytech Univ, Sch Nursing, Ctr Smart Hlth, Hong Kong, Hong Kong, Peoples R China
基金
国家重点研发计划;
关键词
Correntropy; Mixture correntropy; Robust learning; Extreme learning machine; Kernel adaptive filtering; MACHINE; REGRESSION;
D O I
10.1016/j.patcog.2018.02.010
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Correntropy is a local similarity measure defined in kernel space, hence can combat large outliers in robust signal processing and machine learning. So far, many robust learning algorithms have been developed under the maximum correntropy criterion (MCC), among which, a Gaussian kernel is generally used in correntropy. To further improve the learning performance, in this paper we propose the concept of mixture correntropy, which uses the mixture of two Gaussian functions as the kernel function. Some important properties of the mixture correntropy are presented. Applications of the maximum mixture correntropy criterion (MMCC) to extreme learning machine (ELM) and kernel adaptive filtering (KAF) for function approximation and data regression are also studied. Experimental results show that the learning algorithms under MMCC can perform very well and achieve better performance than the conventional MCC based algorithms as well as several other state-of-the-art algorithms. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:318 / 327
页数:10
相关论文
共 56 条
[1]  
[Anonymous], PATTERN RECOGNIT LET
[2]  
[Anonymous], 2012, P 2012 INT JOINT C N
[3]  
[Anonymous], J GUID CONTROL DYN
[4]  
[Anonymous], 2011, KERNEL ADAPTIVE FILT
[5]  
[Anonymous], INF THEOR LEARN REN
[6]  
Chen B., 2016, IEEE T CYBERN, VPP, P1
[7]   Maximum correntropy Kalman filter [J].
Chen, Badong ;
Liu, Xi ;
Zhao, Haiquan ;
Principe, Jose C. .
AUTOMATICA, 2017, 76 :70-77
[8]   Generalized Correntropy for Robust Adaptive Filtering [J].
Chen, Badong ;
Xing, Lei ;
Zhao, Haiquan ;
Zheng, Nanning ;
Principe, Jose C. .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2016, 64 (13) :3376-3387
[9]   Steady-State Mean-Square Error Analysis for Adaptive Filtering under the Maximum Correntropy Criterion [J].
Chen, Badong ;
Xing, Lei ;
Liang, Junli ;
Zheng, Nanning ;
Principe, Jose C. .
IEEE SIGNAL PROCESSING LETTERS, 2014, 21 (07) :880-884
[10]   Quantized Kernel Recursive Least Squares Algorithm [J].
Chen, Badong ;
Zhao, Songlin ;
Zhu, Pingping ;
Principe, Jose C. .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2013, 24 (09) :1484-1491