Robust multiple kernel subspace clustering with block diagonal representation and low-rank consensus kernel

被引:19
作者
Zhang, Xiaoqian [1 ,3 ]
Xue, Xuqian [2 ]
Sun, Huaijiang [1 ]
Liu, Zhigui [2 ,3 ]
Guo, Li [3 ]
Guo, Xin [2 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Peoples R China
[2] Southwest Univ Sci & Technol, Sch Comp Sci & Technol, Mianyang 621010, Sichuan, Peoples R China
[3] Southwest Univ Sci & Technol, Sch Informat Engn, Mianyang 621010, Sichuan, Peoples R China
基金
中国国家自然科学基金;
关键词
Multiple kernel learning; Mixture correntropy induced metric; Low-rank consensus kernel; Block diagonal representation; NONNEGATIVE MATRIX FACTORIZATION; CORRENTROPY; GRAPH;
D O I
10.1016/j.knosys.2021.107243
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multiple kernel learning (MKL) is widely used to deal with nonlinear clustering problem, because MKL can obtain the optimal consensus kernel by designing kernel weighting strategy, which avoids the limitation of single-kernel learning restricted by the selected kernel function. However, existing MKL subspace clustering algorithms ignore noise and the low-rank structure of the data in the feature space. We propose a new robust multiple kernel subspace clustering algorithm (LRMKSC) with block diagonal representation (BDR) and low-rank consensus kernel (LRCK), which is more systematic and comprehensive for data processing. In particular, (1) to learn the optimal consensus kernel, we design an automatic weighting strategy using Mixture Correntropy Induced Metric (MCIM), which not only sets the optimal weight for each kernel, but also improves the robustness of LRMKSC by suppressing noise; (2) to explore low-rank structure of input data in feature space, we propose the Weighted Truncated Schatten p-Norm (WTSN) and apply it to the low-rank constraint of the optimal consensus kernel; (3) considering the block diagonal property of the affinity matrix, we apply block diagonal constraint to the coefficient matrix. LRMKSC combines MKL, LRCK and BDR to solve these problems simultaneously. Through the interaction of three technologies, the results of other technologies are used in the overall optimal solution to iteratively improve the efficiency of each technology, and finally form an overall optimal algorithm for processing nonlinear structural data. Compared with the most advanced MKL subspace clustering algorithms, extensive experiments on image and text datasets verify the competitiveness of LRMKSC. (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:11
相关论文
共 46 条
[1]   GLEAM: a graph clustering framework based on potential game optimization for large-scale social networks [J].
Bu, Zhan ;
Cao, Jie ;
Li, Hui-Jia ;
Gao, Guangliang ;
Tao, Haicheng .
KNOWLEDGE AND INFORMATION SYSTEMS, 2018, 55 (03) :741-770
[2]   Deep Self-Evolution Clustering [J].
Chang, Jianlong ;
Meng, Gaofeng ;
Wang, Lingfeng ;
Xiang, Shiming ;
Pan, Chunhong .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (04) :809-823
[3]   Mixture correntropy for robust learning [J].
Chen, Badong ;
Wang, Xin ;
Lu, Na ;
Wang, Shiyuan ;
Cao, Jiuwen ;
Qin, Jing .
PATTERN RECOGNITION, 2018, 79 :318-327
[4]   Locality-constrained least squares regression for subspace clustering [J].
Chen, Yuanyuan ;
Yi, Zhang .
KNOWLEDGE-BASED SYSTEMS, 2019, 163 :51-56
[5]  
Dattorro J., 2010, Convex optimization & Euclidean distance geometry
[6]   Compressive Sensing via Nonlocal Low-Rank Regularization [J].
Dong, Weisheng ;
Shi, Guangming ;
Li, Xin ;
Ma, Yi ;
Huang, Feng .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2014, 23 (08) :3618-3632
[7]  
Du L, 2015, PROCEEDINGS OF THE TWENTY-FOURTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI), P3476
[8]   Sparse Subspace Clustering: Algorithm, Theory, and Applications [J].
Elhamifar, Ehsan ;
Vidal, Rene .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (11) :2765-2781
[9]   Image compressive sensing via Truncated Schatten-p Norm regularization [J].
Feng, Lei ;
Sun, Huaijiang ;
Sun, Quansen ;
Xia, Guiyu .
SIGNAL PROCESSING-IMAGE COMMUNICATION, 2016, 47 :28-41
[10]   On the Impact of Regularization Variation on Localized Multiple Kernel Learning [J].
Han, Yina ;
Yang, Kunde ;
Yang, Yixin ;
Ma, Yuanliang .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (06) :2625-2630