Robust and sparse label propagation for graph-based semi-supervised classification

被引:7
作者
Hua, Zhiwen [1 ]
Yang, Youlong [1 ]
机构
[1] Xidian Univ, Sch Math & Stat, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Semi-supervised learning; Graph construction; Label propagation; Denoising; l(2 1)-norm regularization; CONSTRUCTION;
D O I
10.1007/s10489-021-02360-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Traditional graph-based semi-supervised classification algorithms are usually composed of two independent parts: graph construction and label propagation. However, the predefined graph may not be optimal for label propagation, and these methods usually use the raw data containing noise directly, which may reduce the accuracy of the algorithm. In this paper, we propose a robust label prediction model called the robust and sparse label propagation (RSLP) algorithm. First, our RSLP algorithm decomposes the raw data into a low-rank clean part and a sparse noise part, and performs graph construction and label propagation in the clean data space. Second, RSLP seamlessly combines the processes of graph construction and label propagation. By jointly minimizing the sample reconstruction error and the label reconstruction error, the resulting graph structure is globally optimal. Third, the proposed RSLP performs l(2,1)-norm regularization on the predicted label matrix, thereby enhancing the sparsity and discrimination of soft labels. We also analyze the connection between RSLP and other related algorithms, including label propagation algorithms, the robust graph construction method, and principal component analysis. A series of experiments on several benchmark datasets show that our RSLP algorithm achieves comparable and even higher accuracy than other state-of-the-art algorithms.
引用
收藏
页码:3337 / 3351
页数:15
相关论文
共 52 条
[1]  
[Anonymous], 2005, SEMISUPERVISED LEARN
[2]   A novel spectral-spatial co-training algorithm for the transductive classification of hyperspectral imagery data [J].
Appice, Annalisa ;
Guccione, Pietro ;
Malerba, Donato .
PATTERN RECOGNITION, 2017, 63 :229-245
[3]   Distributed optimization and statistical learning via the alternating direction method of multipliers [J].
Boyd S. ;
Parikh N. ;
Chu E. ;
Peleato B. ;
Eckstein J. .
Foundations and Trends in Machine Learning, 2010, 3 (01) :1-122
[4]   Robust Principal Component Analysis? [J].
Candes, Emmanuel J. ;
Li, Xiaodong ;
Ma, Yi ;
Wright, John .
JOURNAL OF THE ACM, 2011, 58 (03)
[5]  
Chen DD, 2018, PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P2014
[6]   Learning With l1-Graph for Image Analysis [J].
Cheng, Bin ;
Yang, Jianchao ;
Yan, Shuicheng ;
Fu, Yun ;
Huang, Thomas S. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2010, 19 (04) :858-866
[7]   Remote Sensing Image Scene Classification: Benchmark and State of the Art [J].
Cheng, Gong ;
Han, Junwei ;
Lu, Xiaoqiang .
PROCEEDINGS OF THE IEEE, 2017, 105 (10) :1865-1883
[8]   A Two-Stage Approach to Few-Shot Learning for Image Recognition [J].
Das, Debasmit ;
Lee, C. S. George .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :3336-3350
[9]  
de Sousa CAR, 2015, IEEE IJCNN
[10]   Sparse graphs with smoothness constraints: Application to dimensionality reduction and semi-supervised classification [J].
Dornaika, E. ;
Weng, L. .
PATTERN RECOGNITION, 2019, 95 :285-295