Robust Deep Graph Based Learning for Binary Classification

被引:6
作者
Ye, Minxiang [1 ,2 ]
Stankovic, Vladimir [1 ]
Stankovic, Lina [1 ]
Cheung, Gene [3 ]
机构
[1] Univ Strathclyde, Dept Elect & Elect Engn, Glasgow G1 1XW, Lanark, Scotland
[2] Ctr Intelligent Robot, Zhejiang Lab, Hangzhou 311121, Peoples R China
[3] York Univ, Dept Elect Engn & Comp Sci, Toronto, ON M3J 1P3, Canada
来源
IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS | 2021年 / 7卷
关键词
Noise measurement; Training; Laplace equations; Convolution; Support vector machines; Task analysis; Neural networks; Binary classification; graph laplacian regularization; semi-supervised learning; deep learning;
D O I
10.1109/TSIPN.2020.3040993
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Convolutional neural network (CNN)-based feature learning has become the state-of-the-art for many applications since, given sufficient training data, CNN can significantly outperform traditional methods for various classification tasks. However, feature learning is more challenging if training labels are noisy as CNN tends to overfit to the noisy training labels, resulting in sub-par classification performance. In this paper, we propose a robust binary classifier by learning CNN-based deep metric functions, to construct a graph, used to clean the noisy labels via graph Laplacian regularization (GLR). The denoised labels are then used in two proposed loss correction functions to regularize the deep metric functions. As a result, the node-to-node correlations in the graph are better reflected, leading to improved predictive performance. The experiments on three datasets, varying in number and type of features and under different levels of noise, demonstrate that given a noisy training dataset for the semi-supervised classification task, our proposed networks outperform several state-of-the-art classifiers, including label-noise robust support vector machine, CNNs with three different robust loss functions, model-based GLR, and dynamic graph CNN classifiers.
引用
收藏
页码:322 / 335
页数:14
相关论文
共 53 条
[1]  
Alcalá-Fdez J, 2011, J MULT-VALUED LOG S, V17, P255
[2]  
[Anonymous], 2011, P 1 WORKSH UNS LEARN
[3]  
[Anonymous], 2018, ARXIV180400092
[4]  
[Anonymous], 2018, ARXIV180711637
[5]  
[Anonymous], 2020, THE CIFAR 10 DATASET
[6]  
[Anonymous], 2017, ARXIV170401312
[7]  
[Anonymous], 2017, Deep learning is robust to massive label noise
[8]  
[Anonymous], 2011, ACM T INTEL SYST TEC, DOI DOI 10.1145/1899412.1899418
[9]  
[Anonymous], 2014, INT C LEARN REPR ICL
[10]  
Biggio B., 2011, AS C MACH LEARN, P97