CCMN: A General Framework for Learning With Class-Conditional Multi-Label Noise

被引:19
作者
Xie, Ming-Kun [1 ,2 ]
Huang, Sheng-Jun [1 ,2 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, Nanjing 210095, Peoples R China
[2] Collaborat Innovat Ctr Novel Software Technol & In, MIIT Key Lab Pattern Anal & Machine Intelligence, Nanjing 211106, Peoples R China
基金
国家重点研发计划;
关键词
Class-conditional noise; class-conditional multi-label noise; unbiased estimator; partial multi-label learning; CLASSIFICATION; CONSISTENCY;
D O I
10.1109/TPAMI.2022.3141240
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Class-conditional noise commonly exists in machine learning tasks, where the class label is corrupted with a probability depending on its ground-truth. Many research efforts have been made to improve the model robustness against the class-conditional noise. However, they typically focus on the single label case by assuming that only one label is corrupted. In real applications, an instance is usually associated with multiple labels, which could be corrupted simultaneously with their respective conditional probabilities. In this paper, we formalize this problem as a general framework of learning with Class-Conditional Multi-label Noise (CCMN for short). We establish two unbiased estimators with error bounds for solving the CCMN problems, and further prove that they are consistent with commonly used multi-label loss functions. Finally, a new method for partial multi-label learning is implemented with the unbiased estimator under the CCMN framework. Empirical studies on multiple datasets and various evaluation metrics validate the effectiveness of the proposed method.
引用
收藏
页码:154 / 166
页数:13
相关论文
共 60 条
[21]   A Regularization Approach for Instance-Based Superset Label Learning [J].
Gong, Chen ;
Liu, Tongliang ;
Tang, Yuanyan ;
Yang, Jian ;
Yang, Jie ;
Tao, Dacheng .
IEEE TRANSACTIONS ON CYBERNETICS, 2018, 48 (03) :967-978
[22]   Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labels [J].
Han, Bo ;
Yao, Quanming ;
Yu, Xingrui ;
Niu, Gang ;
Xu, Miao ;
Hu, Weihua ;
Tsang, Ivor W. ;
Sugiyama, Masashi .
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
[23]  
Han B, 2018, ADV NEUR IN, V31
[24]  
Jindal I, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P3246
[25]  
Kingma D. P, 2015, P 3 INT C LEARNING R
[26]   ImageNet Classification with Deep Convolutional Neural Networks [J].
Krizhevsky, Alex ;
Sutskever, Ilya ;
Hinton, Geoffrey E. .
COMMUNICATIONS OF THE ACM, 2017, 60 (06) :84-90
[27]  
Ledoux Michel, 2013, Probability in Banach Spaces: Isoperimetry and Processes
[28]  
Li J., 2020, PROC 8 INT C LEARN R, P1
[29]   Crowdsourcing aggregation with deep Bayesian learning [J].
Li, Shao-Yuan ;
Huang, Sheng-Jun ;
Chen, Songcan .
SCIENCE CHINA-INFORMATION SCIENCES, 2021, 64 (03)
[30]   Classification with Noisy Labels by Importance Reweighting [J].
Liu, Tongliang ;
Tao, Dacheng .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (03) :447-461