Chance-Constrained Abnormal Data Cleaning for Robust Classification With Noisy Labels

被引:1
作者
Shen, Xun [1 ]
Luo, Zhaojie [2 ]
Li, Yuanchao [3 ]
Ouyang, Tinghui [4 ]
Wu, Yuhu [5 ]
机构
[1] Osaka Univ, Grad Sch Engn, Osaka 5650871, Japan
[2] Southeast Univ, Sch Biol Sci & Med Engn, Nanjing 210096, Peoples R China
[3] Univ Edinburgh, Inst Language Cognit & Computat, Edinburgh EH8 9YL, Scotland
[4] Natl Inst Adv Ind Sci & Technol, Tokyo 1350064, Japan
[5] Dalian Univ Technol, Sch Control Sci & Engn, Dalian 116024, Peoples R China
来源
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE | 2024年
关键词
Classification with noisy labels; chance constrained optimization; APPROXIMATION; OPTIMIZATION;
D O I
10.1109/TETCI.2024.3375518
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Supervised classification is a common field of machine learning. However, the existing classification methods based on deep models are vulnerable to overfitting the noisy labels in the training set. This paper proposes a data-cleaning method to achieve robust classification against noisy labels. A chance-constrained abnormal data cleaning approach is proposed based on chance-constrained optimization, in which a polynomial sublevel set for the data of each class is generated. The data outside the polynomial sublevel set is abnormal and has a low probability of belonging to the labeled class. The classification method only uses normal data to establish the estimated classifiers. We show the convergence of the proposed abnormal data-cleaning approach. Furthermore, we give the algorithm for classification with abnormal data cleaning. Experimental data-based validations have been implemented to validate the proposed classification algorithm. The results show that the proposed approach can correctly clean the abnormal noisy labels and improve the performance of Supervised classification methods.
引用
收藏
页码:1 / 8
页数:8
相关论文
共 50 条
[31]   Distributionally robust chance-constrained operation of distribution grids considering voltage constraints [J].
Wang, Chao ;
Sun, Junjie ;
Li, Xinwei ;
Yang, Tiankai ;
Liu, Wansong .
FRONTIERS IN ENERGY RESEARCH, 2024, 12
[32]   A Chance-Constrained Programming Approach to the Design of Robust Broadband Beamformers With Microphone Mismatches [J].
Bao, Yu ;
Chen, Huawei .
IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2018, 26 (12) :2475-2488
[33]   A decomposition algorithm for distributionally robust chance-constrained programs with polyhedral ambiguity set [J].
Pathy, Soumya Ranjan ;
Rahimian, Hamed .
OPTIMIZATION LETTERS, 2025,
[34]   Distributionally Robust Chance-Constrained Approximate AC-OPF With Wasserstein Metric [J].
Duan, Chao ;
Fang, Wanliang ;
Jiang, Lin ;
Yao, Li ;
Liu, Jun .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2018, 33 (05) :4924-4936
[35]   Data-driven distributionally robust joint chance-constrained energy management for multi-energy microgrid [J].
Zhai, Junyi ;
Wang, Sheng ;
Guo, Lei ;
Jiang, Yuning ;
Kang, Zhongjian ;
Jones, Colin N. .
APPLIED ENERGY, 2022, 326
[36]   Data-Driven Joint Distributionally Robust Chance-Constrained Operation for Multiple Integrated Electricity and Heating Systems [J].
Zhai, Junyi ;
Jiang, Yuning ;
Zhou, Ming ;
Shi, Yuanming ;
Chen, Wei ;
Jones, Colin N. .
IEEE TRANSACTIONS ON SUSTAINABLE ENERGY, 2024, 15 (03) :1782-1798
[37]   Data-driven Wasserstein distributionally robust chance-constrained optimization for crude oil scheduling under uncertainty [J].
Dai, Xin ;
Zhao, Liang ;
He, Renchu ;
Du, Wenli ;
Zhong, Weimin ;
Li, Zhi ;
Qian, Feng .
CHINESE JOURNAL OF CHEMICAL ENGINEERING, 2024, 69 :152-166
[38]   DATA-DRIVEN APPROXIMATION OF CONTEXTUAL CHANCE-CONSTRAINED STOCHASTIC PROGRAMS [J].
Rahimian, Hamed ;
Pagnoncelli, Bernardo .
SIAM JOURNAL ON OPTIMIZATION, 2023, 33 (03) :2248-2274
[39]   Chance-Constrained Surgery Planning Under Conditions of Limited and Ambiguous Data [J].
Deng, Yan ;
Shen, Siqian ;
Denton, Brian .
INFORMS JOURNAL ON COMPUTING, 2019, 31 (03) :559-575
[40]   Development of an Improved Fuzzy Robust Chance-Constrained Programming Model for Air Quality Management [J].
Xu, Ye ;
Huang, Guohe .
ENVIRONMENTAL MODELING & ASSESSMENT, 2015, 20 (05) :535-548