Convex-hull based robust evolutionary optimization approach for ROC maximization under label noise

被引:0
作者
Qiu, Jianfeng [1 ,2 ,3 ]
Shu, Shengda [4 ]
Zhang, Qiangqiang [4 ]
Wang, Chao [1 ,2 ,3 ]
Cheng, Fan [1 ,2 ,3 ]
Zhang, Xingyi [1 ,2 ,3 ]
机构
[1] Anhui Univ, Informat Mat & Intelligent Sensing Lab Anhui Prov, Hefei 230601, Anhui, Peoples R China
[2] Anhui Univ, Key Lab Intelligent Comp & Signal Proc, Minist Educ, Hefei 230601, Anhui, Peoples R China
[3] Anhui Univ, Sch Artificial Intelligence, Hefei 230601, Peoples R China
[4] Anhui Univ, Sch Comp Sci & Technol, Hefei 230601, Peoples R China
基金
中国国家自然科学基金;
关键词
Receiver operating characteristic convex; hull; Multi-objective optimization; Label noise; Robustness; MULTIOBJECTIVE OPTIMIZATION; ALGORITHM; CLASSIFICATION; CLASSIFIERS;
D O I
10.1016/j.asoc.2023.110651
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Convex-hull based receiver operating characteristic (ROC) maximization has become a hot research topic due to its significance in the study of imbalance binary classification. Recently, a series of multi objective evolutionary algorithms (MOEAs) have been proposed to maximize ROC convex hull by regarding it as a multi-objective optimization problem. However, in real applications, the ubiquitous label noises degrade the performance of the existing MOEAs. To address this issue, in this paper, we propose a robust evolutionary optimization approach, named REO, to enhance the robustness of the existing MOEAs. In the proposed approach, we firstly design a distance-based samples selection method to extract a "clean"data subset, aiming to obtain an ideal individual. Second, with the ideal individual, a problem-oriented two-stage adaptive updating strategy is designed to guide the population evolution and enhance the robustness of MOEAs. Specifically, in the first stage, based on the achieved ideal individual, a bi-level evolution direction is constructed to provide the guidance for the evolution of population. In the second stage, we utilize the cosine similarity to assign different step sizes to adaptively update the inferior individuals. Experimental results on 19 complicated datasets with different noise levels show that the proposed REO approach can effectively enhance the robustness of the existing MOEAs for ROC convex hull maximization under the label noises.& COPY; 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 32 条
[1]  
[Anonymous], 2004, ICML Tutorial
[2]  
Barreno M., 2008, Advances in Neural Information Processing Systems, P57, DOI DOI 10.1002/PMJ
[3]   Evolving Diverse Ensembles Using Genetic Programming for Classification With Unbalanced Data [J].
Bhowan, Urvesh ;
Johnston, Mark ;
Zhang, Mengjie ;
Yao, Xin .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2013, 17 (03) :368-386
[4]   Maximizing receiver operating characteristics convex hull via dynamic reference point-based multi-objective evolutionary algorithm [J].
Cheng, Fan ;
Zhang, Qiangqiang ;
Tian, Ye ;
Zhang, Xingyi .
APPLIED SOFT COMPUTING, 2020, 86
[5]   A new multi-objective evolutionary algorithm based on convex hull for binary classifier optimization [J].
Cococcioni, Marco ;
Ducange, Pietro ;
Lazzerini, Beatrice ;
Marcelloni, Francesco .
2007 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION, VOLS 1-10, PROCEEDINGS, 2007, :3150-3156
[6]  
Coello C.C., 2007, EVOLUTIONARY ALGORIT, DOI [10.1007/978-0-387-36797-2, DOI 10.1007/978-0-387-36797-2]
[7]   A fast and elitist multiobjective genetic algorithm: NSGA-II [J].
Deb, K ;
Pratap, A ;
Agarwal, S ;
Meyarivan, T .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2002, 6 (02) :182-197
[8]  
Dua D., 2017, UCI MACHINE LEARNING
[9]  
Fawcett T, 2001, 2001 IEEE INTERNATIONAL CONFERENCE ON DATA MINING, PROCEEDINGS, P131, DOI 10.1109/ICDM.2001.989510
[10]   PRIE: a system for generating rulelists to maximize ROC performance [J].
Fawcett, Tom .
DATA MINING AND KNOWLEDGE DISCOVERY, 2008, 17 (02) :207-224