Towards Enabling Binary Decomposition for Partial Multi-Label Learning

被引:25
作者
Liu, Bing-Qing [1 ]
Jia, Bin-Bin [2 ]
Zhang, Min-Ling [1 ,3 ]
机构
[1] Southeast Univ, Sch Comp Sci & Engn, Nanjing 210096, Peoples R China
[2] Lanzhou Univ Technol, Coll Elect & Informat Engn, Lanzhou 730050, Peoples R China
[3] Southeast Univ, Key Lab Comp Network & Informat Integrat, Minist Educ, Nanjing 210096, Peoples R China
基金
美国国家科学基金会;
关键词
Encoding; Training; Labeling; Decoding; Phase locked loops; Iterative methods; Codes; Binary decomposition; error-correcting output codes; machine learning; partial multi-label learning; DEPENDENT DESIGN; CLASSIFICATION;
D O I
10.1109/TPAMI.2023.3290797
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Partial multi-label learning (PML) is an emerging weakly supervised learning framework, where each training example is associated with multiple candidate labels which are only partially valid. To learn the multi-label predictive model from PML training examples, most existing approaches work by identifying valid labels within candidate label set via label confidence estimation. In this paper, a novel strategy towards partial multi-label learning is proposed by enabling binary decomposition for handling PML training examples. Specifically, the widely used error-correcting output codes (ECOC) techniques are adapted to transform the PML learning problem into a number of binary learning problems, which refrains from using the error-prone procedure of estimating labeling confidence of individual candidate label. In the encoding phase, a ternary encoding scheme is utilized to balance the definiteness and adequacy of the derived binary training set. In the decoding phase, a loss weighted scheme is applied to consider the empirical performance and predictive margin of derived binary classifiers. Extensive comparative studies against state-of-the-art PML learning approaches clearly show the performance advantage of the proposed binary decomposition strategy for partial multi-label learning.
引用
收藏
页码:13203 / 13217
页数:15
相关论文
共 53 条
[1]   Reducing multiclass to binary: A unifying approach for margin classifiers [J].
Allwein, EL ;
Schapire, RE ;
Singer, Y .
JOURNAL OF MACHINE LEARNING RESEARCH, 2001, 1 (02) :113-141
[2]  
[Anonymous], 2012, P 3 IT INF RETR WORK
[3]   Learning multi-label scene classification [J].
Boutell, MR ;
Luo, JB ;
Shen, XP ;
Brown, CM .
PATTERN RECOGNITION, 2004, 37 (09) :1757-1771
[4]  
Cao N, 2021, PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, P2198
[5]   LIBSVM: A Library for Support Vector Machines [J].
Chang, Chih-Chung ;
Lin, Chih-Jen .
ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2011, 2 (03)
[6]  
Cour T, 2011, J MACH LEARN RES, V12, P1501
[7]  
Demsar J, 2006, J MACH LEARN RES, V7, P1
[8]  
Dietterich TG, 1994, J ARTIF INTELL RES, V2, P263
[9]   Subclass problem-dependent design for error-correcting output codes [J].
Escalera, Sergio ;
Tax, David M. J. ;
Pujol, Oriol ;
Radeva, Petia ;
Duin, Robert P. W. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2008, 30 (06) :1041-1054
[10]   On the Decoding Process in Ternary Error-Correcting Output Codes [J].
Escalera, Sergio ;
Pujol, Oriol ;
Radeva, Petia .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2010, 32 (01) :120-134