A novel soft-coded error-correcting output codes algorithm

被引:4
作者
Liu, Kun-Hong [1 ]
Gao, Jie [3 ]
Xu, Yong [2 ]
Feng, Kai-Jie [1 ]
Ye, Xiao-Na [1 ]
Liong, Sze-Teng [4 ]
Chen, Li-Yan [1 ]
机构
[1] Xiamen Univ, Sch Film, Dept Digital Media Technol, Xiamen, Fujian, Peoples R China
[2] Fujian Univ Technol, Sch Comp Sci & Math, Fuzhou, Peoples R China
[3] Fujian Med Univ, Sch Publ Hlth, Fuzhou 350122, Peoples R China
[4] Feng Chia Univ, Dept Elect Engn, Taichung, Taiwan
基金
中国国家自然科学基金;
关键词
Error-correcting output codes; Self-adaptive Strategy; Soft codes; Coverage measure; Subordination degree; MULTICLASS; ECOC; DESIGN; ENSEMBLE; BINARY;
D O I
10.1016/j.patcog.2022.109122
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Error-Correcting Output Codes (ECOC) algorithms enable multi-class classification by reassigning multiple classes to the positive/negative group with the class reassignment schemes being recorded as binary/ternary hard-coded (HC) codematrices. Different classes tend to get diverse subordination degrees to the positive/negative group, providing clues to correct potential errors. However, the HC codematrices are unable to provide the information in the subordination degrees. In this paper, a Soft-Coded ECOC (SC-ECOC) scheme, namely, the Sequential Forward Floating Selection algorithm, is proposed by filling codematrices with real values instead of hard codes to improve classification performance. This algorithm divides multiple classes into two groups by maximizing the ratio of inter-group distance to intra-group distance. Then a new measure coverage is designed to evaluate the subordination degrees of different classes to both groups, which are set as the elements to form a codematrix. Furthermore, a self-adaptive strategy adjusts the value of each element to fit learners better. Experiments are carried out to verify the performance of our algorithm on various data sets, and results confirm that our algorithm can achieve more balanced results compared with the traditional HC ECOC algorithms. Besides, the values of soft codes correlate with the difficulty level of various classes to improve the multiclass classification ability. (C) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:13
相关论文
共 38 条
[1]   Reducing multiclass to binary: A unifying approach for margin classifiers [J].
Allwein, EL ;
Schapire, RE ;
Singer, Y .
JOURNAL OF MACHINE LEARNING RESEARCH, 2001, 1 (02) :113-141
[2]   On the learnability and design of output codes for multiclass problems [J].
Crammer, K ;
Singer, Y .
MACHINE LEARNING, 2002, 47 (2-3) :201-233
[3]  
Dietterich T. G., 1995, Journal of Artificial Intelligence Research, V2, P263
[4]  
Dua D, 2017, UCI MACHINE LEARNING
[5]  
Escalera S, 2006, INT C PATT RECOG, P578
[6]   Separability of ternary codes for sparse designs of error-correcting output codes [J].
Escalera, Sergio ;
Pujol, Oriol ;
Radeva, Petia .
PATTERN RECOGNITION LETTERS, 2009, 30 (03) :285-297
[7]   The design of variable-length coding matrix for improving error correcting output codes [J].
Feng, Kai-Jie ;
Liong, Sze-Teng ;
Liu, Kun-Hong .
INFORMATION SCIENCES, 2020, 534 :192-217
[8]   Imprecise Deep Forest for Partial Label Learning [J].
Gao, Jie ;
Lin, Weiping ;
Liu, Kunhong ;
Hong, Qingqi ;
Lin, Guangyi ;
Wang, Beizhan .
IEEE ACCESS, 2020, 8 :218530-218541
[9]   Evolving output codes for multiclass problems [J].
Garcia-Pedrajas, Nicolas ;
Fyfe, Colin .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2008, 12 (01) :93-106
[10]   Feature selection with kernelized multi-class support vector machine [J].
Guo, Yinan ;
Zhang, Zirui ;
Tang, Fengzhen .
PATTERN RECOGNITION, 2021, 117