A novel error-correcting output codes based on genetic programming and ternary digit operators

被引:10
|
作者
Yi-Fan, Liang [1 ]
Chang, Liu [1 ]
Han-Rui, Wang [1 ,2 ]
Kun-Hong, Liu [1 ]
Jun-Feng, Yao [1 ]
Ying-Ying, She [1 ]
Gui-Ming, Dai [3 ]
Okina, Yuna [3 ]
机构
[1] Xiamen Univ, Sch Informat, Xiamen 361005, Fujian, Peoples R China
[2] Fudan Univ, Sch Comp Sci, Shanghai Key Lab Intelligent Informat Proc, Shanghai, Peoples R China
[3] Sumitomo Elect Ind Ltd, R&D Unit, Frontier Technol Lab, 1 Taya Cho, Yokohama, Kanagawa 2448588, Japan
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Error-correcting output code; Ternary digit operator; Genetic programming; Feature selection; CLASSIFICATION; ECOC; SELECTION; ENSEMBLE; DESIGN;
D O I
10.1016/j.patcog.2020.107642
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The key to the success of an Error-Correcting Output Code (ECOC) algorithm is the effective codematrix, which represents a set of class reassignment schemes for decomposing a multiclass problem into a set of binary class problems. This paper proposes a new method, which uses Ternary digit Operators based Genetic Programming (GP) to generate effective ECOC codematrix (TOGP-ECOC for short). In our GP, each terminal node stores a ternary digit string, representing a column and a related feature subset; each non-terminal node represents a ternary digit operator, which produces a new column based on its child nodes. In this way, each individual is interpreted as an ECOC codematrix along with a set of corresponding feature subsets, serving the solution for the multiclass classification task. When a new individual is produced, a legality checking process is carried out to verify whether the transformed codematrix follows the ECOC constraints. The illegal one is corrected according to different strategies. Besides, a local optimization algorithm is designed to prune redundant columns and improve the performance of each individual. Our experiments compared TOGP-ECOC with some well known ECOC algorithms on various data sets, and the results confirm the superiority of our algorithm. Our source code is available at: https://github.com/MLDMXM2017/TOGP-ECOC. (c) 2020 Elsevier Ltd. All rights reserved.
引用
收藏
页数:19
相关论文
共 50 条
  • [1] The Research of Ternary Error-Correcting Output Codes Based on Genetic Programming
    Liang, YiFan
    Liu, Chang
    Wang, HanRui
    Liu, KunHong
    2019 IEEE INTL CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, BIG DATA & CLOUD COMPUTING, SUSTAINABLE COMPUTING & COMMUNICATIONS, SOCIAL COMPUTING & NETWORKING (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2019), 2019, : 831 - 837
  • [2] A novel Error-Correcting Output Codes algorithm based on genetic programming
    Li, Ke-Sen
    Wang, Han-Rui
    Liu, Kun-Hong
    SWARM AND EVOLUTIONARY COMPUTATION, 2019, 50
  • [3] On the Decoding Process in Ternary Error-Correcting Output Codes
    Escalera, Sergio
    Pujol, Oriol
    Radeva, Petia
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2010, 32 (01) : 120 - 134
  • [4] Separability of ternary codes for sparse designs of error-correcting output codes
    Escalera, Sergio
    Pujol, Oriol
    Radeva, Petia
    PATTERN RECOGNITION LETTERS, 2009, 30 (03) : 285 - 297
  • [5] Decoding design based on posterior probabilities in Ternary Error-Correcting Output Codes
    Zhou, Jin Deng
    Wang, Xiao Dan
    Zhou, Hong Jian
    Zhang, Jie Ming
    Jia, Ning
    PATTERN RECOGNITION, 2012, 45 (04) : 1802 - 1818
  • [6] Fractional Programming Weighted Decoding for Error-Correcting Output Codes
    Ismailoglu, Firat
    Sprinkhuizen-Kuyper, I. G.
    Smirnov, Evgueni
    Escalera, Sergio
    Peeters, Ralf
    MULTIPLE CLASSIFIER SYSTEMS (MCS 2015), 2015, 9132 : 38 - 50
  • [7] Quantum error-correcting output codes
    Windridge, David
    Mengoni, Riccardo
    Nagarajan, Rajagopal
    INTERNATIONAL JOURNAL OF QUANTUM INFORMATION, 2018, 16 (08)
  • [8] Efficient Decoding of Ternary Error-Correcting Output Codes for Multiclass Classification
    Park, Sang-Hyeun
    Fuernkranz, Johannes
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, PT II, 2009, 5782 : 189 - 204
  • [9] Deep Error-Correcting Output Codes
    Wang, Li-Na
    Wei, Hongxu
    Zheng, Yuchen
    Dong, Junyu
    Zhong, Guoqiang
    ALGORITHMS, 2023, 16 (12)
  • [10] Hierarchical error-correcting output codes based on SVDD
    Lei Lei
    Wang Xiao-dan
    Luo Xi
    Song Ya-fei
    Pattern Analysis and Applications, 2016, 19 : 163 - 171