MSSL: a memetic-based sparse subspace learning algorithm for multi-label classification

被引:22
作者
Bayati, Hamid [1 ]
Dowlatshahi, Mohammad Bagher [1 ]
Hashemi, Amin [1 ]
机构
[1] Lorestan Univ, Dept Comp Engn, Fac Engn, Khorramabad, Iran
关键词
Multi-label data; Filter-based memetic algorithm; Feature selection; Subspace learning; High-dimensional features; GRAVITATIONAL SEARCH ALGORITHM; PARTICLE SWARM OPTIMIZATION; FEATURE-SELECTION ALGORITHM; NEIGHBORHOOD;
D O I
10.1007/s13042-022-01616-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Researchers have considered multi-label learning because of its presence in various real-world applications, in which each entity is associated with more than one class label. Since multi-label data suffers from the curse of high-dimensionality, providing effective feature selection methods is necessary to enhance the learning process. Various multi-label feature selection methods have been proposed so far. However, the existing methods have not yet reached acceptable performance in this research field due to the existence of datasets with various dimensions. This paper proposes a new feature selection algorithm based on subspace learning and a memetic algorithm to provide global and local search in multi-label data. This is the first try that uses a filter-based memetic algorithm for multi-label feature selection. The objective function consists of two conflicting objectives: reconstruction error and sparsity regularization. Finally, nine filter-based multi-label feature selection methods are compared with the proposed method. The comparisons are conducted based on the famous performance evaluation criteria for multi-label classification, such as classification accuracy, hamming-loss, average precision, and one-error. Based on the results obtained in eight real-world datasets, the proposed method is superior to comparing methods according to all evaluation criteria.
引用
收藏
页码:3607 / 3624
页数:18
相关论文
共 68 条
[1]   An optimal pruning algorithm of classifier ensembles: dynamic programming approach [J].
Alzubi, Omar A. ;
Alzubi, Jafar A. ;
Alweshah, Mohammed ;
Qiqieh, Issa ;
Al-Shami, Sara ;
Ramachandran, Manikandan .
NEURAL COMPUTING & APPLICATIONS, 2020, 32 (20) :16091-16107
[2]  
[Anonymous], 2010, P 16 ACM SIGKDD INT
[3]  
Bayati H., 2020, J SOFT COMPUT INF TE, V9, P56
[4]  
Bayati H., 2020, 2020 25 INT COMP C, P1, DOI [10.1109/CSICC49403.2020.9050087, DOI 10.1109/CSICC49403.2020.9050087]
[5]   Learning multi-label scene classification [J].
Boutell, MR ;
Luo, JB ;
Shen, XP ;
Brown, CM .
PATTERN RECOGNITION, 2004, 37 (09) :1757-1771
[6]  
Cai D, 2007, IEEE DATA MINING, P73, DOI 10.1109/ICDM.2007.89
[7]   Feature selection in machine learning: A new perspective [J].
Cai, Jie ;
Luo, Jiawei ;
Wang, Shulin ;
Yang, Sheng .
NEUROCOMPUTING, 2018, 300 :70-79
[8]  
Charte F, 2015, R J, V7, P149
[9]   Document transformation for multi-label feature selection in text categorization [J].
Chen, Weizhu ;
Yan, Jun ;
Zhang, Benyu ;
Chen, Zheng ;
Yang, Qiang .
ICDM 2007: PROCEEDINGS OF THE SEVENTH IEEE INTERNATIONAL CONFERENCE ON DATA MINING, 2007, :451-+
[10]   Feature selection for text classification: A review [J].
Deng, Xuelian ;
Li, Yuqing ;
Weng, Jian ;
Zhang, Jilian .
MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (03) :3797-3816