Multilabel Prototype Generation for data reduction in K-Nearest Neighbour classification

被引:14
作者
Valero-Mas, Jose J. [1 ]
Javier Gallego, Antonio [1 ]
Alonso-Jimenez, Pablo [2 ]
Serra, Xavier [2 ]
机构
[1] Univ Alicante, Univ Inst Comp Res, Alicante, Spain
[2] Univ Pompeu Fabra, Mus Technol Grp, Barcelona, Spain
关键词
Multilabel classification; Prototype generation; Efficient k NN; LABEL; CLASSIFIERS; KNN;
D O I
10.1016/j.patcog.2022.109190
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Prototype Generation (PG) methods are typically considered for improving the efficiency of the k-Nearest Neighbour (kNN) classifier when tackling high-size corpora. Such approaches aim at generating a reduced version of the corpus without decreasing the classification performance when compared to the initial set. Despite their large application in multiclass scenarios, very few works have addressed the proposal of PG methods for the multilabel space. In this regard, this work presents the novel adaptation of four multiclass PG strategies to the multilabel case. These proposals are evaluated with three multilabel kNN-based classifiers, 12 corpora comprising a varied range of domains and corpus sizes, and different noise scenarios artificially induced in the data. The results obtained show that the proposed adaptations are capable of significantly improving-both in terms of efficiency and classification performance-the only reference multilabel PG work in the literature as well as the case in which no PG method is applied, also presenting statistically superior robustness in noisy scenarios. Moreover, these novel PG strategies allow prioritising either the efficiency or efficacy criteria through its configuration depending on the target scenario, hence covering a wide area in the solution space not previously filled by other works.(c) 2022 The Author(s). Published by Elsevier Ltd. This is an open access article under the CC BY license ( http://creativecommons.org/licenses/by/4.0/ )
引用
收藏
页数:15
相关论文
共 41 条
[1]   Local sets for multi-label instance selection [J].
Arnaiz-Gonzalez, Alvar ;
Diez-Pastor, Jose-Francisco ;
Rodriguez, Juan J. ;
Garcia-Osorio, Cesar .
APPLIED SOFT COMPUTING, 2018, 68 :651-666
[2]   On the generation of multi-label prototypes [J].
Bello, Marilyn ;
Napoles, Gonzalo ;
Vanhoof, Koen ;
Bello, Rafael .
INTELLIGENT DATA ANALYSIS, 2020, 24 (S1) :S167-S183
[3]  
Bishop C.M., 2006, Machine Learning, V128
[4]   Improving kNN multi-label classification in Prototype Selection scenarios using class proposals [J].
Calvo-Zaragoza, Jorge ;
Valero-Mas, Jose J. ;
Rico-Juan, Juan R. .
PATTERN RECOGNITION, 2015, 48 (05) :1608-1622
[5]   Prototype generation in the string space via approximate median for data reduction in nearest neighbor classification [J].
Castellanos, Francisco J. ;
Valero-Mas, Jose J. ;
Calvo-Zaragoza, Jorge .
SOFT COMPUTING, 2021, 25 (24) :15403-15415
[6]   A sample set condensation algorithm for the class sensitive artificial neural network [J].
Chen, CH ;
Jozwik, A .
PATTERN RECOGNITION LETTERS, 1996, 17 (08) :819-823
[7]   Combining instance-based learning and logistic regression for multilabel classification [J].
Cheng, Weiwei ;
Huellermeier, Eyke .
MACHINE LEARNING, 2009, 76 (2-3) :211-225
[8]  
Demsar J, 2006, J MACH LEARN RES, V7, P1
[9]   Efficient kNN classification algorithm for big data [J].
Deng, Zhenyun ;
Zhu, Xiaoshu ;
Cheng, Debo ;
Zong, Ming ;
Zhang, Shichao .
NEUROCOMPUTING, 2016, 195 :143-148
[10]   PGGP: Prototype Generation via Genetic Programming [J].
Escalante, Hugo Jair ;
Graff, Mario ;
Morales-Reyes, Alicia .
APPLIED SOFT COMPUTING, 2016, 40 :569-580