A Weighted Ensemble Classification Algorithm Based on Nearest Neighbors for Multi-Label Data Stream

被引:3
作者
Wu, Hongxin [1 ]
Han, Meng [1 ]
Chen, Zhiqiang [1 ]
Li, Muhang [1 ]
Zhang, Xilong [1 ]
机构
[1] North Minzu Univ, Sch Comp Sci & Engn, Yinchuan 750030, Ningxia, Peoples R China
关键词
Multi-label; ensemble classification; data stream; dynamic update; concept; drift; MARGIN; KNN; DIVERSITY;
D O I
10.1145/3570960
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the rapid development of data stream, multi-label algorithms for mining dynamic data become more and more important. At the same time, when data distribution changes, concept drift will occur, which will make the existing classification models lose effectiveness. Ensemble methods have been used for multi-label classification, but few methods consider both the accuracy and diversity of base classifiers. To address the above-mentioned problem, a Weighted Ensemble classification algorithm based on Nearest Neighbors for Multi-Label data stream (WENNML) is proposed. WENNML uses data blocks to train Active candidate Ensemble Classifiers (AEC) and Passive candidate Ensemble Classifiers (PEC). The base classifiers of AEC and PEC are dynamically updated using geometric and diversity weighting methods. When the difference value between the number of current instances and the number of warning instances reaches the passive warning value, the algorithm selects the optimal base classifiers from AEC and PEC according to the subset accuracy and hamming score and puts them into the predictive ensemble classifiers. Experiments are carried out on 12 kinds of datasets with 9 comparison algorithms. The results show that WENNML achieves the best average rankings among the four evaluation metrics.
引用
收藏
页数:21
相关论文
共 58 条
[1]   Adaptive ensemble of self-adjusting nearest neighbor subspaces for multi-label drifting data streams [J].
Alberghini, Gavin ;
Barbon, Sylvio, Jr. ;
Cano, Alberto .
NEUROCOMPUTING, 2022, 481 :228-248
[2]   Fuzzy KNN Method With Adaptive Nearest Neighbors [J].
Bian, Zekang ;
Vong, Chi Man ;
Wong, Pak Kin ;
Wang, Shitong .
IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (06) :5380-5393
[3]  
Bifet A, 2010, JMLR WORKSH CONF PRO, V11, P44
[4]  
Bifet A, 2007, PROCEEDINGS OF THE SEVENTH SIAM INTERNATIONAL CONFERENCE ON DATA MINING, P443
[5]   GOOWE: Geometrically Optimum and Online-Weighted Ensemble Classifier for Evolving Data Streams [J].
Bonab, Hamed R. ;
Can, Fazli .
ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2018, 12 (02)
[6]   Reacting to Different Types of Concept Drift: The Accuracy Updated Ensemble Algorithm [J].
Brzezinski, Dariusz ;
Stefanowski, Jerzy .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2014, 25 (01) :81-94
[7]   A Novel Online Stacked Ensemble for Multi-Label Stream Classification [J].
Buyukcakir, Alican ;
Bonab, Hamed ;
Can, Fazli .
CIKM'18: PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2018, :1063-1072
[8]  
Clare Amanda, 2001, PRINCIPLES DATA MINI, P42
[9]   Considering diversity and accuracy simultaneously for ensemble pruning [J].
Dai, Qun ;
Ye, Rui ;
Liu, Zhuan .
APPLIED SOFT COMPUTING, 2017, 58 :75-91
[10]   Efficient kNN classification algorithm for big data [J].
Deng, Zhenyun ;
Zhu, Xiaoshu ;
Cheng, Debo ;
Zong, Ming ;
Zhang, Shichao .
NEUROCOMPUTING, 2016, 195 :143-148