Ensemble of ML-KNN for classification algorithm recommendation

被引:25
作者
Zhu, Xiaoyan [1 ]
Ying, Chenzhen [1 ]
Wang, Jiayin [1 ]
Li, Jiaxuan [1 ]
Lai, Xin [1 ]
Wang, Guangtao [2 ]
机构
[1] Xi An Jiao Tong Univ, Sch Comp Sci & Technol, Xian, Peoples R China
[2] JD AI Res, Mountain View, CA USA
基金
中国国家自然科学基金;
关键词
Classification algorithm; Recommendation method; Ensemble learning; LEARNING ALGORITHMS; SELECTION;
D O I
10.1016/j.knosys.2021.106933
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the mountains of classification algorithms proposed in the literature, the study of how to select suitable classifier(s) for a given problem is important and practical. Existing methods rely on a single learner built on one type of meta-features or a simple combination of several types of meta-features to address this problem. In this paper, we propose a two-layer classification algorithm recommendation method called EML (Ensemble of ML-KNN for classification algorithm recommendation) to leverage the diversity of different sets of meta-features. The proposed method can automatically recommend different numbers of appropriate algorithms for different dataset, rather than specifying a fixed number of appropriate algorithm(s) as done by the ML-KNN, SLP-based and OBOE methods. Experimental results on 183 public datasets show the effectiveness of the EML method compared to the three baseline methods. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:10
相关论文
共 54 条
[1]  
Alcalá-Fdez J, 2011, J MULT-VALUED LOG S, V17, P255
[2]   A Case-Based Meta-Learning and Reasoning Framework for Classifiers Selection [J].
Ali, Rahman ;
Khatak, Aasad Masood ;
Chow, Francis ;
Lee, Sungyoung .
PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON UBIQUITOUS INFORMATION MANAGEMENT AND COMMUNICATION (IMCOM 2018), 2018,
[3]   Accurate multi-criteria decision making methodology for recommending machine learning algorithm [J].
Ali, Rahman ;
Lee, Sungyoung ;
Chung, Tae Choong .
EXPERT SYSTEMS WITH APPLICATIONS, 2017, 71 :257-278
[4]   On learning algorithm selection for classification [J].
Ali, S ;
Smith, KA .
APPLIED SOFT COMPUTING, 2006, 6 (02) :119-138
[5]  
[Anonymous], 2007, Machine learning: ECML 2001, DOI DOI 10.1007/3-540-44795-43
[6]  
[Anonymous], P 10 INT C MACHINE L
[7]  
[Anonymous], 2015, Communications
[8]  
[Anonymous], 1984, Classifcation and Regression Trees
[9]  
[Anonymous], 2013, INT J SCI ENG RES
[10]  
Balte A., 2014, International Journal of Computer Applications, V105, P47