Mining interpretable rules with MCRM: A novel rule mining algorithm with inherent feature selection and discretization

被引:0
作者
Khosravi, Mohammadreza [1 ]
Basiri, Alireza [1 ]
机构
[1] Isfahan Univ Technol, Dept Elect & Comp Engn, Esfahan 8415683111, Iran
关键词
Data mining; Rule-based classification; Artificial bee colony; Multivariate discretization; Feature selection; DIFFERENTIAL EVOLUTION; OPTIMIZATION; CLASSIFICATION;
D O I
10.1016/j.ins.2024.121785
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper presents MCRM, a new meta-heuristic rule learning algorithm based on the Pittsburgh approach. MCRM extracts all rules simultaneously with a single execution of a meta-heuristic algorithm. The proposed algorithm uses the artificial bee colony (ABC) as a meta-heuristic optimization algorithm. In the MCRM algorithm, classification rules are extracted as a result of a multivariate discretization process and the task of the ABC optimization algorithm is to guide the discretization process. The introduced structure for rule learning guarantees that the extracted rules are mutually exclusive. It also allows the algorithm to ignore the less important features while learning the rules and perform the feature selection operation implicitly. Also, the algorithm uses a special post-pruning step for pruning the final rules, which helps to increase the interpretability of the final rules by reducing the number and length of the rules. The proposed algorithm is compared with 15 other classification algorithms on 32 datasets from the OpenML website and the UCI machine learning repository. The experimental results show the promising performance of the proposed algorithm compared to other classifiers applied in the experiments.
引用
收藏
页数:23
相关论文
共 50 条
[1]  
AL-Behadili HNK, 2020, Journal of Computer Science, V16, P1019, DOI 10.3844/jcssp.2020.1019.1028
[2]  
Alkeshuosh AH, 2017, 2017 INTERNATIONAL CONFERENCE ON COMPUTER AND APPLICATIONS (ICCA), P306, DOI 10.1109/COMAPP.2017.8079784
[3]   Imperialist competitive algorithm: An algorithm for optimization inspired by imperialistic competition [J].
Atashpaz-Gargari, Esmaeil ;
Lucas, Caro .
2007 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION, VOLS 1-10, PROCEEDINGS, 2007, :4661-4667
[4]   Spider Monkey Optimization algorithm for numerical optimization [J].
Bansal, Jagdish Chand ;
Sharma, Harish ;
Jadon, Shimpi Singh ;
Clerc, Maurice .
MEMETIC COMPUTING, 2014, 6 (01) :31-47
[5]  
Basiri J., 2010, Proceedings 2010 IEEE 13th International Conference on Computational Science and Engineering (CSE 2010), P64, DOI 10.1109/CSE.2010.18
[6]  
Basiri J., 2012, 2012 6 INT S TEL IST, P867
[7]   RACER: accurate and efficient classification based on rule aggregation approach [J].
Basiri, Javad ;
Taghiyareh, Fattaneh ;
Faili, Heshaam .
NEURAL COMPUTING & APPLICATIONS, 2019, 31 (03) :895-908
[8]  
Basiri J, 2014, 2014 4TH INTERNATIONAL CONFERENCE ON COMPUTER AND KNOWLEDGE ENGINEERING (ICCKE), P462, DOI 10.1109/ICCKE.2014.6993417
[9]   Defining a standard for particle swarm optimization [J].
Bratton, Daniel ;
Kennedy, James .
2007 IEEE SWARM INTELLIGENCE SYMPOSIUM, 2007, :120-+
[10]   An evolutionary framework for machine learning applied to medical data [J].
Castellanos-Garzon, Jose A. ;
Costa, Ernesto ;
Luis Jaimes, Jose S. ;
Corchado, Juan M. .
KNOWLEDGE-BASED SYSTEMS, 2019, 185