Consensus-Based Combining Method for Classifier Ensembles

被引:0
作者
Alzubi, Omar [1 ]
Alzubi, Jafar [2 ]
Tedmori, Sara [3 ]
Rashaideh, Hasan [4 ]
Almomani, Omar [4 ]
机构
[1] Al Balqa Appl Univ, Comp & Network Secur, Salt, Jordan
[2] Al Balqa Appl Univ, Comp Engn Dept, Salt, Jordan
[3] Princess Sumaya Univ, Comp Sci Dept, Amman, Jordan
[4] Al Balqa Appl Univ, Informat Technol, Salt, Jordan
关键词
Artificial intelligence; classification; machine learning; pattern recognition; classifier ensembles; consensus theory; combining methods; majority voting; mean method; product method; MODEL;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, a new method for combining an ensemble of classifiers, called Consensus-based Combining Method (CCM) is proposed and evaluated. As in most other combination methods, the outputs of multiple classifiers are weighted and summed together into a single final classification decision. However, unlike the other methods, CCM adjusts the weights iteratively after comparing all of the classifiers' outputs. Ultimately, all the weights converge to a final set of weights, and the combined output reaches a consensus. The effectiveness of CCM is evaluated by comparing it with popular linear combination methods (majority voting, product, and average method). Experiments are conducted on 14 public data sets, and on a blog spam data set created by the authors. Experimental results show that CCM provides a significant improvement in classification accuracy over the product and average methods. Moreover, results show that the CCM's classification accuracy is better than or comparable to that of majority voting.
引用
收藏
页码:76 / 86
页数:11
相关论文
共 24 条
[1]  
Alzubi J.A., 2015, Res J Appl Sci Eng Technol, V11, P1336, DOI DOI 10.19026/RJASET.11.2241
[2]  
ALZUBI O, 2015, RES J APPL SCI ENG T, V11, P1329, DOI DOI 10.19026/rjaset.11.2240
[3]  
[Anonymous], 2004, COMBINING PATTERN CL, DOI DOI 10.1002/0471660264
[4]  
[Anonymous], ADV SCI TECHNOL LETT
[5]  
[Anonymous], 1998, TECHNICAL REPORT
[6]  
[Anonymous], P UNC ART INT C ANG
[7]  
[Anonymous], P INT C ENG MIS IST
[8]   CONSENSUS THEORETIC CLASSIFICATION METHODS [J].
BENEDIKTSSON, JA ;
SWAIN, PH .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1992, 22 (04) :688-704
[10]   REACHING A CONSENSUS [J].
DEGROOT, MH .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1974, 69 (345) :118-121