Cluster-Oriented Ensemble Classifier: Impact of Multicluster Characterization on Ensemble Classifier Learning

被引:60
作者
Verma, Brijesh [1 ]
Rahman, Ashfaqur [1 ]
机构
[1] Cent Queensland Univ, Ctr Intelligent & Networked Syst, Rockhampton, Qld 4702, Australia
关键词
Ensemble classifier; clustering; classification; fusion of classifiers; FUSION;
D O I
10.1109/TKDE.2011.28
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a novel cluster-oriented ensemble classifier. The proposed ensemble classifier is based on original concepts such as learning of cluster boundaries by the base classifiers and mapping of cluster confidences to class decision using a fusion classifier. The categorized data set is characterized into multiple clusters and fed to a number of distinctive base classifiers. The base classifiers learn cluster boundaries and produce cluster confidence vectors. A second level fusion classifier combines the cluster confidences and maps to class decisions. The proposed ensemble classifier modifies the learning domain for the base classifiers and facilitates efficient learning. The proposed approach is evaluated on benchmark data sets from UCI machine learning repository to identify the impact of multicluster boundaries on classifier learning and classification accuracy. The experimental results and two-tailed sign test demonstrate the superiority of the proposed cluster-oriented ensemble classifier over existing ensemble classifiers published in the literature.
引用
收藏
页码:605 / 618
页数:14
相关论文
共 31 条
[1]  
[Anonymous], 2010, UCI MACH LEARN DAT
[2]  
[Anonymous], LIBSVM LIB SUPPORT V
[3]  
Banfield RE, 2003, LECT NOTES COMPUT SC, V2709, P306
[4]   Random forests [J].
Breiman, L .
MACHINE LEARNING, 2001, 45 (01) :5-32
[5]   Random forests [J].
Breiman, L .
MACHINE LEARNING, 2001, 45 (01) :5-32
[6]  
Caruana R, 2006, ICML 06: proceedings of the 23rd International Conference on Machine Learning, P161, DOI [DOI 10.1145/1143844.1143865, 10.1145/1143844.1143865.]
[7]   Classification Based on Hybridization of Parametric and Nonparametric Classifiers [J].
Chaudhuri, Probal ;
Ghosh, Anil K. ;
Oja, Hannu .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2009, 31 (07) :1153-1164
[8]   A generalized adaptive ensemble generation and aggregation approach for multiple classifier systems [J].
Chen, Lei ;
Kamel, Mohamed S. .
PATTERN RECOGNITION, 2009, 42 (05) :629-644
[9]  
Demsar J, 2006, J MACH LEARN RES, V7, P1
[10]  
FORGY EW, 1965, BIOMETRICS, V21, P768