Measuring Diversity and Accuracy in ANN Ensembles

被引:1
作者
Paz Sesmero, M. [1 ]
Manuel Alonso-Weber, Juan [1 ]
Giuliani, Alessandro [2 ]
Armano, Giuliano [2 ]
Sanchis, Araceli [1 ]
机构
[1] Univ Carlos III Madrid, Avd Univ 30, Madrid, Spain
[2] Univ Cagliari, Via Is Maglias 198, Cagliari, Italy
来源
ADVANCES IN ARTIFICIAL INTELLIGENCE, CAEPIA 2018 | 2018年 / 11160卷
关键词
Ensemble of classifiers; Diversity; Accuracy; ANN; CLASSIFICATION; ALGORITHM;
D O I
10.1007/978-3-030-00374-6_11
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Performance of classifier ensembles depends on the precision and on the diversity of the members of the ensemble. In this paper we present an experimental study in which the relationship between the accuracy of the ensemble and both the diversity and the accuracy of base learners is analyzed. We conduct experiments on 8 different ANN ensembles and on 5 multiclass data sets. Experimental results show that a high diversity degree among the base learners does not always imply a high accuracy in the ensemble.
引用
收藏
页码:108 / 117
页数:10
相关论文
共 24 条
[1]   AN IMPROVED ALGORITHM FOR NEURAL-NETWORK CLASSIFICATION OF IMBALANCED TRAINING SETS [J].
ANAND, R ;
MEHROTRA, KG ;
MOHAN, CK ;
RANKA, S .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1993, 4 (06) :962-969
[2]   Selection of relevant features and examples in machine learning [J].
Blum, AL ;
Langley, P .
ARTIFICIAL INTELLIGENCE, 1997, 97 (1-2) :245-271
[3]   Random forests [J].
Breiman, L .
MACHINE LEARNING, 2001, 45 (01) :5-32
[4]  
Dietterich T. G., 1995, Journal of Artificial Intelligence Research, V2, P263
[5]   An experimental comparison of three methods for constructing ensembles of decision trees: Bagging, boosting, and randomization [J].
Dietterich, TG .
MACHINE LEARNING, 2000, 40 (02) :139-157
[6]  
Dietterich TG, 1997, AI MAG, V18, P97
[7]   Ensemble methods in machine learning [J].
Dietterich, TG .
MULTIPLE CLASSIFIER SYSTEMS, 2000, 1857 :1-15
[8]  
Gu SK, 2014, 2014 IEEE SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE IN MULTI-CRITERIA DECISION-MAKING (MCDM), P9, DOI 10.1109/MCDM.2014.7007182
[9]  
Hall M. A., 1999, Proceedings of the Twelfth International Florida AI Research Society Conference, P235
[10]  
Hastie T, 1998, ANN STAT, V26, P451