New applications of ensembles of classifiers

被引:218
作者
Barandela, R [1 ]
Sánchez, JS
Valdovinos, RM
机构
[1] Inst Tecnol Toluca, Metepec, Mexico
[2] Univ Jaume 1, Castellon de La Plana, Spain
关键词
algorithm scalability; ensembles; filtering outliers; imbalanced training sample; nearest neighbour rule; preprocessing techniques;
D O I
10.1007/s10044-003-0192-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Combination (ensembles) of classifiers is now a well established research line. It has been observed that the predictive accuracy of a combination of independent classifiers excels that of the single best classifier. While ensembles of classifiers have been mostly employed to achieve higher recognition accuracy, this paper focuses on the use of combinations of individual classifiers for handling several problems from the practice in the machine learning, pattern recognition and data mining domains. In particular, the study presented concentrates on managing the imbalanced training sample problem, scaling up some preprocessing algorithms and filtering the training set. Here, all these situations are examined mainly in connection with the nearest neighbour classifier. Experimental results show the potential of multiple classifier systems when applied to those situations.
引用
收藏
页码:245 / 256
页数:12
相关论文
共 53 条
[11]   Identifying mislabeled training data [J].
Brodley, CE ;
Friedl, MA .
JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 1999, 11 :131-167
[12]   Another move toward the minimum consistent subset:: A tabu search approach to the condensed nearest neighbor rule [J].
Cerverón, V ;
Ferri, FJ .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2001, 31 (03) :408-413
[13]  
CHAN PK, 1995, P 1 INT C KNOWL DISC, P39
[14]  
CHAUCHAT J, 1998, P JCIS 98 ASS INT MA, P28
[15]   Creating ensembles of classifiers [J].
Chawla, N ;
Eschrich, S ;
Hall, LO .
2001 IEEE INTERNATIONAL CONFERENCE ON DATA MINING, PROCEEDINGS, 2001, :580-581
[16]   SMOTE: Synthetic minority over-sampling technique [J].
Chawla, Nitesh V. ;
Bowyer, Kevin W. ;
Hall, Lawrence O. ;
Kegelmeyer, W. Philip .
2002, American Association for Artificial Intelligence (16)
[17]  
Dasarathy B. V., 1991, IEEE COMPUT SOC TUTO
[18]   MINIMAL CONSISTENT SET (MCS) IDENTIFICATION FOR OPTIMAL NEAREST-NEIGHBOR DECISION SYSTEMS-DESIGN [J].
DASARATHY, BV .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1994, 24 (03) :511-517
[19]   An incremental prototype set building technique [J].
Devi, VS ;
Murty, MN .
PATTERN RECOGNITION, 2002, 35 (02) :505-513
[20]  
Devijver P., 1982, PATTERN RECOGN