MC3: A Multi-class Consensus Classification Framework

被引:1
作者
Chakraborty, Tanmoy [1 ]
Chandhok, Des [1 ]
Subrahmanian, V. S. [1 ]
机构
[1] Univ Maryland, College Pk, MD 20742 USA
来源
ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2017, PT I | 2017年 / 10234卷
关键词
Ensemble learning; Consensus; Multi-class classification; ENSEMBLE; STACKING;
D O I
10.1007/978-3-319-57454-7_27
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose MC3, an ensemble framework for multi-class classification. MC3 is built on "consensus learning", a novel learning paradigm where each individual base classifier keeps on improving its classification by exploiting the outcomes obtained from other classifiers until a consensus is reached. Based on this idea, we propose two algorithms, MC3-R and MC3-S that make different trade-offs between quality and runtime. We conduct rigorous experiments comparing MC3-R and MC3-S with 12 baseline classifiers on 13 different datasets. Our algorithms perform as well or better than the best baseline classifier, achieving on average, a 5.56% performance improvement. Moreover, unlike existing baseline algorithms, our algorithms also improve the performance of individual base classifiers up to 10%. (The code is available at https://github.com/MC3-code.)
引用
收藏
页码:343 / 355
页数:13
相关论文
共 21 条
[1]   Searching for exotic particles in high-energy physics with deep learning [J].
Baldi, P. ;
Sadowski, P. ;
Whiteson, D. .
NATURE COMMUNICATIONS, 2014, 5
[2]   Large-Scale Machine Learning with Stochastic Gradient Descent [J].
Bottou, Leon .
COMPSTAT'2010: 19TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL STATISTICS, 2010, :177-186
[3]   Random forests [J].
Breiman, L .
MACHINE LEARNING, 2001, 45 (01) :5-32
[4]  
Cai X, 2012, LECT NOTES COMPUT SC, V7577, P823, DOI 10.1007/978-3-642-33783-3_59
[5]  
Cannings T.I., 2015, RANDOM PROJECTION EN
[6]   A dynamic ensemble approach to robust classification in the presence of missing data [J].
Conroy, Bryan ;
Eshelman, Larry ;
Potes, Cristhian ;
Xu-Wilson, Minnan .
MACHINE LEARNING, 2016, 102 (03) :443-463
[7]  
Dzeroski S, 2004, MACH LEARN, V54, P255, DOI 10.1023/B.MAC.0000015881.36452.6e
[8]  
Gill R, 2010, BMC BIOINFORMATICS, V11, DOI [10.1186/1471-2105-11-427, 10.1186/1471-2105-11-95]
[9]   Margin-based ordered aggregation for ensemble pruning [J].
Guo, Li ;
Boukir, Samia .
PATTERN RECOGNITION LETTERS, 2013, 34 (06) :603-609
[10]   Effective Diagnosis of Coronary Artery Disease Using The Rotation Forest Ensemble Method [J].
Karabulut, Esra Mahsereci ;
Ibrikci, Turgay .
JOURNAL OF MEDICAL SYSTEMS, 2012, 36 (05) :3011-3018