ConvXGB: A new deep learning model for classification problems based on CNN and XGBoost

被引:47
作者
Thongsuwan, Setthanun [1 ]
Jaiyen, Saichon [1 ]
Padcharoen, Anantachai [2 ]
Agarwal, Praveen [3 ]
机构
[1] King Mongkuts Inst Technol Ladkrabang, Dept Comp Sci, Adv Artificial Intelligence AAI Res Lab, Bangkok 10520, Thailand
[2] Rambhai Barni Rajabhat Univ, Fac Sci, Dept Math, Chanthaburi 22000, Thailand
[3] Anand Int Coll Engn, Dept Math, Jaipur 303012, Rajasthan, India
关键词
Convolutional neural network (CNN); Classification algorithms; Deep learning; Extreme gradient boosting; XGBoost; Machine learning; Pattern recognition;
D O I
10.1016/j.net.2020.04.008
中图分类号
TL [原子能技术]; O571 [原子核物理学];
学科分类号
0827 ; 082701 ;
摘要
We describe a new deep learning model - Convolutional eXtreme Gradient Boosting (ConvXGB) for classification problems based on convolutional neural nets and Chen et al.'s XGBoost. As well as image data, ConvXGB also supports the general classification problems, with a data preprocessing module. ConvXGB consists of several stacked convolutional layers to learn the features of the input and is able to learn features automatically, followed by XGBoost in the last layer for predicting the class labels. The ConvXGB model is simplified by reducing the number of parameters under appropriate conditions, since it is not necessary re-adjust the weight values in a back propagation cycle. Experiments on several data sets from UCL Repository, including images and general data sets, showed that our model handled the classification problems, for all the tested data sets, slightly better than CNN and XGBoost alone and was sometimes significantly better. (C) 2020 Korean Nuclear Society, Published by Elsevier Korea LLC.
引用
收藏
页码:522 / 531
页数:10
相关论文
共 44 条
[1]  
Abadi M, 2015, TensorFlow: LargeScale Machine Learning on Heterogeneous Systems
[2]   Computer aided diagnosis of diabetic foot using infrared thermography: A review [J].
Adam, Muhammad ;
Ng, Eddie Y. K. ;
Tan, Jen Hong ;
Heng, Marabelle L. ;
Tong, Jasper W. K. ;
Acharya, U. Rajendra .
COMPUTERS IN BIOLOGY AND MEDICINE, 2017, 91 :326-336
[3]   An Analysis of Intrinsic and Extrinsic Hand Muscle EMG for Improved Pattern Recognition Control [J].
Adewuyi, Adenike A. ;
Hargrove, Levi J. ;
Kuiken, Todd A. .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2016, 24 (04) :485-494
[4]   A New Intrusion Detection System Based on Fast Learning Network and Particle Swarm Optimization [J].
Ali, Mohammed Hasan ;
Al Mohammed, Bahaa Abbas Dawood ;
Ismail, Alyani ;
Zolkipli, Mohamad Fadli .
IEEE ACCESS, 2018, 6 :20255-20261
[5]  
[Anonymous], 2011, Acm T. Intel. Syst. Tec., DOI DOI 10.1145/1961189.1961199
[6]  
Asuncion Arthur, 2007, Uci machine learning repository
[7]   Representation Learning: A Review and New Perspectives [J].
Bengio, Yoshua ;
Courville, Aaron ;
Vincent, Pascal .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (08) :1798-1828
[8]  
Breiman L., 1984, Classification and Regression Trees, DOI [DOI 10.1201/9781315139470, 10.1201/9781315139470]
[9]   Computer vision and deep learning techniques for pedestrian detection and tracking: A survey [J].
Brunetti, Antonio ;
Buongiorno, Domenico ;
Trotta, Gianpaolo Francesco ;
Bevilacqua, Vitoantonio .
NEUROCOMPUTING, 2018, 300 :17-33
[10]  
Cambria E., RECENT TRENDS DEEP L, V1708