A novel hybrid CNN-SVM classifier for recognizing handwritten digits

被引:476
作者
Niu, Xiao-Xiao [1 ]
Suen, Ching Y. [1 ]
机构
[1] Concordia Univ, Ctr Pattern Recognit & Machine Intelligence, Montreal, PQ H3G 1M8, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Hybrid model; Convolutional Neural Network; Support Vector Machine; Handwritten digit recognition;
D O I
10.1016/j.patcog.2011.09.021
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a hybrid model of integrating the synergy of two superior classifiers: Convolutional Neural Network (CNN) and Support Vector Machine (SVM), which have proven results in recognizing different types of patterns. In this model, CNN works as a trainable feature extractor and SVM performs as a recognizer. This hybrid model automatically extracts features from the raw images and generates the predictions. Experiments have been conducted on the well-known MNIST digit database. Comparisons with other studies on the same database indicate that this fusion has achieved better results: a recognition rate of 99.81% without rejection, and a recognition rate of 94.40% with 5.60% rejection. These performances have been analyzed with reference to those by human subjects. (C) 2011 Elsevier Ltd. All rights reserved.
引用
收藏
页码:1318 / 1325
页数:8
相关论文
共 20 条
[1]  
[Anonymous], MNIST DATABASE HANDW
[2]   Rejection strategy for convolutional neural network by adaptive topology applied to handwritten digits recognition [J].
Cecotti, H ;
Belaïd, A .
EIGHTH INTERNATIONAL CONFERENCE ON DOCUMENT ANALYSIS AND RECOGNITION, VOLS 1 AND 2, PROCEEDINGS, 2005, :765-769
[3]   LIBSVM: A Library for Support Vector Machines [J].
Chang, Chih-Chung ;
Lin, Chih-Jen .
ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2011, 2 (03)
[4]  
Cherkassky V, 1997, IEEE Trans Neural Netw, V8, P1564, DOI 10.1109/TNN.1997.641482
[5]  
Ciresan DC., 2010, CoRR
[6]  
Dong J. X., HEROSVM 2 1
[7]  
Hastie T, 1998, ANN STAT, V26, P451
[8]   A comparison of methods for multiclass support vector machines [J].
Hsu, CW ;
Lin, CJ .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2002, 13 (02) :415-425
[9]   Deformation models for image recognition [J].
Keysers, Daniel ;
Deselaers, Thomas ;
Gollan, Christian ;
Ney, Hermann .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2007, 29 (08) :1422-1435
[10]   A trainable feature extractor for handwritten digit recognition [J].
Lauer, Fabien ;
Suen, Ching Y. ;
Bloch, Gerard .
PATTERN RECOGNITION, 2007, 40 (06) :1816-1824