A novel hybrid CNN-SVM classifier for recognizing handwritten digits

被引:467
作者
Niu, Xiao-Xiao [1 ]
Suen, Ching Y. [1 ]
机构
[1] Concordia Univ, Ctr Pattern Recognit & Machine Intelligence, Montreal, PQ H3G 1M8, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Hybrid model; Convolutional Neural Network; Support Vector Machine; Handwritten digit recognition;
D O I
10.1016/j.patcog.2011.09.021
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a hybrid model of integrating the synergy of two superior classifiers: Convolutional Neural Network (CNN) and Support Vector Machine (SVM), which have proven results in recognizing different types of patterns. In this model, CNN works as a trainable feature extractor and SVM performs as a recognizer. This hybrid model automatically extracts features from the raw images and generates the predictions. Experiments have been conducted on the well-known MNIST digit database. Comparisons with other studies on the same database indicate that this fusion has achieved better results: a recognition rate of 99.81% without rejection, and a recognition rate of 94.40% with 5.60% rejection. These performances have been analyzed with reference to those by human subjects. (C) 2011 Elsevier Ltd. All rights reserved.
引用
收藏
页码:1318 / 1325
页数:8
相关论文
共 20 条
  • [1] [Anonymous], MNIST DATABASE HANDW
  • [2] Rejection strategy for convolutional neural network by adaptive topology applied to handwritten digits recognition
    Cecotti, H
    Belaïd, A
    [J]. EIGHTH INTERNATIONAL CONFERENCE ON DOCUMENT ANALYSIS AND RECOGNITION, VOLS 1 AND 2, PROCEEDINGS, 2005, : 765 - 769
  • [3] LIBSVM: A Library for Support Vector Machines
    Chang, Chih-Chung
    Lin, Chih-Jen
    [J]. ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2011, 2 (03)
  • [4] Cherkassky V, 1997, IEEE Trans Neural Netw, V8, P1564, DOI 10.1109/TNN.1997.641482
  • [5] Ciresan DC., 2010, CoRR
  • [6] Dong J. X., HEROSVM 2 1
  • [7] Hastie T, 1998, ANN STAT, V26, P451
  • [8] A comparison of methods for multiclass support vector machines
    Hsu, CW
    Lin, CJ
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2002, 13 (02): : 415 - 425
  • [9] Deformation models for image recognition
    Keysers, Daniel
    Deselaers, Thomas
    Gollan, Christian
    Ney, Hermann
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2007, 29 (08) : 1422 - 1435
  • [10] A trainable feature extractor for handwritten digit recognition
    Lauer, Fabien
    Suen, Ching Y.
    Bloch, Gerard
    [J]. PATTERN RECOGNITION, 2007, 40 (06) : 1816 - 1824