Influence of the receptive field size on accuracy and performance of a convolutional neural network

被引:13
作者
Gabbasov, Rail [1 ]
Paringer, Rustam [1 ,2 ]
机构
[1] Samara Natl Res Univ, Samara, Russia
[2] RAS, Branch FSRC Crystallog & Photon, Image Proc Syst Inst, Samara, Russia
来源
2020 VI INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY AND NANOTECHNOLOGY (IEEE ITNT-2020) | 2020年
关键词
convolution; neural networks; convolutional network; receptive field; classification; ResNet18; VGG16; RECOGNITION;
D O I
10.1109/ITNT49337.2020.9253219
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Convolutional neural networks (CNNs) have been successfully applied to many tasks such as digit and object recognition. In this paper we study the size of the receptive field of deep convolutional neural networks, in particular, we check the idea of a "redundant" receptive field. We run a set of experiments on two common CNN models - VGG16 and ResNet18 - in order to explore the influence of receptive field size on CNN's training time, accuracy, and performance. We run experiments using the MakiFlow framework on the CALTECH256 dataset. The experiments' results show that the optimization of neural networks (NNs) by reducing the size of the receptive field allows to reduce the NN's training time by 5-7% while maintaining the accuracy of the network.
引用
收藏
页数:4
相关论文
共 12 条
[1]   Efficiency of machine learning algorithms and convolutional neural network for detection of pathological changes in MR images of the brain [J].
Agafonova, Yu D. ;
Gaidel, A., V ;
Zelter, P. M. ;
Kapishnikov, A., V .
COMPUTER OPTICS, 2020, 44 (02) :266-+
[2]   Person tracking algorithm based on convolutional neural network for indoor video surveillance [J].
Bohush, R. ;
Zakharava, I .
COMPUTER OPTICS, 2020, 44 (01) :109-116
[3]  
Dumoulin V, 2018, Arxiv, DOI arXiv:1603.07285
[4]  
Griffin G., 2007, Caltech-256 object category dataset'
[5]  
Ioffe Sergey, 2015, Proceedings of Machine Learning Research, V37, P448, DOI DOI 10.48550/ARXIV.1502.03167
[6]  
Kingma D. P., 2015, P INT C LEARN REPR
[7]   ImageNet Classification with Deep Convolutional Neural Networks [J].
Krizhevsky, Alex ;
Sutskever, Ilya ;
Hinton, Geoffrey E. .
COMMUNICATIONS OF THE ACM, 2017, 60 (06) :84-90
[8]  
Le H., 2017, WHAT ARE RECEP UNPUB
[9]   Backpropagation Applied to Handwritten Zip Code Recognition [J].
LeCun, Y. ;
Boser, B. ;
Denker, J. S. ;
Henderson, D. ;
Howard, R. E. ;
Hubbard, W. ;
Jackel, L. D. .
NEURAL COMPUTATION, 1989, 1 (04) :541-551
[10]   Subject independent facial expression recognition with robust face detection using a convolutional neural network [J].
Matsugu, M ;
Mori, K ;
Mitari, Y ;
Kaneda, Y .
NEURAL NETWORKS, 2003, 16 (5-6) :555-559