Increasing the Receptive Field of Neurons in Convolutional Neural Networks

被引:0
作者
Shapovalova, S. [1 ]
Moskalenko, Yu. [1 ]
Baranichenko, O. [1 ]
机构
[1] Natl Tech Univ Ukraine, Igor Sikorsky Kyiv Polytech Inst, Kiev, Ukraine
关键词
convolutional neural networks; ResNet; EfficientNet; WaveNet; receptive field;
D O I
10.1007/s10559-023-00568-0
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The convolutional neural network architectures for classifying 1D and 2D signals are analyzed. The authors have found that for a high-dimensional input signal, one can ensure an adequate classification accuracy only by using a large number of layers. It is impossible to achieve the required accuracy with limited computing resources. However, if the number of layers is limited, the accuracy decreases, starting from some critical dimensionality value. A method for modifying a convolutional neural network with relatively small number of layers to solve this problem has been proposed. Its effectiveness has been experimentally proved.
引用
收藏
页码:339 / 345
页数:7
相关论文
共 15 条
[1]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[2]  
Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/TPAMI.2019.2913372, 10.1109/CVPR.2018.00745]
[3]  
kaggle, WAV SHIFTED RFC PROB
[4]  
kaggle, Kaggle competition
[5]   Searching for Fast Model Families on Datacenter Accelerators [J].
Li, Sheng ;
Tan, Mingxing ;
Pang, Ruoming ;
Li, Andrew ;
Cheng, Liqun ;
Le, Quoc, V ;
Jouppi, Norman P. .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :8081-8091
[6]  
Oord A, 2016, ARXIV PREPRINT ARXIV
[7]   TResNet: High Performance GPU-Dedicated Architecture [J].
Ridnik, Tal ;
Lawen, Hussam ;
Noy, Asaf ;
Ben, Emanuel ;
Sharir, Baruch Gilad ;
Friedman, Itamar .
2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021), 2021, :1399-1408
[8]   Tversky Loss Function for Image Segmentation Using 3D Fully Convolutional Deep Networks [J].
Salehi, Seyed Sadegh Mohseni ;
Erdogmus, Deniz ;
Gholipour, Ali .
MACHINE LEARNING IN MEDICAL IMAGING (MLMI 2017), 2017, 10541 :379-387
[9]  
Shapovalova S., 2020, SCIENCERISE, P10, DOI [10.21303/2313-8416.2020.001550, DOI 10.21303/2313-8416.2020.001550]
[10]  
Sorensen T., 1948, K DANSKE VIDENSK SEL, V5, P1, DOI DOI 10.1234/12345678