CNN-Based Hidden-Layer Topological Structure Design and Optimization Methods for Image Classification

被引:12
作者
Liu, Jian [1 ]
Shao, Haijian [1 ,2 ]
Jiang, Yingtao [3 ]
Deng, Xing [1 ,2 ]
机构
[1] Jiangsu Univ Sci & Technol, Sch Comp, Zhenjiang 212003, Jiangsu, Peoples R China
[2] Southeast Univ, Sch Automat, Minist Educ, Key Lab Measurement & Control CSE, Nanjing 210096, Jiangsu, Peoples R China
[3] Univ Nevada, Dept Elect & Comp Engn, Las Vegas, NV 89154 USA
基金
中国国家自然科学基金;
关键词
Hidden-layer topological optimization; Convolution neural network; Convolution kernel; Image classification;
D O I
10.1007/s11063-022-10742-8
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Convolutional neural networks (CNN) is one of the most important branches of deep learning, which always shows the excellent performance on image classification via unique convolution operations. However, the generalization ability of CNN is always limited due to lack of the specific guidelines in hidden-layer design, Kernel design and Weight initialization design. In this paper, a new topological design method is proposed by analyzing abstract edge information (called texture) in feature map based on the experimental and numerical analysis. Especially, the prior number of convolution kernels in the first layers and combinatorial optimization of all hidden layers are applied to initialize the entire network topology. The experiments based on the MNIST, Chest X-ray and CTs dataset indicate that (1) Traditional CNN layers with doubling nodes are not essential to optimize the hidden-layer topology because of the texture features that extracted from different datasets. (2) Improved hidden-layer topology of the CNN can outperform the better performance in classificationt-asks and improvement up to 30% compared with the benchmark methods. [GRAPHICS] .
引用
收藏
页码:2831 / 2842
页数:12
相关论文
共 28 条
[1]   Face Recognition and Classification Using GoogleNET Architecture [J].
Anand, R. ;
Shanthi, T. ;
Nithish, M. S. ;
Lakshman, S. .
SOFT COMPUTING FOR PROBLEM SOLVING, SOCPROS 2018, VOL 1, 2020, 1048 :261-269
[2]   Traffic Signs Detection for Real-World Application of an Advanced Driving Assisting System Using Deep Learning [J].
Ayachi, Riadh ;
Afif, Mouna ;
Said, Yahia ;
Atri, Mohamed .
NEURAL PROCESSING LETTERS, 2020, 51 (01) :837-851
[3]   A modified YOLOv3 model for fish detection based on MobileNetv1 as backbone [J].
Cai, Kewei ;
Miao, Xinying ;
Wang, Wei ;
Pang, Hongshuai ;
Liu, Ying ;
Song, Jinyan .
AQUACULTURAL ENGINEERING, 2020, 91
[4]  
Cohen J.P., 2020, ARXIV200611988
[5]   A Classification-Detection Approach of COVID-19 Based on Chest X-ray and CT by Using Keras Pre-Trained Deep Learning Models [J].
Deng, Xing ;
Shao, Haijian ;
Shi, Liang ;
Wang, Xia ;
Xie, Tongling .
CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2020, 125 (02) :579-596
[6]  
Dheir I M., 2020, Int. J. Acad. Inf. Syst. Res, V3, P12
[7]  
El-Khatib MJ, 2019, INT J ACAD PEDAGOGIC, V3
[8]  
Farooq M., 2020, ARXIV PREPRINT ARXIV, DOI DOI 10.48550/ARXIV.2003.14395
[9]  
Glorot X, 2010, P 13 INT C ARTIFICIA, P249
[10]  
Kaiming H., 2018, BIOCHEM BIOPH RES CO, V498, p1 254 261, DOI [10.1016/j.bbrc.2018.01.076, DOI 10.1016/J.BBRC.2018.01.076]