Maintaining filter structure: A Gabor-based convolutional neural network for image analysis

被引:19
作者
Molaei, Somayeh [1 ,2 ]
Abadi, Mohammad Ebrahim Shiri Ahmad [2 ]
机构
[1] Univ Michigan, Dept Comp Sci & Engn, Ann Arbor, MI 48105 USA
[2] Amirkabir Univ Technol, Dept Comp Sci, Tehran, Iran
关键词
Convolutional neural networks; Image segmentation; Deep learning; Gabor filter; LEFT-VENTRICLE; CARDIAC MR; SEGMENTATION; EFFICIENT; DESIGN;
D O I
10.1016/j.asoc.2019.105960
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In image segmentation and classification tasks, utilizing filters based on the target object improves performance and requires less training data. We use the Gabor filter as initialization to gain more discriminative power. Considering the mechanism of the error backpropagation procedure to learn the data, after a few updates, filters will lose their initial structure. In this paper, we modify the updating rule in Gradient Descent to maintain the properties of Gabor filters. We use the Left Ventricle (LV) segmentation task and handwritten digit classification task to evaluate our proposed method. We compare Gabor initialization with random initialization and transfer learning initialization using convolutional autoencoders and convolutional networks. We experimented with noisy data and we reduced the amount of training data to compare how different methods of initialization can deal with these matters. The results show that the pixel predictions for the segmentation task are highly correlated with the ground truth. In the classification task, in addition to Gabor and random initialization, we initialized the network using pre-trained weights obtained from a convolutional Autoencoder using two different data sets and pre-trained weights obtained from a convolutional neural network. The experiments confirm the out-performance of Gabor filters comparing to the other initialization method even when using noisy inputs and a lesser amount of training data. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页数:14
相关论文
共 65 条
[1]   Convolutional Neural Networks for Speech Recognition [J].
Abdel-Hamid, Ossama ;
Mohamed, Abdel-Rahman ;
Jiang, Hui ;
Deng, Li ;
Penn, Gerald ;
Yu, Dong .
IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2014, 22 (10) :1533-1545
[2]   Efficient and generalizable statistical models of shape and appearance for analysis of cardiac MRI [J].
Andreopoulos, Alexander ;
Tsotsos, John K. .
MEDICAL IMAGE ANALYSIS, 2008, 12 (03) :335-357
[3]  
[Anonymous], 2012, American Journal of Biomedical Engineering, DOI [DOI 10.5923/j.ajbe.20120203.07, DOI 10.5923/J.AJBE.20120203.07]
[4]  
[Anonymous], 2013, ARXIV13021700
[5]  
[Anonymous], ARXIV170807747
[6]  
[Anonymous], 2015, Deep learn. nat., DOI [10.1038/nature14539, DOI 10.1038/NATURE14539]
[7]  
[Anonymous], 2013, 31 INT C MACH LEARN
[8]  
[Anonymous], ARXIV150506795
[9]  
[Anonymous], 2007, 8 ANN C INT SPEECH C
[10]  
[Anonymous], IAPR WORKSH MACH VIS