Efficient automatically evolving convolutional neural network for image denoising

被引:4
作者
Wei, Fang [1 ]
Zhu, Zhenhao [1 ]
Zhou, Hong [1 ]
Tao, Zhang [2 ]
Jun, Sun [1 ]
Wu, Xiaojun
机构
[1] Jiangnan Univ, Int Joint Lab Artificial Intelligence Jiangsu Prov, Jiangsu Prov Engn Lab Pattern Recognit & Computat, Lihu Ave, Wuxi 214122, Jiangsu, Peoples R China
[2] China Ship Sci Res Ctr, Wuxi 214082, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Image denoising; Convolutional neural network; Neural network architecture design; Evolving neural networks;
D O I
10.1007/s12293-022-00385-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Convolutional neural networks (CNNs) have achieved effective results in image denoising tasks. However, CNN architectures for image denoising tasks are mainly designed manually, which not only relies on CNN-related professional knowledge, but also requires adjustment to different datasets for competitive performance. Algorithms for automatically evolving CNN architectures have been proposed, but most of them are designed for solving image classification tasks and consume considerable computational time and resources. To address these issues, an efficient automatically evolving CNN architecture algorithm for image denoising tasks using genetic algorithm is proposed, which is called fast block-based evolutionary denoising CNN (FBE-DnCNN). In FBE-DnCNN, a genetic encoding strategy based on both deep and wide net blocks is designed to effectively represent the image denoising CNNs for automatic architecture design. With the purpose of solving time-consuming and resource-dependent problems, the partial dataset-based technology is used. A novel refined fitness evaluation method with prior knowledge on parameters of CNNs is designed to improve reliability. For better feature extraction of shallow network layers, convolutional operation, prevention of overfitting, and improvement of the representational capacity, the Feature Block, Transition Block, Dropout Block, and SENet module are introduced in FBE-DnCNN to generate problem-specific search space. With block-specific crossover and mutation, a local search near the good solution is implemented to find better solutions. Experiments show that FBE-DnCNN can evolve distinguished image denoising CNNs with deep and wide architectures in a very short time. FBE-DnCNN achieves competitive performance for the image denoising tasks with different noise levels compared to the traditional approaches, state-of-the-art CNN-based algorithms, and NAS-based methods.
引用
收藏
页码:219 / 235
页数:17
相关论文
共 47 条
  • [1] [Anonymous], 2012, 2012 IEEE C COMPUTER, DOI DOI 10.1109/CVPR.2012.6247952
  • [2] Real Image Denoising with Feature Attention
    Anwar, Saeed
    Barnes, Nick
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 3155 - 3164
  • [3] Aviris, 2012, INDIANAS INDIAN PINE
  • [4] Baker B., 2016, ARXIV
  • [5] Blickle T., 2000, Evolutionary Computation, V1, P181, DOI DOI 10.13140/RG.2.2.23541.42726
  • [6] Large-Scale Machine Learning with Stochastic Gradient Descent
    Bottou, Leon
    [J]. COMPSTAT'2010: 19TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL STATISTICS, 2010, : 177 - 186
  • [7] Cai H, 2018, AAAI CONF ARTIF INTE, P2787
  • [8] Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restoration
    Chen, Yunjin
    Pock, Thomas
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (06) : 1256 - 1272
  • [9] Image denoising by sparse 3-D transform-domain collaborative filtering
    Dabov, Kostadin
    Foi, Alessandro
    Katkovnik, Vladimir
    Egiazarian, Karen
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (08) : 2080 - 2095
  • [10] Gallistel CR, 1999, J COGNITIVE NEUROSCI, V11, P126