Efficient automatically evolving convolutional neural network for image denoising

被引:4
作者
Wei, Fang [1 ]
Zhu, Zhenhao [1 ]
Zhou, Hong [1 ]
Tao, Zhang [2 ]
Jun, Sun [1 ]
Wu, Xiaojun
机构
[1] Jiangnan Univ, Int Joint Lab Artificial Intelligence Jiangsu Prov, Jiangsu Prov Engn Lab Pattern Recognit & Computat, Lihu Ave, Wuxi 214122, Jiangsu, Peoples R China
[2] China Ship Sci Res Ctr, Wuxi 214082, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Image denoising; Convolutional neural network; Neural network architecture design; Evolving neural networks;
D O I
10.1007/s12293-022-00385-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Convolutional neural networks (CNNs) have achieved effective results in image denoising tasks. However, CNN architectures for image denoising tasks are mainly designed manually, which not only relies on CNN-related professional knowledge, but also requires adjustment to different datasets for competitive performance. Algorithms for automatically evolving CNN architectures have been proposed, but most of them are designed for solving image classification tasks and consume considerable computational time and resources. To address these issues, an efficient automatically evolving CNN architecture algorithm for image denoising tasks using genetic algorithm is proposed, which is called fast block-based evolutionary denoising CNN (FBE-DnCNN). In FBE-DnCNN, a genetic encoding strategy based on both deep and wide net blocks is designed to effectively represent the image denoising CNNs for automatic architecture design. With the purpose of solving time-consuming and resource-dependent problems, the partial dataset-based technology is used. A novel refined fitness evaluation method with prior knowledge on parameters of CNNs is designed to improve reliability. For better feature extraction of shallow network layers, convolutional operation, prevention of overfitting, and improvement of the representational capacity, the Feature Block, Transition Block, Dropout Block, and SENet module are introduced in FBE-DnCNN to generate problem-specific search space. With block-specific crossover and mutation, a local search near the good solution is implemented to find better solutions. Experiments show that FBE-DnCNN can evolve distinguished image denoising CNNs with deep and wide architectures in a very short time. FBE-DnCNN achieves competitive performance for the image denoising tasks with different noise levels compared to the traditional approaches, state-of-the-art CNN-based algorithms, and NAS-based methods.
引用
收藏
页码:219 / 235
页数:17
相关论文
共 47 条
  • [31] Shrinkage Fields for Effective Image Restoration
    Schmidt, Uwe
    Roth, Stefan
    [J]. 2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 2774 - 2781
  • [32] Simonyan K, 2015, Arxiv, DOI [arXiv:1409.1556, DOI 10.48550/ARXIV.1409.1556]
  • [33] A Genetic Programming Approach to Designing Convolutional Neural Network Architectures
    Suganuma, Masanori
    Shirakawa, Shinichi
    Nagao, Tomoharu
    [J]. PROCEEDINGS OF THE 2017 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE (GECCO'17), 2017, : 497 - 504
  • [34] Sun Y, 2019, IEEE T NEURAL NETW L
  • [35] IGD Indicator-Based Evolutionary Algorithm for Many-Objective Optimization Problems
    Sun, Yanan
    Yen, Gary G.
    Yi, Zhang
    [J]. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2019, 23 (02) : 173 - 187
  • [36] Completely Automated CNN Architecture Design Based on Blocks
    Sun, Yanan
    Xue, Bing
    Zhang, Mengjie
    Yen, Gary G.
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (04) : 1242 - 1254
  • [37] Szegedy C, 2015, PROC CVPR IEEE, P1, DOI 10.1109/CVPR.2015.7298594
  • [38] Image quality assessment: From error visibility to structural similarity
    Wang, Z
    Bovik, AC
    Sheikh, HR
    Simoncelli, EP
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2004, 13 (04) : 600 - 612
  • [39] Genetic CNN
    Xie, Lingxi
    Yuille, Alan
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 1388 - 1397
  • [40] Yun-Chun Chen, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12363), P442, DOI 10.1007/978-3-030-58523-5_26