Single infrared image stripe removal via deep multi-scale dense connection convolutional neural network

被引:20
|
作者
Xu, Kai [1 ,2 ,3 ,4 ]
Zhao, Yaohong [1 ,2 ,3 ]
Li, Fangzhou [1 ,2 ,3 ,4 ]
Xiang, Wei [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Key Lab Optoelect Informat Proc, Shenyang 110016, Peoples R China
[2] Chinese Acad Sci, Shenyang Inst Automat, Shenyang 110016, Peoples R China
[3] Chinese Acad Sci, Inst Robot & Intelligent Mfg, Shenyang 110169, Peoples R China
[4] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
关键词
Infrared image; Stripe noise removal; Deep learning; Dense connection; Multi-scale feature; NONUNIFORMITY CORRECTION; NOISE REMOVAL;
D O I
10.1016/j.infrared.2021.104008
中图分类号
TH7 [仪器、仪表];
学科分类号
0804 ; 080401 ; 081102 ;
摘要
Stripe noise removal is a crucial step for the infrared imaging system. Existing stripe removal methods are hard to balance stripe removal and image details preservation. In this paper, a deep multi-scale dense connection convolutional neural network (DMD-CNN) is proposed to address this problem. In DMD-CNN, a multi-scale feature representation unit (FR-Unit) is designed to decompose raw image into different scales which can extract diverse fine and coarse features. Dense connection is introduced into the network, which makes full use of the multi-scale information obtained by FR-Unit and avoids performance degradation. Moreover, the regularization term Lh is defined to depict the vertical direction smoothness property of stripe. Experiment results show that DMD-CNN performs more stable stripe removal effects in different scenes and diverse stripe intensity. Meanwhile, DMD-CNN outperforms seven state-of-the-art stripe removal methods on qualitative and quantitative evaluation.
引用
收藏
页数:11
相关论文
共 50 条
  • [11] Deep Convolutional Neural Network Based on Multi-Scale Feature Extraction for Image Denoising
    Zhang, Jing
    Sang, Liu
    Wan, Zekang
    Wang, Yuchen
    Li, Yunsong
    2020 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2020, : 213 - 216
  • [12] A Deep Multi-scale Convolutional Neural Network for Classifying Heartbeats
    Bai, Mengyao
    Xu, Yongjun
    Wang, Lianyan
    Wei, Zhihui
    2018 11TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI 2018), 2018,
  • [13] Single Image Super-Resolution Using Multi-scale Convolutional Neural Network
    Jia, Xiaoyi
    Xu, Xiangmin
    Cai, Bolun
    Guo, Kailing
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2017, PT I, 2018, 10735 : 149 - 157
  • [14] Single Infrared Image Stripe Removal via Residual Attention Network
    Ding, Dan
    Li, Ye
    Zhao, Peng
    Li, Kaitai
    Jiang, Sheng
    Liu, Yanxiu
    SENSORS, 2022, 22 (22)
  • [15] Single Image Dehazing via Multi-scale Convolutional Neural Networks with Holistic Edges
    Wenqi Ren
    Jinshan Pan
    Hua Zhang
    Xiaochun Cao
    Ming-Hsuan Yang
    International Journal of Computer Vision, 2020, 128 : 240 - 259
  • [16] Single Image Dehazing via Multi-scale Convolutional Neural Networks with Holistic Edges
    Ren, Wenqi
    Pan, Jinshan
    Zhang, Hua
    Cao, Xiaochun
    Yang, Ming-Hsuan
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2020, 128 (01) : 240 - 259
  • [17] Multi-Scale Visual Attention Deep Convolutional Neural Network for Multi-Focus Image Fusion
    Lai, Rui
    Li, Yongxue
    Guan, Juntao
    Xiong, Ai
    IEEE ACCESS, 2019, 7 : 114385 - 114399
  • [18] MULTI-SCALE 3D DEEP CONVOLUTIONAL NEURAL NETWORK FOR HYPERSPECTRAL IMAGE CLASSIFICATION
    He, Mingyi
    Li, Bo
    Chen, Huahui
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 3904 - 3908
  • [19] Memory-efficient multi-scale residual dense network for single image rain removal
    Zheng, Ziyang
    Chen, Zhixiang
    Wang, Shuqi
    Wang, Wenpeng
    Wang, Hui
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2023, 235
  • [20] Multi-scale convolutional neural network for multi-focus image fusion
    Mustafa, Hafiz Tayyab
    Yang, Jie
    Zareapoor, Masoumeh
    IMAGE AND VISION COMPUTING, 2019, 85 : 26 - 35