Fixed pattern noise reduction for infrared images based on cascade residual attention CNN

被引:72
作者
Guan, Juntao [1 ]
Lai, Rui [1 ]
Xiong, Ai [2 ]
Liu, Zesheng [1 ]
Gu, Lin [3 ]
机构
[1] Xidian Univ, Dept Microelect, Xian 710071, Shaanxi, Peoples R China
[2] Chengdu Univ Informat Technol, Sch Control Engn, Chengdu 610103, Sichuan, Peoples R China
[3] NII, Tokyo 1018430, Japan
关键词
Fixed pattern noise reduction; Convolution neural network; Multi-scale convolution; Visual attention mechanism; ADAPTIVE NONUNIFORMITY CORRECTION; STRIPE NOISE; ALGORITHM;
D O I
10.1016/j.neucom.2019.10.054
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Existing fixed pattern noise reduction (FPNR) methods are easily affected by the motion state of the scene and working condition of the image sensor, which leads to over smooth effects, ghosting artifacts as well as slow convergence rate. To address these issues, we design an innovative cascade convolution neural network (CNN) model with residual skip connections to realize single frame blind FPNR operation without any parameter tuning. Moreover, a coarse-fine convolution (CF-Conv) unit is introduced to extract complementary features in various scales and fuse them to pick more spatial information. Inspired by the success of the visual attention mechanism, we further propose a particular spatial-channel noise attention unit (SCNAU) to separate the scene details from fixed pattern noise more thoroughly and recover the real scene more accurately. Experimental results on test data demonstrate that the proposed cascade CNN-FPNR method outperforms the existing FPNR methods in both of visual effect and quantitative assessment. (c) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:301 / 313
页数:13
相关论文
共 47 条
[1]  
[Anonymous], P IEEE INT S BIOM IM
[2]  
[Anonymous], IEEE T INTELL TRANSP
[3]  
[Anonymous], P AOPC 2017 OPT SENS
[4]  
[Anonymous], ADV COMPUTER VISION
[5]  
[Anonymous], 2015, Tiny ImageNet Visual Recognition Challenge., DOI DOI 10.1109/ICCV.2015.123
[6]  
[Anonymous], P 2017 OPT SENS IM T
[7]   CVCG: Cooperative V2V-Aided Transmission Scheme Based on Coalitional Game for Popular Content Distribution in Vehicular Ad-Hoc Networks [J].
Chen, Chen ;
Hu, Jinna ;
Qiu, Tie ;
Atiquzzaman, Mohammed ;
Ren, Zhiyuan .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2019, 18 (12) :2811-2828
[8]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307
[9]   A combined temporal and spatial deghosting technique in scene based nonuniformity correction [J].
Fan, Fan ;
Ma, Yong ;
Huang, Jun ;
Liu, Zhe ;
Liu, Chengyin .
INFRARED PHYSICS & TECHNOLOGY, 2015, 71 :408-415
[10]   Nonuniformity two-point linear correction errors in infrared focal plane arrays [J].
Friedenberg, A ;
Goldblatt, I .
OPTICAL ENGINEERING, 1998, 37 (04) :1251-1253