INFRARED IMAGE SUPER RESOLUTION WITH DEEP NEURAL NETWORKS

被引:1
作者
Vassilo, Kyle [1 ]
Taha, Tarek [1 ]
Mehmood, Asif [2 ]
机构
[1] Univ Dayton, Dayton, OH 45469 USA
[2] Air Force Res Lab, Wright Patterson AFB, OH USA
来源
2021 11TH WORKSHOP ON HYPERSPECTRAL IMAGING AND SIGNAL PROCESSING: EVOLUTION IN REMOTE SENSING (WHISPERS) | 2021年
关键词
Deep Learning; Super Resolution; Generative Adversarial Network; Infrared Imaging;
D O I
10.1109/WHISPERS52202.2021.9484045
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent studies have shown that Deep Learning (DL) algorithms can significantly improve Super Resolution (SR) performance. Single image SR is useful in producing High Resolution (HR) images from their Low Resolution (LR) counterparts. The motivation for SR is the potential to assist algorithms such as object detection, localization, and classification. Insufficient work has been conducted using Generative Adversarial Networks (GANs) for SR on infrared (IR) images despite its promising ability to increase object detection accuracy by extracting more precise features from a given image. This work adopts the idea of a relativistic GAN that utilizes Residual in Residual Dense blocks (RRDBs) for feature extraction, a novel residual image addition, and a Pixel Transposed Convolutional Layer (PixelTCL) for up-sampling. Recent work has validated the use of GANs for Visible Light (VL) images, making them a strong candidate. The inclusion of these components produce more realistic and natural features while also receiving superior metric values.
引用
收藏
页数:5
相关论文
共 14 条
[1]  
[Anonymous], 2014, PROC NEURAL INF PRO, P2680
[2]  
Asari V.K., 2018, The history began from alexnet: A comprehensive survey on deep learning approaches
[3]   Super-Resolution for Overhead Imagery Using DenseNets and Adversarial Learning [J].
Bosch, Marc ;
Clifford, Christopher M. ;
Rodriguez, Pedro A. .
2018 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2018), 2018, :1414-1422
[4]   Pixel Transposed Convolutional Networks [J].
Gao, Hongyang ;
Yuan, Hao ;
Wang, Zhengyang ;
Ji, Shuiwang .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (05) :1218-1227
[5]  
Jolicoeur-Martineau A., 2018, ARXIV
[6]   Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network [J].
Ledig, Christian ;
Theis, Lucas ;
Huszar, Ferenc ;
Caballero, Jose ;
Cunningham, Andrew ;
Acosta, Alejandro ;
Aitken, Andrew ;
Tejani, Alykhan ;
Totz, Johannes ;
Wang, Zehan ;
Shi, Wenzhe .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :105-114
[7]   FusionGAN: A generative adversarial network for infrared and visible image fusion [J].
Ma, Jiayi ;
Yu, Wei ;
Liang, Pengwei ;
Li, Chang ;
Jiang, Junjun .
INFORMATION FUSION, 2019, 48 :11-26
[8]  
Miyato T., 2018, INT C LEARN REPR
[9]  
Moulay A., 2018, DEEP GENERATIVE ADVE
[10]  
Shi Wenzhe, 2016, IEEE C COMPUTER VISI