Single infrared image super-resolution based on lightweight multi-path feature fusion network

被引:0
作者
Mo, Fei [1 ,2 ]
Wu, Heng [1 ,2 ]
Qu, Shuo [1 ,2 ]
Luo, Shaojuan [3 ]
Cheng, Lianglun [1 ,2 ]
机构
[1] Guangdong Univ Technol, Sch Automat, Guangdong Prov Key Lab Cyber Phys Syst, Guangzhou 510006, Peoples R China
[2] Guangdong Univ Technol, Sch Comp, Guangzhou, Peoples R China
[3] Guangdong Univ Technol, Sch Chem Engn & Light Ind, Guangzhou 510006, Peoples R China
基金
中国国家自然科学基金;
关键词
ENHANCEMENT;
D O I
10.1049/ipr2.12454
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Single infrared (IR) image super-resolution methods can help to reduce the cost and difficulty in manufacturing IR sensors for the imaging system. However, the deep learning-based image SR methods need to build a complex network and thus consume a lot of computational power, which limits the application of SR technology on devices with low computing resources in practice. To solve this problem, the authors present a lightweight multi-path feature fusion network (MFFN) for the single infrared (IR) image SR. A multi-path feature fusion block (MFFB) is developed to extract and fuse multiple and discriminative features in a recursive feedback way. Specifically, the multiple features are refined via the linear feature extraction branch, shared-source residual feature extraction branch, and channel attention branch in MFFB. Finally, the authors reconstruct the high-resolution IR images from the low-resolution counterpart based on the refined multiple features. The experimental results demonstrate that MFFN achieves high-quality single infrared image SR and shows superiority over previous methods for several scale factors (e.g. x2, x3, and x4). MFFN has potential applications in the mobile infrared imaging system.
引用
收藏
页码:1880 / 1896
页数:17
相关论文
共 52 条
[1]   Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Network [J].
Ahn, Namhyuk ;
Kang, Byungkon ;
Sohn, Kyung-Ah .
COMPUTER VISION - ECCV 2018, PT X, 2018, 11214 :256-272
[2]   A saliency-based multiscale approach for infrared and visible image fusion [J].
Chen, Jun ;
Wu, Kangle ;
Cheng, Zhuo ;
Luo, Linbo .
SIGNAL PROCESSING, 2021, 182
[3]   OPTICAL SYMBOLIC SUBSTITUTION - EDGE-DETECTION USING PREWITT, SOBEL, AND ROBERTS OPERATORS [J].
CHERRI, AK ;
KARIM, MA .
APPLIED OPTICS, 1989, 28 (21) :4644-4648
[4]  
Choi Y, 2016, 2016 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2016), P223, DOI 10.1109/IROS.2016.7759059
[5]   Second-order Attention Network for Single Image Super-Resolution [J].
Dai, Tao ;
Cai, Jianrui ;
Zhang, Yongbing ;
Xia, Shu-Tao ;
Zhang, Lei .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :11057-11066
[6]   Stimulus-driven and concept-driven analysis for image caption generation [J].
Ding, Songtao ;
Qu, Shiru ;
Xi, Yuling ;
Wan, Shaohua .
NEUROCOMPUTING, 2020, 398 :520-530
[7]   Accelerating the Super-Resolution Convolutional Neural Network [J].
Dong, Chao ;
Loy, Chen Change ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :391-407
[8]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307
[9]   Deep learning enhancement of infrared face images using generative adversarial networks [J].
Guei, Axel-Christian ;
Akhloufi, Moulay .
APPLIED OPTICS, 2018, 57 (18) :D98-D107
[10]   Infrared image super-resolution using auxiliary convolutional neural network and visible image under low-light conditions [J].
Han, Tae Young ;
Kim, Dae Ha ;
Lee, Seung Hyun ;
Song, Byung Cheol .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2018, 51 :191-200