VISIBLE AND INFRARED IMAGE FUSION USING ENCODER-DECODER NETWORK

被引:5
作者
Ataman, Ferhat Can [1 ]
Bozdagi Akar, Gozde [1 ]
机构
[1] Middle East Tech Univ, Ankara, Turkey
来源
2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP) | 2021年
关键词
infrared; visible images; image fusion; deep learning; encoder-decoder network;
D O I
10.1109/ICIP42928.2021.9506740
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The aim of multispectral image fusion is to combine object or scene features of images with different spectral characteristics to increase the perceptual quality. In this paper, we present a novel learning-based solution to image fusion problem focusing on infrared and visible spectrum images. The proposed solution utilizes only convolution and pooling layers together with a loss function using no-reference quality metrics. The analysis is performed qualitatively and quantitatively on various datasets. The results show better performance than stateof-the-art methods. Also, the size of our network enables real-time performance on embedded devices. Project codes can be found at https://github.com/ferhatcan/ pyFusionSR.
引用
收藏
页码:1779 / 1783
页数:5
相关论文
共 20 条
[1]   Two-scale image fusion of visible and infrared images using saliency detection [J].
Bavirisetti, Durga Prasad ;
Dhuli, Ravindra .
INFRARED PHYSICS & TECHNOLOGY, 2016, 76 :52-64
[2]   Bland-AltmanAnalysis of Different Radiographic Measurements of the Hallux Valgus Angle and the Intermetatarsal Angle After Distal Osteotomy [J].
Cao, Xuhan ;
Bai, Zixing ;
Sun, Chengyi ;
Wen, Jianmin ;
Lin, Xinxiao ;
Sun, Weidong .
ORTHOPAEDIC SURGERY, 2020, 12 (06) :1621-1626
[3]  
Fu Yu, 2021, DUAL BRANCH NETWORK
[4]  
Hwang S., 2015, P IEEE C COMP VIS PA
[5]  
Kingma DP, 2014, ADV NEUR IN, V27
[6]   RFN-Nest: An end-to-end residual fusion network for infrared and visible images [J].
Li, Hui ;
Wu, Xiao-Jun ;
Kittler, Josef .
INFORMATION FUSION, 2021, 73 :72-86
[7]   Infrared and visible image fusion with ResNet and zero-phase component analysis [J].
Li, Hui ;
Wu, Xiao-jun ;
Durrani, Tariq S. .
INFRARED PHYSICS & TECHNOLOGY, 2019, 102
[8]  
Li H, 2018, INT C PATT RECOG, P2705, DOI 10.1109/ICPR.2018.8546006
[9]   Image Fusion with Guided Filtering [J].
Li, Shutao ;
Kang, Xudong ;
Hu, Jianwen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2013, 22 (07) :2864-2875
[10]   Objective Assessment of Multiresolution Image Fusion Algorithms for Context Enhancement in Night Vision: A Comparative Study [J].
Liu, Zheng ;
Blasch, Erik ;
Xue, Zhiyun ;
Zhao, Jiying ;
Laganiere, Robert ;
Wu, Wei .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (01) :94-109