Image-to-Image Translation for Near-Infrared Image Colorization

被引:0
作者
Kim, Hyeongyu [1 ]
Kim, Jonghyun [1 ]
Kim, Joongkyu [1 ]
机构
[1] Sungkyunkwan Univ, Dept Elect & Comp Engn, Suwon, South Korea
来源
2022 INTERNATIONAL CONFERENCE ON ELECTRONICS, INFORMATION, AND COMMUNICATION (ICEIC) | 2022年
基金
新加坡国家研究基金会;
关键词
Image-to-image translation; Near-infrared image colorization; feature fusion module;
D O I
10.1109/ICEIC54506.2022.9748773
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In the existing near-infrared image colorization methods, the main obstacles are distortion of color consistency and texture. We propose a feature fusion module using multiscale channel attention module (MS-CAM) that extracts edges by Canny filter and fuses two colorized images with feature maps. The proposed method improves the PSNR of NIR2VC compared to the baseline on VSIAD datasets and output has consistency to the exterior wall of the building. Moreover, the proposed method well captures textures in objects. However, when predicting gray color like roads and cars, artifacts are occurred and the output tends to be slightly brighter. This method can also be applied to the field of monitoring such as CCTV and military facilities, as well as thermal imaging cameras with properties similar to near-infrared rays.
引用
收藏
页数:4
相关论文
共 12 条
[1]   VQA: Visual Question Answering [J].
Antol, Stanislaw ;
Agrawal, Aishwarya ;
Lu, Jiasen ;
Mitchell, Margaret ;
Batra, Dhruv ;
Zitnick, C. Lawrence ;
Parikh, Devi .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :2425-2433
[2]   Deep Colorization [J].
Cheng, Zezhou ;
Yang, Qingxiong ;
Sheng, Bin .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :415-423
[3]   Attentional Feature Fusion [J].
Dai, Yimian ;
Gieseke, Fabian ;
Oehmcke, Stefan ;
Wu, Yiquan ;
Barnard, Kobus .
2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, :3559-3568
[4]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[5]   Image-to-Image Translation with Conditional Adversarial Networks [J].
Isola, Phillip ;
Zhu, Jun-Yan ;
Zhou, Tinghui ;
Efros, Alexei A. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5967-5976
[6]   Perceptual Losses for Real-Time Style Transfer and Super-Resolution [J].
Johnson, Justin ;
Alahi, Alexandre ;
Li Fei-Fei .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :694-711
[7]  
Limmer M, 2016, 2016 15TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA 2016), P61, DOI [10.1109/ICMLA.2016.114, 10.1109/ICMLA.2016.0019]
[8]   U-Net: Convolutional Networks for Biomedical Image Segmentation [J].
Ronneberger, Olaf ;
Fischer, Philipp ;
Brox, Thomas .
MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION, PT III, 2015, 9351 :234-241
[9]   High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs [J].
Wang, Ting-Chun ;
Liu, Ming-Yu ;
Zhu, Jun-Yan ;
Tao, Andrew ;
Kautz, Jan ;
Catanzaro, Bryan .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :8798-8807
[10]  
Wu Guangming, 2020, EUROPEAN C COMPUTER