Frequency-Aware Axial-ShiftedNet in Generative Adversarial Networks for Visible-to-Infrared Image Translation

被引:0
作者
Lin, Hsi-Ju [1 ]
Cheng, Wei-Yuan [2 ]
Chen, Duan-Yu [1 ]
机构
[1] Yuan Ze Univ, Dept Elect Engn, Zhongli City 320, Taiwan
[2] Chunghwa Telecom Labs, Taoyuan 30010, Taiwan
关键词
Generators; Feature extraction; Wavelet transforms; Training; Decoding; Computational modeling; Wavelet analysis; Generative adversarial networks; Frequency-domain analysis; Convolutional neural networks; Infrared imaging; Image processing; Infrared image; generative adversarial model; wavelet transform; image translation;
D O I
10.1109/ACCESS.2024.3478356
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Infrared imagery is indispensable for capturing temperature data by detecting infrared radiation, particularly in challenging environments characterized by low-light conditions where visual perception is compromised. As a result, there has been considerable interest in the conversion of visible images into their infrared counterparts. In this research, we present the Freq-ShiftedNet model, which employs an adversarial generative network approach for training. By harnessing the power of the Haar wavelet transform, we adeptly preserve frequency information, directing low-frequency features to the Decoder and high-frequency features to the Encoder. Analysis of the KAIST dataset demonstrates that our model outperforms InfraGAN, achieving a Structural Similarity (SSIM) score of 0.825, marking a 5.4% improvement, and a Learned Perceptual Image Patch Similarity (LPIPS) score of 0.228, indicating a 41.3% decrease. Similarly, using the VEDAI dataset, Freq-ShiftedNet surpasses InfraGAN with an SSIM score of 0.938, representing a 6.6% improvement. These results highlight the effectiveness of our proposed generator, the successful integration of wavelet features into the Freq-ShiftedNet model, and its suitability for real-world applications.
引用
收藏
页码:151432 / 151443
页数:12
相关论文
共 50 条
[21]   A Domain Gap Aware Generative Adversarial Network for Multi-Domain Image Translation [J].
Xu, Wenju ;
Wang, Guanghui .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 :72-84
[22]   Structure Aware Generative Adversarial Networks for Hyperspectral Image Classification [J].
Alipour-Fard, Tayeb ;
Arefi, Hossein .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 :5424-5438
[23]   MSFD: Multiscale Feature Decomposition for Cross-Modality Visible-to-Infrared Drone Image Translation [J].
Chen, Xiaoning ;
Liu, Zhiquan ;
Han, Zonghao ;
Ma, Mingyang ;
Zhao, Jian .
IEEE INTERNET OF THINGS JOURNAL, 2025, 12 (13) :25951-25965
[24]   GANILLA: Generative adversarial networks for image to illustration translation [J].
Hicsonmez, Samet ;
Samet, Nermin ;
Akbas, Emre ;
Duygulu, Pinar .
IMAGE AND VISION COMPUTING, 2020, 95
[25]   DCDR-GAN: A Densely Connected Disentangled Representation Generative Adversarial Network for Infrared and Visible Image Fusion [J].
Gao, Yuan ;
Ma, Shiwei ;
Liu, Jingjing .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (02) :549-561
[26]   Semantic-Supervised Infrared and Visible Image Fusion Via a Dual-Discriminator Generative Adversarial Network [J].
Zhou, Huabing ;
Wu, Wei ;
Zhang, Yanduo ;
Ma, Jiayi ;
Ling, Haibin .
IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 :635-648
[27]   FusionGAN: A generative adversarial network for infrared and visible image fusion [J].
Ma, Jiayi ;
Yu, Wei ;
Liang, Pengwei ;
Li, Chang ;
Jiang, Junjun .
INFORMATION FUSION, 2019, 48 :11-26
[28]   FreqGAN: Infrared and Visible Image Fusion via Unified Frequency Adversarial Learning [J].
Wang, Zhishe ;
Zhang, Zhuoqun ;
Qi, Wuqiang ;
Yang, Fengbao ;
Xu, Jiawei .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2025, 35 (01) :728-740
[29]   PUFA-GAN: A Frequency-Aware Generative Adversarial Network for 3D Point Cloud Upsampling [J].
Liu, Hao ;
Yuan, Hui ;
Hou, Junhui ;
Hamzaoui, Raouf ;
Gao, Wei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 :7389-7402
[30]   Deep generative adversarial networks for infrared image enhancement [J].
Guei, Axel-Christian ;
Akhloufi, Moulay A. .
THERMOSENSE: THERMAL INFRARED APPLICATIONS XL, 2018, 10661