StawGAN: Structural-Aware Generative Adversarial Networks for Infrared Image Translation

被引:5
作者
Sigillo, Luigi [1 ,2 ]
Grassucci, Eleonora [1 ]
Comminiello, Danilo [1 ]
机构
[1] Sapienza Univ Rome, Dept Informat Engn Elect & Telecom, Rome, Italy
[2] Leonardo Labs, Rome, Italy
来源
2023 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS | 2023年
关键词
Image Modality Translation; Generative Adversarial Networks; Drone Images; Infrared Images;
D O I
10.1109/ISCAS46773.2023.10181838
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper addresses the problem of translating night-time thermal infrared images, which are the most adopted image modalities to analyze night-time scenes, to daytime color images (NTIT2DC), which provide better perceptions of objects. We introduce a novel model that focuses on enhancing the quality of the target generation without merely colorizing it. The proposed structural aware (StawGAN) enables the translation of better-shaped and high-definition objects in the target domain. We test our model on aerial images of the DroneVeichle dataset containing RGB-IR paired images. The proposed approach produces a more accurate translation with respect to other stateof-the-art image translation models. The source code will be available after the revision process.
引用
收藏
页数:5
相关论文
共 30 条
  • [1] [Anonymous], 2017, ACM Trans. Graph
  • [2] MEASURES OF THE AMOUNT OF ECOLOGIC ASSOCIATION BETWEEN SPECIES
    DICE, LR
    [J]. ECOLOGY, 1945, 26 (03) : 297 - 302
  • [3] Goodfellow I., 2014, ADV NEURAL INF P SYS, V27
  • [4] Hypercomplex Image-to-Image Translation
    Grassucci, Eleonora
    Sigillo, Luigi
    Uncini, Aurelio
    Comminiello, Danilo
    [J]. 2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [5] Heusel Martin, 2017, ADV NEURAL INF P SYS, V30
  • [6] ISOLA P, 2017, PROC CVPR IEEE, P5967, DOI [DOI 10.1109/CVPR.2017.632, 10.1109/CVPR.2017.632]
  • [7] JI GL, 2022, IEEE ROBOTICS AUTOMA, P1, DOI DOI 10.14232/EJQTDE.2022.1.46
  • [8] Junxiao Chen, 2021, INT C MED IM COMP AS
  • [9] MLPD: Multi-Label Pedestrian Detector in Multispectral Domain
    Kim, Jiwon
    Kim, Hyeongjun
    Kim, Taejoo
    Kim, Namil
    Choi, Yukyung
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (04) : 7846 - 7853
  • [10] Kingma D. P., 2014, arXiv