Asymmetric slack contrastive learning for full use of feature information in image translation

被引:0
作者
Zhang, Yusen [1 ]
Li, Min [1 ]
Gou, Yao [1 ]
He, Yujie [1 ]
机构
[1] Xian Res Inst Hitech, Xian 710025, Shaanxi, Peoples R China
关键词
Image translation; Cross-domain learning; Asymmetric slack contrast; Contrastive learning; Structure consistency;
D O I
10.1016/j.knosys.2024.112136
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, contrastive learning has been proven to be powerful in cross -domain feature learning and has been widely used in image translation tasks. However, these methods often overlook the differences between positive and negative samples regarding model optimization ability and treat them equally. This weakens the feature representation ability of the generative models. In this paper, we propose a novel image translation model based on asymmetric slack contrastive learning. We design a new contrastive loss asymmetrically by introducing a slack adjustment factor. Theoretical analysis shows that it can adaptively optimize and adjust according to different positive and negative samples and significantly improve optimization efficiency. In addition, to better preserve local structural relationships during image translation, we constructed a regional differential structural consistency correction block using differential vectors. Comparative experiments were conducted using seven existing methods on five datasets. The results indicate that our method can maintain structural consistency between cross -domain images at a deeper level. Furthermore, it is more effective in establishing real image -domain mapping relations, resulting in higher -quality images being generated.
引用
收藏
页数:14
相关论文
共 47 条
  • [21] SuperstarGAN: Generative adversarial networks for image-to-image translation in large-scale domains
    Ko, Kanghyeok
    Yeom, Taesun
    Lee, Minhyeok
    [J]. NEURAL NETWORKS, 2023, 162 : 330 - 339
  • [22] Residual Local Feature Network for Efficient Super-Resolution
    Kong, Fangyuan
    Li, Mingxi
    Liu, Songwei
    Liu, Ding
    He, Jingwen
    Bai, Yang
    Chen, Fangmin
    Fu, Lean
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 765 - 775
  • [23] Contrastive Representation Learning: A Framework and Review
    Le-Khac, Phuc H.
    Healy, Graham
    Smeaton, Alan F.
    [J]. IEEE ACCESS, 2020, 8 : 193907 - 193934
  • [24] Unsupervised Image-to-Image Translation with Stacked Cycle-Consistent Adversarial Networks
    Li, Minjun
    Huang, Haozhi
    Ma, Lin
    Liu, Wei
    Zhang, Tong
    Jiang, Yugang
    [J]. COMPUTER VISION - ECCV 2018, PT IX, 2018, 11213 : 186 - 201
  • [25] Ling H, 2021, ADV NEUR IN, V34
  • [26] Liu MY, 2017, ADV NEUR IN, V30
  • [27] Cross-domain Mutual Information Adversarial Maximization
    Meng, Lichao
    Su, Hongzu
    Lou, Chunwei
    Li, Jingjing
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2022, 110
  • [28] Image-to-Image Translation: Methods and Applications
    Pang, Yingxue
    Lin, Jianxin
    Qin, Tao
    Chen, Zhibo
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 3859 - 3881
  • [29] Park T., 2020, Computer VisionECCV 2020: 16th European Conference, Glasgow, UK, 2328 August 2020, Proceedings, P319
  • [30] Robinson J., 2020, arXiv