Image generation step by step: animation generation-image translation

被引:5
作者
Jing, Beibei [1 ]
Ding, Hongwei [1 ]
Yang, Zhijun [1 ]
Li, Bo [1 ]
Liu, Qianlin [1 ]
机构
[1] Yunnan Univ, Sch Informat Sci & Engn, Kunming, Yunnan, Peoples R China
基金
中国国家自然科学基金;
关键词
Generative adversarial networks; LGAN (Link Generative Adversarial Networks); Unconditional generation part; Anime images conditional generation part; Super-resolution network; WASSERSTEIN DISTANCE;
D O I
10.1007/s10489-021-02835-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Generative adversarial networks play an important role in image generation, but the successful generation of high-resolution images from complex data sets remains a challenging goal. In this paper, we propose the LGAN (Link Generative Adversarial Networks) model, which can effectively enhance the quality of the synthesized images. The LGAN model consists of two parts, G1 and G2. G1 is responsible for the unconditional generation part, which generates anime images with highly abstract features containing few coefficients but continuous image elements covering the overall image features. Moreover, G2 is responsible for the conditional generation part (image translation), consisting of mapping and Superresolution networks. The mapping network fills the output of G1 into the real-world image after semantic segmentation or edge detection processing; the Superresolution network super-resolves the actual picture after completing mapping to improve the image's resolution. In the comparison test with WGAN, SAGAN, WGAN-GP and PG-GAN, this paper's LGAN(SEG) leads 64.36 and 12.28, respectively, fully proving the model's superiority.
引用
收藏
页码:8087 / 8100
页数:14
相关论文
共 50 条
  • [21] Generative convolution layer for image generation
    Park, Seung
    Shin, Yong-Goo
    NEURAL NETWORKS, 2022, 152 : 370 - 379
  • [22] Multiview image generation for vehicle reidentification
    Zhang, Fukai
    Ma, Yongqiang
    Yuan, Guan
    Zhang, Haiyan
    Ren, Jianji
    APPLIED INTELLIGENCE, 2021, 51 (08) : 5665 - 5682
  • [23] Generative adversarial text-to-image generation with style image constraint
    Wang, Zekang
    Liu, Li
    Zhang, Huaxiang
    Liu, Dongmei
    Song, Yu
    MULTIMEDIA SYSTEMS, 2023, 29 (06) : 3291 - 3303
  • [24] Omni-Directional Image Generation from Single Snapshot Image
    Okubo, Keisuke
    Yamanaka, Takao
    2020 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2020, : 3021 - 3028
  • [25] Infrared Image Generation Algorithm Based on Conditional Generation Adversarial Networks
    Li Bing
    Xian Yong
    Zhang Daqiao
    ACTA PHOTONICA SINICA, 2021, 50 (11)
  • [26] Generative adversarial text-to-image generation with style image constraint
    Zekang Wang
    Li Liu
    Huaxiang Zhang
    Dongmei Liu
    Yu Song
    Multimedia Systems, 2023, 29 : 3291 - 3303
  • [27] Infrared Image Generation Based on Improved CycleGAN
    Liu, Xinyi
    Liu, Yu
    Zhang, Zheng
    Zhang, Maojun
    2024 10TH INTERNATIONAL CONFERENCE ON BIG DATA AND INFORMATION ANALYTICS, BIGDIA 2024, 2024, : 161 - 166
  • [28] Text to Image Generation with Conformer-GAN
    Deng, Zhiyu
    Yu, Wenxin
    Che, Lu
    Chen, Shiyu
    Zhang, Zhiqiang
    Shang, Jun
    Chen, Peng
    Gong, Jun
    NEURAL INFORMATION PROCESSING, ICONIP 2023, PT V, 2024, 14451 : 3 - 14
  • [29] Panoramic Image Generation: From 2-D Sketch to Spherical Image
    Duan, Yiping
    Han, Chaoyi
    Tao, Xiaoming
    Geng, Bingrui
    Du, Yunfei
    Lu, Jianhua
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2020, 14 (01) : 194 - 208
  • [30] Generative image completion with image-to-image translation
    Shuzhen Xu
    Qing Zhu
    Jin Wang
    Neural Computing and Applications, 2020, 32 : 7333 - 7345