Image Inpainting Based on Generative Adversarial Networks

被引:42
|
作者
Jiang, Yi [1 ,3 ]
Xu, Jiajie [1 ]
Yang, Baoqing [1 ]
Xu, Jing [1 ]
Zhu, Junwu [1 ,2 ]
机构
[1] Yangzhou Univ, Coll Informat Engn, Yangzhou 225009, Jiangsu, Peoples R China
[2] Univ Guelph, Dept Comp Sci & Technol, Guelph, ON N1G 2W1, Canada
[3] Shanghai Jiao Tong Univ, State Key Lab Ocean Engn, Shanghai 200240, Peoples R China
来源
IEEE ACCESS | 2020年 / 8卷 / 08期
基金
中国国家自然科学基金;
关键词
AutoEncoder; image inpainting; skip-connection; stable training; wasserstein GAN;
D O I
10.1109/ACCESS.2020.2970169
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Image inpainting aims to fill missing regions of a damaged image with plausibly synthesized content. Existing methods for image inpainting either fill the missing regions by borrowing information from surrounding areas or generating semantically coherent content from region context. They often produce ambiguous or semantically incoherent content when the missing region is large or with complex structures. In this paper, we present an approach for image inpainting. The completion model based on our proposed algorithm contains one generator, one global discriminator, and one local discriminator. The generator is responsible for inpainting the missing area, the global discriminator aims evaluating whether the repair result has global consistency, and the local discriminator is responsible for identifying whether the repair area is correct. The architecture of the generator is an auto-encoder. We use the skip-connection in the generator to improve the prediction power of the model. Also, we use Wasserstein GAN loss to ensure the stability of training. Experiments on CelebA dataset and LFW dataset demonstrate that our proposed model can deal with large-scale missing pixels and generate realistic completion results.
引用
收藏
页码:22884 / 22892
页数:9
相关论文
共 50 条
  • [41] Image hashing retrieval based on generative adversarial networks
    Lei Lei
    Dongen Guo
    Zhen Shen
    Zechen Wu
    Applied Intelligence, 2023, 53 : 9056 - 9067
  • [42] Infrared Image Deblurring Based on Generative Adversarial Networks
    Zhao, Yuqing
    Fu, Guangyuan
    Wang, Hongqiao
    Zhang, Shaolei
    Yue, Min
    INTERNATIONAL JOURNAL OF OPTICS, 2021, 2021
  • [43] Image Hazing Algorithm Based on Generative Adversarial Networks
    Xiao, Jinsheng
    Zhou, Jinglong
    Lei, Junfeng
    Xu, Chuan
    Sui, Haigang
    IEEE ACCESS, 2020, 8 : 15883 - 15894
  • [44] Image registration method based on Generative Adversarial Networks
    Sun, Yujie
    Qi, Heping
    Wang, Chuanyou
    Tao, Lei
    2020 EIGHTH INTERNATIONAL CONFERENCE ON ADVANCED CLOUD AND BIG DATA (CBD 2020), 2020, : 183 - 188
  • [45] Image hashing retrieval based on generative adversarial networks
    Lei, Lei
    Guo, Dongen
    Shen, Zhen
    Wu, Zechen
    APPLIED INTELLIGENCE, 2023, 53 (08) : 9056 - 9067
  • [46] Multimodal Image Fusion Based on Generative Adversarial Networks
    Yang Xiaoli
    Lin Suzhen
    Lu Xiaofei
    Wang Lifang
    Li Dawei
    Wang Bin
    LASER & OPTOELECTRONICS PROGRESS, 2019, 56 (16)
  • [47] Face Image Colorization Based on Generative Adversarial Networks
    Han X.-J.
    Liu Y.-L.
    Yang H.-Y.
    Beijing Ligong Daxue Xuebao/Transaction of Beijing Institute of Technology, 2019, 39 (12): : 1285 - 1291
  • [48] An image translation algorithm based on Generative Adversarial Networks
    Chen, Ruiying
    Liu, Long
    Luo, Zhuo
    2021 3RD INTERNATIONAL CONFERENCE ON MACHINE LEARNING, BIG DATA AND BUSINESS INTELLIGENCE (MLBDBI 2021), 2021, : 369 - 373
  • [49] Semantic Image Inpainting with Progressive Generative Networks
    Zhang, Haoran
    Hu, Zhenzhen
    Luo, Changzhi
    Zuo, Wangmeng
    Wang, Meng
    PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 1939 - 1947
  • [50] A Face Inpainting Algorithm with Local Attribute Generative Adversarial Networks
    Jiang B.
    Liu H.
    Yang C.
    Tu W.
    Zhao Z.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2019, 56 (11): : 2485 - 2493