The Importance of Growing Up: Progressive Growing GANs for Image Inpainting

被引:0
作者
Speck, Daniel [1 ]
Rosin, Theresa Pekarek [1 ]
Kerzel, Matthias [1 ]
Wermter, Stefan [1 ]
机构
[1] Univ Hamburg, Knowledge Technol Dept Informat, Hamburg, Germany
来源
2023 IEEE INTERNATIONAL CONFERENCE ON DEVELOPMENT AND LEARNING, ICDL | 2023年
关键词
progressive growing; GAN; image inpainting; model size reduction; efficient training; DIFFUSION;
D O I
10.1109/ICDL55364.2023.10364530
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
In recent years, Generative Adversarial Networks (GANs) have proven to be a sophisticated approach for generative tasks in image processing, especially inpainting and image synthesis While most GAN approaches feature comparatively large networks, we introduce an approach to image inpainting using progressive growing GANs, which enables significantly reduced model sizes, faster convergence, and thus an overall more efficient training that is inspired by insights on the development of visual abilities in biological systems. We demonstrate the effectiveness and efficiency of our approach on Places, a comprehensive dataset encompassing a wide variety of images from diverse locations in the wild.
引用
收藏
页码:294 / 299
页数:6
相关论文
共 28 条
  • [1] Learning Sparse Masks for Diffusion-Based Image Inpainting
    Alt, Tobias
    Peter, Pascal
    Weickert, Joachim
    [J]. PATTERN RECOGNITION AND IMAGE ANALYSIS (IBPRIA 2022), 2022, 13256 : 528 - 539
  • [2] Data-driven high-fidelity 2D microstructure reconstruction via non-local patch-based image inpainting
    Anh Tran
    Hoang Tran
    [J]. ACTA MATERIALIA, 2019, 178 : 207 - 218
  • [3] PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing
    Barnes, Connelly
    Shechtman, Eli
    Finkelstein, Adam
    Goldman, Dan B.
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2009, 28 (03):
  • [4] Berthelot D, 2017, Arxiv, DOI [arXiv:1703.10717, DOI 10.1109/AC-CESS.2018.2804278]
  • [5] Chi L., 2020, ADV NEURAL INFORM PR, P4479, DOI DOI 10.5555/3495724.3496100
  • [6] Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
  • [7] Image Inpainting: A Review
    Elharrouss, Omar
    Almaadeed, Noor
    Al-Maadeed, Somaya
    Akbari, Younes
    [J]. NEURAL PROCESSING LETTERS, 2020, 51 (02) : 2007 - 2028
  • [8] Fundamental Technologies in Modern Speech Recognition
    Furui, Sadaoki
    Deng, Li
    Gales, Mark
    Ney, Hermann
    Tokuda, Keiichi
    [J]. IEEE SIGNAL PROCESSING MAGAZINE, 2012, 29 (06) : 16 - 17
  • [9] Ho J., 2020, P NIPS, V33, P6840
  • [10] Hongyu Liu, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12347), P725, DOI 10.1007/978-3-030-58536-5_43