EDBGAN: Image Inpainting via an Edge-Aware Dual Branch Generative Adversarial Network

被引:10
|
作者
Chen, Minyu [1 ,2 ]
Liu, Zhi [1 ,2 ]
机构
[1] Shanghai Univ, Shanghai Inst Adv Commun & Data Sci, Shanghai 200444, Peoples R China
[2] Shanghai Univ, Sch Commun & Informat Engn, Shanghai 200444, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Image edge detection; Convolution; Generators; Task analysis; Logic gates; Generative adversarial networks; Attention mechanism; dual branch encoder-decoder; generative adversarial network; image inpainting;
D O I
10.1109/LSP.2021.3070738
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As deep learning technology develops rapidly, image inpainting methods have made significant progress in generating reasonable contents for images with large and irregular holes. Nevertheless, existing methods either use one encoder-decoder to generate results in one step without making good use of structure features which are helpful, or adopt two encoder-decoders to recover structures and textures subsequently where the second encoder-decoder used for recovering textures relies heavily on the first encoder-decoder. Thus, an one-stage method which simultaneously utilizes structures and textures is promising. In this letter, we propose a dual branch encoder-decoder, whose texture branch and edge branch can simultaneously extract features from the masked RGB image and its corresponding edge map. Moreover, we propose a lightweight mutually guided attention block (MGAB), which makes features of two branches guide each other from low level to high level. At the end of two branches, we apply dual attention block (DAB) to perform feature fusion, which uses self-attention mechanism and lightweight attention mechanism on features of texture branch and edge branch, respectively. Extensive experiments demonstrate that our proposed method is effective in recovering edges and textures and achieves the state-of-the-art performance.
引用
收藏
页码:842 / 846
页数:5
相关论文
共 50 条
  • [21] OCCLUSION-AWARE FACE INPAINTING VIA GENERATIVE ADVERSARIAL NETWORKS
    Chen, Yu-An
    Chen, Wei-Che
    Wei, Chia-Po
    Wang, Yu-Chiang Frank
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 1202 - 1206
  • [22] EAN: Edge-Aware Network for Image Manipulation Localization
    Chen, Yun
    Cheng, Hang
    Wang, Haichou
    Liu, Ximeng
    Chen, Fei
    Li, Fengyong
    Zhang, Xinpeng
    Wang, Meiqing
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2025, 35 (02) : 1591 - 1601
  • [23] A Generate Adversarial Network with Structural Branch Assistance for Image Inpainting
    Wang, Jin
    Jia, Dongli
    Zhang, Heng
    ELECTRONICS, 2023, 12 (09)
  • [24] Edge-Aware Dual-Task Image Watermarking Against Social Network Noise
    Jiang, Hao
    Wang, Jiahao
    Yao, Yuhan
    Li, Xingchen
    Kou, Feifei
    Tang, Xinkun
    Qi, Limei
    APPLIED SCIENCES-BASEL, 2025, 15 (01):
  • [25] Image inpainting method based on incomplete image samples in generative adversarial network
    Li H.
    Huang H.
    Guo L.
    Li H.
    Chen J.
    Li H.
    Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2021, 47 (10): : 1949 - 1958
  • [26] DH-GAN: Image manipulation localization via a dual homology-aware generative adversarial network
    Liu, Weihuang
    Cun, Xiaodong
    Pun, Chi -Man
    PATTERN RECOGNITION, 2024, 155
  • [27] Image inpainting based on tensor ring decomposition with generative adversarial network
    Yuan, Jianjun
    Wu, Hong
    Zhao, Luoming
    Wu, Fujun
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, : 7621 - 7634
  • [28] Image inpainting based on tensor ring decomposition with generative adversarial network
    Yuan, Jianjun
    Wu, Hong
    Zhao, Luoming
    Wu, Fujun
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024,
  • [29] Image Multi-Inpainting via Progressive Generative Adversarial Networks
    Cai, Jiayin
    Li, Changlin
    Tao, Xin
    Tai, Yu-Wing
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 977 - 986
  • [30] Self-prior guided generative adversarial network for image inpainting
    Shi, Changhong
    Liu, Weirong
    Meng, Jiahao
    Jia, Xiongfei
    Liu, Jie
    VISUAL COMPUTER, 2025, 41 (04): : 2939 - 2951