Degression receptive field network for image inpainting

被引:0
|
作者
Meng, Jiahao [1 ]
Liu, Weirong [1 ]
Shi, Changhong [1 ]
Li, Zhijun [1 ]
Liu, Chaorong [1 ]
机构
[1] Lanzhou Univ Technol, Coll Elect & Informat Engn, Lanzhou 730050, Peoples R China
基金
中国国家自然科学基金;
关键词
Image inpainting; Generative adversarial networks; Degression receptive field; Coarse to fine inpainting network; Object removal and image editing; Deep learning;
D O I
10.1016/j.engappai.2024.131158
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-stage image inpainting methods from coarse-to-fine have achieved satisfactory inpainting results in recent years. However, an in-depth analysis of multi-stage inpainting networks reveals that simply increasing complexity of refined network may lead to degradation problems. The paper proposes a degression receptive field network (DRFNet) via multi-head attention mechanism and U-shaped network with different receptive fields to address above phenomenon that existing image inpainting methods have detail blur and artifacts due to insufficient constraints. Initially, DRFNet innovatively takes receptive field as a perspective and consists of five sub-networks with decreasing receptive fields. Secondly, an easy-to-use TransConv module is designed to overcome the problem of local-pixel influence in convolution. Experiments show that comprehensive optimal rate of DRFNet on L1 error, Peak Signal-to-Noise Ratio (PSNR), Structural Similarity Index Measure (SSIM), Fr(SIC)chet Inception Distance (FID), and Learned Perceptual Image Patch Similarity (LPIPS) is more than 82.86% on all three benchmark datasets, which achieves state-of-the-art results. Moreover, real-world experiments demonstrate the potential of DRFNet for object removal and image editing.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Diverse Receptive Field Based Adversarial Concurrent Encoder Network for Image Inpainting
    Phutke, Shruti S.
    Murala, Subrahmanyam
    IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 1873 - 1877
  • [2] A Deep Network Architecture for Image Inpainting
    Xiang, Peng
    Wang, Lei
    Cheng, Jun
    Zhang, Bin
    Wu, Jiaji
    PROCEEDINGS OF 2017 3RD IEEE INTERNATIONAL CONFERENCE ON COMPUTER AND COMMUNICATIONS (ICCC), 2017, : 1851 - 1856
  • [3] PEPSI: Fast and Lightweight Network for Image Inpainting
    Shin, Yong-Goo
    Sagong, Min-Cheol
    Yeo, Yoon-Jae
    Kim, Seung-Wook
    Ko, Sung-Jea
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (01) : 252 - 265
  • [4] Context Adaptive Network for Image Inpainting
    Deng, Ye
    Hui, Siqi
    Zhou, Sanping
    Huang, Wenli
    Wang, Jinjun
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 6332 - 6345
  • [5] Dynamic Selection Network for Image Inpainting
    Wang, Ning
    Zhang, Yipeng
    Zhang, Lefei
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 1784 - 1798
  • [6] Multistage attention network for image inpainting
    Wang, Ning
    Ma, Sihan
    Li, Jingyuan
    Zhang, Yipeng
    Zhang, Lefei
    PATTERN RECOGNITION, 2020, 106
  • [7] INTERACTIVE SEPARATION NETWORK FOR IMAGE INPAINTING
    Li, Siyuan
    Lu, Lu
    Zhang, Zhiqiang
    Cheng, Xin
    Xu, Kepeng
    Yu, Wenxin
    He, Gang
    Zhou, Jinjia
    Yang, Zhuo
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 1008 - 1012
  • [8] Image Inpainting with Context Flow Network
    Liu, Jianwen
    Xue, Jiarui
    Zhang, Juan
    Yang, Ying
    2022 IEEE 34TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, ICTAI, 2022, : 923 - 930
  • [9] INTERLEAVED ZOOMING NETWORK FOR IMAGE INPAINTING
    Liu, Sen
    Guo, Zongyu
    Chen, Jiale
    Yu, Tao
    Chen, Zhibo
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2019, : 673 - 678
  • [10] LRGAN: A computational lightweight image inpainting neural network
    Liao N.
    Zhang X.
    Peng C.
    Fan H.
    Zhongguo Kexue Jishu Kexue/Scientia Sinica Technologica, 2022, 52 (03): : 447 - 457