Degression receptive field network for image inpainting

被引:0
|
作者
Meng, Jiahao [1 ]
Liu, Weirong [1 ]
Shi, Changhong [1 ]
Li, Zhijun [1 ]
Liu, Chaorong [1 ]
机构
[1] Lanzhou Univ Technol, Coll Elect & Informat Engn, Lanzhou 730050, Peoples R China
基金
中国国家自然科学基金;
关键词
Image inpainting; Generative adversarial networks; Degression receptive field; Coarse to fine inpainting network; Object removal and image editing; Deep learning;
D O I
10.1016/j.engappai.2024.131158
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-stage image inpainting methods from coarse-to-fine have achieved satisfactory inpainting results in recent years. However, an in-depth analysis of multi-stage inpainting networks reveals that simply increasing complexity of refined network may lead to degradation problems. The paper proposes a degression receptive field network (DRFNet) via multi-head attention mechanism and U-shaped network with different receptive fields to address above phenomenon that existing image inpainting methods have detail blur and artifacts due to insufficient constraints. Initially, DRFNet innovatively takes receptive field as a perspective and consists of five sub-networks with decreasing receptive fields. Secondly, an easy-to-use TransConv module is designed to overcome the problem of local-pixel influence in convolution. Experiments show that comprehensive optimal rate of DRFNet on L1 error, Peak Signal-to-Noise Ratio (PSNR), Structural Similarity Index Measure (SSIM), Fr(SIC)chet Inception Distance (FID), and Learned Perceptual Image Patch Similarity (LPIPS) is more than 82.86% on all three benchmark datasets, which achieves state-of-the-art results. Moreover, real-world experiments demonstrate the potential of DRFNet for object removal and image editing.
引用
收藏
页数:17
相关论文
共 50 条
  • [31] Image Inpainting Based on Interactive Separation Network and Progressive Reconstruction Algorithm
    Gong, Jun
    Li, Siyuan
    Chen, Shiyu
    Nie, Liang
    Cheng, Xin
    Zhang, Zhiqiang
    Yu, Wenxin
    IEEE ACCESS, 2022, 10 : 67814 - 67825
  • [32] RNON: image inpainting via repair network and optimization network
    Yuantao Chen
    Runlong Xia
    Ke Zou
    Kai Yang
    International Journal of Machine Learning and Cybernetics, 2023, 14 : 2945 - 2961
  • [33] Lightweight Generative Network for Image Inpainting Using Feature Contrast Enhancement
    Han, Qihui
    Liu, Jie
    Jung, Cheolkon
    IEEE ACCESS, 2022, 10 : 86458 - 86469
  • [34] Infrared and Visible Image Fusion via Multiscale Receptive Field Amplification Fusion Network
    Ji, Chuanming
    Zhou, Wujie
    Lei, Jingsheng
    Ye, Lv
    IEEE SIGNAL PROCESSING LETTERS, 2023, 30 : 493 - 497
  • [35] Inpainting with style: forcing style coherence to image inpainting with deep image prior
    Morotti, Elena
    Merizzi, Fabio
    Evangelista, Davide
    Cascarano, Pasquale
    FRONTIERS IN COMPUTER SCIENCE, 2024, 6
  • [36] Multi-scale attention network for image inpainting
    Qin, Jia
    Bai, Huihui
    Zhao, Yao
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2021, 204
  • [37] A 360-Degree Panoramic Image Inpainting Network Using a Cube Map
    Han, Seo Woo
    Suh, Doug Young
    CMC-COMPUTERS MATERIALS & CONTINUA, 2021, 66 (01): : 213 - 228
  • [38] Semantic image inpainting with dense and dilated deep convolutional autoencoder adversarial network
    Ren, Kun
    Fan, Chunqi
    Meng, Lisha
    Huang, Long
    OPTOELECTRONIC IMAGING AND MULTIMEDIA TECHNOLOGY VI, 2019, 11187
  • [39] Edge missing image inpainting with compression–decompression network in low similarity images
    Zhenghang Wu
    Yidong Cui
    Machine Vision and Applications, 2021, 32
  • [40] FASNet: Feature Aggregation and Sharing Network for Image Inpainting
    Phutke, Shruti S.
    Murala, Subrahmanyam
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 1664 - 1668