Optimized global perception for high-fidelity image inpainting

被引:0
|
作者
Liu, Huaming [1 ]
Zhang, Minglong [1 ]
Wang, Xiuyou [1 ]
Bi, Xuehui [1 ]
Liu, Enze [1 ]
机构
[1] Fuyang Normal Univ, Sch Comp & Informat Engn, 100 Qinghe West Rd, Fuyang 236037, Anhui, Peoples R China
关键词
Image inpainting; Fast Fourier convolution; Multi-stage; Global perception; Attention mechanism;
D O I
10.1007/s00371-025-03881-1
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Image inpainting, a crucial technology in computer vision and image processing, aims to fill damaged or missing regions of an image with plausible content. Current deep learning-based inpainting methods often struggle with large missing areas and complex textures due to limited receptive fields or inadequate global context capture. To address these challenges, this paper proposes an image inpainting method based on optimized global perception. The method employs a three-stage network framework, incorporating coarse inpainting, local refinement and global refinement networks. In the first stage, an encoder-decoder structure with a large receptive field is used to generate a coarse inpainting result. The second stage utilizes dynamic convolution and fast Fourier convolution residual blocks to refine local textures and structures while capturing global context. Finally, the third stage introduces an attention-based global refinement network to enhance the overall consistency and quality of the inpainted image. Experimental results on the CelebA, Paris StreetView and Places2 datasets demonstrate that the proposed method achieves significant improvements in PSNR, SSIM and LPIPS metrics, outperforming existing inpainting networks. The qualitative results also show that the method can effectively restore fine details and complex textures, even for large missing regions.
引用
收藏
页数:16
相关论文
共 48 条
  • [1] High-Fidelity Image Inpainting with GAN Inversion
    Yu, Yongsheng
    Zhang, Libo
    Fan, Heng
    Luo, Tiejian
    COMPUTER VISION - ECCV 2022, PT XVI, 2022, 13676 : 242 - 258
  • [2] High-Fidelity and Efficient Pluralistic Image Completion With Transformers
    Wan, Ziyu
    Zhang, Jingbo
    Chen, Dongdong
    Liao, Jing
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (12) : 9612 - 9629
  • [3] Data-driven high-fidelity 2D microstructure reconstruction via non-local patch-based image inpainting
    Anh Tran
    Hoang Tran
    ACTA MATERIALIA, 2019, 178 : 207 - 218
  • [4] Image Inpainting With Local and Global Refinement
    Quan, Weize
    Zhang, Ruisong
    Zhang, Yong
    Li, Zhifeng
    Wang, Jue
    Yan, Dong-Ming
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 2405 - 2420
  • [5] Rate-distortion optimized image compression based on image inpainting
    Wei Jiang
    Multimedia Tools and Applications, 2016, 75 : 919 - 933
  • [6] Rate-distortion optimized image compression based on image inpainting
    Jiang, Wei
    MULTIMEDIA TOOLS AND APPLICATIONS, 2016, 75 (02) : 919 - 933
  • [7] HiFiMSFA: Robust and High-Fidelity Image Watermarking Using Attention Augmented Deep Network
    Zhang, Yulin
    Ni, Jiangqun
    Su, Wenkang
    IEEE SIGNAL PROCESSING LETTERS, 2025, 32 : 781 - 785
  • [8] Local and global mixture network for image inpainting
    Woo, Seunggyun
    Ko, Keunsoo
    Kim, Chang-Su
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 104
  • [9] Optimized segmentation with image inpainting for semantic mapping in dynamic scenes
    Jianfeng Zhang
    Yang Liu
    Chi Guo
    Jiao Zhan
    Applied Intelligence, 2023, 53 : 2173 - 2188
  • [10] Optimized segmentation with image inpainting for semantic mapping in dynamic scenes
    Zhang, Jianfeng
    Liu, Yang
    Guo, Chi
    Zhan, Jiao
    APPLIED INTELLIGENCE, 2023, 53 (02) : 2173 - 2188