Image inpainting algorithm based on inference attention module and two-stage network

被引:14
作者
Chen, Yuantao [1 ,2 ]
Xia, Runlong [3 ]
Yang, Kai [4 ]
Zou, Ke [5 ]
机构
[1] Hunan Univ Informat Technol, Sch Comp Sci & Engn, Changsha 410151, Hunan, Peoples R China
[2] Hunan Univ Informat Technol, Hunan Prov Higher Educ Key Lab Intelligent Sensing, Changsha 410151, Hunan, Peoples R China
[3] Hunan Prov Sci & Technol Affairs Ctr, Hunan Prov Sci & Technol Dept, Changsha 410013, Hunan, Peoples R China
[4] Hunan ZOOML Intelligent Technol Corp Ltd, Changsha 410005, Hunan, Peoples R China
[5] Hunan Initial New Mat Corp Ltd, Loudi 417000, Hunan, Peoples R China
关键词
Application of Artificial Intelligence; Computer vision; Image inpainting; Inference attention mechanism; Two-stage network;
D O I
10.1016/j.engappai.2024.109181
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Current image inpainting techniques often yield distorted structures or blurred textures that clash with the surrounding context, particularly when addressing extensive missing regions or highly textured images. These methods often struggle to reconstruct realistic and coherent image structures. To address this challenge, we introduce a two-stage network image restoration approach that leverages an inferential attention mechanism. In the first stage, an edge generation network is employed to produce plausible phantom edge information. Subsequently, an image complementation network is utilized to complete the image restoration process. To enhance the visual realism and restoration accuracy of the generated images, we incorporate an inferential attention mechanism within the image complementation network. This mechanism effectively mitigates inconsistencies in the generated features, leading to the production of more meaningful and effective information. We evaluate our proposed method on benchmark datasets, including Places2 dataset, CelebFaces Attributes dataset, and Paris StreetView dataset. The experimental results can demonstrate that the proposed method achieves better Structural Similarity Index and Peak Signal-to-noise Ratio than others. These metrics indicate superior performance compared to existing image inpainting methods, delivering higher image inpainting accuracy and more realistic image reconstruction effect.
引用
收藏
页数:11
相关论文
共 52 条
  • [1] Arjovsky M, 2017, PR MACH LEARN RES, V70
  • [2] PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing
    Barnes, Connelly
    Shechtman, Eli
    Finkelstein, Adam
    Goldman, Dan B.
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2009, 28 (03):
  • [3] Image inpainting
    Bertalmio, M
    Sapiro, G
    Caselles, V
    Ballester, C
    [J]. SIGGRAPH 2000 CONFERENCE PROCEEDINGS, 2000, : 417 - 424
  • [4] RFA-Net: Residual feature attention network for fine-grained image inpainting
    Chen, Min
    Zang, Shengrui
    Ai, Zhenhua
    Chi, Jieru
    Yang, Guowei
    Chen, Chenglizhao
    Yu, Teng
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 119
  • [5] Image Melding: Combining Inconsistent Images using Patch-based Synthesis
    Darabi, Soheil
    Shechtman, Eli
    Barnes, Connelly
    Goldman, Dan B.
    Sen, Pradeep
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2012, 31 (04):
  • [6] Low-dose COVID-19 CT Image Denoising Using CNN and its Method Noise Thresholding
    Diwakar, Manoj
    Pandey, Neeraj Kumar
    Singh, Ravinder
    Sisodia, Dilip
    Arya, Chandrakala
    Singh, Prabhishek
    Chakraborty, Chinmay
    [J]. CURRENT MEDICAL IMAGING, 2023, 19 (02) : 182 - 193
  • [7] What Makes Paris Look like Paris?
    Doersch, Carl
    Singh, Saurabh
    Gupta, Abhinav
    Sivic, Josef
    Efros, Alexei A.
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2012, 31 (04):
  • [8] Face completion with Hybrid Dilated Convolution
    Fang, Yuchun
    Li, Yifan
    Tu, Xiaokang
    Tan, Taifeng
    Wang, Xin
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2020, 80
  • [9] Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
  • [10] Hays J, 2007, ACM T GRAPHIC, V26, DOI 10.1145/1276377.1276382