The improved image inpainting algorithm via encoder and similarity constraint

被引:101
作者
Chen, Yuantao [1 ,2 ]
Liu, Linwu [1 ,2 ]
Tao, Jiajun [1 ,2 ]
Xia, Runlong [3 ]
Zhang, Qian [4 ]
Yang, Kai [4 ]
Xiong, Jie [5 ]
Chen, Xi [1 ,2 ]
机构
[1] Changsha Univ Sci & Technol, Sch Comp & Commun Engn, Changsha 410114, Hunan, Peoples R China
[2] Changsha Univ Sci & Technol, Hunan Prov Key Lab Intelligent Proc Big Data Tran, Changsha 410114, Hunan, Peoples R China
[3] Hunan Inst Sci & Tech Informat, Changsha 411105, Hunan, Peoples R China
[4] Hunan ZOOMLION Intelligent Technol Corp Ltd, Dept Elect Prod, Changsha 410005, Hunan, Peoples R China
[5] Yangtze Univ, Elect & Informat Sch, Jingzhou 434023, Peoples R China
基金
中国国家自然科学基金;
关键词
Generative adversarial network; Image inpainting; Residual network; Contextual loss function; SUPERRESOLUTION;
D O I
10.1007/s00371-020-01932-3
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Existing image inpainting algorithms based on neural network models are affected by structural distortions and blurred textures on visible connectivity. As a result, overfitting and overlearning phenomena can easily emerge during the image inpainting procedure. Image inpainting refers to the repairing of missing parts of an image, given an image that is broken or incomplete. After the repairing operation is complete, there are obvious signs of repair in damaged areas, semantic discontinuities, and unclearness. This paper proposes an improved image inpainting method based on a new encoder combined with a context loss function. In order to obtain clear repaired images and ensure that the semantic features of images are fully learned, a generative network based on the fusion model of squeeze-and-excitation networks deep residual learning has been proposed to improve the application of network features in order to obtain clear images and reduce network parameters. At the same time, a discriminative network based on the squeeze-and-excitation residual Network has been proposed to strengthen the capability of the discriminative network. In order to make the generated image more realistic, so that the restored image will be more similar to the original image, a joint context-awareness loss training method (contextual perception loss network) has also been proposed to generate the similarity of the local features of the network constraint, with the result that the repaired image is closer to the original picture and more realistic. The experimental results can demonstrate that the proposed algorithm demonstrates better adaptive capability than the comparison algorithms on a number of image categories. In addition, the processing results of the image inpainting procedure were also superior to those of five state-of-the-art algorithms.
引用
收藏
页码:1691 / 1705
页数:15
相关论文
共 55 条
[1]   K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation [J].
Aharon, Michal ;
Elad, Michael ;
Bruckstein, Alfred .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2006, 54 (11) :4311-4322
[2]   Texture-guided depth upsampling using Bregman split: a clustering graph-based approach [J].
Altantawy, Doaa A. ;
Saleh, Ahmed I. ;
Kishk, Sherif S. .
VISUAL COMPUTER, 2020, 36 (02) :333-359
[3]  
[Anonymous], 2018, PROC CVPR IEEE, DOI DOI 10.1109/TPAMI.2019.2913372
[4]   PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing [J].
Barnes, Connelly ;
Shechtman, Eli ;
Finkelstein, Adam ;
Goldman, Dan B. .
ACM TRANSACTIONS ON GRAPHICS, 2009, 28 (03)
[5]   Astronomical image denoising using dictionary learning [J].
Beckouche, S. ;
Starck, J. L. ;
Fadili, J. .
ASTRONOMY & ASTROPHYSICS, 2013, 556
[6]  
Chen YB, 2020, J CONTEMP CHINA, V29, P1, DOI [10.1007/s12652-020-02066-z, 10.1080/10670564.2019.1621526, 10.1080/01932691.2020.1791172]
[7]   Saliency Detection via the Improved Hierarchical Principal Component Analysis Method [J].
Chen, Yuantao ;
Tao, Jiajun ;
Zhang, Qian ;
Yang, Kai ;
Chen, Xi ;
Xiong, Jie ;
Xia, Runlong ;
Xie, Jingbo .
WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2020, 2020
[8]   A novel online incremental and decremental learning algorithm based on variable support vector machine [J].
Chen, Yuantao ;
Xiong, Jie ;
Xu, Weihong ;
Zuo, Jingwen .
CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2019, 22 (Suppl 3) :S7435-S7445
[9]   RETRACTED: Multiscale fast correlation filtering tracking algorithm based on a feature fusion model (Retracted article. See vol. 34, 2022) [J].
Chen, Yuantao ;
Wang, Jin ;
Liu, Songjie ;
Chen, Xi ;
Xiong, Jie ;
Xie, Jingbo ;
Yang, Kai .
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2021, 33 (15)
[10]   RETRACTED: The visual object tracking algorithm research based on adaptive combination kernel (Retracted Article) [J].
Chen, Yuantao ;
Wang, Jin ;
Xia, Runlong ;
Zhang, Qian ;
Cao, Zhouhong ;
Yang, Kai .
JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2019, 10 (12) :4855-4867