Research on image inpainting algorithm of improved total variation minimization method

被引:78
作者
Chen, Yuantao [1 ,2 ]
Zhang, Haopeng [1 ,2 ]
Liu, Linwu [1 ,2 ]
Tao, Jiajun [1 ,2 ]
Zhang, Qian [3 ]
Yang, Kai [3 ]
Xia, Runlong [4 ]
Xie, Jingbo [4 ]
机构
[1] Changsha Univ Sci & Technol, Sch Comp & Commun Engn, Changsha 410114, Hunan, Peoples R China
[2] Changsha Univ Sci & Technol, Hunan Prov Key Lab Intelligent Proc Big Data Tran, Changsha 410114, Hunan, Peoples R China
[3] ZOOMLION Intelligent Technol Corp Ltd, Dept Elect Prod, Changsha 410005, Hunan, Peoples R China
[4] Hunan Inst Sci & Tech Informat, Changsha 410001, Hunan, Peoples R China
基金
中国国家自然科学基金;
关键词
Improved image completion algorithm; Local variation minimization method; Global structure; Known information; Unknown information; QUALITY ASSESSMENT;
D O I
10.1007/s12652-020-02778-2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In order to solve the issue mismatching and structure disconnecting in exemplar-based image inpainting, an image completion algorithm based on improved total variation minimization method had been proposed in the paper, refer as ETVM. The structure of image had been extracted using improved total variation minimization method, and the known information of image is sufficiently used by existing methods. The robust filling mechanism can be achieved according to the direction of image structure and it has less noise than original image. The priority term had been redefined to eliminate the product effect and ensure data term had always effective. The priority of repairing patch and the best matching patch are determined by the similarity of the known information and the consistency of the unknown information in the repairing patch. The comparisons with cognitive computing image algorithms had been shown that the proposed method can ensure better selection of candidate image pixel to fill with, and it is achieved better global coherence of image completion than others. The inpainting results of noisy images show that the proposed method has good robustness and can also get good inpainting results for noisy images.
引用
收藏
页码:5555 / 5564
页数:10
相关论文
共 50 条
[1]   Representation Learning: A Review and New Perspectives [J].
Bengio, Yoshua ;
Courville, Aaron ;
Vincent, Pascal .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (08) :1798-1828
[2]   Image inpainting [J].
Bertalmio, M ;
Sapiro, G ;
Caselles, V ;
Ballester, C .
SIGGRAPH 2000 CONFERENCE PROCEEDINGS, 2000, :417-424
[3]   Exemplar-Based Inpainting: Technical Review and New Heuristics for Better Geometric Reconstructions [J].
Buyssens, Pierre ;
Daisy, Maxime ;
Tschumperle, David ;
Lezoray, Olivier .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (06) :1809-1824
[4]   Geometrically Guided Exemplar-Based Inpainting [J].
Cao, Frederic ;
Gousseau, Yann ;
Masnou, Simon ;
Perez, Patrick .
SIAM JOURNAL ON IMAGING SCIENCES, 2011, 4 (04) :1143-1179
[5]   Nontexture inpainting by curvature-driven diffusions [J].
Chan, TF .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2001, 12 (04) :436-449
[6]   Mathematical models for local nontexture inpaintings [J].
Chan, TF ;
Shen, JH .
SIAM JOURNAL ON APPLIED MATHEMATICS, 2002, 62 (03) :1019-1043
[7]   The face image super-resolution algorithm based on combined representation learning [J].
Chen, Yuantao ;
Phonevilay, Volachith ;
Tao, Jiajun ;
Chen, Xi ;
Xia, Runlong ;
Zhang, Qian ;
Yang, Kai ;
Xiong, Jie ;
Xie, Jingbo .
MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (20) :30839-30861
[8]   Research on image Inpainting algorithm of improved GAN based on two-discriminations networks [J].
Chen, Yuantao ;
Zhang, Haopeng ;
Liu, Linwu ;
Chen, Xi ;
Zhang, Qian ;
Yang, Kai ;
Xia, Runlong ;
Xie, Jingbo .
APPLIED INTELLIGENCE, 2021, 51 (06) :3460-3474
[9]   The image annotation algorithm using convolutional features from intermediate layer of deep learning [J].
Chen, Yuantao ;
Liu, Linwu ;
Tao, Jiajun ;
Chen, Xi ;
Xia, Runlong ;
Zhang, Qian ;
Xiong, Jie ;
Yang, Kai ;
Xie, Jingbo .
MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (03) :4237-4261
[10]   The improved image inpainting algorithm via encoder and similarity constraint [J].
Chen, Yuantao ;
Liu, Linwu ;
Tao, Jiajun ;
Xia, Runlong ;
Zhang, Qian ;
Yang, Kai ;
Xiong, Jie ;
Chen, Xi .
VISUAL COMPUTER, 2021, 37 (07) :1691-1705