Image inpainting based on deep learning: A review

被引:110
作者
Qin, Zhen [1 ]
Zeng, Qingliang [2 ]
Zong, Yixin [3 ]
Xu, Fan [4 ]
机构
[1] Hunan Univ, Sch Design, Changsha, Peoples R China
[2] Wave Grp, Cognit Comp Technol Joint Lab, Beijing, Peoples R China
[3] Chinese Acad Sci, Bur Frontier Sci & Educ, Beijing, Peoples R China
[4] Beijing Inst Control Engn, Beijing, Peoples R China
基金
美国国家科学基金会;
关键词
Computer vision; Image inpainting; Variational autoencoder (VAE); Generative adversarial networks (GAN); INTERPOLATION; REMOVAL;
D O I
10.1016/j.displa.2021.102028
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Image inpainting aims to restore the pixel features of damaged parts in incomplete image and plays a key role in many computer vision tasks. Image inpainting technology based on deep learning is a major current research hotspot. To deeply understand related methods and technologies, this article combs and summarizes the latest research status in this field. Firstly, we summarize inpainting methods of different types of neural network structure based on deep learning, then analyze and study important technical improvement mechanisms. In addition, various algorithms are comprehensively reviewed from the aspects of model network structure and restoration methods. And we select some representative image inpainting methods for comparison and analysis. Finally, the current problems of image inpainting are summarized, and the future development trend and research direction are prospected.
引用
收藏
页数:14
相关论文
共 96 条
[1]  
[Anonymous], 2017, Computing Research Repository
[2]  
[Anonymous], 2018, INFORM CONSTRAINTS A
[3]  
Arjovsky M, 2017, PR MACH LEARN RES, V70
[4]   Adaptive hash retrieval with kernel based similarity [J].
Bai, Xiao ;
Yan, Cheng ;
Yang, Haichuan ;
Bai, Lu ;
Zhou, Jun ;
Hancock, Edwin Robert .
PATTERN RECOGNITION, 2018, 75 :136-148
[5]   Filling-in by joint interpolation of vector fields and gray levels [J].
Ballester, C ;
Bertalmio, M ;
Caselles, V ;
Sapiro, G ;
Verdera, J .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2001, 10 (08) :1200-1211
[6]   PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing [J].
Barnes, Connelly ;
Shechtman, Eli ;
Finkelstein, Adam ;
Goldman, Dan B. .
ACM TRANSACTIONS ON GRAPHICS, 2009, 28 (03)
[7]  
Bera Sutanu, 2020, LIGHTWEIGHT MODULES
[8]  
Bertalmío M, 2001, PROC CVPR IEEE, P355
[9]   Simultaneous structure and texture image inpainting [J].
Bertalmio, M ;
Vese, L ;
Sapiro, G ;
Osher, S .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2003, 12 (08) :882-889
[10]   Image inpainting [J].
Bertalmio, M ;
Sapiro, G ;
Caselles, V ;
Ballester, C .
SIGGRAPH 2000 CONFERENCE PROCEEDINGS, 2000, :417-424