An Adaptive Iterative Inpainting Method with More Information Exploration

被引:0
作者
Chen, Shengjie [1 ]
Guo, Zhenhua [1 ]
Yuan, Bo [1 ]
机构
[1] Tsinghua Univ, Beijing, Peoples R China
来源
PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021 | 2021年
关键词
Image inpainting; neural networks; adversarial learning; IMAGE; DIFFUSION;
D O I
10.1145/3474085.3475475
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The CNN-based image inpainting methods have achieved promising performance because of its outstanding semantic understanding and reasoning potentialities. However, previous works could not get satisfied results in some situations because information is not fully explored. In this paper, we propose a new method by combining three innovative ideas. First, to increase the diversity of the semantic information obtained by the network in image synthesis, we propose a multiple hidden space perceptual (MHSP) loss, which extracts high-level features from multiple pre-trained autoencoders. Second, we adopt an adaptive iterative reasoning (AIR) stategy to reduce the calculations under small-hole circumstances while ensuring the performance in large-hole circumstances. Third, we find that color inconsistencies occasionally occurred in the final image merging process, so we add a novel interval maximum saturation (IMS) loss to the final loss function. Experiments on the benchmark datasets show our method performs favorably against state-of-the-art approaches. Code is made publicly available at: https://github.com/IC-LAB/adaptive_iterative_inpainting.
引用
收藏
页码:3247 / 3256
页数:10
相关论文
共 58 条
[1]   Fast image stitching method for handling dynamic object problems in Panoramic Images [J].
Abdukholikov, Murodjon ;
Whangbo, Taegkeun .
KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2017, 11 (11) :5419-5435
[2]  
[Anonymous], 2017, ARXIV171205927
[3]   PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing [J].
Barnes, Connelly ;
Shechtman, Eli ;
Finkelstein, Adam ;
Goldman, Dan B. .
ACM TRANSACTIONS ON GRAPHICS, 2009, 28 (03)
[4]   Underwater Image Stitching based on SIFT and Wavelet Fusion [J].
Chen, Meimei ;
Nian, Rui ;
He, Bo ;
Qiu, Shuqi ;
Liu, Xuefei ;
Yan, Tianhong .
OCEANS 2015 - GENOVA, 2015,
[5]   An Improved Method for Semantic Image Inpainting with GANs: Progressive Inpainting [J].
Chen, Yizhen ;
Hu, Haifeng .
NEURAL PROCESSING LETTERS, 2019, 49 (03) :1355-1367
[6]   What Makes Paris Look like Paris? [J].
Doersch, Carl ;
Singh, Saurabh ;
Gupta, Abhinav ;
Sivic, Josef ;
Efros, Alexei A. .
ACM TRANSACTIONS ON GRAPHICS, 2012, 31 (04)
[7]   Image Inpainting: A Review [J].
Elharrouss, Omar ;
Almaadeed, Noor ;
Al-Maadeed, Somaya ;
Akbari, Younes .
NEURAL PROCESSING LETTERS, 2020, 51 (02) :2007-2028
[8]   Progressive Image Inpainting with Full-Resolution Residual Network [J].
Guo, Zongyu ;
Chen, Zhibo ;
Yu, Tao ;
Chen, Jiale ;
Liu, Sen .
PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, :2496-2504
[9]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[10]  
Heusel M, 2017, ADV NEUR IN, V30