AN EDGE INFORMATION AND MASK SHRINKING BASED IMAGE INPAINTING APPROACH

被引:1
作者
Xu, Huali [1 ]
Su, Xiangdong [1 ]
Wang, Meng [1 ]
Hao, Xiang [1 ]
Gao, Guanglai [1 ]
机构
[1] Inner Mongolia Univ, Coll Comp Sci, Inner Mongolia Key Lab Mongolian Informat Proc Te, Hohhot, Peoples R China
来源
2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME) | 2020年
基金
中国国家自然科学基金;
关键词
image inpainting; edge information; mask shrinking strategy; adversarial learning;
D O I
10.1109/icme46284.2020.9102892
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In the image inpainting task, the ability to repair both high-frequency and low-frequency information in the missing regions has a substantial influence on the quality of the restored image. However, existing inpainting methods usually fail to consider both high-frequency and low-frequency information simultaneously. To solve this problem, this paper proposes edge information and mask shrinking based image inpainting approach, which consists of two models. The first model is an edge generation model used to generate complete edge information from the damaged image, and the second model is an image completion model used to fix the missing regions with the generated edge information and the valid contents of the damaged image. The mask shrinking strategy is employed in the image completion model to track the areas to be repaired. The proposed approach is evaluated qualitatively and quantitatively on the dataset Places2. The result shows our approach outperforms state-of-the-art methods.
引用
收藏
页数:6
相关论文
共 17 条
[11]  
Liu G., 2018, IMAGE INPAINTING IRR
[12]   Context Encoders: Feature Learning by Inpainting [J].
Pathak, Deepak ;
Krahenbuhl, Philipp ;
Donahue, Jeff ;
Darrell, Trevor ;
Efros, Alexei A. .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :2536-2544
[13]   U-Net: Convolutional Networks for Biomedical Image Segmentation [J].
Ronneberger, Olaf ;
Fischer, Philipp ;
Brox, Thomas .
MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION, PT III, 2015, 9351 :234-241
[14]   High-Resolution Image Inpainting using Multi-Scale Neural Patch Synthesis [J].
Yang, Chao ;
Lu, Xin ;
Lin, Zhe ;
Shechtman, Eli ;
Wang, Oliver ;
Li, Hao .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :4076-4084
[15]   Pluralistic Image Completion [J].
Zheng, Chuanxia ;
Cham, Tat-Jen ;
Cai, Jianfei .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1438-1447
[16]   Places: A 10 Million Image Database for Scene Recognition [J].
Zhou, Bolei ;
Lapedriza, Agata ;
Khosla, Aditya ;
Oliva, Aude ;
Torralba, Antonio .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (06) :1452-1464
[17]   Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks [J].
Zhu, Jun-Yan ;
Park, Taesung ;
Isola, Phillip ;
Efros, Alexei A. .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :2242-2251