INTERACTIVE SEPARATION NETWORK FOR IMAGE INPAINTING

被引:0
作者
Li, Siyuan [1 ]
Lu, Lu [1 ]
Zhang, Zhiqiang [1 ]
Cheng, Xin [1 ]
Xu, Kepeng [1 ]
Yu, Wenxin [1 ]
He, Gang [2 ]
Zhou, Jinjia [3 ]
Yang, Zhuo [4 ]
机构
[1] Southwest Univ Sci & Technol, Mianyang, Sichuan, Peoples R China
[2] Xidian Univ, Xian, Shaanxi, Peoples R China
[3] Hosei Univ, Tokyo, Japan
[4] Guangdong Univ Technol, Guangzhou, Guangdong, Peoples R China
来源
2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP) | 2020年
基金
中国国家自然科学基金;
关键词
Image Inpainting; Deep Learning; Feature Representation; Multi-Scale Feature; Feature Fusion;
D O I
10.1109/icip40778.2020.9191263
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
Image inpainting, also known as image completion, is the process of filling in the missing region of an incomplete image to make the repaired image visually plausible. Strided convolutional layer learns high-level representations while reducing the computational complexity, but fails to preserve existing detail from the original images (eg, texture, sharp transients), therefore it degrades the generative model in image inpainting task. To reduce the erosion of high-resolution components of images meanwhile maintaining the semantic representation, this paper designs a brand-new network called Interactive Separation Network that progressively decomposites the features into two streams and fuses them. Besides, the rationality of network design and the efficiency of proposed network is demonstrated in the ablation study. To the best of our knowledge, the experimental results of proposed method are superior to state-of-the-art inpainting approaches.
引用
收藏
页码:1008 / 1012
页数:5
相关论文
共 19 条
  • [1] [Anonymous], 2018, P 35 INT C MACH LEAR
  • [2] Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolution
    Chen, Yunpeng
    Fan, Haoqi
    Xu, Bing
    Yan, Zhicheng
    Kalantidis, Yannis
    Rohrbach, Marcus
    Yan, Shuicheng
    Feng, Jiashi
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 3434 - 3443
  • [3] Generative Adversarial Networks
    Goodfellow, Ian
    Pouget-Abadie, Jean
    Mirza, Mehdi
    Xu, Bing
    Warde-Farley, David
    Ozair, Sherjil
    Courville, Aaron
    Bengio, Yoshua
    [J]. COMMUNICATIONS OF THE ACM, 2020, 63 (11) : 139 - 144
  • [4] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778
  • [5] Globally and Locally Consistent Image Completion
    Iizuka, Satoshi
    Simo-Serra, Edgar
    Ishikawa, Hiroshi
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (04):
  • [6] Perceptual Losses for Real-Time Style Transfer and Super-Resolution
    Johnson, Justin
    Alahi, Alexandre
    Li Fei-Fei
    [J]. COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 : 694 - 711
  • [7] Feature Pyramid Networks for Object Detection
    Lin, Tsung-Yi
    Dollar, Piotr
    Girshick, Ross
    He, Kaiming
    Hariharan, Bharath
    Belongie, Serge
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 936 - 944
  • [8] Image Inpainting for Irregular Holes Using Partial Convolutions
    Liu, Guilin
    Reda, Fitsum A.
    Shih, Kevin J.
    Wang, Ting-Chun
    Tao, Andrew
    Catanzaro, Bryan
    [J]. COMPUTER VISION - ECCV 2018, PT XI, 2018, 11215 : 89 - 105
  • [9] Deep Learning Face Attributes in the Wild
    Liu, Ziwei
    Luo, Ping
    Wang, Xiaogang
    Tang, Xiaoou
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 3730 - 3738
  • [10] Miyato Takeru, 2018, P ICLR