Image Inpainting Based on Interactive Separation Network and Progressive Reconstruction Algorithm

被引:3
作者
Gong, Jun [1 ,2 ]
Li, Siyuan [2 ]
Chen, Shiyu [2 ]
Nie, Liang [2 ]
Cheng, Xin [3 ]
Zhang, Zhiqiang [3 ]
Yu, Wenxin [2 ]
机构
[1] Beijing Inst Technol, Informat Syst & Secur & Countermeasures Expt Ctr, Beijing 100081, Peoples R China
[2] Southwest Univ Sci & Technol, Sch Comp Sci & Technol, Mianyang 621010, Sichuan, Peoples R China
[3] Hosei Univ, Grad Sch Sci & Engn, Tokyo 1848584, Japan
关键词
Semantics; Image reconstruction; Feature extraction; Generative adversarial networks; Image edge detection; Task analysis; Robustness; Image inpainting; image completion; feature fusion; reconstruction algorithms; QUALITY ASSESSMENT; MODEL;
D O I
10.1109/ACCESS.2022.3186009
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, learning-based image inpainting has gained much attention. It widely utilizes an auto-encoder structure and can obtain compact feature representation in the encoder to achieve high-quality image inpainting. Although this approach has achieved encouraging inpainting results, it inevitably reduces the high-resolution representation due to interval downsampling. In order to solve this problem and achieve an excellent image inpainting effect, this paper proposes a brand-new generative network, Interactive Separation Network, which retains the high-resolution information and extracts the semantic features from corrupted images. Furthermore, this paper also discusses network designs with different complexity in different application scenarios. Finally, to improve the effectiveness and robustness of our proposal to large corrupted regions in the inpainting image, we further propose a flexible and highly reusable reconstruction scheme to complete the inpainting in the prediction process gradually. Experiments show that our proposed generation network and reconstruction scheme can significantly improve the quality of repaired images. The proposed method significantly outperforms the state-of-the-art image inpainting approaches in image quality.
引用
收藏
页码:67814 / 67825
页数:12
相关论文
共 41 条
[1]  
[Anonymous], 2017, PROC INT C LEARN REP
[2]  
[Anonymous], 2012, P 25 INT C NEUR INF
[3]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307
[4]  
Erhan D, 2016, ARXIV, P21
[5]  
Fan Q., 2019, PROC CVPR IEEE
[7]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[8]  
Guo X, 2021, ICCV, P14134
[9]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[10]   Rethinking Image Inpainting via a Mutual Encoder-Decoder with Feature Equalizations [J].
Liu, Hongyu ;
Jiang, Bin ;
Song, Yibing ;
Huang, Wei ;
Yang, Chao .
COMPUTER VISION - ECCV 2020, PT II, 2020, 12347 :725-741