Semantic face image inpainting based on Generative Adversarial Network

被引:1
作者
Zhang, Heshu [1 ]
Li, Tao [1 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Automat, Nanjing, Peoples R China
来源
2020 35TH YOUTH ACADEMIC ANNUAL CONFERENCE OF CHINESE ASSOCIATION OF AUTOMATION (YAC) | 2020年
关键词
image degradation; image inpainting; generative adversarial network; multi-scale; feature fusion;
D O I
10.1109/YAC51587.2020.9337498
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the popularity of Internet technology and camera equipment, people are accustomed to using images and videos to record life. Image deletion is one of the most important degradation directions when image degradation occurs. The repair process of the digital image repair method is to use the information of the missing part of the image, according to certain repair rules to repair and fill the missing part of the image, so that the repaired image is complete and natural. At present, the existing image inpainting algorithms still have some shortcomings in visual effect and algorithm efficiency. In order to solve the problems of fuzzy details and poor visual perception of the existing technology in the implementation of face image inpainting results, as well as the problem that the whole model could not be controlled due to the mode collapse caused by the use of the generative adversarial network, this paper provides a semantic inpainting method of face image based on multi-scale feature fusion. Using suppression enhancement unit to suppress useless channels, enhance useful channels, acquire long-range and multi-level dependency interaction without increasing parameters, coordinate the details of each position and the details of the far end when repairing the image, expand the receptive field, make up for the lack of information when generating the missing image edge, balance the learning ability of generating network and discriminating network to improve the inpainting effect of missing face image.
引用
收藏
页码:530 / 535
页数:6
相关论文
共 13 条
  • [1] Filling-in by joint interpolation of vector fields and gray levels
    Ballester, C
    Bertalmio, M
    Caselles, V
    Sapiro, G
    Verdera, J
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2001, 10 (08) : 1200 - 1211
  • [2] Single Image Super-Resolution Based on Multi-Scale Competitive Convolutional Neural Network
    Du, Xiaofeng
    Qu, Xiaobo
    He, Yifan
    Guo, Di
    [J]. SENSORS, 2018, 18 (03)
  • [3] Goodfellow I J, 2014, ADV NEUR IN, P1110
  • [4] Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/CVPR.2018.00745, 10.1109/TPAMI.2019.2913372]
  • [5] Globally and Locally Consistent Image Completion
    Iizuka, Satoshi
    Simo-Serra, Edgar
    Ishikawa, Hiroshi
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (04):
  • [6] Image-to-Image Translation with Conditional Adversarial Networks
    Isola, Phillip
    Zhu, Jun-Yan
    Zhou, Tinghui
    Efros, Alexei A.
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 5967 - 5976
  • [7] Oktay O., 2018, PROC INT C MED IMAG
  • [8] Paszke Adam., AUTOMANTIC DIFFERENT, P207
  • [9] Context Encoders: Feature Learning by Inpainting
    Pathak, Deepak
    Krahenbuhl, Philipp
    Donahue, Jeff
    Darrell, Trevor
    Efros, Alexei A.
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 2536 - 2544
  • [10] U-Net: Convolutional Networks for Biomedical Image Segmentation
    Ronneberger, Olaf
    Fischer, Philipp
    Brox, Thomas
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION, PT III, 2015, 9351 : 234 - 241