Multi-channel Image Inpainting Algorithm Based on Edge Prediction

被引:0
|
作者
Liu, Jianwen [1 ,2 ,3 ]
Yang, Ying [1 ,2 ,3 ]
Zhang, Juan [2 ,3 ]
Zhou, Mingquan [2 ,3 ]
Xue, Jiarui [1 ]
机构
[1] Shaanxi Normal Univ, Sch Comp Sci, Xian 710062, Peoples R China
[2] Shaanxi Normal Univ, Sch Journalism & Commun, Xian 710062, Peoples R China
[3] Shaanxi Normal Univ, Culture Educ Intelligent & Commun Engn Technol Re, Xian 710062, Peoples R China
来源
THIRTEENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING (ICGIP 2021) | 2022年 / 12083卷
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Image Inpainting; DCGAN; Gated Convolution; Multi-channel; Deep Learning;
D O I
10.1117/12.2623237
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
This paper considers how to restore an image with large stained areas. An end to end model is proposed, which contains two networks, an edge generation adversarial network and a content generative adversarial network. First, the edge generation adversarial network is deployed to infer the missing boundaries of the image. Then the second network with a designed edge information channel is employed to restore the missing or stained areas of the image with the guidance of the inferred boundaries. Experiments were performed on ImageNet. The results show that the proposed model can better understand the semantic information of the stained area by introducing additional object contour channels and greatly improve the inpainting capability of the model. Quantitative evaluation indexes show that the proposed model is 4.5% better than the DeepFill V2 model in structural similarity and 7.1% better than the DeepFill V2 model in Peak Signal-to-Noise Ratio.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Blind dereverberation algorithm for speech signals based on multi-channel linear prediction
    Delcroix, Marc
    Hikichi, Takafumi
    Miyoshi, Masato
    ACOUSTICAL SCIENCE AND TECHNOLOGY, 2005, 26 (05) : 432 - 439
  • [2] Image Inpainting Algorithm Based on Edge Feature and Pixel Structure Similarity
    Tao Z.
    Zhang J.
    Wang L.
    Zhan W.
    Wang L.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2019, 31 (10): : 1768 - 1776
  • [3] ISAR Image Inpainting Algorithm Based on DCGAN
    Wang, Tingfei
    Gao, Jingpeng
    Jiang, Zhiye
    2021 INTERNATIONAL SYMPOSIUM ON ANTENNAS AND PROPAGATION (ISAP), 2021,
  • [4] On a blind speech dereverberation algorithm using multi-channel linear prediction
    Delcroix, Marc
    Hikichi, Takafumi
    Miyoshvi, Masato
    IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2006, E89A (10) : 2837 - 2846
  • [5] Low-light image enhancement algorithm based on multi-channel fusion attention network
    Chen Q.
    Gu Y.
    Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2023, 31 (14): : 2111 - 2122
  • [6] Image compression with edge-based inpainting
    Liu, Dong
    Sun, Xiaoyan
    Wu, Feng
    Li, Shipeng
    Zhang, Ya-Qin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2007, 17 (10) : 1273 - 1287
  • [7] Generative image inpainting using edge prediction and appearance flow
    Qian Liu
    Hua Ji
    Gang Liu
    Multimedia Tools and Applications, 2022, 81 : 31709 - 31725
  • [8] Generative image inpainting using edge prediction and appearance flow
    Liu, Qian
    Ji, Hua
    Liu, Gang
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (22) : 31709 - 31725
  • [9] Multi-Channel Based Image Processing Scheme for Pneumonia Identification
    Nneji, Grace Ugochi
    Cai, Jingye
    Deng, Jianhua
    Monday, Happy Nkanta
    James, Edidiong Christopher
    Ukwuoma, Chiagoziem Chima
    DIAGNOSTICS, 2022, 12 (02)
  • [10] An Improved Image Inpainting Algorithm based on Image Segmentation
    Ying, Huang
    Kai, Li
    Ming, Yang
    ADVANCES IN INFORMATION AND COMMUNICATION TECHNOLOGY, 2017, 107 : 796 - 801