Multi-channel Image Inpainting Algorithm Based on Edge Prediction

被引:0
作者
Liu, Jianwen [1 ,2 ,3 ]
Yang, Ying [1 ,2 ,3 ]
Zhang, Juan [2 ,3 ]
Zhou, Mingquan [2 ,3 ]
Xue, Jiarui [1 ]
机构
[1] Shaanxi Normal Univ, Sch Comp Sci, Xian 710062, Peoples R China
[2] Shaanxi Normal Univ, Sch Journalism & Commun, Xian 710062, Peoples R China
[3] Shaanxi Normal Univ, Culture Educ Intelligent & Commun Engn Technol Re, Xian 710062, Peoples R China
来源
THIRTEENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING (ICGIP 2021) | 2022年 / 12083卷
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Image Inpainting; DCGAN; Gated Convolution; Multi-channel; Deep Learning;
D O I
10.1117/12.2623237
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
This paper considers how to restore an image with large stained areas. An end to end model is proposed, which contains two networks, an edge generation adversarial network and a content generative adversarial network. First, the edge generation adversarial network is deployed to infer the missing boundaries of the image. Then the second network with a designed edge information channel is employed to restore the missing or stained areas of the image with the guidance of the inferred boundaries. Experiments were performed on ImageNet. The results show that the proposed model can better understand the semantic information of the stained area by introducing additional object contour channels and greatly improve the inpainting capability of the model. Quantitative evaluation indexes show that the proposed model is 4.5% better than the DeepFill V2 model in structural similarity and 7.1% better than the DeepFill V2 model in Peak Signal-to-Noise Ratio.
引用
收藏
页数:9
相关论文
共 50 条
[21]   A Channel Calibration Algorithm Based on Isolated Scatterers for Multi-Channel HRWS-SAR [J].
Wu, Di ;
Zhang, Yudong ;
Zhu, Daiyin ;
Wang, Shuihua ;
Shen, Mingwei .
IEEE ACCESS, 2019, 7 :135665-135677
[22]   Toxicity Prediction Method Based on Multi-Channel Convolutional Neural Network [J].
Yuan, Qing ;
Wei, Zhiqiang ;
Guan, Xu ;
Jiang, Mingjian ;
Wang, Shuang ;
Zhang, Shugang ;
Li, Zhen .
MOLECULES, 2019, 24 (18)
[23]   A Multi-Channel Frequency Router Based on an Optimization Algorithm and Dispersion Engineering [J].
Yuan, Hongyi ;
Zhang, Nianen ;
Zhang, Hongyu ;
Lu, Cuicui .
NANOMATERIALS, 2023, 13 (14)
[24]   A Novel Multi-Channel Image Encryption Algorithm Leveraging Pixel Reorganization and Hyperchaotic Maps [J].
Feng, Wei ;
Yang, Jiaxin ;
Zhao, Xiangyu ;
Qin, Zhentao ;
Zhang, Jing ;
Zhu, Zhengguo ;
Wen, Heping ;
Qian, Kun .
MATHEMATICS, 2024, 12 (24)
[25]   A image processing algorithm with marker for high-speed and multi-channel star sensor [J].
Zhou Q. ;
Mao X. ;
Zhang Q. ;
Ma X. ;
Wei L. .
Harbin Gongye Daxue Xuebao/Journal of Harbin Institute of Technology, 2016, 48 (10) :119-124
[26]   Design of an Adaptive Multi-Channel Algorithm in WLANs [J].
Alsufyani, Azhar A. ;
Almotairi, Khaled H. .
2019 2ND INTERNATIONAL CONFERENCE ON COMPUTER APPLICATIONS & INFORMATION SECURITY (ICCAIS), 2019,
[27]   Multi-discriminator image inpainting algorithm based on hybrid dilated convolution network [J].
Li H. ;
Wu Z. ;
Guo L. ;
Chen J. .
Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition), 2021, 49 (03) :40-45
[28]   A distributed channel allocation algorithm for multi-channel wireless networks [J].
Yu, Xutao ;
Shi, Xiaoxiang ;
Hua, Jingyu .
Information Technology Journal, 2013, 12 (01) :209-213
[29]   Image Inpainting Based on Structural Tensor Edge Intensity Model [J].
Jing Wang ;
Yan-Hong Zhou ;
Hai-Feng Sima ;
Zhan-Qiang Huo ;
Ai-Zhong Mi .
International Journal of Automation and Computing, 2021, 18 :256-265
[30]   Image Inpainting Based on Structural Tensor Edge Intensity Model [J].
Wang, Jing ;
Zhou, Yan-Hong ;
Sima, Hai-Feng ;
Huo, Zhan-Qiang ;
Mi, Ai-Zhong .
INTERNATIONAL JOURNAL OF AUTOMATION AND COMPUTING, 2021, 18 (02) :256-265