Multi-channel Image Inpainting Algorithm Based on Edge Prediction

被引:0
作者
Liu, Jianwen [1 ,2 ,3 ]
Yang, Ying [1 ,2 ,3 ]
Zhang, Juan [2 ,3 ]
Zhou, Mingquan [2 ,3 ]
Xue, Jiarui [1 ]
机构
[1] Shaanxi Normal Univ, Sch Comp Sci, Xian 710062, Peoples R China
[2] Shaanxi Normal Univ, Sch Journalism & Commun, Xian 710062, Peoples R China
[3] Shaanxi Normal Univ, Culture Educ Intelligent & Commun Engn Technol Re, Xian 710062, Peoples R China
来源
THIRTEENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING (ICGIP 2021) | 2022年 / 12083卷
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Image Inpainting; DCGAN; Gated Convolution; Multi-channel; Deep Learning;
D O I
10.1117/12.2623237
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
This paper considers how to restore an image with large stained areas. An end to end model is proposed, which contains two networks, an edge generation adversarial network and a content generative adversarial network. First, the edge generation adversarial network is deployed to infer the missing boundaries of the image. Then the second network with a designed edge information channel is employed to restore the missing or stained areas of the image with the guidance of the inferred boundaries. Experiments were performed on ImageNet. The results show that the proposed model can better understand the semantic information of the stained area by introducing additional object contour channels and greatly improve the inpainting capability of the model. Quantitative evaluation indexes show that the proposed model is 4.5% better than the DeepFill V2 model in structural similarity and 7.1% better than the DeepFill V2 model in Peak Signal-to-Noise Ratio.
引用
收藏
页数:9
相关论文
共 50 条
[41]   Image inpainting algorithm based on double cross TV [J].
Zhai, Dong-Hai ;
Duan, Wei-Xia ;
Yu, Jiang .
Dianzi Keji Daxue Xuebao/Journal of the University of Electronic Science and Technology of China, 2014, 43 (03) :432-436
[42]   A New Approach of Image Inpainting Based on PSO Algorithm [J].
Chung, Shu-Chiang ;
Kuan, Ta-Wen ;
Lu, Chuan-Pin ;
Lin, Hsin-Yi .
1ST INTERNATIONAL CONFERENCE ON ORANGE TECHNOLOGIES (ICOT 2013), 2013, :205-209
[43]   Research on Algorithm for Fast Image Inpainting Based on Exemplars [J].
Zhu, Shengfeng .
PROCEEDINGS OF THE 2018 3RD INTERNATIONAL WORKSHOP ON MATERIALS ENGINEERING AND COMPUTER SCIENCES (IWMECS 2018), 2018, 78 :226-230
[44]   Multi-Channel CNN based image classification using SKIP connection and MSVM [J].
Kesav N. ;
Jibukumar M.G. .
International Journal of Computers and Applications, 2022, 44 (10) :981-990
[45]   A New Image Inpainting Approach based on Criminisi Algorithm [J].
Ouattara, Nouho ;
Loum, Georges Laussane ;
Pandry, Ghislain Koffi ;
Atiampo, Armand Kodjo .
INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2019, 10 (06) :423-433
[46]   Underwater Image Enhancement Network Based on Multi-channel Hybrid Attention Mechanism [J].
Li, Yun ;
Sun, Shanlin ;
Huang, Qing ;
Jing, Peiguang .
JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2024, 46 (01) :118-128
[47]   Research on Luggage Package Extraction of X-ray Images Based on Edge Sensitive Multi-Channel Background Difference Algorithm [J].
Song, Xueping ;
Zhang, Shuyu ;
Yang, Jianming ;
Zhang, Jicun .
APPLIED SCIENCES-BASEL, 2023, 13 (21)
[48]   A Novel Exemplar-based Image Inpainting Algorithm [J].
Liu Ying ;
Liu Chan-juan ;
Zou Hai-lin ;
Zhou Shu-sen ;
Shen Qian ;
Chen Tong-tong .
2015 INTERNATIONAL CONFERENCE ON INTELLIGENT NETWORKING AND COLLABORATIVE SYSTEMS IEEE INCOS 2015, 2015, :86-90
[49]   Image Inpainting Algorithm Based on Deep Neural Networks [J].
Lyu, Jianfeng ;
Shao, Lizhen ;
Lei, Xuemei .
Computer Engineering and Applications, 2023, 59 (20) :1-12
[50]   Enhanced algorithm for Exemplar-based Image Inpainting [J].
Liu, Ye-fei ;
Wang, Fu-long ;
Xi, Xiang-yan .
2013 9TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND SECURITY (CIS), 2013, :209-213