DARGS: Image inpainting algorithm via deep attention residuals group and semantics

被引:48
作者
Chen, Yuantao [1 ]
Xia, Runlong [2 ]
Yang, Kai [3 ]
Zou, Ke [4 ]
机构
[1] Hunan Univ Informat Technol, Sch Comp Sci & Engn, Changsha 410151, Hunan, Peoples R China
[2] Mt Yuelu Breeding Innovat Ctr Ltd, Changsha 410000, Hunan, Peoples R China
[3] Hunan ZOOMLION Intelligent Technol Corp Ltd, Changsha 410005, Hunan, Peoples R China
[4] Hunan WUJO High Tech Mat Corp Ltd, Loudi 417000, Hunan, Peoples R China
关键词
Image Inpainting; Deep Learning; Deep Attention Residual Group; Semantic Network;
D O I
10.1016/j.jksuci.2023.101567
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To solving the problems that the existing image inpainting methods lack authenticity, do not deal with the information of missing and non-missing regions flexibly, and do not deal with the image feature information on different stages effectively, we propose an image restoration method combining Semantic Priors and Deep Attention Residual Group. The image restoration method mainly consists of Semantic Priors Network, Deep Attention Residual Group, and Full-scale Skip Connection. The Semantic Priors Network learns the complete semantic prior information of the visual elements in the missing regions and completes the missing regions with the learned semantic information. The deep attention residual set allows the generator to focus more on not only the missing regions of the image but also to learn the features of each channel adaptive. The full-scale jump joins can combine the lowlevel feature maps containing image boundaries with the high-level feature maps containing image textures and details to repair the missing regions. In this paper, a full comparison experiment is conducted on the CelebA-HQ and the Paris StreetView datasets, and the experimental results show that proposed method outperforms the current representative state-of-the-art image restoration methods.& COPY; 2023 The Author(s). Published by Elsevier B.V. on behalf of King Saud University. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
引用
收藏
页数:11
相关论文
共 31 条
[1]   The effect of loss function on conditional generative adversarial networks [J].
Abu-Srhan, Alaa ;
Abushariah, Mohammad A. M. ;
Al-Kadi, Omar S. .
JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (09) :6977-6988
[2]  
Agarwal M, 2019, INT CONF ADV COMPU, P176, DOI [10.1109/IACC48062.2019.8971602, 10.1109/iacc48062.2019.8971602]
[3]   AuSR1: Authentication and self-recovery using a new image inpainting technique with LSB shifting in fragile image watermarking [J].
Aminuddin, Afrig ;
Ernawan, Ferda .
JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (08) :5822-5840
[4]  
Bescos B, 2019, IEEE INT CONF ROBOT, P5460, DOI [10.1109/icra.2019.8794417, 10.1109/ICRA.2019.8794417]
[5]   Eye In-Painting with Exemplar Generative Adversarial Networks [J].
Dolhansky, Brian ;
Ferrer, Cristian Canton .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :7902-7911
[6]  
Dong HY, 2019, Arxiv, DOI arXiv:1906.00884
[7]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[8]   FiNet: Compatible and Diverse Fashion Image Inpainting [J].
Han, Xintong ;
Wu, Zuxuan ;
Huang, Weilin ;
Scott, Matthew R. ;
Davis, Larry S. .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :4480-4490
[9]  
Hui Z, 2020, Arxiv, DOI arXiv:2002.02609
[10]   Globally and Locally Consistent Image Completion [J].
Iizuka, Satoshi ;
Simo-Serra, Edgar ;
Ishikawa, Hiroshi .
ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (04)