Face image super-resolution with an attention mechanism

被引:0
作者
Chen X. [1 ]
Shen H. [1 ]
Bian Q. [1 ]
Wang Z. [1 ]
Tian X. [1 ]
机构
[1] School of Electronical and Information Engineering, Xi'an SiYuan Univ., Xi'an
来源
Xi'an Dianzi Keji Daxue Xuebao/Journal of Xidian University | 2019年 / 46卷 / 03期
关键词
Attention mechanism; Deep convolutional neural network; Deep residual network; Generative adversarial network; Super-resolution;
D O I
10.19665/j.issn1001-2400.2019.03.022
中图分类号
学科分类号
摘要
Because of the limitation of the imaging equipment, the face images captured by it usually have the problem of low resolution and low quality. This paper proposes a method based on the generative adversarial network and attention mechanism for the multi-scale super-resolution of face images. In this paper, the deep residual network and the deep convolutional neural network (VGG-net) are used as the generator and the discriminator, respectively. The attention modules are combined with the residual blocks in the deep residual network to reconstruct face images which are highly similar to the high-resolution images and difficult for the discriminator to distinguish. Experimental results demonstrate the effectiveness of the proposed method in multi-scale face image super-resolution and the important role of the attention mechanism in image detail reconstruction. © 2019, The Editorial Board of Journal of Xidian University. All right reserved.
引用
收藏
页码:148 / 153
页数:5
相关论文
共 16 条
[1]  
Goodfellow I.J., Pouget-Abadie J., Mirza M., Et al., Generative Adversarial Nets, Advances in Neural Information Processing Systems, pp. 2672-2680, (2014)
[2]  
Ledig C., Theis L., Huszar F., Et al., Photo-realistic Single Image Super-resolution Using a Generative Adversarial Network, Proceedings of the 2017 30th IEEE Conference on Computer Vision and Pattern Recognition, pp. 105-114, (2017)
[3]  
Chen Z., Tong Y., Face Super-resolution through Wasserstein GANs
[4]  
Sun Y., Song H., Zhang K., Et al., Face Super-resolution via Deep Convolutional Neural Networks, Journal of Computer Application, 38, 4, pp. 1141-1145, (2018)
[5]  
Zhang H., Goodfellow I., Metaxas D., Et al., Self-attention Generative Adversarial Networks
[6]  
Wang F., Jiang M.Q., Qian C., Et al., Residual Attention Network for Image Classification, Proceedings of the 2017 30th IEEE Conference on Computer Vision and Pattern Recognition, pp. 6450-6458, (2017)
[7]  
Zhang Y., Li K.P., Li K., Et al., Image Super-resolution Using Very Deep Residual Channel Attention Networks, Lecture Notes in Computer Science: 11211, pp. 294-310, (2018)
[8]  
Lim B., Son S., Kim H., Et al., Enhanced Deep Residual Networks for Single Image Super-resolution, Proceedings of the 2017 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, pp. 1132-1140, (2017)
[9]  
Arjovsky M., Chintala S., Bottou L., Wasserstein GAN
[10]  
Jetley S., Lord N.A., Lee N., Et al., Learn to Pay Attention