Image Super-Resolution Based on Non-local Convolutional Neural Network

被引:0
作者
Zhao, Liling [1 ,2 ]
Lu, Taohui [1 ]
Sun, Quansen [1 ,2 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Nanjing 210044, Jiangsu, Peoples R China
[2] Nanjing Univ Sci & Technol, Nanjing 210094, Jiangsu, Peoples R China
来源
PATTERN RECOGNITION AND COMPUTER VISION, PT I, PRCV 2020 | 2020年 / 12305卷
基金
中国国家自然科学基金;
关键词
Non-local; SRGAN; Super-resolution; Deep learning;
D O I
10.1007/978-3-030-60633-6_48
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Super-resolution (SR) is a widely used image processing technology. Recently, deep learning theory has been introduced into image SR task and achieved a significant improvement. However, feature extraction by convolutional mask is often operated in image local blocks, few attentions are given to non-local. Our aim is to insert a non-local network module into deep learning framework to further improve the performance of SR network. We choose ResNet as backbone and SRGAN as benchmark. The non-local network module is added into ResNet and a newgenerator network based on SRGANis designed. To our knowledge, it is the first time to introduce non-local module into SR convolutional neural network. With a full discussion about the new generator network structure, our experiment shows that the introduction of non-local network for high resolution image generation has a superior performance to local or global convolutional neural network in image SR tasks.
引用
收藏
页码:577 / 588
页数:12
相关论文
共 27 条
[1]   NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study [J].
Agustsson, Eirikur ;
Timofte, Radu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1122-1131
[2]   Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding [J].
Bevilacqua, Marco ;
Roumy, Aline ;
Guillemot, Christine ;
Morel, Marie-Line Alberi .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
[3]   Learning a Deep Convolutional Network for Image Super-Resolution [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 :184-199
[4]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[5]   Image Super-Resolution via Dual-State Recurrent Networks [J].
Han, Wei ;
Chang, Shiyu ;
Liu, Ding ;
Yu, Mo ;
Witbrock, Michael ;
Huang, Thomas S. .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :1654-1663
[6]   Reducing the dimensionality of data with neural networks [J].
Hinton, G. E. ;
Salakhutdinov, R. R. .
SCIENCE, 2006, 313 (5786) :504-507
[7]  
Kim J, 2016, IEEE CONF COMPUT
[8]   Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolution [J].
Lai, Wei-Sheng ;
Huang, Jia-Bin ;
Ahuja, Narendra ;
Yang, Ming-Hsuan .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5835-5843
[9]   Deep learning [J].
LeCun, Yann ;
Bengio, Yoshua ;
Hinton, Geoffrey .
NATURE, 2015, 521 (7553) :436-444
[10]   Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network [J].
Ledig, Christian ;
Theis, Lucas ;
Huszar, Ferenc ;
Caballero, Jose ;
Cunningham, Andrew ;
Acosta, Alejandro ;
Aitken, Andrew ;
Tejani, Alykhan ;
Totz, Johannes ;
Wang, Zehan ;
Shi, Wenzhe .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :105-114