Unsupervised simple Siamese representation learning for blind super-resolution

被引:11
作者
Yin, Pengfei [1 ]
Liu, Zhonghua [1 ]
Wu, Di [2 ,3 ]
Huo, Hua [1 ]
Wang, Haijun [1 ]
Zhang, Kaibing [4 ]
机构
[1] Univ Sci & Technol, Informat Engn Coll, Luoyang, Henan, Peoples R China
[2] Shanghai Jiao Tong Univ, Dept Automat, Shanghai, Peoples R China
[3] Univ, Sch Informat & Commun Engn, Haikou, Hainan, Peoples R China
[4] Polytech Univ, Coll Elect & Informat, Xian, Shaanxi, Peoples R China
关键词
Imagesuper-resolution; Blindsuper-resolution; Siamesenetwork; DRAN; IMAGE SUPERRESOLUTION;
D O I
10.1016/j.engappai.2022.105092
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep convolutional neural networks have made unprecedented achievements in image super-resolution (SR) and dominated the field due to their remarkable performance. When the degradation pattern of the test images is inconsistent with the training images, it leads to poor model performance. For example, the degradation could happen after a dimensional stretching. In this case, the most common method is to take blurry, noise, and low-resolution (LR) images and reconstructs SR images by degradation estimation. However, the SR results for this method are highly dependent on the estimation accuracy. To overcome the difficulty with the degradation estimation, this paper designs a degradation representation attention network (DRAN) for image SR. In which, we propose the use of a simple Siamese representation learning to extract the degradation information from various LR images. Specifically, DRAN distinguishes degradation information instead of performing degradation estimation, which can greatly reduce the difficulty. In other words, DRAN can avoid pixel-level operations, transform degradation computation problems into degradation classification problems and flexibly process LR images through degradation representation learning. Finally, DRAN also introduces a channel attention mechanism to enhance the performance of SR. Experimental results show that the proposed scheme can distinguish different degradation modes and obtain accurate degradation information. Meanwhile, experiments on synthetic and real images show that the DRAN achieves remarkable performance on blind SR tasks with good visual effects.
引用
收藏
页数:10
相关论文
共 33 条
[1]   Correction Filter for Single Image Super-Resolution: Robustifying Off-the-Shelf Deep Super-Resolvers [J].
Abu Hussein, Shady ;
Tirer, Tom ;
Giryes, Raja .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :1425-1434
[2]   Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Network [J].
Ahn, Namhyuk ;
Kang, Byungkon ;
Sohn, Kyung-Ah .
COMPUTER VISION - ECCV 2018, PT X, 2018, 11214 :256-272
[3]  
Bell-Kligler S, 2019, ADV NEUR IN, V32
[4]  
Caron M, 2020, ADV NEUR IN, V33
[5]  
Chen T, 2020, PR MACH LEARN RES, V119
[6]   Exploring Simple Siamese Representation Learning [J].
Chen, Xinlei ;
He, Kaiming .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :15745-15753
[7]   Second-order Attention Network for Single Image Super-Resolution [J].
Dai, Tao ;
Cai, Jianrui ;
Zhang, Yongbing ;
Xia, Shu-Tao ;
Zhang, Lei .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :11057-11066
[8]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307
[9]   Learning a Deep Convolutional Network for Image Super-Resolution [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 :184-199
[10]   Accurate Blur Models vs. Image Priors in Single Image Super-Resolution [J].
Efrat, Netalee ;
Glasner, Daniel ;
Apartsin, Alexander ;
Nadler, Boaz ;
Levin, Anat .
2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, :2832-2839