Single image super-resolution incorporating example-based gradient profile estimation and weighted adaptive p-norm

被引:14
作者
Li, Tao [1 ]
Dong, Xiucheng [1 ]
Chen, Honggang [2 ]
机构
[1] Xihua Univ, Sch Elect Engn & Elect Informat, Chengdu 610039, Sichuan, Peoples R China
[2] Sichuan Univ, Coll Elect & Informat Engn, Chengdu 610065, Sichuan, Peoples R China
关键词
Image super-resolution; Gradient profile; Example dictionary; Weighted Schatten p-norm; Split Bregman iteration; QUALITY ASSESSMENT; ALGORITHM; REGULARIZATION; RESTORATION; REGRESSION;
D O I
10.1016/j.neucom.2019.04.051
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Single image super-resolution (SR) aims to estimate a high-resolution (HR) image from only one observed low-resolution (LR) image. It is a severely ill-posed problem that needs image priors to ensure a reliable HR estimation. Since different priors usually emphasize different aspects of image characteristics, it's a big challenge to impose a balanced-and-overall image property constraint on single image SR. In this paper, we cast single image SR into a maximum a posteriori optimization problem and combine two types of complementary priors to answer this challenge. One prior is a novel local gradient field prior derived from example-based gradient field estimation (EGFE) that focuses on recovering the sharpness of gradient profiles. It is good at enhancing the edge sharpness and restoring fine texture details. Whereas the other is a powerful non-local low rank prior implemented in a weighted adaptive p-norm model (WANM). By imposing 1 p penalties adaptive to regional saliency and weighted constraints, the WANM prior performs well in preserving edge smoothness and suppressing image noise and reconstruction artifacts. An improved Split Bregman Iteration method that adaptively attenuates the regularization strength is further developed to solve the proposed EGFE-WANM SR problem. Comprehensive experiments are conducted and the results show that the proposed EGFE-WANM SR method outperforms many state-of-the-art methods in both objective evaluations and subjective visual comparisons. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:105 / 120
页数:16
相关论文
共 64 条
[41]   Kernel regression for image processing and reconstruction [J].
Takeda, Hiroyuki ;
Farsiu, Sina ;
Milanfar, Peyman .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (02) :349-366
[42]  
Tian YP, 2016, IEEE IMAGE PROC, P2827, DOI 10.1109/ICIP.2016.7532875
[43]   A plus : Adjusted Anchored Neighborhood Regression for Fast Super-Resolution [J].
Timofte, Radu ;
De Smet, Vincent ;
Van Gool, Luc .
COMPUTER VISION - ACCV 2014, PT IV, 2015, 9006 :111-126
[44]   Edge-Directed Single-Image Super-Resolution via Adaptive Gradient Magnitude Self-Interpolation [J].
Wang, Lingfeng ;
Xiang, Shiming ;
Meng, Gaofeng ;
Wu, Huaiyu ;
Pan, Chunhong .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2013, 23 (08) :1289-1299
[45]   Non-local Neural Networks [J].
Wang, Xiaolong ;
Girshick, Ross ;
Gupta, Abhinav ;
He, Kaiming .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :7794-7803
[46]   Image quality assessment: From error visibility to structural similarity [J].
Wang, Z ;
Bovik, AC ;
Sheikh, HR ;
Simoncelli, EP .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2004, 13 (04) :600-612
[47]   Edge-Guided Single Depth Image Super Resolution [J].
Xie, Jun ;
Feris, Rogerio Schmidt ;
Sun, Ming-Ting .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (01) :428-438
[48]   Weighted Schatten p-Norm Minimization for Image Denoising and Background Subtraction [J].
Xie, Yuan ;
Gu, Shuhang ;
Liu, Yan ;
Zuo, Wangmeng ;
Zhang, Wensheng ;
Zhang, Lei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (10) :4842-4857
[49]   Multi-Scale Continuous CRFs as Sequential Deep Networks for Monocular Depth Estimation [J].
Xu, Dan ;
Ricci, Elisa ;
Ouyang, Wanli ;
Wang, Xiaogang ;
Sebe, Nicu .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :161-169
[50]   Image Smoothing via L0 Gradient Minimization [J].
Xu, Li ;
Lu, Cewu ;
Xu, Yi ;
Jia, Jiaya .
ACM TRANSACTIONS ON GRAPHICS, 2011, 30 (06)