An efficient blur kernel estimation method for blind image Super-Resolution

被引:2
作者
Xu, Yimin [1 ]
Gao, Nanxi [1 ]
Chao, Fei [1 ]
Ji, Rongrong [1 ]
机构
[1] Xiamen Univ, Sch Informat, Dept Artificial Intelligence, Media Analyt & Comp Lab, Xiamen, Fujian, Peoples R China
基金
中国国家自然科学基金;
关键词
Blind super-resolution reconstruction; Efficient inference; Kernel detection and reconstruction;
D O I
10.1016/j.patcog.2024.110590
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Many existing space-variant blind image Super-Resolution (SR) methods require the generation of blur kernels for all input pixels. However, the existing methods overlook the possibility of similar blur kernel patterns among adjacent pixels, leading to spatial incoherence and wasteful computational resources. In this study, we introduce an efficient two-stage method for estimating blur kernels. Instead of generating pixel-wise kernels, a limited set of kernels at pixels with distinct information are generated first and the remaining kernels are reconstructed based on this initial set. This novel method, referred to as Anchor Detection and Kernel Reconstruction, comprises two main components: an Anchor Detection Module (ADM) and a Kernel Reconstruction Module (KRM). The objective of ADM is to identify pixels in a given Low-Resolution image that contain rich information, which are called anchors. The corresponding blur kernels, denoted as anchor kernels, are then generated for these identified pixels using a complete backbone network. The remaining blur kernels are reconstructed using KRM with a lightweight interpolation method based on the anchor kernels to enhance spatial consistency among the reconstructed pixels. Extensive experiments demonstrate that the proposed ADKR method maintains comparable performance while estimating only 50% of blur kernels with a full backbone network, reaching approximately 20% reduction in FLOPs. The code has been made available at https://github.com/xuyimin0926/ADKR.
引用
收藏
页数:9
相关论文
共 46 条
[1]   NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study [J].
Agustsson, Eirikur ;
Timofte, Radu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1122-1131
[2]  
Bell-Kligler S, 2019, ADV NEUR IN, V32
[3]  
Chen Q., 2024, Pattern Recognit. (PR)
[4]   Multi-attention augmented network for single image super-resolution [J].
Chen, Rui ;
Zhang, Heng ;
Liu, Jixin .
PATTERN RECOGNITION, 2022, 122
[5]   Better "CMOS" Produces Clearer Images: Learning Space-Variant Blur Estimation for Blind Image Super-Resolution [J].
Chen, Xuhai ;
Zhang, Jiangning ;
Xu, Chao ;
Wang, Yabiao ;
Wang, Chengjie ;
Liu, Yong .
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, :1651-1661
[6]   Learning self-target knowledge for few-shot segmentation [J].
Chen, Yadang ;
Chen, Sihan ;
Yang, Zhi-Xin ;
Wu, Enhua .
PATTERN RECOGNITION, 2024, 149
[7]  
Chen Z., 2024, Adv. Neural Inf. Process. Syst., V36
[8]   Blind Image Super-Resolution with Spatially Variant Degradations [J].
Cornillere, Victor ;
Djelouah, Abdelaziz ;
Wang Yifan ;
Sorkine-Hornung, Olga ;
Schroers, Christopher .
ACM TRANSACTIONS ON GRAPHICS, 2019, 38 (06)
[9]   Learning a Deep Convolutional Network for Image Super-Resolution [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 :184-199
[10]   Uncertainty Learning in Kernel Estimation for Multi-stage Blind Image Super-Resolution [J].
Fang, Zhenxuan ;
Dong, Weisheng ;
Li, Xin ;
Wu, Jinjian ;
Li, Leida ;
Shi, Guangming .
COMPUTER VISION - ECCV 2022, PT XVIII, 2022, 13678 :144-161