Multi-Scale Memory-Based Video Deblurring

被引:21
作者
Ji, Bo [1 ]
Yao, Angela [1 ]
机构
[1] Natl Univ Singapore, Singapore, Singapore
来源
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022) | 2022年
基金
新加坡国家研究基金会;
关键词
D O I
10.1109/CVPR52688.2022.00196
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Video deblurring has achieved remarkable progress thanks to the success of deep neural networks. Most methods solve for the deblurring end-to-end with limited information propagation from the video sequence. However, different frame regions exhibit different characteristics and should be provided with corresponding relevant information. To achieve fine-grained deblurring, we designed a memory branch to memorize the blurry-sharp feature pairs in the memory bank, thus providing useful information for the blurry query input. To enrich the memory of our memory bank, we further designed a bidirectional recurrency and multi-scale strategy based on the memory bank. Experimental results demonstrate that our model outperforms other state-of-the-art methods while keeping the model complexity and inference time low The code is available at https://github.com/jibo27/MemDeblur.
引用
收藏
页码:1918 / 1927
页数:10
相关论文
共 36 条
[1]  
[Anonymous], 2014, ARXIV14103916
[2]  
CHARBONNIER P, 1994, IEEE IMAGE PROC, P168
[3]  
Cheng Ho Kei, 2021, ARXIV210605210
[4]  
Gast Jochen, 2019, P IEEE CVF INT C COM, P0
[5]   Toward Convolutional Blind Denoising of Real Photographs [J].
Guo, Shi ;
Yan, Zifei ;
Zhang, Kai ;
Zuo, Wangmeng ;
Zhang, Lei .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1712-1722
[6]  
Han H, 2019, INT CONF INFO SCI, P152, DOI [10.1109/icist.2019.8836815, 10.1109/ICIST.2019.8836815]
[7]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[8]   Online Video Deblurring via Dynamic Temporal Blending Network [J].
Kim, Tae Hyun ;
Lee, Kyoung Mu ;
Schoelkopf, Bernhard ;
Hirsch, Michael .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :4058-4067
[9]  
Kim Y, 2017, INTERNATIONAL CONFERENCE ON SUSTAINABLE INFRASTRUCTURE 2017: POLICY, FINANCE, AND EDUCATION, P348
[10]  
Kingma DP, 2014, ADV NEUR IN, V27