Enhanced Image Deblurring: An Efficient Frequency Exploitation and Preservation Network

被引:1
作者
Dong, Shuting [1 ,2 ]
Wu, Zhe [2 ]
Lu, Feng [1 ,2 ]
Yuan, Chun [1 ,2 ]
机构
[1] Tsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Shenzhen, Peoples R China
[2] Peng Cheng Lab, Shenzhen, Peoples R China
来源
PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023 | 2023年
基金
国家重点研发计划;
关键词
Image deblurring; motion deblurring; defocus deblurring; poor light deblurring; frequency-domain; RESTORATION;
D O I
10.1145/3581783.3611976
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Most of these frequency-based deblurring methods mainly have two major limitations: (1) insufficient exploitation of frequency information, (2) inadequate preservation of frequency information. In this paper, we propose a novel Efficient Frequency Exploitation and Preservation Network (EFEP) to address these limitations. Firstly, we propose a novel Frequency-Balanced Exploitation Encoder (FBE-Encoder) to sufficiently exploit frequency information. We insert a novel Frequency-Balanced Navigator (FBN) module in the encoder, which establishes a dynamic balance that adaptively explores and integrates the correlations between frequency features and other features presented in the network. And it also can highlight the most important regions in frequency features. Secondly, considering the limitation that frequency information is inevitably lost in deep network architectures, we present an Enhanced Selective Frequency Decoder (ESF-Decoder) that not only effectively reduces spatial information redundancy, but also fully explores the different importance of various frequency information to ensure the supplement of valid spatial information and weaken the invalid information. Thirdly, each encoder/decoder block of the EFEP consists of multiple Contrastive Residual Blocks (CRBs), which are designed to explicitly compute and incorporate feature distinctions. Powered by the above designs, our EFEP outperforms state-of-the-art models on both quantitative and qualitative evaluations.
引用
收藏
页码:7184 / 7193
页数:10
相关论文
共 42 条
[1]  
Abuolaim A., 2021, P IEEE CVF INT C COM, P2289
[2]   Defocus Deblurring Using Dual-Pixel Data [J].
Abuolaim, Abdullah ;
Brown, Michael S. .
COMPUTER VISION - ECCV 2020, PT X, 2020, 12355 :111-126
[3]   A Fault-Tolerant and High-Speed Memory Controller Targeting 3D Flash Memory Cubes for Space Applications [J].
Agnesina, Anthony ;
Shim, Da Eun ;
Yamaguchi, James ;
Krutzik, Christian ;
Carson, John ;
Nakamura, Dan ;
Lim, Sung Kyu .
2020 IEEE 38TH INTERNATIONAL CONFERENCE ON COMPUTER DESIGN (ICCD 2020), 2020, :425-432
[4]  
Cai YH, 2022, ADV NEUR IN
[5]   Coarse-to-Fine Sparse Transformer for Hyperspectral Image Reconstruction [J].
Cai, Yuanhao ;
Lin, Jing ;
Hu, Xiaowan ;
Wang, Haoqian ;
Yuan, Xin ;
Zhang, Yulun ;
Timofte, Radu ;
Van Gool, Luc .
COMPUTER VISION - ECCV 2022, PT XVII, 2022, 13677 :686-704
[6]   Mask-guided Spectral-wise Transformer for Efficient Hyperspectral Image Reconstruction [J].
Cai, Yuanhao ;
Lin, Jing ;
Hu, Xiaowan ;
Wang, Haoqian ;
Yuan, Xin ;
Zhang, Yulun ;
Timofte, Radu ;
Van Gool, Luc .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :17481-17490
[7]  
CHARBONNIER P, 1994, IEEE IMAGE PROC, P168
[8]   Pre-Trained Image Processing Transformer [J].
Chen, Hanting ;
Wang, Yunhe ;
Guo, Tianyu ;
Xu, Chang ;
Deng, Yiping ;
Liu, Zhenhua ;
Ma, Siwei ;
Xu, Chunjing ;
Xu, Chao ;
Gao, Wen .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :12294-12305
[9]   Rethinking Coarse-to-Fine Approach in Single Image Deblurring [J].
Cho, Sung-Jin ;
Ji, Seo-Won ;
Hong, Jun-Pyo ;
Jung, Seung-Won ;
Ko, Sung-Jea .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :4621-4630
[10]  
Cui Y., 2022, 11 INT C LEARN REPR