Frequency Disentanglement Distillation Image Deblurring Network

被引:2
作者
Liu, Yiming [1 ]
Guo, Jianping [2 ]
Yang, Sen [1 ]
Liu, Ting [1 ]
Zhou, Hualing [1 ]
Liang, Mengzi [1 ]
Li, Xi [1 ]
Xu, Dahong [1 ]
机构
[1] Hunan Normal Univ, Coll Informat Sci & Engn, Changsha 410081, Peoples R China
[2] Hunan Normal Univ, Coll Phys Educ, Changsha 410081, Peoples R China
关键词
image deblurring; feature disentanglement; distillation block; frequency split;
D O I
10.3390/s21144702
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Due to the blur information and content information entanglement in the blind deblurring task, it is very challenging to directly recover the sharp latent image from the blurred image. Considering that in the high-dimensional feature map, blur information mainly exists in the low-frequency region, and content information exists in the high-frequency region. In this paper, we propose a encoder-decoder model to realize disentanglement from the perspective of frequency, and we named it as frequency disentanglement distillation image deblurring network (FDDN). First, we modified the traditional distillation block by embedding the frequency split block (FSB) in the distillation block to separate the low-frequency and high-frequency region. Second, the modified distillation block, we named frequency distillation block (FDB), can recursively distill the low-frequency feature to disentangle the blurry information from the content information, so as to improve the restored image quality. Furthermore, to reduce the complexity of the network and ensure the high-dimension of the feature map, the frequency distillation block (FDB) is placed on the end of encoder to edit the feature map on the latent space. Quantitative and qualitative experimental evaluations indicate that the FDDN can remove the blur effect and improve the image quality of actual and simulated images.
引用
收藏
页数:15
相关论文
共 35 条
[1]  
Aittala M., 2018, P EUR C COMP VIS ECC
[2]  
[Anonymous], 2019, IEEE I CONF COMP VIS, DOI DOI 10.1109/ICCV.2019.00353
[3]   Dark and Bright Channel Prior Embedded Network for Dynamic Scene Deblurring [J].
Cai, Jianrui ;
Zuo, Wangmeng ;
Zhang, Lei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :6885-6897
[4]  
Chen L., 2019, P 2019 IEEE CVF COMP
[5]  
Dong G., 2017, P 2017 IEEE C COMP V
[6]   SharpGAN: Dynamic Scene Deblurring Method for Smart Ship Based on Receptive Field Block and Generative Adversarial Networks [J].
Feng, Hui ;
Guo, Jundong ;
Xu, Haixiang ;
Ge, Shuzhi Sam .
SENSORS, 2021, 21 (11)
[7]   Dynamic Scene Deblurring with Parameter Selective Sharing and Nested Skip Connections [J].
Gao, Hongyun ;
Tao, Xin ;
Shen, Xiaoyong ;
Jia, Jiaya .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3843-3851
[8]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[9]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[10]   Lightweight Image Super-Resolution with Information Multi-distillation Network [J].
Hui, Zheng ;
Gao, Xinbo ;
Yang, Yunchu ;
Wang, Xiumei .
PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, :2024-2032