Ghost-Unet: multi-stage network for image deblurring via lightweight subnet learning

被引:6
作者
Feng, Ziliang [1 ]
Zhang, Ju [1 ]
Ran, Xusong [1 ]
Li, Donglu [1 ]
Zhang, Chengfang [2 ]
机构
[1] Sichuan Univ, Coll Comp Sci, Chengdu 610065, Peoples R China
[2] Sichuan Police Coll, Intelligent Policing Key Lab Sichuan Prov, Luzhou 646000, Peoples R China
关键词
Image deblurring; Multi-stage network; U-Net; Ghost module; Lightweight subnet; Neural network;
D O I
10.1007/s00371-024-03315-4
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Multi-stage networks function by applying the concept of cascading, which alleviates the difficulties of network structure optimization using the single-stage method. Image deblurring methods based on multi-stage networks have previously been proposed and provided satisfactory results. However, owing to an excessive reliance on stacked subnets and residual blocks, most existing image deblurring methods that employ multi-stage networks suffer from two drawbacks: a complicated network structure and insufficient image representation of the model. To avoid these constraints, a novel multi-stage network deblurring model is proposed. Lightweight subnets are embedded in each stage of the model to gradually learn input image characteristics, which facilitates process optimization. The Ghost module is introduced as the basic unit of a neural network to reduce the required number of calculations and parameters. A wavelet reconstruction module is also added to avoid loss of image details. Finally, a more comprehensive loss function is designed to improve the quality of the generated images. Experimental results obtained using the GoPro dataset show that the proposed deblurring model achieves satisfactory performance in terms of both subjective results and objective evaluation.
引用
收藏
页码:141 / 155
页数:15
相关论文
共 46 条
[31]   A Deep Motion Deblurring Network based on Per-Pixel Adaptive Kernels with Residual Down-Up and Up-Down Modules [J].
Sim, Hyeonjun ;
Kim, Munchurl .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, :2140-2149
[32]  
Simonyan K, 2015, Arxiv, DOI arXiv:1409.1556
[33]   Noise-Adaptive Non-Blind Image Deblurring [J].
Slutsky, Michael .
SENSORS, 2022, 22 (18)
[34]   Scale-recurrent Network for Deep Image Deblurring [J].
Tao, Xin ;
Gao, Hongyun ;
Shen, Xiaoyong ;
Wang, Jue ;
Jia, Jiaya .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :8174-8182
[35]   R-L ALGORITHM: AN APPROXIMATION ALGORITHM FOR FRACTAL SIGNALS BASED ON FRACTIONAL CALCULUS [J].
Wang, Chengyuan ;
Tan, Huobin ;
Hu, Jiakui ;
Zhou, Dulan .
FRACTALS-COMPLEX GEOMETRY PATTERNS AND SCALING IN NATURE AND SOCIETY, 2021, 29 (08)
[36]  
Xu L., 2014, ADV NEURAL INFORM PR, V27, P1024
[37]   Motion Blur Kernel Estimation via Deep Learning [J].
Xu, Xiangyu ;
Pan, Jinshan ;
Zhang, Yu-Jin ;
Yang, Ming-Hsuan .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (01) :194-205
[38]   Using contour loss constraining residual attention U-net on optical remote sensing interpretation [J].
Yang, Peiqi ;
Wang, Mingjun ;
Yuan, Hao ;
He, Ci ;
Cong, Li .
VISUAL COMPUTER, 2023, 39 (09) :4279-4291
[39]  
Ye M., 2020, IEEE ACCESS PP, V22, P1
[40]   Multi-Stage Progressive Image Restoration [J].
Zamir, Syed Waqas ;
Arora, Aditya ;
Khan, Salman ;
Hayat, Munawar ;
Khan, Fahad Shahbaz ;
Yang, Ming-Hsuan ;
Shao, Ling .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :14816-14826