Ghost-Unet: multi-stage network for image deblurring via lightweight subnet learning

被引:6
作者
Feng, Ziliang [1 ]
Zhang, Ju [1 ]
Ran, Xusong [1 ]
Li, Donglu [1 ]
Zhang, Chengfang [2 ]
机构
[1] Sichuan Univ, Coll Comp Sci, Chengdu 610065, Peoples R China
[2] Sichuan Police Coll, Intelligent Policing Key Lab Sichuan Prov, Luzhou 646000, Peoples R China
关键词
Image deblurring; Multi-stage network; U-Net; Ghost module; Lightweight subnet; Neural network;
D O I
10.1007/s00371-024-03315-4
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Multi-stage networks function by applying the concept of cascading, which alleviates the difficulties of network structure optimization using the single-stage method. Image deblurring methods based on multi-stage networks have previously been proposed and provided satisfactory results. However, owing to an excessive reliance on stacked subnets and residual blocks, most existing image deblurring methods that employ multi-stage networks suffer from two drawbacks: a complicated network structure and insufficient image representation of the model. To avoid these constraints, a novel multi-stage network deblurring model is proposed. Lightweight subnets are embedded in each stage of the model to gradually learn input image characteristics, which facilitates process optimization. The Ghost module is introduced as the basic unit of a neural network to reduce the required number of calculations and parameters. A wavelet reconstruction module is also added to avoid loss of image details. Finally, a more comprehensive loss function is designed to improve the quality of the generated images. Experimental results obtained using the GoPro dataset show that the proposed deblurring model achieves satisfactory performance in terms of both subjective results and objective evaluation.
引用
收藏
页码:141 / 155
页数:15
相关论文
共 46 条
[1]  
[Anonymous], 2016, ARXIV
[2]  
[Anonymous], 2018, IET IMAGE PROCESSING
[3]  
[Anonymous], 2013, IMAGE RECONSTRUCTION
[4]   A Neural Approach to Blind Motion Deblurring [J].
Chakrabarti, Ayan .
COMPUTER VISION - ECCV 2016, PT III, 2016, 9907 :221-235
[5]   HINet: Half Instance Normalization Network for Image Restoration [J].
Chen, Liangyu ;
Lu, Xin ;
Zhang, Jie ;
Chu, Xiaojie ;
Chen, Chengpeng .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, :182-192
[6]   Dynamic Scene Deblurring with Parameter Selective Sharing and Nested Skip Connections [J].
Gao, Hongyun ;
Tao, Xin ;
Shen, Xiaoyong ;
Jia, Jiaya .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3843-3851
[7]   From Motion Blur to Motion Flow: a Deep Learning Solution for Removing Heterogeneous Motion Blur [J].
Gong, Dong ;
Yang, Jie ;
Liu, Lingqiao ;
Zhang, Yanning ;
Reid, Ian ;
Shen, Chunhua ;
van den Hengel, Anton ;
Shi, Qinfeng .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :3806-3815
[8]   GhostNet: More Features from Cheap Operations [J].
Han, Kai ;
Wang, Yunhe ;
Tian, Qi ;
Guo, Jianyuan ;
Xu, Chunjing ;
Xu, Chang .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :1577-1586
[9]  
Jia Xia, 2020, Advances in 3D Image and Graphics Representation, Analysis, Computing and Information Technology. Methods and Algorithms. Proceedings of IC3DIT 2019. Smart Innovation, Systems and Technologies (SIST 179), P277, DOI 10.1007/978-981-15-3863-6_31
[10]  
Jiang Z., 2020, arXiv