Two-Stream Learning-Based Compressive Sensing Network With High-Frequency Compensation for Effective Image Denoising

被引:5
作者
Lee, Bokyeung [1 ]
Ku, Bonwha [1 ]
Kim, Wanjin [2 ]
Ko, Hanseok [1 ]
机构
[1] Korea Univ, Sch Elect Engn, Seoul 02841, South Korea
[2] Agcy Def Dev, Jinhae 51678, South Korea
关键词
Feature extraction; Convolution; Image restoration; Convolutional codes; Image reconstruction; Dictionaries; Computational modeling; ISTA; compressive sensing; deep learning; denoising; THRESHOLDING ALGORITHM;
D O I
10.1109/ACCESS.2021.3091971
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper presents a two-stream learning-based compressive sensing network with a high-frequency compensation module (TSLCSNet) that betters restores the detailed components of an image during the image denoising process. The proposed two-stream network consists of a compressive sensing network (CSN) and a high-frequency compensation network (HCN). CSN restores the main structure of the image, while HCN adds the detail that is not obtainable from the CSN. To improve the performance of the proposed model, we add an incoherence loss function to the total loss function. We also employ an octave convolution to allow the two-stream network to communicate in order to extract less redundant and more compressive features. Representative experimental results show the superiority of the proposed TSLCSNet and TSLCSNet+ compared to state-of-the-art methods for the removal of synthetic and real noise.
引用
收藏
页码:91974 / 91982
页数:9
相关论文
共 51 条
[11]   Denoising Prior Driven Deep Neural Network for Image Restoration [J].
Dong, Weisheng ;
Wang, Peiyao ;
Yin, Wotao ;
Shi, Guangming ;
Wu, Fangfang ;
Lu, Xiaotong .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (10) :2305-2318
[12]  
Dong WS, 2011, PROC CVPR IEEE, P457, DOI 10.1109/CVPR.2011.5995478
[13]   Removing rain from single images via a deep detail network [J].
Fu, Xueyang ;
Huang, Jiabin ;
Zeng, Delu ;
Huang, Yue ;
Ding, Xinghao ;
Paisley, John .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1715-1723
[14]  
Gregor K., 2010, P 27 INT C INT C MAC, P399
[15]   Self-Guided Network for Fast Image Denoising [J].
Gu, Shuhang ;
Li, Yawei ;
Van Gool, Luc ;
Timofte, Radu .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :2511-2520
[16]   Toward Convolutional Blind Denoising of Real Photographs [J].
Guo, Shi ;
Yan, Zifei ;
Zhang, Kai ;
Zuo, Wangmeng ;
Zhang, Lei .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1712-1722
[17]   Unsupervised Real-World Super Resolution with Cycle Generative Adversarial Network and Domain Discriminator [J].
Kim, Gwantae ;
Park, Jaihyun ;
Lee, Kanghyu ;
Lee, Junyeop ;
Min, Jeongki ;
Lee, Bokyeung ;
Han, David K. ;
Ko, Hanseok .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, :1862-1871
[18]   Single Image Haze Removal Using Dark Channel Prior [J].
He, Kaiming ;
Sun, Jian ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (12) :2341-2353
[19]   Identity Mappings in Deep Residual Networks [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
COMPUTER VISION - ECCV 2016, PT IV, 2016, 9908 :630-645
[20]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778