Two-Stream Learning-Based Compressive Sensing Network With High-Frequency Compensation for Effective Image Denoising

被引:5
作者
Lee, Bokyeung [1 ]
Ku, Bonwha [1 ]
Kim, Wanjin [2 ]
Ko, Hanseok [1 ]
机构
[1] Korea Univ, Sch Elect Engn, Seoul 02841, South Korea
[2] Agcy Def Dev, Jinhae 51678, South Korea
关键词
Feature extraction; Convolution; Image restoration; Convolutional codes; Image reconstruction; Dictionaries; Computational modeling; ISTA; compressive sensing; deep learning; denoising; THRESHOLDING ALGORITHM;
D O I
10.1109/ACCESS.2021.3091971
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper presents a two-stream learning-based compressive sensing network with a high-frequency compensation module (TSLCSNet) that betters restores the detailed components of an image during the image denoising process. The proposed two-stream network consists of a compressive sensing network (CSN) and a high-frequency compensation network (HCN). CSN restores the main structure of the image, while HCN adds the detail that is not obtainable from the CSN. To improve the performance of the proposed model, we add an incoherence loss function to the total loss function. We also employ an octave convolution to allow the two-stream network to communicate in order to extract less redundant and more compressive features. Representative experimental results show the superiority of the proposed TSLCSNet and TSLCSNet+ compared to state-of-the-art methods for the removal of synthetic and real noise.
引用
收藏
页码:91974 / 91982
页数:9
相关论文
共 51 条
[1]   NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study [J].
Agustsson, Eirikur ;
Timofte, Radu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1122-1131
[2]   K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation [J].
Aharon, Michal ;
Elad, Michael ;
Bruckstein, Alfred .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2006, 54 (11) :4311-4322
[3]  
Anwar S., 2017, ARXIV171202933
[4]   A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems [J].
Beck, Amir ;
Teboulle, Marc .
SIAM JOURNAL ON IMAGING SCIENCES, 2009, 2 (01) :183-202
[5]   A non-local algorithm for image denoising [J].
Buades, A ;
Coll, B ;
Morel, JM .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 2, PROCEEDINGS, 2005, :60-65
[6]   Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restoration [J].
Chen, Yunjin ;
Pock, Thomas .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (06) :1256-1272
[7]   Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolution [J].
Chen, Yunpeng ;
Fan, Haoqi ;
Xu, Bing ;
Yan, Zhicheng ;
Kalantidis, Yannis ;
Rohrbach, Marcus ;
Yan, Shuicheng ;
Feng, Jiashi .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :3434-3443
[8]  
Cheng B., ARXIV190502649
[9]   Image denoising by sparse 3-D transform-domain collaborative filtering [J].
Dabov, Kostadin ;
Foi, Alessandro ;
Katkovnik, Vladimir ;
Egiazarian, Karen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (08) :2080-2095
[10]   An iterative thresholding algorithm for linear inverse problems with a sparsity constraint [J].
Daubechies, I ;
Defrise, M ;
De Mol, C .
COMMUNICATIONS ON PURE AND APPLIED MATHEMATICS, 2004, 57 (11) :1413-1457