Subband Adaptive Image Deblocking Using Wavelet Based Convolutional Neural Networks

被引:6
作者
Qi, Zhanyuan [1 ]
Jung, Cheolkon [1 ]
Xie, Binghua [1 ]
机构
[1] Xidian Univ, Sch Elect Engn, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Image coding; Discrete wavelet transforms; High frequency; Convolution; Transform coding; Image reconstruction; Adaptive systems; Image deblocking; compression; convolutional neural network; wavelet; subband adaptive;
D O I
10.1109/ACCESS.2021.3073202
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we propose subband adaptive image deblocking using wavelet based convolutional neural networks (CNNs). We build wavelet based CNNs for image deblocking to achieve subband adaptive reconstruction. First, we perform subband adaptive processing after the discrete wavelet transform (DWT) on the input image. For low frequency subband (LL), we use a simple and effective shallow CNN to restore the low frequency component, while for high frequency subbands (LH, HL, and HH) we utilize multi-kernel convolution to capture multiscale features and restore sparse high frequency components. Then, we conduct mixed convolution of dilated convolution and standard convolution to expand the receptive field while introducing channel and spatial attentions to adjust the proportion of different subbands and spatial coordinates. Various experiments on Classic5 and LIVE1 datasets show that the proposed method successfully recovers sharp edges and clear textures in highly compressed images while removing compression artifacts such as blocking and banding. Moreover, the proposed method achieves comparable state-of-the-art performance on compression artifact removal in terms of both visual quality and quantitative measurements.
引用
收藏
页码:62593 / 62601
页数:9
相关论文
共 34 条
[1]   NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study [J].
Agustsson, Eirikur ;
Timofte, Radu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1122-1131
[2]  
[Anonymous], 2017, ARXIV170301383
[3]   DPW-SDNet: Dual Pixel-Wavelet Domain Deep CNNs for Soft Decoding of JPEG-Compressed Images [J].
Chen, Honggang ;
He, Xiaohai ;
Qing, Linbo ;
Xiong, Shuhua ;
Nguyen, Truong Q. .
PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, :824-833
[4]   Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restoration [J].
Chen, Yunjin ;
Pock, Thomas .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (06) :1256-1272
[5]   Xception: Deep Learning with Depthwise Separable Convolutions [J].
Chollet, Francois .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1800-1807
[6]   THE WAVELET TRANSFORM, TIME-FREQUENCY LOCALIZATION AND SIGNAL ANALYSIS [J].
DAUBECHIES, I .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1990, 36 (05) :961-1005
[7]  
Daubechies I., 1993, Acoust. Soc. Am. J, V93, P1671, DOI DOI 10.1121/1.406784
[8]   Compression Artifacts Reduction by a Deep Convolutional Network [J].
Dong, Chao ;
Deng, Yubin ;
Loy, Chen Change ;
Tang, Xiaoou .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :576-584
[9]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307
[10]   Learning a Deep Convolutional Network for Image Super-Resolution [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 :184-199