Mixed distortion image enhancement method based on joint of deep residuals learning and reinforcement learning

被引:7
作者
Wang, Xiaohong [1 ]
Liu, Fang [2 ]
Ma, Xiangcai [1 ]
机构
[1] Univ Shanghai Sci & Technol, Shanghai 200093, Peoples R China
[2] Quzhou Coll Technol, Quzhou 324000, Peoples R China
关键词
Mixed distortion; Image enhancement; Reinforcement learning; Deep residual learning;
D O I
10.1007/s11760-020-01824-y
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The images distortion leads to the loss of image information and the degradation of perceptual quality. To solve this problem, we investigate a novel mixed distortion image enhancement method based on the parallel network combines deep residual and reinforcement learning. The no-reference image quality assessment algorithm is used to determine the type and level of distorted images accurately. According to the type of distortion, the mixed distortion images enter one of the subsequent parallel joint learning networks automatically. In the joint learning framework, we prepare different residual networks to handle specialized restoration assignments including deblurring, denoising, or JPEG compression. Simultaneously, reinforcement learning then learns a policy to select the next best restoration tasks to progressively restore the quality of a corrupted image. Our method is capable of restoring images corrupted with complex mixed distortions in a more parameter-efficient manner in comparison to conventional networks. The extensive experiments on synthetic and real-world images validate the superior performances of the proposed method.
引用
收藏
页码:995 / 1002
页数:8
相关论文
共 26 条
[1]  
Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
[2]   NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study [J].
Agustsson, Eirikur ;
Timofte, Radu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1122-1131
[3]  
[Anonymous], 2016, Journal of WSCG
[4]  
[Anonymous], 2016, CVPR
[5]  
Brown J, 2018, 2018 IEEE SYMPOSIUM ON VLSI TECHNOLOGY, P95, DOI 10.1109/VLSIT.2018.8510671
[6]   Reducing Artifacts in JPEG Decompression Via a Learned Dictionary [J].
Chang, Huibin ;
Ng, Michael K. ;
Zeng, Tieyong .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2014, 62 (03) :718-728
[7]   Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restoration [J].
Chen, Yunjin ;
Pock, Thomas .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (06) :1256-1272
[8]   Image denoising by sparse 3-D transform-domain collaborative filtering [J].
Dabov, Kostadin ;
Foi, Alessandro ;
Katkovnik, Vladimir ;
Egiazarian, Karen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (08) :2080-2095
[9]   Compression Artifacts Reduction by a Deep Convolutional Network [J].
Dong, Chao ;
Deng, Yubin ;
Loy, Chen Change ;
Tang, Xiaoou .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :576-584
[10]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307