CNN-Based Classification of Degraded Images With Awareness of Degradation Levels

被引:18
作者
Endo, Kazuki [1 ,2 ]
Tanaka, Masayuki [1 ,2 ]
Okutomi, Masatoshi [1 ,2 ]
机构
[1] Tokyo Inst Technol, Dept Syst & Control Engn, Tokyo 1528550, Japan
[2] Tokyo Inst Technol, Sch Engn, Tokyo 1528550, Japan
关键词
Degradation; Image restoration; Estimation; Transform coding; Feature extraction; Distortion; Training; Degraded image; classification; convolutional neural network; ensemble; restoration;
D O I
10.1109/TCSVT.2020.3045659
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Image classification needs to consider the existence of image degradations in practice. Although degraded images have various levels of degradation, the degradation levels are usually unknown. This paper proposes a convolutional neural network to classify degraded images by using a restoration network and an ensemble learning. The proposed network can automatically infer ensemble weights by using estimated degradation levels of degraded images and features of restored images, where the degradation levels are estimated internally. The proposed network is mainly discussed with JPEG distortion, while degradations of both Gaussian noise and blurring are also examined. We demonstrate that the proposed network can classify degraded images over various levels of degradation. This paper also reveals how the image-quality of training data for a classification network affects the classification performance of degraded images.
引用
收藏
页码:4046 / 4057
页数:12
相关论文
共 38 条
[1]  
[Anonymous], 2009, LEARNING MULTIPLE LA
[2]  
[Anonymous], 2011, JMLR WORKSHOP C P
[3]   Convolutional low-resolution fine-grained classification [J].
Cai, Dingding ;
Chen, Ke ;
Qian, Yanlin ;
Kamarainen, Joni-Kristian .
PATTERN RECOGNITION LETTERS, 2019, 119 :166-171
[4]   A Deep Learning Framework for Joint Image Restoration and Recognition [J].
Chen, Ruilong ;
Mihaylova, Lyudmila ;
Zhu, Hao ;
Bouaynaya, Nidhal Carla .
CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2020, 39 (03) :1561-1580
[5]   Accelerating the Super-Resolution Convolutional Neural Network [J].
Dong, Chao ;
Loy, Chen Change ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :391-407
[6]   Learning a Deep Convolutional Network for Image Super-Resolution [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 :184-199
[7]  
Endo K., 2020, Electron. Imaging, P1, DOI DOI 10.2352/ISSN.2470-1173.2020.10.IPAS-028
[8]  
Endo K, 2020, IEEE IMAGE PROC, P1691, DOI [10.1109/ICIP40778.2020.9191087, 10.1109/icip40778.2020.9191087]
[9]  
Ghosh S, 2018, 2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), P2916, DOI 10.1109/ICASSP.2018.8461907
[10]  
Gnansambandam A, 2020, PR MACH LEARN RES, V119