Deep Generative Adversarial Compression Artifact Removal

被引:139
作者
Galteri, Leonardo [1 ]
Seidenari, Lorenzo [1 ]
Bertini, Marco [1 ]
Del Bimbo, Alberto [1 ]
机构
[1] Univ Florence, MICC, Florence, Italy
来源
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV) | 2017年
关键词
QUALITY ASSESSMENT; IMAGE;
D O I
10.1109/ICCV.2017.517
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Compression artifacts arise in images whenever a lossy compression algorithm is applied. These artifacts eliminate details present in the original image, or add noise and small structures; because of these effects they make images less pleasant for the human eye, and may also lead to decreased performance of computer vision algorithms such as object detectors. To eliminate such artifacts, when decompressing an image, it is required to recover the original image from a disturbed version. To this end, we present a feed-forward fully convolutional residual network model trained using a generative adversarial framework. To provide a baseline, we show that our model can be also trained optimizing the Structural Similarity (SSIM), which is a better loss with respect to the simpler Mean Squared Error (MSE). Our GAN is able to produce images with more photorealistic details than MSE or SSIM based networks. Moreover we show that our approach can be used as a pre-processing step for object detection in case images are degraded by compression to a point that state-of-the art detectors fail. In this task, our GAN method obtains better performance than MSE or SSIM trained networks.
引用
收藏
页码:4836 / 4845
页数:10
相关论文
共 41 条
  • [31] Martin D, 2001, EIGHTH IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOL II, PROCEEDINGS, P416, DOI 10.1109/ICCV.2001.937655
  • [32] Mirza M., 2014, ARXIV PREPRINT ARXIV
  • [33] VQone MATLAB toolbox: A graphical experiment builder for image and video quality evaluations
    Nuutinen, Mikko
    Virtanen, Toni
    Rummukainen, Olli
    Hakkinen, Jukka
    [J]. BEHAVIOR RESEARCH METHODS, 2016, 48 (01) : 138 - 150
  • [34] Sheikh H.R., 2014, LIVE Image Quality Assessment Database Release 2
  • [35] Image quality assessment: From error visibility to structural similarity
    Wang, Z
    Bovik, AC
    Sheikh, HR
    Simoncelli, EP
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2004, 13 (04) : 600 - 612
  • [36] D3: Deep Dual-Domain Based Fast Restoration of JPEG-Compressed Images
    Wang, Zhangyang
    Liu, Ding
    Chang, Shiyu
    Ling, Qing
    Yang, Yingzhen
    Huang, Thomas S.
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 2764 - 2772
  • [37] A Document Image Model and Estimation Algorithm for Optimized JPEG Decompression
    Wong, Tak-Shing
    Bouman, Charles A.
    Pollak, Ilya
    Fan, Zhigang
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2009, 18 (11) : 2518 - 2535
  • [38] Blocking artifact free inverse discrete cosine transform
    Yang, S
    Kittitornkun, S
    Hu, YH
    Nguyen, TQ
    Tull, DL
    [J]. 2000 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL III, PROCEEDINGS, 2000, : 869 - 872
  • [39] Quality Assessment of Deblocked Images
    Yim, Changhoon
    Bovik, Alan Conrad
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2011, 20 (01) : 88 - 98
  • [40] CONCOLOR: Constrained Non-Convex Low-Rank Model for Image Deblocking
    Zhang, Jian
    Xiong, Ruiqin
    Zhao, Chen
    Zhang, Yongbing
    Ma, Siwei
    Gao, Wen
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (03) : 1246 - 1259