Efficient Learning of Image Super-Resolution and Compression Artifact Removal with Semi-Local Gaussian Processes

被引:49
|
作者
Kwon, Younghee [1 ]
Kim, Kwang In [2 ]
Tompkin, James [3 ]
Kim, Jin Hyung [4 ]
Theobalt, Christian [5 ]
机构
[1] Google Inc, Mountain View, CA 94043 USA
[2] Univ Lancaster, Sch Comp & Commun, Lancaster LA1 4WA, England
[3] Harvard Univ, Sch Engn & Appl Sci, Cambridge, MA 02138 USA
[4] Korea Adv Inst Sci & Technol, Dept Comp Sci, Taejon 305701, South Korea
[5] Max Planck Inst Informat, D-66123 Saarbrucken, Germany
关键词
Image enhancement; super-resolution; image compression; Gaussian process; regression; RECONSTRUCTION; LIMITS; DCT;
D O I
10.1109/TPAMI.2015.2389797
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Improving the quality of degraded images is a key problem in image processing, but the breadth of the problem leads to domain-specific approaches for tasks such as super-resolution and compression artifact removal. Recent approaches have shown that a general approach is possible by learning application-specific models from examples; however, learning models sophisticated enough to generate high-quality images is computationally expensive, and so specific per-application or per-dataset models are impractical. To solve this problem, we present an efficient semi-local approximation scheme to large-scale Gaussian processes. This allows efficient learning of task-specific image enhancements from example images without reducing quality. As such, our algorithm can be easily customized to specific applications and datasets, and we show the efficiency and effectiveness of our approach across five domains: single-image super-resolution for scene, human face, and text images, and artifact removal in JPEG- and JPEG 2000-encoded images.
引用
收藏
页码:1792 / 1805
页数:14
相关论文
共 50 条
  • [1] Efficient Learning-based Image Enhancement: Application to Super-resolution and Compression Artifact Removal
    Kwon, Younghee
    Kim, Kwang In
    Kim, Jin Hyung
    Theobalt, Christian
    PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
  • [2] Learning local Gaussian process regression for image super-resolution
    Li, Jianmin
    Qu, Yanyun
    Li, Cuihua
    Xie, Yuan
    Wu, Yang
    Fan, Jianping
    NEUROCOMPUTING, 2015, 154 : 284 - 295
  • [3] OW-SLR: Overlapping Windows on Semi-Local Region for Image Super-Resolution
    Bhardwaj, Rishav
    Jothi Balaji, Janarthanam
    Lakshminarayanan, Vasudevan
    JOURNAL OF IMAGING, 2023, 9 (11)
  • [4] From Artifact Removal to Super-Resolution
    Wang, Jiaming
    Shao, Zhenfeng
    Huang, Xiao
    Lu, Tao
    Zhang, Ruiqian
    Li, Yong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [5] Efficient image compression method using image super-resolution residual learning network
    Hu, Jianhua
    Wang, Bo
    Liu, Xiaolin
    Zheng, Shuzhao
    Chen, Zongren
    Wu, Weimei
    Guo, Jianding
    Huang, Woqing
    JOURNAL OF COMPUTATIONAL METHODS IN SCIENCES AND ENGINEERING, 2023, 23 (03) : 1561 - 1571
  • [6] Learning Local Distribution for Extremely Efficient Single-Image Super-Resolution
    Wu, Wei
    Xu, Wen
    Zheng, Bolun
    Huang, Aiai
    Yan, Chenggang
    ELECTRONICS, 2022, 11 (09)
  • [7] Local Learning-Based Image Super-Resolution
    Lu, Xiaoqiang
    Yuan, Haoliang
    Yuan, Yuan
    Yan, Pingkun
    Li, Luoqing
    Li, Xuelong
    2011 IEEE 13TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP), 2011,
  • [8] Joint Super-Resolution and Compression Artifact Reduction Based on Dual-Learning
    Lee, Oh-Young
    Lee, Jae-Won
    Lee, Dae-Yeol
    Kim, Jong-Ok
    2016 30TH ANNIVERSARY OF VISUAL COMMUNICATION AND IMAGE PROCESSING (VCIP), 2016,
  • [9] Low-rate Image Compression with Super-resolution Learning
    Gao, Wei
    Tao, Lvfang
    Zhou, Linjie
    Yang, Dinghao
    Zhang, Xiaoyu
    Guo, Zixuan
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 607 - 610
  • [10] Single-image super-resolution via local learning
    Yi Tang
    Pingkun Yan
    Yuan Yuan
    Xuelong Li
    International Journal of Machine Learning and Cybernetics, 2011, 2 : 15 - 23