StarEnhancer: Learning Real-Time and Style-Aware Image Enhancement

被引:23
作者
Song, Yuda [1 ]
Qian, Hui [1 ]
Du, Xin [2 ]
机构
[1] Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou, Peoples R China
[2] Zhejiang Univ, Coll Informat Sci & Elect Engn, Hangzhou, Peoples R China
来源
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021) | 2021年
关键词
NETWORK;
D O I
10.1109/ICCV48922.2021.00409
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image enhancement is a subjective process whose targets vary with user preferences. In this paper, we propose a deep learning-based image enhancement method covering multiple tonal styles using only a single model dubbed StarEnhancer. It can transform an image from one tonal style to another, even if that style is unseen. With a simple one-time setting, users can customize the model to make the enhanced images more in line with their aesthetics. To make the method more practical, we propose a well-designed enhancer that can process a 4K-resolution image over 200 FPS but surpasses the contemporaneous single style image enhancement methods in terms of PSNR, SSIM, and LPIPS. Finally, our proposed enhancement method has good interactability, which allows the user to fine-tune the enhanced image using intuitive options.
引用
收藏
页码:4106 / 4115
页数:10
相关论文
共 53 条
  • [1] Learning Multi-Scale Photo Exposure Correction
    Afifi, Mahmoud
    Derpanis, Konstantinos G.
    Ommer, Bjoern
    Brown, Michael S.
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 9153 - 9163
  • [2] Deep White-Balance Editing
    Afifi, Mahmoud
    Brown, Michael S.
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 1394 - 1403
  • [3] Bickel Marc, 2020, ARXIV200602921
  • [4] Bychkovsky V, 2011, PROC CVPR IEEE, P97
  • [5] Chai Y, 2020, IEEE WINT CONF APPL, P981, DOI 10.1109/WACV45572.2020.9093321
  • [6] Fast Image Processing with Fully-Convolutional Networks
    Chen, Qifeng
    Xu, Jia
    Koltun, Vladlen
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 2516 - 2525
  • [7] Deep Photo Enhancer: Unpaired Learning for Image Enhancement from Photographs with GANs
    Chen, Yu-Sheng
    Wang, Yu-Ching
    Kao, Man-Hsin
    Chuang, Yung-Yu
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 6306 - 6314
  • [8] StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation
    Choi, Yunjey
    Choi, Minje
    Kim, Munyoung
    Ha, Jung-Woo
    Kim, Sunghun
    Choo, Jaegul
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 8789 - 8797
  • [9] ArcFace: Additive Angular Margin Loss for Deep Face Recognition
    Deng, Jiankang
    Guo, Jia
    Xue, Niannan
    Zafeiriou, Stefanos
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 4685 - 4694
  • [10] MONOTONE PIECEWISE CUBIC INTERPOLATION
    FRITSCH, FN
    CARLSON, RE
    [J]. SIAM JOURNAL ON NUMERICAL ANALYSIS, 1980, 17 (02) : 238 - 246