Hybrid Conditional Deep Inverse Tone Mapping

被引:8
作者
Shao, Tong [1 ]
Zhai, Deming [1 ]
Jiang, Junjun [1 ]
Liu, Xianming [1 ]
机构
[1] Harbin Inst Technol, Harbin, Peoples R China
来源
PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022 | 2022年
基金
中国国家自然科学基金;
关键词
high dynamic range; inverse tone mapping; deep learning; NETWORK;
D O I
10.1145/3503161.3548129
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Emerging modern displays are capable to render ultra-high definition (UHD) media contents with high dynamic range (HDR) and wide color gamut (WCG). Although more and more native contents as such have been getting produced, the total amount is still in severe lack. Considering the massive amount of legacy contents with standard dynamic range (SDR) which may be exploitable, the urgent demand for proper conversion techniques thus springs up. In this paper, we try to tackle the conversion task from SDR to HDR-WCG for media contents and consumer displays. We propose a deep learning based SDR-to-HDR solution, Hybrid Conditional Deep Inverse Tone Mapping (HyCondITM), which is an end-to-end trainable framework including global transform, local adjustment, and detail refinement in a single unified pipeline. We present a hybrid condition network that can simultaneously extract both global and local priors for guidance to achieve scene-adaptive and spatially-variant manipulations. Experiments show that our method achieves state-of-the-art performance in both quantitative comparisons and visual quality, out-performing the previous methods.
引用
收藏
页码:1016 / 1024
页数:9
相关论文
共 50 条
  • [1] Deep Video Inverse Tone Mapping
    Xu, Yucheng
    Song, Li
    Xie, Rong
    Zhang, Wenjun
    2019 IEEE FIFTH INTERNATIONAL CONFERENCE ON MULTIMEDIA BIG DATA (BIGMM 2019), 2019, : 142 - 147
  • [2] Deep Inverse Tone Mapping for Compressed Images
    Wang, Chao
    Zhao, Yang
    Wang, Ronggang
    IEEE ACCESS, 2019, 7 (74558-74569) : 74558 - 74569
  • [3] Deep HDR Hallucination for Inverse Tone Mapping
    Marnerides, Demetris
    Bashford-Rogers, Thomas
    Debattista, Kurt
    SENSORS, 2021, 21 (12)
  • [4] Deep Conditional HDRI: Inverse Tone Mapping via Dual Encoder-Decoder Conditioning Method
    Nam, YoonChan
    Kim, JoonKyu
    Shim, Jae-hun
    Kang, Suk-Ju
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 8504 - 8515
  • [5] Deep Arbitrary HDRI: Inverse Tone Mapping With Controllable Exposure Changes
    Jo, So Yeon
    Lee, Siyeong
    Ahn, Namhyun
    Kang, Suk-Ju
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 2713 - 2726
  • [6] iTM-Net: Deep Inverse Tone Mapping Using Novel Loss Function Based on Tone Mapping Operator
    Kinoshita, Yuma
    Kiya, Hitoshi
    2019 27TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2019,
  • [7] iTM-Net: Deep Inverse Tone Mapping Using Novel Loss Function Considering Tone Mapping Operator
    Kinoshita, Yuma
    Kiya, Hitoshi
    IEEE ACCESS, 2019, 7 : 73555 - 73563
  • [8] Deep Recursive HDRI: Inverse Tone Mapping Using Generative Adversarial Networks
    Lee, Siyeong
    An, Gwon Hwan
    Kang, Suk-Ju
    COMPUTER VISION - ECCV 2018, PT II, 2018, 11206 : 613 - 628
  • [9] GAN BASED MULTI-EXPOSURE INVERSE TONE MAPPING
    Xu, Yucheng
    Ning, Shiyu
    Xie, Rong
    Song, Li
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 4365 - 4369
  • [10] Deep Inverse Tone Mapping Optimized for High Dynamic Range Display
    Hirao, Katsuhiko
    Cheng, Zhengxue
    Takeuchi, Masaru
    Katto, Jiro
    2018 INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY CONVERGENCE (ICTC), 2018, : 472 - 474