Hybrid Conditional Deep Inverse Tone Mapping

被引:8
作者
Shao, Tong [1 ]
Zhai, Deming [1 ]
Jiang, Junjun [1 ]
Liu, Xianming [1 ]
机构
[1] Harbin Inst Technol, Harbin, Peoples R China
来源
PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022 | 2022年
基金
中国国家自然科学基金;
关键词
high dynamic range; inverse tone mapping; deep learning; NETWORK;
D O I
10.1145/3503161.3548129
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Emerging modern displays are capable to render ultra-high definition (UHD) media contents with high dynamic range (HDR) and wide color gamut (WCG). Although more and more native contents as such have been getting produced, the total amount is still in severe lack. Considering the massive amount of legacy contents with standard dynamic range (SDR) which may be exploitable, the urgent demand for proper conversion techniques thus springs up. In this paper, we try to tackle the conversion task from SDR to HDR-WCG for media contents and consumer displays. We propose a deep learning based SDR-to-HDR solution, Hybrid Conditional Deep Inverse Tone Mapping (HyCondITM), which is an end-to-end trainable framework including global transform, local adjustment, and detail refinement in a single unified pipeline. We present a hybrid condition network that can simultaneously extract both global and local priors for guidance to achieve scene-adaptive and spatially-variant manipulations. Experiments show that our method achieves state-of-the-art performance in both quantitative comparisons and visual quality, out-performing the previous methods.
引用
收藏
页码:1016 / 1024
页数:9
相关论文
共 50 条
[31]   Redistributing the Precision and Content in 3D-LUT-based Inverse Tone-mapping for HDR/WCG Display [J].
Guo, Cheng ;
Fan, Leidong ;
Zhang, Qian ;
Liu, Hanyuan ;
Liu, Kanglin ;
Jiang, Xiuhua .
20TH ACM SIGGRAPH EUROPEAN CONFERENCE ON VISUAL MEDIA PRODUCTION, CVMP 2023, 2023,
[32]   Lightweight improved residual network for efficient inverse tone mapping [J].
Xue, Liqi ;
Xu, Tianyi ;
Song, Yongbao ;
Liu, Yan ;
Zhang, Lei ;
Zhen, Xiantong ;
Xu, Jun .
MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (25) :67059-67082
[33]   TMO-Det: Deep tone-mapping optimized with and for object detection [J].
Kocdemir, Ismail Hakki ;
Koz, Alper ;
Akyuz, Ahmet Oguz ;
Chalmers, Alan ;
Alatan, Aydin ;
Kalkan, Sinan .
PATTERN RECOGNITION LETTERS, 2023, 172 :230-236
[34]   A Real-Time Semi-Supervised Deep Tone Mapping Network [J].
Zhang, Ning ;
Zhao, Yang ;
Wang, Chao ;
Wang, Ronggang .
IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 :2815-2827
[35]   A brightness-adaptive kernel prediction network for inverse tone mapping [J].
Cao, Gaofeng ;
Zhou, Fei ;
Liu, Kanglin ;
Liu, Bozhi .
NEUROCOMPUTING, 2021, 464 :1-14
[36]   Cyclic Learning-Based Lightweight Network for Inverse Tone Mapping [J].
Park, Jiyun ;
Song, Byung Cheol .
ELECTRONICS, 2022, 11 (15)
[37]   An Inverse Tone Mapping Operator Based on Reinhard's Global Operator [J].
Kinoshita, Yuma ;
Siota, Sayaka ;
Kiya, Hitoshi .
2016 INTERNATIONAL SYMPOSIUM ON INTELLIGENT SIGNAL PROCESSING AND COMMUNICATION SYSTEMS (ISPACS), 2016, :106-111
[38]   Fine-grained detection of inverse tone mapping in HDR images [J].
Fan, Wei ;
Valenzise, Giuseppe ;
Banterle, Francesco ;
Dufaux, Frederic .
SIGNAL PROCESSING, 2018, 152 :178-188
[39]   A NR-IQA Based Deep Neural Network for Tone Mapping HDR Images [J].
Choi, Minseok ;
Park, Pilkyu ;
Choi, Kwang Pyo ;
Nair, Tejas .
APPLICATIONS OF DIGITAL IMAGE PROCESSING XLII, 2019, 11137
[40]   Distilling Style from Image Pairs for Global Forward and Inverse Tone Mapping [J].
Mustafa, Aamir ;
Hanji, Param ;
Mantiuk, Rafal K. .
19TH ACM SIGGRAPH EUROPEAN CONFERENCE ON VISUAL MEDIA PRODUCTION, CVMP 2022, 2022,