Hybrid Conditional Deep Inverse Tone Mapping

被引:8
作者
Shao, Tong [1 ]
Zhai, Deming [1 ]
Jiang, Junjun [1 ]
Liu, Xianming [1 ]
机构
[1] Harbin Inst Technol, Harbin, Peoples R China
来源
PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022 | 2022年
基金
中国国家自然科学基金;
关键词
high dynamic range; inverse tone mapping; deep learning; NETWORK;
D O I
10.1145/3503161.3548129
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Emerging modern displays are capable to render ultra-high definition (UHD) media contents with high dynamic range (HDR) and wide color gamut (WCG). Although more and more native contents as such have been getting produced, the total amount is still in severe lack. Considering the massive amount of legacy contents with standard dynamic range (SDR) which may be exploitable, the urgent demand for proper conversion techniques thus springs up. In this paper, we try to tackle the conversion task from SDR to HDR-WCG for media contents and consumer displays. We propose a deep learning based SDR-to-HDR solution, Hybrid Conditional Deep Inverse Tone Mapping (HyCondITM), which is an end-to-end trainable framework including global transform, local adjustment, and detail refinement in a single unified pipeline. We present a hybrid condition network that can simultaneously extract both global and local priors for guidance to achieve scene-adaptive and spatially-variant manipulations. Experiments show that our method achieves state-of-the-art performance in both quantitative comparisons and visual quality, out-performing the previous methods.
引用
收藏
页码:1016 / 1024
页数:9
相关论文
共 50 条
[41]   Reinhard's Global Operator Based Inverse Tone Mapping with One Parameter [J].
Kinoshita, Yuma ;
Shiota, Sayaka ;
Kiya, Hitoshi .
2017 EIGHTH INTERNATIONAL WORKSHOP ON SIGNAL DESIGN AND ITS APPLICATIONS IN COMMUNICATIONS (IWSDA), 2017, :49-53
[42]   Local Inverse Tone Mapping for Scalable High Dynamic Range Image Coding [J].
Wei, Zhe ;
Wen, Changyun ;
Li, Zhengguo .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2018, 28 (02) :550-555
[43]   A dynamic range adjustable inverse tone mapping operator based on human visual system [J].
Yufan Zhang ;
Wenbiao Zhou ;
Jinling Xu .
The Visual Computer, 2023, 39 :413-427
[44]   A Fully Automatic Content Adaptive Inverse Tone Mapping Operator With Improved Color Accuracy [J].
Mohammadi, Pedram ;
Pourazad, Mahsa T. ;
Nasiopoulos, Panos .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (11) :4198-4213
[45]   A High Contrast Video Inverse Tone Mapping Operator for High Dynamic Range Applications [J].
Mohammadi, Pedram ;
Pourazad, Mahsa T. ;
Nasiopoulos, Panos .
2019 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2019,
[46]   Near Constant-time Optimal Piecewise LDR to HDR Inverse Tone Mapping [J].
Chen, Qian ;
Su, Guan-Ming ;
Yin, Peng .
DIGITAL PHOTOGRAPHY XI, 2015, 9404
[47]   Fast Inverse Tone Mapping Based on Reinhard's Global Operator with Estimated Parameters [J].
Kinoshita, Yuma ;
Shiota, Sayaka ;
Kiya, Hitoshi .
IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2017, E100A (11) :2248-2255
[48]   EFFICIENT BANDING-ALLEVIATING INVERSE TONE MAPPING FOR HIGH DYNAMIC RANGE VIDEO [J].
Gadgil, Neeraj J. ;
Song, Qing ;
Su, Guan-Ming .
CONFERENCE RECORD OF THE 2019 FIFTY-THIRD ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS, 2019, :1885-1889
[49]   An optimization framework for inverse tone mapping using a single low dynamic range image [J].
Fan, Ming ;
Lee, Dae-Hong ;
Kim, Seung-Wook ;
Ko, Sung-Jea .
SIGNAL PROCESSING-IMAGE COMMUNICATION, 2019, 78 :274-283
[50]   A dynamic range adjustable inverse tone mapping operator based on human visual system [J].
Zhang, Yufan ;
Zhou, Wenbiao ;
Xu, Jinling .
VISUAL COMPUTER, 2023, 39 (01) :413-427