Inverse Tone Mapping Operator Using Sequential Deep Neural Networks Based on the Human Visual System

被引:10
作者
Jang, Hanbyol [1 ]
Bang, Kihun [1 ]
Jang, Jinseong [1 ]
Hwang, Dosik [1 ]
机构
[1] Yonsei Univ, Sch Elect & Elect Engn, Coll Engn, Seoul 03722, South Korea
来源
IEEE ACCESS | 2018年 / 6卷
关键词
Color difference; deep neural network; high dynamic range; inverse tone mapping operator; human visual system; COLOR; ENHANCEMENT; VIDEO;
D O I
10.1109/ACCESS.2018.2870295
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Conventional digital displays show images with much less dynamic range than that of human visual perception. High-dynamic range (HDR) displays are being developed for viewing images with higher dynamic range than that of conventional low-dynamic range (LDR) images. However, to view existing LDR images on HDR displays, an inverse tone mapping operator (ITMO), which is a process to extend the dynamic range of LDR images, is required. In this paper, we propose an adaptive ITMO by effectively learning the differences between LDR and HDR images using a sequential learning process: dynamic range learning followed by color difference learning. Our proposed method enables visualization of colors similar to real-world colors better than conventional ITMOs by learning color differences based on the human visual system properties. For the objective comparison, seven different evaluation metrics optimized for HDR image evaluation were used. Our method resulted in 10%-25% improved HDR-visual difference predictor-2.2 values over those of other ITMOs. Other metrics also demonstrated the superior performance of our method. For the subjective comparison, eight human observers evaluated the estimated HDR images in terms of color appearance and overall preferences. Our method received an average 4.7 out of 5 score, whereas other ITMOs received below 3.5 scores in the evaluation of color appearance. The objective and subjective evaluations' results showed that our proposed method outperformed the conventional ITMOs in estimating the dynamic range and color appearance of ground-truth HDR images.
引用
收藏
页码:52058 / 52072
页数:15
相关论文
共 57 条
  • [1] Akyüz AG, 2007, ACM T GRAPHIC, V26, DOI [10.1145/1276377.1276425, 10.1145/1239451.1239489]
  • [2] [Anonymous], 2012, P 2012 AS PAC SIGN I
  • [3] [Anonymous], 2000, Methodology for the subjective assessment of the quality of television pictures
  • [4] [Anonymous], FAIRCHILDS HDR PHOTO
  • [5] [Anonymous], 2008, ACM SIGGRAPH 2008 CL, DOI [DOI 10.1145/1401132.1401174, 10.1145/258734.258884]
  • [6] [Anonymous], 2017, ACM Trans. Graph., DOI DOI 10.1145/3072959.3073609
  • [7] [Anonymous], UNDERSTANDING RAW FI
  • [8] [Anonymous], SIJ T COMPUT SCI ENG
  • [9] [Anonymous], EPFLS DATASET HDR IM
  • [10] [Anonymous], 2015, P 6 ACM MULT SYST C, DOI DOI 10.1145/2713168.2713194