Real-time self-supervised tone curve estimation for HDR image

被引:2
作者
Chen, Xiyu [1 ,2 ]
Jia, Tao [3 ]
Xiao, Jiangjian [1 ,2 ]
Zhuang, Jiayan [1 ,2 ]
机构
[1] Chinese Acad Sci, Ningbo Inst Mat Technol & Engn, Ningbo 315201, Zhejiang, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Yongjiang Lab, Ningbo 315202, Zhejiang, Peoples R China
来源
COMPUTERS & GRAPHICS-UK | 2023年 / 115卷
关键词
Tone mapping operator; High Dynamic Range; Self-supervised learning; MAPPING OPERATOR; QUALITY ASSESSMENT; MODEL; NETWORK;
D O I
10.1016/j.cag.2023.07.034
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
High dynamic range (HDR) image acquisition technology can record real-scene information. However, most display devices only support standard dynamic range images; therefore, dynamic range compression via tone mapping operators is a key technology for HDR image visualization. Recently, deep learning has achieved significantly better results than traditional methods in tone mapping; however, some problems remain. On the one hand, the labels of datasets are usually selected from the results of existing traditional methods, which limit the quality of newly generated results. On the other hand, these algorithms require huge computational resources and cannot be practically applied. As the dynamic range can be compressed using an intuitive and simple sigmoid curve mapping, a lightweight network is designed in this study to estimate the patch-wise tone curve parameters for HDR images. Simultaneously, the differentiable approximation of tone mapped image quality assessment is introduced as a self-supervised loss term so that the method only needs HDR data as training data. Experimental results demonstrate that the proposed method achieves better results than existing methods in both objective and subjective metrics at a low computational cost. (c) 2023 Elsevier Ltd. All rights reserved.
引用
收藏
页码:461 / 471
页数:11
相关论文
共 65 条
[1]  
Akyuz AO, 2013, SIGGRAPH ASIA 2013 T, P1
[2]   Automatic saturation correction for dynamic range management algorithms [J].
Artusi, Alessandro ;
Pouli, Tania ;
Banterle, Francesco ;
Akyuz, Ahmet Oguz .
SIGNAL PROCESSING-IMAGE COMMUNICATION, 2018, 63 :100-112
[3]   High-order wavelet reconstruction for multi-scale edge aware tone mapping [J].
Artusi, Alessandro ;
Su, Zhuo ;
Zhang, Zongwei ;
Drikakis, Dimitris ;
Luo, Xiaonan .
COMPUTERS & GRAPHICS-UK, 2014, 45 :51-63
[4]   Dynamic range independent image quality assessment [J].
Aydin, Tunc Ozan ;
Mantiuk, Rafal ;
Myszkowski, Karol ;
Seidel, Hans-Peter .
ACM TRANSACTIONS ON GRAPHICS, 2008, 27 (03)
[5]  
Bai Yuanchao, 2022, P AAAI C ART INT
[6]  
Banterle F., 2017, Advanced high dynamic range imaging
[7]   Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images [J].
Cai, Jianrui ;
Gu, Shuhang ;
Zhang, Lei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (04) :2049-2062
[8]  
CHIU K, 1993, GRAPH INTER, P245
[9]   Xception: Deep Learning with Depthwise Separable Convolutions [J].
Chollet, Francois .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1800-1807
[10]   Adaptive logarithmic mapping for displaying high contrast scenes [J].
Drago, F ;
Myszkowski, K ;
Annen, T ;
Chiba, N .
COMPUTER GRAPHICS FORUM, 2003, 22 (03) :419-426