HDR Image Reconstruction Using Segmented Image Learning

被引:6
作者
Lee, Byeong Dae [1 ]
Sunwoo, Myung Hoon [1 ]
机构
[1] Ajou Univ, Sch Elect Engn, Suwon 16499, South Korea
基金
新加坡国家研究基金会;
关键词
Image restoration; Dynamic range; Deep learning; Image segmentation; Image reconstruction; Brightness; Cameras; High dynamic range imaging; inverse tone mapping; deep learning; single exposure image; DYNAMIC-RANGE EXPANSION;
D O I
10.1109/ACCESS.2021.3119586
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Converting a low dynamic range (LDR) image into a high dynamic range (HDR) image produces an image that closely depicts the real world without requiring expensive devices. Recent deep learning developments can produce highly realistic and sophisticated HDR images. This paper proposes a deep learning method to segment the bright and dark regions from an input LDR image and reconstruct the corresponding HDR image with similar dynamic ranges in the real world. The proposed multi-stage deep learning network brightens bright regions and darkens dark regions, and features with extended brightness range are combined to form the HDR image. Dividing the LDR image into the bright and dark regions effectively implements information on lost over-exposed and under-exposed areas, reconstructing a natural HDR image with color and appearance that is similar to reality. Experimental results confirm that the proposed method achieves an 8.52% higher HDR visual difference predictor (HDR-VDP) and a 41.2% higher log exposure range than current methods. Qualitative evaluation also verifies that the proposed method generates images that are close in quality to the ground truth.
引用
收藏
页码:142729 / 142742
页数:14
相关论文
共 49 条
[1]   Do HDR displays support LDR content?: a psychophysical evaluation [J].
Akyuez, Ahmet Oguz ;
Fleming, Roland ;
Riecke, Bernhard E. ;
Reinhard, Erik ;
Buethoff, Heinrich H. .
ACM TRANSACTIONS ON GRAPHICS, 2007, 26 (03)
[2]  
[Anonymous], 2008, ACM SIGGRAPH 2008 classes, page, DOI DOI 10.1145/1401132.1401174
[3]  
[Anonymous], INT C LEARN REPR
[4]   High Dynamic Range Imaging and Low Dynamic Range Expansion for Generating HDR Content [J].
Banterle, Francesco ;
Debattista, Kurt ;
Artusi, Alessandro ;
Pattanaik, Sumanta ;
Myszkowski, Karol ;
Ledda, Patrick ;
Chalmers, Alan .
COMPUTER GRAPHICS FORUM, 2009, 28 (08) :2343-2367
[5]  
Banterle Francesco, 2006, P 4 INT C COMP GRAPH, P349
[6]   Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images [J].
Cai, Jianrui ;
Gu, Shuhang ;
Zhang, Lei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (04) :2049-2062
[7]   Enhancement of bright video features for HDR displays [J].
Didyk, P. ;
Mantiuk, R. ;
Hein, M. ;
Seidel, H. P. .
COMPUTER GRAPHICS FORUM, 2008, 27 (04) :1265-1274
[8]   Adaptive logarithmic mapping for displaying high contrast scenes [J].
Drago, F ;
Myszkowski, K ;
Annen, T ;
Chiba, N .
COMPUTER GRAPHICS FORUM, 2003, 22 (03) :419-426
[9]   HDR image reconstruction from a single exposure using deep CNNs [J].
Eilertsen, Gabriel ;
Kronander, Joel ;
Denes, Gyorgy ;
Mantiuk, Rafal K. ;
Unger, Jonas .
ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (06)
[10]   Deep Reverse Tone Mapping [J].
Endo, Yuki ;
Kanamori, Yoshihiro ;
Mitani, Jun .
ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (06)