Fast and Accurate Illumination Estimation Using LDR Panoramic Images for Realistic Rendering

被引:5
作者
Cheng, Haojie [1 ,2 ]
Xu, Chunxiao [1 ,2 ]
Wang, Jiajun [1 ,2 ]
Chen, Zhenxin [2 ]
Zhao, Lingxiao [1 ,2 ]
机构
[1] Univ Sci & Technol China, Hefei 230052, Peoples R China
[2] Chinese Acad Sci, Suzhou Inst Biomed Engn & Technol, Suzhou 215123, Peoples R China
关键词
Lighting; Light sources; Rendering (computer graphics); Estimation; Cameras; Dynamic range; Attenuation; Illumination estimation; LDR panoramic image; image-based lighting; realistic rendering; OBJECT; STATE;
D O I
10.1109/TVCG.2022.3205614
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
A high dynamic range (HDR) image is commonly used to reveal stereo illumination, which is crucial for generating high-quality realistic rendering effects. Compared to the high-cost HDR imaging technique, low dynamic range (LDR) imaging provides a low-cost alternative and is preferable for interactive graphics applications. However, the limited LDR pixel bit depth significantly bothers accurate illumination estimation using LDR images. The conflict between the realism and promptness of illumination estimation for realistic rendering is yet to be resolved. In this paper, an efficient method that accurately infers illuminations of real-world scenes using LDR panoramic images is proposed. It estimates multiple lighting parameters, including locations, types and intensities of light sources. In our approach, a new algorithm that extracts illuminant characteristics during the exposure attenuation process is developed to locate light sources and outline their boundaries. To better predict realistic illuminations, a new deep learning model is designed to efficiently parse complex LDR panoramas and classify detected light sources. Finally, realistic illumination intensities are calculated by recovering the inverse camera response function and extending the dynamic range of pixel values based on previously estimated parameters of light sources. The reconstructed radiance map can be used to compute high-quality image-based lighting of virtual models. Experimental results demonstrate that the proposed method is capable of efficiently and accurately computing comprehensive illuminations using LDR images. Our method can be used to produce better realistic rendering results than existing approaches.
引用
收藏
页码:5235 / 5249
页数:15
相关论文
共 52 条
[1]   SLIC Superpixels Compared to State-of-the-Art Superpixel Methods [J].
Achanta, Radhakrishna ;
Shaji, Appu ;
Smith, Kevin ;
Lucchi, Aurelien ;
Fua, Pascal ;
Suesstrunk, Sabine .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2274-2281
[2]  
Barrow H., 1978, Comput. Vis. Syst, V2, P2
[3]  
Bertel T., 2020, PROC SIGGRAPH ASIA E, P1
[4]   From Faces to Outdoor Light Probes [J].
Calian, Dan A. ;
Lalonde, Jean-Francois ;
Gotardo, Paulo ;
Simon, Tomas ;
Matthews, Iain ;
Mitchell, Kenny .
COMPUTER GRAPHICS FORUM, 2018, 37 (02) :51-61
[5]  
Debevec P., 1998, Computer Graphics. Proceedings. SIGGRAPH 98 Conference Proceedings, P189, DOI 10.1145/280814.280864
[6]  
Debevec P.E., 2008, Recovering High Dynamic Range Radiance Maps from Photographs, P31
[7]   HDR image reconstruction from a single exposure using deep CNNs [J].
Eilertsen, Gabriel ;
Kronander, Joel ;
Denes, Gyorgy ;
Mantiuk, Rafal K. ;
Unger, Jonas .
ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (06)
[8]   Deep Reverse Tone Mapping [J].
Endo, Yuki ;
Kanamori, Yoshihiro ;
Mitani, Jun .
ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (06)
[9]   Learning to Detect Specular Highlights from Real-world Images [J].
Fu, Gang ;
Zhang, Qing ;
Lin, Qifeng ;
Zhu, Lei ;
Xiao, Chunxia .
MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, :1873-1881
[10]   Learning to Predict Indoor Illumination from a Single Image [J].
Gardner, Marc-Andre ;
Sunkavalli, Kalyan ;
Yumer, Ersin ;
Shen, Xiaohui ;
Gambaretto, Emiliano ;
Gagne, Christian ;
Lalonde, Jean-Francois .
ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (06)