High-Fidelity Specular SVBRDF Acquisition From Flash Photographs

被引:0
作者
Tetzlaff, Michael [1 ]
机构
[1] Univ Wisconsin Stout, Dept Math Stat & Comp Sci, Menomonie, WI 54751 USA
关键词
Reflectivity; Rendering (computer graphics); Three-dimensional displays; Optimization; Geometry; Image color analysis; Lighting; Computational photography; flash photography; image-based relighting; non-linear optimization; normal map refinement; photogrammetry; real-time rendering; SVBRDF acquisition; APPEARANCE;
D O I
10.1109/TVCG.2023.3235277
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Obtaining accurate SVBRDFs from 2D photographs of shiny, heterogeneous 3D objects is a highly sought-after goal for domains like cultural heritage archiving, where it is critical to document color appearance in high fidelity. In prior work such as the promising framework by Nam et al., the problem is simplified by assuming that specular highlights exhibit symmetry and isotropy about an estimated surface normal. The present work builds on this foundation with several significant modifications. Recognizing the importance of the surface normal as an axis of symmetry, we compare nonlinear optimization for normals with a linear approximation proposed by Nam et al. and find that nonlinear optimization is superior to the linear approximation, while noting that the surface normal estimates generally have a very significant impact on the reconstructed color appearance of the object. We also examine the use of a monotonicity constraint for reflectance and develop a generalization that also enforces continuity and smoothness when optimizing continuous monotonic functions like a microfacet distribution. Finally, we explore the impact of simplifying from an arbitrary 1D basis function to a traditional parametric microfacet distribution (GGX), and we find this to be a reasonable approximation that trades some fidelity for practicality in certain applications. Both representations can be used in existing rendering architectures like game engines or online 3D viewers, while retaining accurate color appearance for fidelity-critical applications like cultural heritage or online sales.
引用
收藏
页码:1885 / 1896
页数:12
相关论文
共 61 条
[1]   Reflectance Modeling by Neural Texture Synthesis [J].
Aittala, Miika ;
Aila, Timo ;
Lehtinen, Jaakko .
ACM TRANSACTIONS ON GRAPHICS, 2016, 35 (04)
[2]   Two-Shot SVBRDF Capture for Stationary Materials [J].
Aittala, Miika ;
Weyrich, Tim ;
Lehtinen, Jaakko .
ACM TRANSACTIONS ON GRAPHICS, 2015, 34 (04)
[3]   Practical SVBRDF Capture In The Frequency Domain [J].
Aittala, Miika ;
Weyrich, Tim ;
Lehtinen, Jaakko .
ACM TRANSACTIONS ON GRAPHICS, 2013, 32 (04)
[4]  
[Anonymous], 2007, Rendering Techniques, DOI DOI 10.2312/EGWR/EGSR07/195-206
[5]  
[Anonymous], 1944, Q. Appl. Math, DOI DOI 10.1090/QAM/10666
[6]  
Ashikhmin M., 2002, J GRAPHICS TOOLS, V7, P3
[7]   Accurate fitting of measured reflectances using a Shifted Gamma micro-facet distribution [J].
Bagher, M. M. ;
Soler, C. ;
Holzschuch, N. .
COMPUTER GRAPHICS FORUM, 2012, 31 (04) :1509-1518
[8]  
Bi S., 2020, ACM Trans. Graph., V38
[9]  
Bi Sai, 2020, COMPUTER VISION ECCV, P294
[10]   Two-shot Spatially-varying BRDF and Shape Estimation [J].
Boss, Mark ;
Jampani, Varun ;
Kim, Kihwan ;
Lensch, Hendrik P. A. ;
Kautz, Jan .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :3981-3990