High-Fidelity Specular SVBRDF Acquisition From Flash Photographs

被引:0
作者
Tetzlaff, Michael [1 ]
机构
[1] Univ Wisconsin Stout, Dept Math Stat & Comp Sci, Menomonie, WI 54751 USA
关键词
Reflectivity; Rendering (computer graphics); Three-dimensional displays; Optimization; Geometry; Image color analysis; Lighting; Computational photography; flash photography; image-based relighting; non-linear optimization; normal map refinement; photogrammetry; real-time rendering; SVBRDF acquisition; APPEARANCE;
D O I
10.1109/TVCG.2023.3235277
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Obtaining accurate SVBRDFs from 2D photographs of shiny, heterogeneous 3D objects is a highly sought-after goal for domains like cultural heritage archiving, where it is critical to document color appearance in high fidelity. In prior work such as the promising framework by Nam et al., the problem is simplified by assuming that specular highlights exhibit symmetry and isotropy about an estimated surface normal. The present work builds on this foundation with several significant modifications. Recognizing the importance of the surface normal as an axis of symmetry, we compare nonlinear optimization for normals with a linear approximation proposed by Nam et al. and find that nonlinear optimization is superior to the linear approximation, while noting that the surface normal estimates generally have a very significant impact on the reconstructed color appearance of the object. We also examine the use of a monotonicity constraint for reflectance and develop a generalization that also enforces continuity and smoothness when optimizing continuous monotonic functions like a microfacet distribution. Finally, we explore the impact of simplifying from an arbitrary 1D basis function to a traditional parametric microfacet distribution (GGX), and we find this to be a reasonable approximation that trades some fidelity for practicality in certain applications. Both representations can be used in existing rendering architectures like game engines or online 3D viewers, while retaining accurate color appearance for fidelity-critical applications like cultural heritage or online sales.
引用
收藏
页码:1885 / 1896
页数:12
相关论文
共 61 条
[11]  
Cook R.L., 1982, ACM Trans. Graph, V1, P7, DOI [DOI 10.1145/357290.357293, 10.1145/357290.357293]
[12]  
Debevec P., 1998, Rendering Techniques '98. Proceedings of the Eurographics Workshop, P105
[13]   Deep Polarization Imaging for 3D Shape and SVBRDF Acquisition [J].
Deschaintre, Valentin ;
Lin, Yiming ;
Ghosh, Abhijeet .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :15562-15571
[14]   Single-Image SVBRDF Capture with a Rendering-Aware Deep Network [J].
Deschaintre, Valentin ;
Aittala, Miika ;
Durand, Fredo ;
Drettakis, George ;
Bousseau, Adrien .
ACM TRANSACTIONS ON GRAPHICS, 2018, 37 (04)
[15]  
Dong Y., 2014, ACM Trans. Graph., V33
[16]   Extracting Microfacet-based BRDF Parameters from Arbitrary Materials with Power Iterations [J].
Dupuy, Jonathan ;
Heitz, Eric ;
Iehl, Jean-Claude ;
Poulin, Pierre ;
Ostromoukhov, Victor .
COMPUTER GRAPHICS FORUM, 2015, 34 (04) :21-30
[17]  
Everitt C., 2001, White paper, nVIDIA, V2, P7
[18]   Fast method of sparse acquisition and reconstruction of view and illumination dependent datasets [J].
Filip, Jiri ;
Vavra, Radomir .
COMPUTERS & GRAPHICS-UK, 2013, 37 (05) :376-388
[19]   Near-Instant Capture of High-Resolution Facial Geometry and Reflectance [J].
Fyffe, G. ;
Graham, P. ;
Tunwattanapong, B. ;
Ghosh, A. ;
Debevec, P. .
COMPUTER GRAPHICS FORUM, 2016, 35 (02) :353-363
[20]   Deferred Neural Lighting: Free-viewpoint Relighting from Unstructured Photographs [J].
Gao, Duan ;
Chen, Guojun ;
Dong, Yue ;
Peers, Pieter ;
Xu, Kun ;
Tong, Xin .
ACM TRANSACTIONS ON GRAPHICS, 2020, 39 (06)