Unbiased Warped-Area Sampling for Differentiable Rendering

被引:90
作者
Bangaru, Sai Praveen [1 ]
Li, Tzu-Mao [1 ]
Durand, Fredo [1 ]
机构
[1] MIT, 77 Massachusetts Ave, Cambridge, MA 02139 USA
来源
ACM TRANSACTIONS ON GRAPHICS | 2020年 / 39卷 / 06期
关键词
inverse graphics; differentiable rendering; light transport; differentiating visibility;
D O I
10.1145/3414685.3417833
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Differentiable rendering computes derivatives of the light transport equation with respect to arbitrary 3D scene parameters, and enables various applications in inverse rendering and machine learning. We present an unbiased and efficient differentiable rendering algorithm that does not require explicit boundary sampling. We apply the divergence theorem to the derivative of the rendering integral to convert the boundary integral into an area integral. We rewrite the converted area integral to a form that is suitable for Monte Carlo rendering. We then develop an efficient Monte Carlo sampling algorithm for solving the area integral. Our method can be easily plugged into a traditional path tracer and does not require dedicated data structures for sampling boundaries. We analyze the convergence properties through bias-variance metrics, and demonstrate our estimator's advantages over existing methods for some synthetic inverse rendering examples.
引用
收藏
页数:18
相关论文
共 50 条
[1]   Reflectance Modeling by Neural Texture Synthesis [J].
Aittala, Miika ;
Aila, Timo ;
Lehtinen, Jaakko .
ACM TRANSACTIONS ON GRAPHICS, 2016, 35 (04)
[2]  
[Anonymous], 2015, ACM Transactions on Graphics
[3]  
[Anonymous], 2012, ACM T GRAPHIC, DOI DOI 10.1145/2185520.2185554
[4]  
Arvo J., 1995, Computer Graphics Proceedings. SIGGRAPH 95, P335, DOI 10.1145/218380.218467
[5]  
Arvo J., 1994, Computer Graphics Proceedings. Annual Conference Series 1994. SIGGRAPH 94 Conference Proceedings, P343, DOI 10.1145/192161.192250
[6]  
Beatson A, 2019, PR MACH LEARN RES, V97
[7]   A morphable model for the synthesis of 3D faces [J].
Blanz, V ;
Vetter, T .
SIGGRAPH 99 CONFERENCE PROCEEDINGS, 1999, :187-194
[8]   Unbiased Monte Carlo estimation of the reciprocal of an integral [J].
Booth, Thomas E. .
NUCLEAR SCIENCE AND ENGINEERING, 2007, 156 (03) :403-407
[9]   Theory and application of specular path perturbation [J].
Chen, M ;
Arvo, J .
ACM TRANSACTIONS ON GRAPHICS, 2000, 19 (04) :246-278
[10]   Model-Based 3D Hand Pose Estimation from Monocular Video [J].
de La Gorce, Martin ;
Fleet, David J. ;
Paragios, Nikos .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (09) :1793-1805