Mitsuba 2: A Retargetable Forward and Inverse Renderer

被引:276
作者
Nimier-David, Merlin [1 ]
Vicini, Delio [1 ]
Zeltner, Tizian [1 ]
Jakob, Wenzel [1 ]
机构
[1] Ecole Polytech Fed Lausanne, Lausanne, Switzerland
来源
ACM TRANSACTIONS ON GRAPHICS | 2019年 / 38卷 / 06期
基金
瑞士国家科学基金会;
关键词
Ray Tracing; Global Illumination; Differentiable Rendering; SIMD;
D O I
10.1145/3355089.3356498
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Modern rendering systems are confronted with a dauntingly large and growing set of requirements: in their pursuit of realism, physically based techniques must increasingly account for intricate properties of light, such as its spectral composition or polarization. To reduce prohibitive rendering times, vectorized renderers exploit coherence via instruction-level parallelism on CPUs and CPUs. Differentiable rendering algorithms propagate derivatives through a simulation to optimize an objective function, e.g., to reconstruct a scene from reference images. Catering to such diverse use cases is challenging and has led to numerous purpose-built systems-partly, because retrofitting features of this complexity onto an existing renderer involves an error-prone and infeasibly intrusive transformation of elementary data structures, interfaces between components, and their implementations (in other words, everything). We propose Mitsuba 2, a versatile renderer that is intrinsically retargetable to various applications including the ones listed above. Mitsuba 2 is implemented in modern C++ and leverages template metaprogramming to replace types and instrument the control flow of components such as BSDFs, volumes, emitters, and rendering algorithms. At compile time, it automatically transforms arithmetic, data structures, and function dispatch, turning generic algorithms into a variety of efficient implementations without the tedium of manual redesign. Possible transformations include changing the representation of color, generating a "wide" renderer that operates on bundles of light paths, just-in-time compilation to create computational kernels that run on the GPU, and forward/reverse-mode automatic differentiation. Transformations can be chained, which further enriches the space of algorithms derived from a single generic implementation. We demonstrate the effectiveness and simplicity of our approach on several applications that would be very challenging to create without assistance: a rendering algorithm based on coherent MCMC exploration, a caustic design method for gradient-index optics, and a technique for reconstructing heterogeneous media in the presence of multiple scattering.
引用
收藏
页数:17
相关论文
共 74 条
  • [1] Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
  • [2] Altmann, 1986, PSYCHOLINGUISTICS
  • [3] Aether: An Embedded Domain Specific Sampling Language for Monte Carlo Rendering
    Anderson, Luke
    Li, Tzu-Mao
    Lehtinen, Jaakko
    Durand, Fredo
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (04):
  • [4] [Anonymous], P ACM PROGR LANG PAC
  • [5] [Anonymous], ACM T GRAPHICS P SIG
  • [6] [Anonymous], TECHNICAL REPORT
  • [7] [Anonymous], 2013, P 5 HIGH PERF GRAPH
  • [8] [Anonymous], SIGPLAN NOTICES
  • [9] [Anonymous], 2017, ACM SIGGRAPH 2017 TA
  • [10] [Anonymous], 2019, P COMP VIS PATT REC