Fast Dual Deep Convolutional Autoencoder Network for Denoising Monte Carlo Rendering

被引:2
作者
Alzbier, Ahmed Mustafa Taha [1 ,2 ]
Chen, Chunyi [1 ]
Shen, Zhongye [1 ]
Zhang, Ripei [1 ]
机构
[1] Changchun Univ Sci & Technol, Sch Comp Sci & Technol, Changchun 130022, Changchun, Peoples R China
[2] Omdurman Islamic Univ, Sch Comp & Informat Technol, Omdurman 382, Khartoum, Sudan
基金
中国国家自然科学基金;
关键词
RECONSTRUCTION; NOISE;
D O I
10.2352/J.ImagingSci.Technol.2023.67.3.030501
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
Monte Carlo (MC) rendering has attracted unprecedented attention for denoising and creating high-quality images, while deep learning-based MC denoisers also aim to improve rendering quality. Recently, there has been rapid development in using MC rendering synthesis along with deep learning, and significant progress has been reported on denoising using models trained on convolutional neural networks. Such usage and recent novel ideas have contributed to generating denoising rendering results, and sufficient details for image reconstruction from sparse MC samples or basic geometric auxiliary features. In this paper, we present a fast method for denoising Monte Carlo Rendering with a few samples per pixel. The basic idea is to use Dual Deep AutoEncoder Networks (DDAE) with a skip connection, for end-to-end inference from noisy rendered images to reconstructed realistic images. The first autoencoder accepts the noisy image together with the auxiliary buffers and outputs a sampling map. The second autoencoder accepts the noisy image together with the sampling map and outputs the final image. Consequently, our approach is less time-consuming and keeps the high-frequency details features lossless. In addition, we compare our DDAE results against state-of-the-art results by using the mean squared error (MSE) values with the peak signal-to-noise ratio (PSNR) values, and our approach reported better performance effects. (C) 2023 Society for Imaging Science and Technology.
引用
收藏
页数:12
相关论文
共 39 条
  • [1] Bako S, 2017, ACM T GRAPHIC, V36, DOI [10.1145/3072959.3073703, 10.1145/3072959.3073708]
  • [2] General and Robust Error Estimation and Reconstruction for Monte Carlo Rendering
    Bauszat, Pablo
    Eisemann, Martin
    Eisemann, Elmar
    Magnor, Marcus
    [J]. COMPUTER GRAPHICS FORUM, 2015, 34 (02) : 597 - 608
  • [3] Guided Image Filtering for Interactive High-quality Global Illumination
    Bauszat, Pablo
    Eisemann, Martin
    Magnor, Marcus
    [J]. COMPUTER GRAPHICS FORUM, 2011, 30 (04) : 1361 - 1368
  • [4] Bitterli B., 2016, Rendering resources, V9
  • [5] Nonlinearly Weighted First-order Regression for Denoising Monte Carlo Renderings
    Bitterli, Benedikt
    Rousselle, Fabrice
    Moon, Bochang
    Iglesias-Guitian, Jose A.
    Adler, David
    Mitchell, Kenny
    Jarosz, Wojciech
    Novak, Jan
    [J]. COMPUTER GRAPHICS FORUM, 2016, 35 (04) : 107 - 117
  • [6] Interactive Reconstruction of Monte Carlo Image Sequences using a Recurrent Denoising Autoencoder
    Chaitanya, Chakravarty R. Alla
    Kaplanyan, Anton S.
    Schied, Christoph
    Salvi, Marco
    Lefohn, Aaron
    Nowrouzezahrai, Derek
    Aila, Timo
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (04):
  • [7] Comparison of SNR image quality metrics for remote sensing systems
    Fiete, RD
    Tantalo, T
    [J]. OPTICAL ENGINEERING, 2001, 40 (04) : 574 - 585
  • [8] Sample-based Monte Carlo Denoising using a Kernel-Splatting Network
    Gharbi, Michatel
    Li, Tzu-Mao
    Aittala, Miika
    Lehtinen, Jaakko
    Durand, Fredo
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2019, 38 (04):
  • [9] Glorot X., 13 INT C ART INT STA
  • [10] GradNet: Unsupervised Deep Screened Poisson Reconstruction for Gradient-Domain Rendering
    Guo, Jie
    Li, Mengtian
    Li, Quewei
    Qiang, Yuting
    Hu, Bingyang
    GUO, Yanwen
    Yan, Ling-Qi
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2019, 38 (06):