Estimation of Global Illumination Using Cycle-Consistent Adversarial Networks

被引:0
作者
Oh, Junho [1 ]
Abbott, Amos Lynn [1 ]
机构
[1] Virginia Polytech Inst & State Univ, Blacksburg, VA 24061 USA
来源
ADVANCES IN VISUAL COMPUTING, ISVC 2024, PT I | 2025年 / 15046卷
关键词
Virtual Reality; Video Games; Graphics; Lighting; Global Illumination; GAN; CycleGAN;
D O I
10.1007/978-3-031-77392-1_6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Synthesis of realistic virtual environments requires careful rendering of light and shadows, a task often bottle-necked by the high computational cost of global illumination (GI) techniques. This paper introduces a new GI approach that improves computational efficiency without a significant reduction in image quality. The proposed system transforms initial direct-illumination renderings into globally illuminated representations by incorporating a Cycle-Consistent Adversarial Network (CycleGAN). Our CycleGAN-based approach has demonstrated superior performance over the Pix2Pix model according to the LPIPS metric, which emphasizes perceptual similarity. To facilitate such comparisons, we have created a novel dataset (to be shared with the research community) that provides in-game images that were obtained with and without GI rendering. This work aims to advance real-time GI estimation without the need for costly, specialized computational hardware. Our work and the dataset are made publicly available at https://github.com/junhofive/CycleGAN-Illumination.
引用
收藏
页码:73 / 86
页数:14
相关论文
共 21 条
  • [1] [Anonymous], 2007, Valve: Portal
  • [2] Appel A., 1968, P AM FED INF PROC SO, P37, DOI 10.1145/1468075.1468082
  • [3] Blender Foundation, 1994, Blender
  • [4] Cohen M., 1993, Radiosity and Realistic Image Synthesis
  • [5] Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
  • [6] Parallel Discord Discovery
    Huang, Tian
    Zhu, Yongxin
    Mao, Yishu
    Li, Xinyang
    Liu, Mengyun
    Wu, Yafei
    Ha, Yajun
    Dobbie, Gillian
    [J]. ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2016, PT II, 2016, 9652 : 233 - 244
  • [7] Image-to-Image Translation with Conditional Adversarial Networks
    Isola, Phillip
    Zhu, Jun-Yan
    Zhou, Tinghui
    Efros, Alexei A.
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 5967 - 5976
  • [8] Jensen H. W., 1996, Rendering Techniques '96. Proceedings of the Eurographics Workshop. Eurographics, P21
  • [9] Kingma D.P., 2015, ACS SYM SER, DOI 10.48550/arXiv.1412.6980
  • [10] Kitanovski V., 2021, COL IM C, V29, P264