A real 3D scene rendering optimization method based on region of interest and viewing frustum prediction in virtual reality

被引:7
|
作者
Dang, Pei [1 ]
Zhu, Jun [1 ]
Wu, Jianlin [1 ]
Li, Weilian [1 ,2 ]
You, Jigang [1 ]
Fu, Lin [1 ]
Shi, Yiqun [3 ]
Gong, Yuhang [4 ]
机构
[1] Southwest Jiaotong Univ, Fac Geosci & Environm Engn, Chengdu, Sichuan, Peoples R China
[2] Univ Bonn, Inst Geodesy & Geoinformat, Bonn, Germany
[3] Southwest Jiaotong Univ, Fac Civil Engn, Chengdu, Peoples R China
[4] Sichuan Inst Land Sci & Technol, Dept Nat Resources Sichuan Prov, Chengdu, Peoples R China
基金
中国国家自然科学基金;
关键词
Real 3D scene; virtual reality; Kalman filter; region of interest; viewing frustum; SACCADE TARGET SELECTION; MESH SIMPLIFICATION; VISUAL-ATTENTION; EYE TRACKING; ALGORITHM;
D O I
10.1080/17538947.2022.2080878
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
As an important technology of digital construction, real 3D models can improve the immersion and realism of virtual reality (VR) scenes. The large amount of data for real 3D scenes requires more effective rendering methods, but the current rendering optimization methods have some defects and cannot render real 3D scenes in virtual reality. In this study, the location of the viewing frustum is predicted by a Kalman filter, and eye-tracking equipment is used to recognize the region of interest (ROI) in the scene. Finally, the real 3D model of interest in the predicted frustum is rendered first. The experimental results show that the method of this study can predict the frustrum location approximately 200 ms in advance, the prediction accuracy is approximately 87%, the scene rendering efficiency is improved by 8.3%, and the motion sickness is reduced by approximately 54.5%. These studies help promote the use of real 3D models in virtual reality and ROI recognition methods. In future work, we will further improve the prediction accuracy of viewing frustums in virtual reality and the application of eye tracking in virtual geographic scenes.
引用
收藏
页码:1081 / 1100
页数:20
相关论文
共 50 条
  • [1] Adaptive 3D Rendering based on Region-of-Interest
    Chamaret, Christel
    Godeffroy, Sylvain
    Lopez, Patrick
    Le Meur, Olivier
    STEREOSCOPIC DISPLAYS AND APPLICATIONS XXI, 2010, 7524
  • [2] A 3D interactive scene construction method for interior design based on virtual reality
    Fan, Yafei
    Liang, Lijuan
    ARTIFICIAL LIFE AND ROBOTICS, 2024, : 173 - 183
  • [3] CAPTURE, REPRESENTATION, AND RENDERING OF 3D AUDIO FOR VIRTUAL AND AUGMENTED REALITY
    Tashev, Ivan J.
    INTERNATIONAL JOURNAL ON INFORMATION TECHNOLOGIES AND SECURITY, 2019, 11 : 49 - 62
  • [4] 3D virtual colonoscopy with real-time volume rendering
    Wan, M
    Li, W
    Kreeger, K
    Bitter, I
    Kaufman, A
    Liang, ZR
    Chen, DQ
    Wax, M
    MEDICAL IMAGING 2000: PHYSIOLOGY AND FUNCTION FORM MULTIDIMENSIONAL IMAGES, 2000, 3978 : 165 - 171
  • [5] Real-time 3D Audio Downmixing System based on Sound Rendering for the Immersive Sound of Mobile Virtual Reality Applications
    Hong, Dukki
    Kwon, Hyuck-Joo
    Kim, Cheong Ghil
    Park, Woo-Chan
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2018, 12 (12): : 5936 - 5954
  • [6] Analysis of 3D reconstruction of large-scale architectural scene based on virtual reality
    Li Fang
    Jiang Tao
    Gang Jia-lin
    2017 INTERNATIONAL CONFERENCE ON COMPUTER SYSTEMS, ELECTRONICS AND CONTROL (ICCSEC), 2017, : 142 - 146
  • [7] 3D Modeling System of Mobile Robot Based on Virtual Reality in Real Environment
    Guo Zhongyuan
    Xu Feng
    Wang Guiyang
    Yu Dongying
    Cui Yunxuan
    LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (02)
  • [8] Design of 3D Virtual Reality Reservoir Models Based on Scene Simulation of VP/OpenGL Technology
    Zheng Kaidong
    2014 Fifth International Conference on Intelligent Systems Design and Engineering Applications (ISDEA), 2014, : 348 - 351
  • [9] Proposal of Digital Twin Platform Based on 3D Rendering and IIoT Principles Using Virtual/Augmented Reality
    Leskovsky, Roman
    Kucera, Erik
    Haffner, Oto
    Rosinova, Danica
    PROCEEDINGS OF THE 2020 30TH INTERNATIONAL CONFERENCE CYBERNETICS & INFORMATICS (K&I '20), 2020,
  • [10] Re-viewing Pompeian domestic space through combined virtual reality-based eye tracking and 3D GIS
    Campanaro, Danilo M.
    Landeschi, Giacomo
    ANTIQUITY, 2022, 96 (386) : 479 - 486