A real 3D scene rendering optimization method based on region of interest and viewing frustum prediction in virtual reality

被引:7
|
作者
Dang, Pei [1 ]
Zhu, Jun [1 ]
Wu, Jianlin [1 ]
Li, Weilian [1 ,2 ]
You, Jigang [1 ]
Fu, Lin [1 ]
Shi, Yiqun [3 ]
Gong, Yuhang [4 ]
机构
[1] Southwest Jiaotong Univ, Fac Geosci & Environm Engn, Chengdu, Sichuan, Peoples R China
[2] Univ Bonn, Inst Geodesy & Geoinformat, Bonn, Germany
[3] Southwest Jiaotong Univ, Fac Civil Engn, Chengdu, Peoples R China
[4] Sichuan Inst Land Sci & Technol, Dept Nat Resources Sichuan Prov, Chengdu, Peoples R China
基金
中国国家自然科学基金;
关键词
Real 3D scene; virtual reality; Kalman filter; region of interest; viewing frustum; SACCADE TARGET SELECTION; MESH SIMPLIFICATION; VISUAL-ATTENTION; EYE TRACKING; ALGORITHM;
D O I
10.1080/17538947.2022.2080878
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
As an important technology of digital construction, real 3D models can improve the immersion and realism of virtual reality (VR) scenes. The large amount of data for real 3D scenes requires more effective rendering methods, but the current rendering optimization methods have some defects and cannot render real 3D scenes in virtual reality. In this study, the location of the viewing frustum is predicted by a Kalman filter, and eye-tracking equipment is used to recognize the region of interest (ROI) in the scene. Finally, the real 3D model of interest in the predicted frustum is rendered first. The experimental results show that the method of this study can predict the frustrum location approximately 200 ms in advance, the prediction accuracy is approximately 87%, the scene rendering efficiency is improved by 8.3%, and the motion sickness is reduced by approximately 54.5%. These studies help promote the use of real 3D models in virtual reality and ROI recognition methods. In future work, we will further improve the prediction accuracy of viewing frustums in virtual reality and the application of eye tracking in virtual geographic scenes.
引用
收藏
页码:1081 / 1100
页数:20
相关论文
共 50 条
  • [31] A New Method of Virtual Reality Based on Unity3D
    Wang, Sa
    Mao, Zhengli
    Zeng, Changhai
    Gong, Huili
    Li, Shanshan
    Chen, Beibei
    2010 18TH INTERNATIONAL CONFERENCE ON GEOINFORMATICS, 2010,
  • [32] Research and implementation of digital 3D panoramic visual communication technology based on virtual reality
    Zhang, Guangchao
    Kou, Xinyue
    INTERNATIONAL JOURNAL OF COMMUNICATION SYSTEMS, 2022, 35 (05)
  • [33] NormalTouch and TextureTouch: High-fidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers
    Benko, Hrvoje
    Holz, Christian
    Sinclair, Mike
    Ofek, Eyal
    UIST 2016: PROCEEDINGS OF THE 29TH ANNUAL SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY, 2016, : 717 - 728
  • [34] 3D Model Design and Interactive Experience Optimization of Cultural Creativity Product Based on Virtual Reality Technology
    Gong Y.
    Yang H.
    Computer-Aided Design and Applications, 2024, 21 (S12): : 19 - 33
  • [35] Design and implement of 3D virtual walk-through system based on virtual reality
    Wang, Zhaofeng
    Li, Xiaofei
    Cui, Yifei
    2011 INTERNATIONAL CONFERENCE ON FUTURE COMPUTER SCIENCE AND APPLICATION (FCSA 2011), VOL 4, 2011, : 100 - 103
  • [36] Affordance Maintenance-based 3D Scene Synthesis for Immersive Mixed Reality
    Jiang, Haiyan
    Weng, Dongdong
    Dongye, Xiaonuo
    2024 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES ABSTRACTS AND WORKSHOPS, VRW 2024, 2024, : 805 - 806
  • [37] Access to complex reality-based 3D models using virtual reality solutions
    Jimenez Fernandez-Palacios, Belen
    Morabito, Daniele
    Remondino, Fabio
    JOURNAL OF CULTURAL HERITAGE, 2017, 23 : 40 - 48
  • [38] Real-time 3D Rendering Based on Multiple Cameras and Point Cloud
    Chang, Wei-Chun
    Chang, Wen-Chih
    2014 7TH INTERNATIONAL CONFERENCE ON UBI-MEDIA COMPUTING AND WORKSHOPS (UMEDIA), 2014, : 121 - 126
  • [39] Immersive and interactive virtual reality applications based on 3D web browsers
    Guimaraes, Marcelo de Paiva
    Colombo Dias, Diego Roberto
    Mota, Jose Hamilton
    Gnecco, Bruno Barberi
    Serapilha Durelli, Vinicius Humberto
    Trevelin, Luis Carlos
    MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (01) : 347 - 361
  • [40] Historical Building 3D Reconstruction for a Virtual Reality-based Documentation
    Fanani, Ahmad Zainul
    Syarif, Arry Maulana
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2023, 14 (09) : 811 - 818