A real 3D scene rendering optimization method based on region of interest and viewing frustum prediction in virtual reality

被引:7
|
作者
Dang, Pei [1 ]
Zhu, Jun [1 ]
Wu, Jianlin [1 ]
Li, Weilian [1 ,2 ]
You, Jigang [1 ]
Fu, Lin [1 ]
Shi, Yiqun [3 ]
Gong, Yuhang [4 ]
机构
[1] Southwest Jiaotong Univ, Fac Geosci & Environm Engn, Chengdu, Sichuan, Peoples R China
[2] Univ Bonn, Inst Geodesy & Geoinformat, Bonn, Germany
[3] Southwest Jiaotong Univ, Fac Civil Engn, Chengdu, Peoples R China
[4] Sichuan Inst Land Sci & Technol, Dept Nat Resources Sichuan Prov, Chengdu, Peoples R China
基金
中国国家自然科学基金;
关键词
Real 3D scene; virtual reality; Kalman filter; region of interest; viewing frustum; SACCADE TARGET SELECTION; MESH SIMPLIFICATION; VISUAL-ATTENTION; EYE TRACKING; ALGORITHM;
D O I
10.1080/17538947.2022.2080878
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
As an important technology of digital construction, real 3D models can improve the immersion and realism of virtual reality (VR) scenes. The large amount of data for real 3D scenes requires more effective rendering methods, but the current rendering optimization methods have some defects and cannot render real 3D scenes in virtual reality. In this study, the location of the viewing frustum is predicted by a Kalman filter, and eye-tracking equipment is used to recognize the region of interest (ROI) in the scene. Finally, the real 3D model of interest in the predicted frustum is rendered first. The experimental results show that the method of this study can predict the frustrum location approximately 200 ms in advance, the prediction accuracy is approximately 87%, the scene rendering efficiency is improved by 8.3%, and the motion sickness is reduced by approximately 54.5%. These studies help promote the use of real 3D models in virtual reality and ROI recognition methods. In future work, we will further improve the prediction accuracy of viewing frustums in virtual reality and the application of eye tracking in virtual geographic scenes.
引用
收藏
页码:1081 / 1100
页数:20
相关论文
共 50 条
  • [41] BCI based Hybrid Interface for 3D Object Control in Virtual Reality
    Chun, Jinsung
    Bae, Byeonguk
    Jo, Sungho
    2016 4TH INTERNATIONAL WINTER CONFERENCE ON BRAIN-COMPUTER INTERFACE (BCI), 2016,
  • [42] Virtual Reality based Welding Training Simulator with 3D Multimodal Interaction
    Yang, Ungyeon
    Lee, Gun A.
    Kim, Yongwan
    Jo, Dongsik
    Choi, Jinsung
    Kim, Ki-Hong
    2010 INTERNATIONAL CONFERENCE ON CYBERWORLDS (CW 2010), 2010, : 150 - 154
  • [43] Integrating Ceramic Design CAD and Virtual Reality Based on 3D Printing
    Zhang, Xiaoyan
    Yuan, Ye
    Computer-Aided Design and Applications, 2024, 21 (S28): : 139 - 152
  • [44] VIRTUAL REALITY TRAINING SYSTEM BASED ON 3D SCANNED AUTOMOTIVE PARTS
    Comes, Radu
    Newmtu, Calin
    Grajdeanu, Anca
    Bodi, Stefan
    ACTA TECHNICA NAPOCENSIS SERIES-APPLIED MATHEMATICS MECHANICS AND ENGINEERING, 2021, 64 (0I): : 55 - 62
  • [45] Authenticity and interest in virtual reality: Findings from an experiment including educational virtual environments created with 3D modeling and photogrammetry
    Fink, Maximilian C. C.
    Sosa, Diana
    Eisenlauer, Volker
    Ertl, Bernhard
    FRONTIERS IN EDUCATION, 2023, 8
  • [46] Research of Distributed Virtual-Reality Scene Based on Java']Java3D Technology
    Lu, Chuiwei
    2009 IEEE 10TH INTERNATIONAL CONFERENCE ON COMPUTER-AIDED INDUSTRIAL DESIGN & CONCEPTUAL DESIGN, VOLS 1-3: E-BUSINESS, CREATIVE DESIGN, MANUFACTURING - CAID&CD'2009, 2009, : 1954 - 1957
  • [47] Design and application of a virtual reality 3D engine based on rapid indices
    Jiang, Nan
    Mai, Jin
    GEOINFORMATICS 2007: GEOSPATIAL INFORMATION SCIENCE, PTS 1 AND 2, 2007, 6753
  • [48] Immersive and interactive virtual reality applications based on 3D web browsers
    Marcelo de Paiva Guimarães
    Diego Roberto Colombo Dias
    José Hamilton Mota
    Bruno Barberi Gnecco
    Vinícius Humberto Serapilha Durelli
    Luis Carlos Trevelin
    Multimedia Tools and Applications, 2018, 77 : 347 - 361
  • [49] Practical Analysis of Virtual Reality 3d Modelling Technology for Animation Majors Based on Predictive Correction Method
    Li, Tianfeng
    Guo, Zhaoxia
    Informatica (Slovenia), 2024, 48 (13): : 143 - 154
  • [50] Region of Interest-Based 3D Inpainting of Cultural Heritage Artifacts
    Setty, Shankar
    Mudenagudi, Uma
    ACM JOURNAL ON COMPUTING AND CULTURAL HERITAGE, 2018, 11 (02):