The use of CNNs in VR/AR/MR/XR: a systematic literature review

被引:2
作者
Cortes, David [1 ]
Bermejo, Belen [1 ]
Juiz, Carlos [1 ]
机构
[1] Univ Balearic Isl, Comp Sci Dept, Palma De Mallorca, Spain
关键词
Systematic literature review; Virtual reality; Augmented reality; Mixed reality; Extended reality; Convolutional neural network; CONVOLUTIONAL NEURAL-NETWORK; DEEP FEATURE FUSION; LIGHT-FIELD IMAGE; AUGMENTED REALITY; GESTURE RECOGNITION; POSE ESTIMATION; SEMANTIC SEGMENTATION; SINGLE IMAGE; LEARNING FRAMEWORK; OBJECT DETECTION;
D O I
10.1007/s10055-024-01044-6
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This study offers a systematic literature review on the application of Convolutional Neural Networks in Virtual Reality, Augmented Reality, Mixed Reality, and Extended Reality technologies. We categorise these applications into three primary classifications: interaction, where the networks amplify user engagements with virtual and augmented settings; creation, showcasing the networks' ability to assist in producing high-quality visual representations; and execution, emphasising the optimisation and adaptability of apps across diverse devices and situations. This research serves as a comprehensive guide for academics, researchers, and professionals in immersive technologies, offering profound insights into the cross-disciplinary realm of network applications in these realities. Additionally, we underscore the notable contributions concerning these realities and their intersection with neural networks.
引用
收藏
页数:46
相关论文
共 412 条
[1]   Driver information system: a combination of augmented reality, deep learning and vehicular Ad-hoc networks [J].
Abdi, Lotfi ;
Meddeb, Aref .
MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (12) :14673-14703
[2]  
Abhishek Mukhopadhyay G.S., 2022, Virtual Reality & Intelligent Hardware, V4, P55
[3]   Decoding Hand Motor Imagery Tasks Within the Same Limb From EEG Signals Using Deep Learning [J].
Achanccaray, David ;
Hayashibe, Mitsuhiro .
IEEE TRANSACTIONS ON MEDICAL ROBOTICS AND BIONICS, 2020, 2 (04) :692-699
[4]   Deep Learning and Bidirectional Optical Flow Based Viewport Predictions for 360° Video Coding [J].
Adhuran, Jayasingam ;
Kulupana, Gosala ;
Fernando, Anil .
IEEE ACCESS, 2022, 10 :118380-118396
[5]   Body-Worn Sensors for Recognizing Physical Sports Activities in Exergaming via Deep Learning Model [J].
Afsar, Mir Mushhood ;
Saqib, Shizza ;
Aladfaj, Mohammad ;
Alatiyyah, Mohammed Hamad ;
Alnowaiser, Khaled ;
Aljuaid, Hanan ;
Jalal, Ahmad ;
Park, Jeongmin .
IEEE ACCESS, 2023, 11 :12460-12473
[6]   Real-Time Energy Efficient Hand Pose Estimation: A Case Study [J].
Al Koutayni, Mhd Rashed ;
Rybalkin, Vladimir ;
Malik, Jameel ;
Elhayek, Ahmed ;
Weis, Christian ;
Reis, Gerd ;
Wehn, Norbert ;
Stricker, Didier .
SENSORS, 2020, 20 (10)
[7]   Enabling human-machine collaboration in infrastructure inspections through mixed reality [J].
Al-Sabbag, Zaid Abbas ;
Yeum, Chul Min ;
Narasimhan, Sriram .
ADVANCED ENGINEERING INFORMATICS, 2022, 53
[8]   Interactive defect quantification through extended reality [J].
Al-Sabbag, Zaid Abbas ;
Yeum, Chul Min ;
Narasimhan, Sriram .
ADVANCED ENGINEERING INFORMATICS, 2022, 51
[9]   Efficient vision-based multi-target augmented reality in the browser [J].
Al-Zoube, Mohammed A. .
MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (10) :14303-14320
[10]  
Alam MM., 2020, Virtual Real Intell Hardware, V2, P534, DOI DOI 10.1016/J.VRIH.2020.10.001