VR-Based Immersive Service Management in B5G Mobile Systems: A UAV Command and Control Use Case

被引:18
作者
Taleb, Tarik [1 ,3 ]
Sehad, Nassim [2 ]
Nadir, Zinelaabidine [2 ]
Song, Jaeseung [3 ]
机构
[1] Univ Oulu, Fac Informat Technol & Elect Engn, Oulu 90570, Finland
[2] Aalto Univ, Dept Commun & Networking, Espoo 02600, Finland
[3] Sejong Univ, Dept Comp & Informat Secur, Seoul 15600, South Korea
基金
芬兰科学院;
关键词
Streaming media; Cameras; Reliability; Delays; 5G mobile communication; Internet of Things; Autonomous aerial vehicles; 5G and beyond; edge computing; immersive services; mobile networking; unmanned aerial vehicle (UAV); virtual reality (VR); 5G; INTERNET; VISION; ENERGY;
D O I
10.1109/JIOT.2022.3222282
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
management of remote services, such as remote surgery, remote sensing, or remote driving, has become increas-ingly important, especially with the emerging 5G and Beyond 5G technologies. However, the strict network requirements of these remote services represent one of the major challenges that hinder their fast and large-scale deployment in critical infras-tructures. This article addresses certain issues inherent in remote and immersive control of virtual reality (VR)-based unmanned aerial vehicles (UAVs), whereby a user remotely controls UAVs, equipped with 360 degrees cameras, using their head-mounted devices (HMD) and their respective controllers. Remote and immersive control services, using 360 degrees video streams, require much lower latency and higher throughput for true immersion and high ser-vice reliability. To assess and analyze these requirements, this article introduces a real-life testbed system that leverages dif-ferent technologies (e.g., VR, 360 degrees video streaming over 4G/5G, and edge computing). In the performance evaluation, different latency types are considered. They are namely: 1) glass-to-glass latency between the 360 degrees camera of a remote UAV and the HMD display; 2) user/pilot's reaction latency; and 3) the com-mand/execution latency. The obtained results indicate that the responsiveness (dubbed Glass-to-Reaction-to-Execution-GRE- latency) of a pilot, using our system, to a sudden event is within an acceptable range, i.e., around 900 ms.
引用
收藏
页码:5349 / 5363
页数:15
相关论文
共 82 条
[31]  
Hosseini M, 2016, IEEE INT SYM MULTIM, P107, DOI [10.1109/ISM.2016.45, 10.1109/ISM.2016.0028]
[32]   Cyberphysical System With Virtual Reality for Intelligent Motion Recognition and Training [J].
Hu, Fei ;
Hao, Qi ;
Sun, Qingquan ;
Cao, Xiaojun ;
Ma, Rui ;
Zhang, Ting ;
Patil, Yogendra ;
Lu, Jiang .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2017, 47 (02) :347-363
[33]  
Hu W., 2019, MOB INF SYST
[34]  
ITUT FG-NET2030, 2019, FGNET2030
[35]   The H.264 video coding standard - Editor's note [J].
Smith, John R. .
IEEE MULTIMEDIA, 2006, 13 (04) :86-86
[36]   The effectiveness of virtual reality for people with mild cognitive impairment or dementia: a meta-analysis [J].
Kim, Oksoo ;
Pang, Yanghee ;
Kim, Jung-Hee .
BMC PSYCHIATRY, 2019, 19 (1)
[37]   Micro Air Vehicle Link (MAVlink) in a Nutshell: A Survey [J].
Koubaa, Anis ;
Allouch, Azza ;
Alajlan, Maram ;
Javed, Yasir ;
Belghith, Abdelfettah ;
Khalgui, Mohamed .
IEEE ACCESS, 2019, 7 :87658-87680
[38]  
Lan GJ, 2016, 2016 IEEE INTERNATIONAL CONFERENCE ON MULTISENSOR FUSION AND INTEGRATION FOR INTELLIGENT SYSTEMS (MFI), P481
[39]   UAV Communications for 5G and Beyond: Recent Advances and Future Trends [J].
Li, Bin ;
Fei, Zesong ;
Zhang, Yan .
IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (02) :2241-2263
[40]  
Li C., 2018, VMAF JOURNEY CONTINU, V25