VR-Based Immersive Service Management in B5G Mobile Systems: A UAV Command and Control Use Case

被引:18
作者
Taleb, Tarik [1 ,3 ]
Sehad, Nassim [2 ]
Nadir, Zinelaabidine [2 ]
Song, Jaeseung [3 ]
机构
[1] Univ Oulu, Fac Informat Technol & Elect Engn, Oulu 90570, Finland
[2] Aalto Univ, Dept Commun & Networking, Espoo 02600, Finland
[3] Sejong Univ, Dept Comp & Informat Secur, Seoul 15600, South Korea
基金
芬兰科学院;
关键词
Streaming media; Cameras; Reliability; Delays; 5G mobile communication; Internet of Things; Autonomous aerial vehicles; 5G and beyond; edge computing; immersive services; mobile networking; unmanned aerial vehicle (UAV); virtual reality (VR); 5G; INTERNET; VISION; ENERGY;
D O I
10.1109/JIOT.2022.3222282
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
management of remote services, such as remote surgery, remote sensing, or remote driving, has become increas-ingly important, especially with the emerging 5G and Beyond 5G technologies. However, the strict network requirements of these remote services represent one of the major challenges that hinder their fast and large-scale deployment in critical infras-tructures. This article addresses certain issues inherent in remote and immersive control of virtual reality (VR)-based unmanned aerial vehicles (UAVs), whereby a user remotely controls UAVs, equipped with 360 degrees cameras, using their head-mounted devices (HMD) and their respective controllers. Remote and immersive control services, using 360 degrees video streams, require much lower latency and higher throughput for true immersion and high ser-vice reliability. To assess and analyze these requirements, this article introduces a real-life testbed system that leverages dif-ferent technologies (e.g., VR, 360 degrees video streaming over 4G/5G, and edge computing). In the performance evaluation, different latency types are considered. They are namely: 1) glass-to-glass latency between the 360 degrees camera of a remote UAV and the HMD display; 2) user/pilot's reaction latency; and 3) the com-mand/execution latency. The obtained results indicate that the responsiveness (dubbed Glass-to-Reaction-to-Execution-GRE- latency) of a pilot, using our system, to a sudden event is within an acceptable range, i.e., around 900 ms.
引用
收藏
页码:5349 / 5363
页数:15
相关论文
共 82 条
[1]   Operating From a Distance: Robotic Vocal Cord 5G Telesurgery on a Cadaver [J].
Acemoglu, Alperen ;
Peretti, Giorgio ;
Trimarchi, Matteo ;
Hysenbelli, Juljana ;
Krieglstein, Jan ;
Geraldes, Andre ;
Deshpande, Nikhil ;
Ceysens, Pierre Marie Vincent ;
Caldwell, Darwin Gordon ;
Delsanto, Marco ;
Barboni, Ottavia ;
Vio, Tommaso ;
Baggioni, Sabrina ;
Vinciguerra, Alessandro ;
Sanna, Alberto ;
Oleari, Elettra ;
Carobbio, Andrea Luigi Camillo ;
Guastini, Luca ;
Mora, Francesco ;
Mattos, Leonardo S. .
ANNALS OF INTERNAL MEDICINE, 2020, 173 (11) :940-+
[2]  
Aksu Ridvan, 2018, 2018 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), DOI 10.1109/ICMEW.2018.8551577
[3]   Design Guidelines for Blockchain-Assisted 5G-UAV Networks [J].
Aloqaily, Moayad ;
Bouachir, Ouns ;
Boukerche, Azzedine ;
Al Ridhawi, Ismaeel .
IEEE NETWORK, 2021, 35 (01) :64-71
[4]  
[Anonymous], 2013, PROCEEDING 23 ACM WO, DOI DOI 10.1145/2460782.2460789
[5]  
Bachhuber C, 2016, IEEE IMAGE PROC, P2132, DOI 10.1109/ICIP.2016.7532735
[6]  
Bao YN, 2016, 2016 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), P1161, DOI 10.1109/BigData.2016.7840720
[7]   Non-Immersive Virtual Reality for Rehabilitation of the Older People: A Systematic Review into Efficacy and Effectiveness [J].
Bevilacqua, Roberta ;
Maranesi, Elvira ;
Riccardi, Giovanni Renato ;
Di Donna, Valentina ;
Pelliccioni, Paolo ;
Luzi, Riccardo ;
Lattanzio, Fabrizia ;
Pelliccioni, Giuseppe .
JOURNAL OF CLINICAL MEDICINE, 2019, 8 (11)
[8]   vDelay: A Tool to Measure Capture-to-Display Latency and Frame Rate [J].
Boyaci, Omer ;
Forte, Andrea ;
Baset, Salman Abdul ;
Schulzrinne, Henning .
2009 11TH IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM 2009), 2009, :194-200
[9]   Future Networking Challenges: The Case of Mobile Augmented Reality [J].
Braud, Tristan ;
Hassani Bijarbooneh, Farshid ;
Chatzopoulos, Dimitris ;
Hui, Pan .
2017 IEEE 37TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS 2017), 2017, :1796-1807
[10]   An Energy Efficient Framework for UAV-Assisted Millimeter Wave 5G Heterogeneous Cellular Networks [J].
Chakareski, Jacob ;
Naqvi, Syed ;
Mastronarde, Nicholas ;
Xu, Jie ;
Afghah, Fatemeh ;
Razi, Abolfazl .
IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING, 2019, 3 (01) :37-44