Deep learning-based object detection in augmented reality: A systematic review

被引:88
作者
Ghasemi, Yalda [1 ]
Jeong, Heejin [1 ]
Choi, Sung Ho [2 ]
Park, Kyeong-Beom [2 ]
Lee, Jae Yeol [2 ]
机构
[1] Univ Illinois, Dept Mech & Ind Engn, Chicago, IL 60607 USA
[2] Chonnam Natl Univ, Dept Ind Engn, Gwangju, South Korea
关键词
Deep learning; Object detection; Augmented reality; Mixed reality; Computation platform; Systematic review; RECOGNITION;
D O I
10.1016/j.compind.2022.103661
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Recent advances in augmented reality (AR) and artificial intelligence have caused these technologies to pioneer innovation and alteration in any field and industry. The fast-paced developments in computer vision (CV) and augmented reality facilitated analyzing and understanding the surrounding environments. This paper systematically reviews and presents studies that integrated augmented/mixed reality and deep learning for object detection over the past decade. Five sources including Scopus, Web of Science, IEEE Xplore, ScienceDirect, and ACM were used to collect data. Finally, a total of sixty-nine papers were analyzed from two perspectives: (1) application analysis of deep learning-based object detection in the context of augmented reality and (2) analyzing the use of servers or local AR devices to perform the object detection computations to understand the relation between object detection algorithms and AR technology. Furthermore, the advantages of using deep learning-based object detection to solve the AR problems and limitations hindering the ultimate use of this technology are critically discussed. Our findings affirm the promising future of integrating AR and CV. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:15
相关论文
共 98 条
[1]  
ABDI L., 2017, P S APPL COMP, P131
[2]   Driver information system: a combination of augmented reality, deep learning and vehicular Ad-hoc networks [J].
Abdi, Lotfi ;
Meddeb, Aref .
MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (12) :14673-14703
[3]  
Abdi L, 2017, INT WIREL COMMUN, P396, DOI 10.1109/IWCMC.2017.7986319
[4]   Augmented Reality Meets Computer Vision: Efficient Data Generation for Urban Driving Scenes [J].
Abu Alhaija, Hassan ;
Mustikovela, Siva Karthik ;
Mescheder, Lars ;
Geiger, Andreas ;
Rother, Carsten .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2018, 126 (09) :961-972
[5]   Novel QoS-Guaranteed Orchestration Scheme for Energy-Efficient Mobile Augmented Reality Applications in Multi-Access Edge Computing [J].
Ahn, Jaewon ;
Lee, Joohyung ;
Niyato, Dusit ;
Park, Hong-Shik .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (11) :13631-13645
[6]   Feasibility Study on the Utilization of Microsoft HoloLens to Increase Driving Conditions Awareness [J].
Anderson, Ryan ;
Toledo, Juan ;
ElAarag, IIala .
2019 IEEE SOUTHEASTCON, 2019,
[7]   Frugal Following: Power Thrifty Object Detection and Tracking for Mobile Augmented Reality [J].
Apicharttrisorn, Kittipat ;
Ran, Xukan ;
Chen, Jiasi ;
Krishnamurthy, Srikanth, V ;
Roy-Chowdhury, Amit K. .
PROCEEDINGS OF THE 17TH CONFERENCE ON EMBEDDED NETWORKED SENSOR SYSTEMS (SENSYS '19), 2019, :96-109
[8]  
Bahri Haythem, 2019, 2019 International Conference on Control, Artificial Intelligence, Robotics & Optimization (ICCAIRO). Proceedings, P219, DOI 10.1109/ICCAIRO47923.2019.00042
[9]  
Bhattarai Manish, 2020, 2020 19th IEEE International Conference on Machine Learning and Applications (ICMLA), P1224, DOI 10.1109/ICMLA51294.2020.00193
[10]  
Bosche F, 2019, P ISARC INT S AUT RO