Review and Perspectives on Driver Digital Twin and Its Enabling Technologies for Intelligent Vehicles

被引:100
作者
Hu, Zhongxu [1 ]
Lou, Shanhe [1 ]
Xing, Yang [2 ]
Wang, Xiao [3 ,4 ]
Cao, Dongpu [5 ]
Lv, Chen [1 ]
机构
[1] Nanyang Technol Univ, Sch Mech & Aerosp Engn, Singapore 637460, Singapore
[2] Cranfield Univ, Ctr Autonomous & Cyber Phys Syst, Cranfield MK43 0AL, Beds, England
[3] Chinese Acad Sci, Inst Automat, Qingdao Acad Intelligent Ind, Beijing 100190, Peoples R China
[4] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
[5] Tsinghua Univ, Sch Vehicle & Mobil, Beijing 100084, Peoples R China
来源
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES | 2022年 / 7卷 / 03期
关键词
Vehicles; Digital twins; Data models; Behavioral sciences; Safety; Autonomous vehicles; Reliability; Driver digital twin; human-centric deisgn; intelligent vehicles; human-machine interactions; cyber-physical systems; CYBER-PHYSICAL SYSTEM; CONVOLUTIONAL NEURAL-NETWORK; EMERGENCY BRAKING INTENTION; AUTONOMIC NERVOUS-SYSTEM; HEART-RATE-VARIABILITY; SHARED CONTROL; EMOTION RECOGNITION; AUTOMATED VEHICLES; ARTIFICIAL-INTELLIGENCE; CHANNEL ESTIMATION;
D O I
10.1109/TIV.2022.3195635
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Digital Twin (DT) is an emerging technology and has been introduced into intelligent driving and transportation systems to digitize and synergize connected automated vehicles. However, existing studies focus on the design of the automated vehicle, whereas the digitization of the human driver, who plays an important role in driving, is largely ignored. Furthermore, previous driver-related tasks are limited to specific scenarios and have limited applicability. Thus, a novel concept of a driver digital twin (DDT) is proposed in this study to bridge the gap between existing automated driving systems and fully digitized ones and aid in the development of a complete driving human cyber-physical system (H-CPS). This concept is essential for constructing a harmonious human-centric intelligent driving system that considers the proactivity and sensitivity of the human driver. The primary characteristics of the DDT include multimodal state fusion, personalized modeling, and time variance. Compared with the original DT, the proposed DDT emphasizes on internal personality and capability with respect to the external physiological-level state. This study systematically illustrates the DDT and outlines its key enabling aspects. The related technologies are comprehensively reviewed and discussed with a view to improving them by leveraging the DDT. In addition, the potential applications and unsettled challenges are considered. This study aims to provide fundamental theoretical support to researchers in determining the future scope of the DDT system
引用
收藏
页码:417 / 440
页数:24
相关论文
共 320 条
[1]   A cooperative heterogeneous vehicular clustering framework for efficiency improvement [J].
Ahmad, Iftikhar ;
Noor, Rafidah Md ;
Ahmed, Zaheed ;
Umm-e-Habiba ;
Akram, Naveed ;
Garcia Marquez, Fausto Pedro .
FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2021, 22 (09) :1247-1259
[2]   Decentralized Dynamic Event-Triggered Communication and Active Suspension Control of In-Wheel Motor Driven Electric Vehicles with Dynamic Damping [J].
Ahmad, Iftikhar ;
Ge, Xiaohua ;
Han, Qing-Long .
IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2021, 8 (05) :971-986
[3]   A sensorless state estimation for a safety-oriented cyber-physical system in urban driving: Deep learning approach [J].
Al-Sharman, Mohammad ;
Murdoch, David ;
Cao, Dongpu ;
Lv, Chen ;
Zweiri, Yahya ;
Rayside, Derek ;
Melek, William .
IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2021, 8 (01) :169-178
[4]   Constraining Design: Applying the Insights of Cognitive Work Analysis to the Design of Novel In-Car Interfaces to Support Eco-Driving [J].
Allison, Craig K. ;
Stanton, Neville A. .
AUTOMOTIVE INNOVATION, 2020, 3 (01) :30-41
[5]   Learning Robust Control Policies for End-to-End Autonomous Driving From Data-Driven Simulation [J].
Amini, Alexander ;
Gilitschenski, Igor ;
Phillips, Jacob ;
Moseyko, Julia ;
Banerjee, Rohan ;
Karaman, Sertac ;
Rus, Daniela .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2020, 5 (02) :1143-1150
[6]  
[Anonymous], 2005, REV AUTOMOT ENG
[7]   Human-Machine Shared Driving: Challenges and Future Directions [J].
Ansari, Shahzeb ;
Naghdy, Fazel ;
Du, Haiping .
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2022, 7 (03) :499-519
[8]   Towards Computationally Efficient and Realtime Distracted Driver Detection With MobileVGG Network [J].
Baheti, Bhakti ;
Talbar, Sanjay ;
Gajre, Suhas .
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2020, 5 (04) :565-574
[9]   Assessing public opinions of and interest in new vehicle technologies: An Austin perspective [J].
Bansal, Prateek ;
Kockelman, Kara M. ;
Singh, Amit .
TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2016, 67 :1-14
[10]   Learning a Deep Predictive Coding Network for a Semi-Supervised 3D-Hand Pose Estimation [J].
Banzi, Jamal ;
Bulugu, Isack ;
Huang, Shiliang ;
Ye, Zhongfu .
IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2020, 7 (05) :1371-1379