Haptic Assistive Control With Learning-Based Driver Intent Recognition for Semi-Autonomous Vehicles

被引:12
|
作者
Wang, Chengshi [1 ]
Li, Fangjian [2 ]
Wang, Yue [2 ]
Wagner, John R. [2 ]
机构
[1] Nanosci & Technol Div, Argonne Natl Lab, Lemont, IL 60439 USA
[2] Clemson Univ, Mech Engn, Clemson, SC 29634 USA
来源
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES | 2023年 / 8卷 / 01期
关键词
Vehicles; Haptic interfaces; Hidden Markov models; Object oriented modeling; Vehicle dynamics; Automation; Roads; Haptic feedback; nonlinear model predictive control; semi-autonomous vehicles; driver intent recognition; machine learning; ensemble learning; SHARED CONTROL; DRIVING INTENTION; ARCHITECTURES; AUTOMATION; INFERENCE; ROAD;
D O I
10.1109/TIV.2021.3137805
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Semi-autonomous vehicles equipped with assistive control systems may experience degraded lateral behaviors when aggressive driver steering commands compete with high levels of autonomy. This challenge can be mitigated with effective operator intent recognition, which can configure automated systems in context-specific situations where the driver intends to perform a steering maneuver. In this article, an ensemble learning-based driver intent recognition strategy has been developed. A nonlinear model predictive control algorithm has been designed and implemented to generate haptic feedback for lateral vehicle guidance, assisting the drivers in accomplishing their intended action. To validate the framework, operator-in-the-loop testing with 30 human subjects was conducted on a steer-by-wire platform with a virtual reality driving environment. The roadway scenarios included lane change, obstacle avoidance, intersection turns, and highway exit. The automated system with learning-based driver intent recognition was compared to both the automated system with a finite state machine-based driver intent estimator and the automated system without any driver intent prediction for all driving events. Test results demonstrate that semi-autonomous vehicle performance can be enhanced by up to 74.1% with a learning-based intent predictor. Further, the learning-based model has a 30.9% higher driver intent recognition accuracy than the finite state machine-based method. The holistic framework that integrates human intelligence, machine learning algorithms, and vehicle control can help solve the driver-system conflict problem leading to safer operation.
引用
收藏
页码:425 / 437
页数:13
相关论文
共 50 条
  • [1] Robust Predictive Control for Semi-Autonomous Vehicles with an Uncertain Driver Model
    Gray, Andrew
    Gao, Yiqi
    Hedrick, J. Karl
    Borrelli, Francesco
    2013 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2013, : 208 - 213
  • [2] Stochastic Predictive Control for Semi-Autonomous Vehicles with an Uncertain Driver Model
    Gray, Andrew
    Gao, Yiqi
    Lin, Theresa
    Hedrick, J. Karl
    Borrelli, Francesco
    2013 16TH INTERNATIONAL IEEE CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS - (ITSC), 2013, : 2329 - 2334
  • [3] Evaluation of a Robust Haptic Interface for Semi-Autonomous Vehicles
    Clemson University, United States
    SAE Int. J. Connect. Autom. Veh., 2019, 2
  • [4] A Framework for Analysing Driver Interactions with Semi-Autonomous Vehicles
    Shaikh, Siraj Ahmed
    Krishnan, Padmanabhan
    ELECTRONIC PROCEEDINGS IN THEORETICAL COMPUTER SCIENCE, 2012, (105): : 85 - 99
  • [5] Semi-Autonomous Vehicles as a Cognitive Assistive Device for Older Adults
    Knoefel, Frank
    Wallace, Bruce
    Goubran, Rafik
    Sabra, Iman
    Marshall, Shawn
    GERIATRICS, 2019, 4 (04)
  • [6] Emotion recognition for semi-autonomous vehicles framework
    Izquierdo-Reyes J.
    Ramirez-Mendoza R.A.
    Bustamante-Bello M.R.
    Pons-Rovira J.L.
    Gonzalez-Vargas J.E.
    International Journal on Interactive Design and Manufacturing (IJIDeM), 2018, 12 (4): : 1447 - 1454
  • [7] Redefining the Driver's Attention Gauge in Semi-Autonomous Vehicles
    Anwar, Raja Hasnain
    Anwar, Fatima Muhammad
    Haider, Muhammad Kumail
    Efrat, Alon
    Raza, Muhammad Taqi
    PROCEEDINGS OF THE INT'L ACM CONFERENCE ON MODELING, ANALYSIS AND SIMULATION OF WIRELESS AND MOBILE SYSTEMS, MSWIM 2023, 2023, : 307 - 311
  • [8] Safe Semi-Autonomous Control with Enhanced Driver Modeling
    Vasudevan, Ram
    Shia, Victor
    Gao, Yiqi
    Cervera-Navarro, Ricardo
    Bajcsy, Ruzena
    Borrelli, Francesco
    2012 AMERICAN CONTROL CONFERENCE (ACC), 2012, : 2896 - 2903
  • [9] Advanced Driver Assistance System based on NeuroFSM applied in the detection of autonomous human faults and support to semi-autonomous control for robotic vehicles
    Bruno, Diego Renan
    Gomes, Iago Pacheco
    Osorio, Fernando Santos
    Wolf, Denis Fernando
    2019 LATIN AMERICAN ROBOTICS SYMPOSIUM, 2019 BRAZILIAN SYMPOSIUM ON ROBOTICS (SBR) AND 2019 WORKSHOP ON ROBOTICS IN EDUCATION (LARS-SBR-WRE 2019), 2019, : 92 - 97
  • [10] A Camera-Based System to Detect Driver Hands on the Steering Wheel in Semi-autonomous Vehicles
    Morvillier, Raphael
    Prat, Christophe
    Aloui, Saifeddine
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2022, PT VI, 2023, 13718 : 617 - 621