Hybrid Supervised and Reinforcement Learning for Motion-Sickness-Aware Path Tracking in Autonomous Vehicles

被引:0
作者
Lv, Yukang [1 ]
Chen, Yi [1 ]
Chen, Ziguo [1 ]
Fan, Yuze [1 ]
Tao, Yongchao [1 ]
Zhao, Rui [1 ]
Gao, Fei [1 ,2 ]
机构
[1] Jilin Univ, Coll Automot Engn, Changchun 130025, Peoples R China
[2] Jilin Univ, Natl Key Lab Automot Chassis Integrat & Bion, Changchun 130025, Peoples R China
基金
美国国家科学基金会;
关键词
autonomous vehicles; path tracking; motion sickness; supervised learning; reinforcement learning; OF-THE-ART; CONTROL STRATEGIES; STEERING CONTROL; FREQUENCY; SYSTEM;
D O I
10.3390/s25123695
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Path tracking is an essential task for autonomous driving (AD), for which controllers are designed to issue commands so that vehicles will follow the path of upper-level decision planning properly to ensure operational safety, comfort, and efficiency. Current path-tracking methods still face challenges in balancing tracking accuracy with computational overhead, and more critically, lack consideration for Motion Sickness (MS) mitigation. However, as AD applications divert occupants' attention to non-driving activities at varying degrees, MS in self-driving vehicles has been significantly exacerbated. This study presents a novel framework, the Hybrid Supervised-Reinforcement Learning (HSRL), designed to reduce passenger discomfort while achieving high-precision tracking performance with computational efficiency. The proposed HSRL employs expert data-guided supervised learning to rapidly optimize the path-tracking model, effectively mitigating the sample efficiency bottleneck inherent in pure Reinforcement Learning (RL). Simultaneously, the RL architecture integrates a passenger MS mechanism into a multi-objective reward function. This design enhances model robustness and control performance, achieving both high-precision tracking and passenger comfort optimization. Simulation experiments demonstrate that the HSRL significantly outperforms Proportional-Integral-Derivative (PID) and Model Predictive Control (MPC), achieving improved tracking accuracy and significantly reducing passengers' cumulative Motion Sickness Dose Value (MSDV) across several test scenarios.
引用
收藏
页数:21
相关论文
共 41 条
[1]  
Amer N.H., 2016, P 2016 SICE INT S CO, P1
[2]   Modelling and Control Strategies in Path Tracking Control for Autonomous Ground Vehicles: A Review of State of the Art and Challenges [J].
Amer, Noor Hafizah ;
Zamzuri, Hairi ;
Hudha, Khisbullah ;
Kadir, Zulkiffli Abdul .
JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2017, 86 (02) :225-254
[3]   Moving in a Moving World: A Review on Vestibular Motion Sickness [J].
Bertolini, Giovanni ;
Straumann, Dominik .
FRONTIERS IN NEUROLOGY, 2016, 7
[4]   A Fast and Efficient Double-Tree RRT*-Like Sampling-Based Planner Applying on Mobile Robotic Systems [J].
Chen, Long ;
Shan, Yunxiao ;
Tian, Wei ;
Li, Bijun ;
Cao, Dongpu .
IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2018, 23 (06) :2568-2578
[5]   Moving-Object Detection From Consecutive Stereo Pairs Using Slanted Plane Smoothing [J].
Chen, Long ;
Fan, Lei ;
Xie, Guodong ;
Huang, Kai ;
Nuechter, Andreas .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2017, 18 (11) :3093-3102
[6]   Implementation of MPC-Based Path Tracking for Autonomous Vehicles Considering Three Vehicle Dynamics Models with Different Fidelities [J].
Chen, Shuping ;
Chen, Huiyan ;
Negrut, Dan .
AUTOMOTIVE INNOVATION, 2020, 3 (04) :386-399
[7]   TransFuser: Imitation With Transformer-Based Sensor Fusion for Autonomous Driving [J].
Chitta, Kashyap ;
Prakash, Aditya ;
Jaeger, Bernhard ;
Yu, Zehao ;
Renz, Katrin ;
Geiger, Andreas .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (11) :12878-12895
[8]   Self-driving carsickness [J].
Diels, Cyriel ;
Bos, Jelte E. .
APPLIED ERGONOMICS, 2016, 53 :374-382
[9]  
Donohew BE, 2004, AVIAT SPACE ENVIR MD, V75, P649
[10]   Predictive active steering control for autonomous vehicle systems [J].
Falcone, Paolo ;
Borrelli, Francesco ;
Asgari, Jahan ;
Tseng, Hongtei Eric ;
Hrovat, Davor .
IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2007, 15 (03) :566-580