Intelligent In-Car Emotion Regulation Interaction System Based on Speech Emotion Recognition

被引:1
作者
Yang, Yuhan [1 ]
Zhang, Yan [1 ]
Zhong, Zhinan [1 ]
Dai, Wan [1 ]
Chen, Yunfei [1 ]
Chen, Mo [2 ]
机构
[1] Southeast Univ, Sch Mech Engn, Nanjing, Peoples R China
[2] Nanjing Tech Univ, Coll Art & Design, Nanjing, Peoples R China
来源
2024 4TH INTERNATIONAL CONFERENCE ON COMPUTER, CONTROL AND ROBOTICS, ICCCR 2024 | 2024年
关键词
Human machine interaction (HMI); automotive travel; feature selection; speech emotion recognition; machine learning; emotion regulation; FEATURES;
D O I
10.1109/ICCCR61138.2024.10585371
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With driving emerging as a common mode of transportation, the automotive industry has increasingly prioritized driving safety and experience. A substantial body of research focused on driving safety and the overall travel experience has underscored the pivotal role of emotions. In this article, we introduce an innovative in-car emotion recognition and interaction system, carefully crafted to intelligently respond to the emotional states of drivers. This system captures real-time emotional data through its user input layer and seamlessly integrates it into the technological architecture layer, residing within the vehicle's CPU. Leveraging cutting-edge deep learning models for emotion recognition, the system's outcomes trigger tailored emotion regulation strategies within the interaction feedback layer. Notably, our study introduces a groundbreaking speech fusion feature, MFCCs+, meticulously crafted for driving contexts. Furthermore, we have optimized the driving speech emotion recognition model using 1D-CNN, resulting in a remarkable 10% improvement in recognition accuracy. Subsequent validation experiments affirm the system's effectiveness in enhancing driving safety. In conclusion, the integration of emotion-based interaction solutions holds immense potential for elevating both driving safety and the overall travel experience within intelligent driving scenarios. This innovation promises to shape the future landscape of automotive travel, offering a safer and more enjoyable journey for all.
引用
收藏
页码:142 / 150
页数:9
相关论文
共 32 条
  • [1] Deep Learning Techniques for Speech Emotion Recognition, from Databases to Models
    Abbaschian, Babak Joze
    Sierra-Sosa, Daniel
    Elmaghraby, Adel
    [J]. SENSORS, 2021, 21 (04) : 1 - 27
  • [2] Infant cry classification by MFCC feature extraction with MLP and CNN structures
    Abbaskhah, Ahmad
    Sedighi, Hamed
    Marvi, Hossein
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 86
  • [3] Speech emotion recognition: Emotional models, databases, features, preprocessing methods, supporting modalities, and classifiers
    Akcay, Mehmet Berkehan
    Oguz, Kaya
    [J]. SPEECH COMMUNICATION, 2020, 116 (116) : 56 - 76
  • [4] A survey of state-of-the-art approaches for emotion recognition in text
    Alswaidan, Nourah
    Menai, Mohamed El Bachir
    [J]. KNOWLEDGE AND INFORMATION SYSTEMS, 2020, 62 (08) : 2937 - 2987
  • [5] Affective Automotive User Interfaces-Reviewing the State of Driver Affect Research and Emotion Regulation in the Car
    Braun, Michael
    Weber, Florian
    Alt, Florian
    [J]. ACM COMPUTING SURVEYS, 2021, 54 (07)
  • [6] Improving Driver Emotions with Affective Strategies
    Braun, Michael
    Schubert, Jonas
    Pfleging, Bastian
    Alt, Florian
    [J]. MULTIMODAL TECHNOLOGIES AND INTERACTION, 2019, 3 (01)
  • [7] Dempster AP, 2008, STUD FUZZ SOFT COMP, V219, P57
  • [8] How to Increase Automated Vehicles' Acceptance through In-Vehicle Interaction Design: A Review
    Detjen, Henrik
    Faltaous, Sarah
    Pfleging, Bastian
    Geisler, Stefan
    Schneegass, Stefan
    [J]. INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION, 2021, 37 (04) : 308 - 330
  • [9] Dwivedi K, 2014, IEEE INT ADV COMPUT, P995, DOI 10.1109/IAdCC.2014.6779459
  • [10] Eyben F., 2010, P 18 ACM INT C MULT, P1459, DOI 10.1145/1873951.1874246