Deep learning based response generation using emotion feature extraction

被引:7
|
作者
Lee, Young-Jun [1 ]
Choi, Ho-Jin [1 ]
机构
[1] Korea Adv Inst Sci & Technol, Sch Comp, Daejeon, South Korea
来源
2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP 2020) | 2020年
关键词
Emotion feature extraction; response generation model; emotion classification model; encoder-decoder architecture;
D O I
10.1109/BigComp48618.2020.00-65
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Neural response generation is to generate human-like response given human utterance by using a deep learning. In the previous studies, expressing emotion in response generation improve user performance, user engagement, and user satisfaction. Also, the conversational agents can communicate with users at the human level. However, the previous emotional response generation model cannot understand the subtle part of emotions, because this model use the desired emotion of response as a token form. Moreover, this model is difficult to generate natural responses related to input utterance at the content level, since the information of input utterance can be biased to the emotion token. To overcome these limitations, we propose an emotional response generation model which generates emotional and natural responses by using the emotion feature extraction. Our model consists of two parts: Extraction part and Generation part. The extraction part is to extract the emotion of input utterance as a vector form by using the pre-trained LSTM based classification model. The generation part is to generate an emotional and natural response to the input utterance by reflecting the emotion vector from the extraction part and the thought vector from the encoder. We evaluate our model on the emotion-labeled dialogue dataset: DailyDialog. We evaluate our model on quantitative analysis and qualitative analysis: emotion classification; response generation modeling; comparative study. In general, experiments show that the proposed model can generate emotional and natural responses.
引用
收藏
页码:255 / 262
页数:8
相关论文
共 50 条
  • [1] Two-Way Feature Extraction for Speech Emotion Recognition Using Deep Learning
    Aggarwal, Apeksha
    Srivastava, Akshat
    Agarwal, Ajay
    Chahal, Nidhi
    Singh, Dilbag
    Alnuaim, Abeer Ali
    Alhadlaq, Aseel
    Lee, Heung-No
    SENSORS, 2022, 22 (06)
  • [2] DEEP LEARNING FOR ROBUST FEATURE GENERATION IN AUDIOVISUAL EMOTION RECOGNITION
    Kim, Yelin
    Lee, Honglak
    Provost, Emily Mower
    2013 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2013, : 3687 - 3691
  • [3] Deep learning based text detection using resnet for feature extraction
    Li-Kun Huang
    Hsiao-Ting Tseng
    Chen-Chiung Hsieh
    Chih-Sin Yang
    Multimedia Tools and Applications, 2023, 82 : 46871 - 46903
  • [4] Deep learning based text detection using resnet for feature extraction
    Huang, Li-Kun
    Tseng, Hsiao-Ting
    Hsieh, Chen-Chiung
    Yang, Chih-Sin
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (30) : 46871 - 46903
  • [5] Driver Identification Based on Hidden Feature Extraction by Using Deep Learning
    Chen, Jie
    Wu, ZhongCheng
    Zhang, Jun
    Chen, Song
    PROCEEDINGS OF 2019 IEEE 3RD INFORMATION TECHNOLOGY, NETWORKING, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (ITNEC 2019), 2019, : 1765 - 1768
  • [6] DHERF: A Deep Learning Ensemble Feature Extraction Framework for Emotion Recognition Using Enhanced-CNN
    Basha, Shaik Abdul Khalandar
    Vincent, P. M. Durai Raj
    JOURNAL OF ADVANCES IN INFORMATION TECHNOLOGY, 2024, 15 (07) : 853 - 861
  • [7] Feature Fusion of Speech Emotion Recognition Based on Deep Learning
    Liu, Gang
    He, Wei
    Jin, Bicheng
    PROCEEDINGS OF 2018 INTERNATIONAL CONFERENCE ON NETWORK INFRASTRUCTURE AND DIGITAL CONTENT (IEEE IC-NIDC), 2018, : 193 - 197
  • [8] EEG-Based Music Emotion Prediction Using Supervised Feature Extraction for MIDI Generation
    Gomez-Morales, Oscar
    Perez-Nastar, Hernan
    alvarez-Meza, Andres Marino
    Torres-Cardona, Hector
    Castellanos-Dominguez, German
    SENSORS, 2025, 25 (05)
  • [9] Feature Extraction of Plant Leaf Using Deep Learning
    Ahmad, Muhammad Umair
    Ashiq, Sidra
    Badshah, Gran
    Khan, Ali Haider
    Hussain, Muzammil
    COMPLEXITY, 2022, 2022
  • [10] Visualization of Driving Behavior Based on Hidden Feature Extraction by Using Deep Learning
    Liu, HaiLong
    Taniguchi, Tadahiro
    Tanaka, Yusuke
    Takenaka, Kazuhito
    Bando, Takashi
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2017, 18 (09) : 2477 - 2489