EmoDet2: Emotion Detection in English Textual Dialogue using BERT and BiLSTM Models

被引:30
作者
Al-Omari, Hani [1 ]
Abdullah, Malak A. [2 ]
Shaikh, Samira [3 ]
机构
[1] Jordan Univ Sci & Technol, Dept Comp Sci, Irbid, Jordan
[2] Jordan Unive Sci & Technol, Dept Comp Sci, Irbid, Jordan
[3] Univ North Carolina Charlotte, Dept Comp Sci, Charlotte, NC USA
来源
2020 11TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION SYSTEMS (ICICS) | 2020年
关键词
Neural Network; BERT; Deep Learning; Machine learning; Emotions; Sentiment;
D O I
10.1109/ICICS49469.2020.239539
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Emotion detection is one of the most challenging problems in the automated understand of language. Understanding human emotions using text without facial expression is considered a complicated task. Therefore, building a machine that understands the context of the sentences and differentiates between emotions has motivated the machine learning community recently. We propose a system to detect emotions using deep learning approaches. The main input to the system is a combination of GloVe word embeddings, BERT Embeddings and a set of psycholinguistic features (e.g. from AffectiveTweets Weka-package). The proposed system (EmoDet2) is combining a fully connected neural network architecture and BiLSTM neural network to obtain performance results that show substantial improvements (F1-Score 0.748) over the baseline model provided by Semeval-2019 / Task-3 organizers (F1-score 0.58).
引用
收藏
页码:226 / 232
页数:7
相关论文
共 25 条
[1]   EmoNet: Fine-Grained Emotion Detection with Gated Recurrent Neural Networks [J].
Abdul-Mageed, Muhammad ;
Ungar, Lyle .
PROCEEDINGS OF THE 55TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2017), VOL 1, 2017, :718-728
[2]   SEDAT: Sentiment and Emotion Detection in Arabic Text using CNN-LSTM Deep Learning [J].
Abdullah, Malak ;
Hadzikadic, Mirsad ;
Shaikh, Samira .
2018 17TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA), 2018, :835-840
[3]  
Al-Omari Hani, 2019, P 13 INT WORKSH SEM, P200
[4]  
Alm C.O., 2005, P HUM LANG TECHN C C, P579
[5]  
Bataineh B., 2019, P 2019 3 INT C ADV A, P146
[6]  
Baziotis C, 2017, P 11 INT WORKSH SEM, DOI [DOI 10.18653/V1/S17-2126, 10.18653/v1/s17-2126]
[7]   Understanding Emotions in Text Using Deep Learning and Big Data [J].
Chatterjee, Ankush ;
Gupta, Umang ;
Chinnakotla, Manoj Kumar ;
Srikanth, Radhakrishnan ;
Galley, Michel ;
Agrawal, Puneet .
COMPUTERS IN HUMAN BEHAVIOR, 2019, 93 :309-317
[8]  
Chatterjee Ankush, 2019, P 13 INT WORKSH SEM, P39, DOI 10.18653/v1/S19-2005
[9]  
De Choudhury M., 2013, P 5 ANN ACM WEB SCI, P47, DOI DOI 10.1145/2464464.2464480
[10]  
Ekman P., 1999, Handbook of cognition and emotion, P45, DOI [10.1002/0470013494.ch3, DOI 10.1002/0470013494.CH3]