BERT-LSTM model for sarcasm detection in code-mixed social media post

被引:0
作者
Rajnish Pandey
Jyoti Prakash Singh
机构
[1] National Institute of Technology Patna,Department of Computer Science and Engineering
来源
Journal of Intelligent Information Systems | 2023年 / 60卷
关键词
BERT; LSTM; Sarcasm; Sentiment analysis; Deep learning; Code-mixed;
D O I
暂无
中图分类号
学科分类号
摘要
Sarcasm is the acerbic use of words to mock someone or something, mostly in a satirical way. Scandal or mockery is used harshly, often crudely and contemptuously, for destructive purposes in sarcasm. To extract the actual sentiment of a sentence for code-mixed language is complex because of the unavailability of sufficient clues for sarcasm. In this work, we proposed a model consisting of Bidirectional Encoder Representations from Transformers (BERT) stacked with Long Short Term Memory (LSTM) (BERT-LSTM). A pre-trained BERT model is used to create embedding for the code-mixed dataset. These embedding vectors were used by an LSTM network consisting of a single layer to identify the nature of a sentence, i.e., sarcastic or non-sarcastic. The experiments show that the proposed BERT-LSTM model detects sarcastic sentences more effectively compared to other models on the code-mixed dataset, with an improvement of up to 6 % in terms of F1-score.
引用
收藏
页码:235 / 254
页数:19
相关论文
共 61 条
[1]  
Agarwal K(2021)Humor generation and detection in code-mixed Hindi-English Proceedings of the Student Research Workshop Associated with RANLP 2021 1-6
[2]  
Narula R(2019)Analysis of emoticon and sarcasm effect on sentiment analysis of Indonesian language on Twitter Journal of Information Systems Engineering and Business Intelligence 5 100-109
[3]  
Alita D(2021)Multi-modal sarcasm detection and humor classification in code-mixed conversations IEEE Transactions on Affective Computing 55 51-66
[4]  
Priyanta S(2020)Sentiment analysis using rule-based and case-based reasoning Journal of Intelligent Information Systems 57 601-626
[5]  
Rokhman N(2021)Leveraging contextual embeddings and self-attention neural networks with bi-attention for sentiment analysis Journal of Intelligent Information Systems 4 5477-5488
[6]  
Bedi M(2016)A pattern-based approach for sarcasm detection on Twitter IEEE Access 53 4215-4258
[7]  
Kumar S(2020)Sarcasm identification in textual data: systematic review, research challenges and open directions Artificial Intelligence Review 2 1-14
[8]  
Akhtar MS(2015)Sentiment analysis using product review data Journal of Big Data 15 66-78
[9]  
Berka P(2019)Sarcasm detection using RNN with relation vector International Journal of Data Warehousing and Mining (IJDWM) 9 1735-1780
[10]  
Biesialska M(1997)Long short-term memory Neural Computation 91 1-15