Bidirectional transfer learning model for sentiment analysis of natural language

被引:0
作者
Shivani Malhotra
Vinay Kumar
Alpana Agarwal
机构
[1] Thapar Institute of Engineering and Technology,Department of Electronics and Communication Engineering
来源
Journal of Ambient Intelligence and Humanized Computing | 2021年 / 12卷
关键词
Universal language model fine-tuning (ULMFit); Bidirectional encoder representations from transformers (BERT); Average stochastic gradient weight-dropped LSTM (AWD-LSTM); Transfer learning; Sentiment classification;
D O I
暂无
中图分类号
学科分类号
摘要
The contemporary unsupervised word representation methods have been successful in capturing semantic statistics on various Natural Language Processing tasks. However, these methods proved to be futile in addressing tasks like polysemy or homonymy, which prevail in such tasks. There has been a rise in the number of state-of-the-art transfer learning techniques bringing into play the language models pre-trained on large inclusive corpus. Motivated by these techniques, the present paper proposes an efficacious transfer learning based ensemble model. This model is inspired by ULMFit and presents results on challenging sentiment analysis tasks such as contextualization and regularization. We have empirically validated the efficiency of our proposed model by applying it to three conventional datasets for sentiment classification task. Our model accomplished the state-of-the-art outcomes remarkably when compared to acknowledged baselines in terms of classification accuracy.
引用
收藏
页码:10267 / 10287
页数:20
相关论文
共 84 条
  • [1] Abid F(2020)Multi-source social media data sentiment analysis using bidirectional recurrent convolutional neural networks Comput Commun 157 102-115
  • [2] Li C(2003)A neural probabilistic language model J Mach Learn Res 3 1137-1155
  • [3] Alam M(2017)Enriching word vectors with subword information Trans Assoc Comput Linguist 5 135-146
  • [4] Bengio Y(2017)A pattern-based approach for multi-class sentiment analysis in twitter IEEE Access 5 20617-20639
  • [5] Ducharme R(2016)Affective computing and sentiment analysis IEEE Intell Syst 31 102-107
  • [6] Vincent P(2017)Sentiment analysis is a big suitcase IEEE Intell Syst 32 74-80
  • [7] Jauvin C(2017)Improving sentiment analysis via sentence type classification using BiLSTM-CRF and CNN Expert Syst Appl 72 221-230
  • [8] Bojanowski P(2011)Natural language processing (almost) from scratch J Mach Learn Res 12 2493-2537
  • [9] Grave E(2016)Combining supervised term-weighting metrics for SVM text classification with extended term representation Knowl Inf Syst 3 909-931
  • [10] Joulin A(2018)Universal language model fine-tuning for text classification Assoc Comput Linguist 1 328-339