Bidirectional transfer learning model for sentiment analysis of natural language

被引:0
作者
Shivani Malhotra
Vinay Kumar
Alpana Agarwal
机构
[1] Thapar Institute of Engineering and Technology,Department of Electronics and Communication Engineering
来源
Journal of Ambient Intelligence and Humanized Computing | 2021年 / 12卷
关键词
Universal language model fine-tuning (ULMFit); Bidirectional encoder representations from transformers (BERT); Average stochastic gradient weight-dropped LSTM (AWD-LSTM); Transfer learning; Sentiment classification;
D O I
暂无
中图分类号
学科分类号
摘要
The contemporary unsupervised word representation methods have been successful in capturing semantic statistics on various Natural Language Processing tasks. However, these methods proved to be futile in addressing tasks like polysemy or homonymy, which prevail in such tasks. There has been a rise in the number of state-of-the-art transfer learning techniques bringing into play the language models pre-trained on large inclusive corpus. Motivated by these techniques, the present paper proposes an efficacious transfer learning based ensemble model. This model is inspired by ULMFit and presents results on challenging sentiment analysis tasks such as contextualization and regularization. We have empirically validated the efficiency of our proposed model by applying it to three conventional datasets for sentiment classification task. Our model accomplished the state-of-the-art outcomes remarkably when compared to acknowledged baselines in terms of classification accuracy.
引用
收藏
页码:10267 / 10287
页数:20
相关论文
共 84 条
  • [21] He Y(2020)Siamese capsule networks with global and local features for text classification Neurocomputing 390 88-98
  • [22] Wang X(2018)Recent trends in deep learning based natural language processing IEEE Comput Intell Mag 13 55-75
  • [23] Collobert R(2020)Pre-train, Interact, Fine-tune: a novel interaction representation for text classification Inf Process Manag 57 102215-undefined
  • [24] Weston J(undefined)undefined undefined undefined undefined-undefined
  • [25] Bottou L(undefined)undefined undefined undefined undefined-undefined
  • [26] Karlen M(undefined)undefined undefined undefined undefined-undefined
  • [27] Kavukcuoglu K(undefined)undefined undefined undefined undefined-undefined
  • [28] Kuksa P(undefined)undefined undefined undefined undefined-undefined
  • [29] Haddoud M(undefined)undefined undefined undefined undefined-undefined
  • [30] Mokhtari A(undefined)undefined undefined undefined undefined-undefined