Universally domain adaptive algorithm for sentiment classification using transfer learning approach

被引:2
作者
Krishna, B. Vamshi [1 ]
Pandey, Ajeet Kumar [2 ]
Kumar, A. P. Siva [3 ]
机构
[1] Sapiens Technol Pvt Ltd, Bangalore, Karnataka, India
[2] Bombardier Transportat Ltd, Hyderabad, India
[3] JNTUA Univ, Anantapur, India
关键词
Sentiment classification; Domain adaptation; Deep learning; Transfer learning; Word embeddings;
D O I
10.1007/s13198-021-01113-y
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Huge amount of unstructured data is posted on the cloud from various sources for the purpose of feedback and reviews. These review needs require classification for many a reasons and sentiment classification is one of them. Sentiment classification of these reviews quite difficult as they are arriving from many sources. A robust classifier is needed to deal with different data distributions. Traditional supervised machine learning approaches not works well as they require retraining when domain is changed. Deep learning techniques perform well to handle these situations, but they are more data hungry and computationally expensive. Transfer learning is a feature in the cross-domain sentiment classification where features are transferred from one domain to another without any training. Moreover, transfer learning allows the domains, tasks, and distributions used in training and testing to be different. Therefor transfer learning mechanism is required to transfer the sentiment features across the domains. This paper presents a transfer learning approach using pretrained language model, ELMO which helps in transferring sentiment features across domains. This model has been tested on text reviews posted on twitter data set and compared with deep learning methods with and without pretraining process, also our model delivers promising results. This model permits flexibility to plug and play parameters with target models with easier domain adaptivity and transfer sentiment features. Also, model enables sentiment classifiers by using the transferred features from an already trained domain and reuse the sentiment features by saving the time and training cost.
引用
收藏
页码:542 / 552
页数:11
相关论文
共 29 条
  • [1] [Anonymous], 2015, C N AM CHAPTER ASSOC
  • [2] Blitzer J., 2007, ANN M ASS COMP LING, V45, P440
  • [3] Cui W., 2019, ICLR
  • [4] Dahou A., Proceedings of coling 2016, the 26th international conference on computational linguistics: Technical papers, P2418
  • [5] Bringing Transparency Design into Practice
    Eiband, Malin
    Schneider, Hanna
    Bilandzic, Mark
    Fazekas-Con, Julian
    Haug, Mareike
    Hussmann, Heinrich
    [J]. IUI 2018: PROCEEDINGS OF THE 23RD INTERNATIONAL CONFERENCE ON INTELLIGENT USER INTERFACES, 2018, : 211 - 223
  • [6] Glorot Xavier, 2011, P 28 INT C MACH LEAR, P513, DOI DOI 10.5555/3104482.3104547
  • [7] Identifying Features in Opinion Mining via Intrinsic and Extrinsic Domain Relevance
    Hai, Zhen
    Chang, Kuiyu
    Kim, Jung-Jae
    Yang, Christopher C.
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2014, 26 (03) : 623 - 634
  • [8] He Y, 2011, P 49 ANN M ASS COMP, V1, P123, DOI DOI 10.1007/978-3-319-18458-6_3
  • [9] Howard J, 2018, PROCEEDINGS OF THE 56TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL), VOL 1, P328
  • [10] Iyyer M, 2015, PROCEEDINGS OF THE 53RD ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 7TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING, VOL 1, P1681