Research on Text Sentiment Semantic Optimization Method Based on Supervised Contrastive Learning

被引:0
|
作者
Xiong, Shuchu [1 ,2 ]
Li, Xuan [1 ]
Wu, Jiani [1 ]
Zhou, Zhaohong [1 ]
Meng, Han [2 ]
机构
[1] School of Computer Science, Hunan University of Technology and Business, Changsha,410205, China
[2] School of Frontier Crossover Studies, Hunan University of Technology and Business, Changsha,410205, China
关键词
Extraction - Feature extraction - Learning systems - Semantics - Supervised learning - Vector spaces;
D O I
10.11925/infotech.2096-3467.2023.0319
中图分类号
学科分类号
摘要
[Objective] This study aims to solve problems such as text feature extraction bias and difficult separation of ambiguous semantics caused by the unique expressions and semantic drift phenomenon in Chinese. [Methods] This paper proposes a supervised contrastive learning semantic optimization method, which first uses a pre-trained model to generate semantic vectors, then designs a supervised joint self-supervised method to construct contrastive sample pairs, and finally constructs a supervised contrastive loss for semantic space measurement and optimization. [Results] On the ChnSentiCorp dataset, the five mainstream neural network models optimized by this method achieved F1 value improvements of 2.77%-3.82%. [Limitations] Due to limited hardware resources, a larger number of contrastive learning sample pairs were not constructed. [Conclusions] The semantic optimization method can effectively solve problems such as text feature extraction bias and difficult separation of ambiguous semantics, and provide new research ideas for text sentiment analysis tasks. © 2024 Chinese Academy of Sciences. All rights reserved.
引用
收藏
页码:69 / 81
相关论文
共 50 条
  • [1] Text semantic matching with an enhanced sample building method based on contrastive learning
    Wu, Lishan
    Hu, Jie
    Teng, Fei
    Li, Tianrui
    Du, Shengdong
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2023, 14 (09) : 3105 - 3112
  • [2] Text semantic matching with an enhanced sample building method based on contrastive learning
    Lishan Wu
    Jie Hu
    Fei Teng
    Tianrui Li
    Shengdong Du
    International Journal of Machine Learning and Cybernetics, 2023, 14 : 3105 - 3112
  • [3] Enhancing Aspect-Based Sentiment Analysis with Supervised Contrastive Learning
    Liang, Bin
    Luo, Wangda
    Li, Xiang
    Gui, Lin
    Yang, Min
    Yu, Xiaoqi
    Xu, Ruifeng
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 3242 - 3247
  • [4] SEMANTIC-ENHANCED SUPERVISED CONTRASTIVE LEARNING
    Zhang, Pingyue
    Wu, Mengyue
    Yu, Kai
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 6030 - 6034
  • [5] An implicit aspect-based sentiment analysis method using supervised contrastive learning and knowledge embedding
    Fu, Junsen
    Li, Xianyong
    Zhu, Yihong
    Du, Yajun
    Fan, Yongquan
    Chen, Xiaoliang
    Huang, Dong
    Wang, Shumin
    APPLIED SOFT COMPUTING, 2024, 167
  • [6] Learning Implicit Sentiment in Aspect-based Sentiment Analysis with Supervised Contrastive Pre-Training
    Li, Zhengyan
    Zou, Yicheng
    Zhang, Chong
    Zhang, Qi
    Wei, Zhongyu
    2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 246 - 256
  • [7] Supervised Contrastive Learning for Text Emotion Category Representations
    Wang, Xiang-Yu
    Zong, Cheng-Qing
    Ruan Jian Xue Bao/Journal of Software, 2024, 35 (10): : 4794 - 4805
  • [8] A Robust and Effective Text Detector Supervised by Contrastive Learning
    Wei, Ran
    Li, Yaoyi
    Li, Haiyan
    Tang, Ze
    Lu, Hongtao
    Cai, Nengbin
    Zhao, Xuejun
    IEEE ACCESS, 2021, 9 : 26431 - 26441
  • [9] Supervised contrastive learning for robust text adversarial training
    Weidong Li
    Bo Zhao
    Yang An
    Chenhan Shangguan
    Minzi Ji
    Anqi Yuan
    Neural Computing and Applications, 2023, 35 : 7357 - 7368
  • [10] Aspect-Pair Supervised Contrastive Learning for aspect-based sentiment analysis
    Li, Pan
    Li, Ping
    Xiao, Xiao
    KNOWLEDGE-BASED SYSTEMS, 2023, 274