Research on Text Sentiment Semantic Optimization Method Based on Supervised Contrastive Learning

被引:0
|
作者
Xiong, Shuchu [1 ,2 ]
Li, Xuan [1 ]
Wu, Jiani [1 ]
Zhou, Zhaohong [1 ]
Meng, Han [2 ]
机构
[1] School of Computer Science, Hunan University of Technology and Business, Changsha,410205, China
[2] School of Frontier Crossover Studies, Hunan University of Technology and Business, Changsha,410205, China
关键词
Extraction - Feature extraction - Learning systems - Semantics - Supervised learning - Vector spaces;
D O I
10.11925/infotech.2096-3467.2023.0319
中图分类号
学科分类号
摘要
[Objective] This study aims to solve problems such as text feature extraction bias and difficult separation of ambiguous semantics caused by the unique expressions and semantic drift phenomenon in Chinese. [Methods] This paper proposes a supervised contrastive learning semantic optimization method, which first uses a pre-trained model to generate semantic vectors, then designs a supervised joint self-supervised method to construct contrastive sample pairs, and finally constructs a supervised contrastive loss for semantic space measurement and optimization. [Results] On the ChnSentiCorp dataset, the five mainstream neural network models optimized by this method achieved F1 value improvements of 2.77%-3.82%. [Limitations] Due to limited hardware resources, a larger number of contrastive learning sample pairs were not constructed. [Conclusions] The semantic optimization method can effectively solve problems such as text feature extraction bias and difficult separation of ambiguous semantics, and provide new research ideas for text sentiment analysis tasks. © 2024 Chinese Academy of Sciences. All rights reserved.
引用
收藏
页码:69 / 81
相关论文
共 50 条
  • [31] A Hybrid Method for Bilingual Text Sentiment Classification Based on Deep Learning
    Liu, Guolong
    Xu, Xiaofei
    Deng, Bailong
    Chen, Siding
    Li, Li
    2016 17TH IEEE/ACIS INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING, ARTIFICIAL INTELLIGENCE, NETWORKING AND PARALLEL/DISTRIBUTED COMPUTING (SNPD), 2016, : 93 - 98
  • [32] Image-Text Fusion Sentiment Analysis Method Based on Image Semantic Translation
    Huang, Jian
    Wang, Ying
    Computer Engineering and Applications, 2023, 59 (11) : 180 - 187
  • [33] Cooperative Hybrid Semi-Supervised Learning for Text Sentiment Classification
    Li, Yang
    Lv, Ying
    Wang, Suge
    Liang, Jiye
    Li, Juanzi
    Li, Xiaoli
    SYMMETRY-BASEL, 2019, 11 (02):
  • [34] Contrastive Learning-Based Semantic Communications
    Tang, Shunpu
    Yang, Qianqian
    Fan, Lisheng
    Lei, Xianfu
    Nallanathan, Arumugam
    Karagiannidis, George K.
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2024, 72 (10) : 6328 - 6343
  • [35] Research on high precision Chinese text sentiment Classification based on ALBERT Optimization
    Gao, Xuejia
    Ding, Gejian
    Liu, Chang
    Xu, Jiahong
    2023 15TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTATIONAL INTELLIGENCE, ICACI, 2023,
  • [36] Improving Multimodal Sentiment Analysis: Supervised Angular Margin-based Contrastive Learning for Enhanced Fusion Representation
    Nguyen, Cong-Duy
    Nguyen, Thong
    Vu, Duc Anh
    Tuan, Luu Anh
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EMNLP 2023), 2023, : 14714 - 14724
  • [37] Supervised Contrastive Learning for Robust and Efficient Multi-modal Emotion and Sentiment Analysis
    Gomaa, Ahmed
    Maier, Andreas
    Kosti, Ronak
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 2423 - 2429
  • [38] Optimization Research of Short Text Semantic Clustering Based On the Social Media
    Zhang, Ping
    Wang, Jianzhong
    2017 IEEE 3RD INFORMATION TECHNOLOGY AND MECHATRONICS ENGINEERING CONFERENCE (ITOEC), 2017, : 717 - 721
  • [39] Weakly-Supervised Domain Adaptive Semantic Segmentation with Prototypical Contrastive Learning
    Das, Anurag
    Xian, Yongqin
    Dai, Dengxin
    Schiele, Bernt
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 15434 - 15443
  • [40] Semantic Change Detection Based on Supervised Contrastive Learning for High-Resolution Remote Sensing Imagery
    Wang, Jue
    Zhong, Yanfei
    Zhang, Liangpei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62