Research on Text Sentiment Semantic Optimization Method Based on Supervised Contrastive Learning

被引:0
|
作者
Xiong, Shuchu [1 ,2 ]
Li, Xuan [1 ]
Wu, Jiani [1 ]
Zhou, Zhaohong [1 ]
Meng, Han [2 ]
机构
[1] School of Computer Science, Hunan University of Technology and Business, Changsha,410205, China
[2] School of Frontier Crossover Studies, Hunan University of Technology and Business, Changsha,410205, China
关键词
Extraction - Feature extraction - Learning systems - Semantics - Supervised learning - Vector spaces;
D O I
10.11925/infotech.2096-3467.2023.0319
中图分类号
学科分类号
摘要
[Objective] This study aims to solve problems such as text feature extraction bias and difficult separation of ambiguous semantics caused by the unique expressions and semantic drift phenomenon in Chinese. [Methods] This paper proposes a supervised contrastive learning semantic optimization method, which first uses a pre-trained model to generate semantic vectors, then designs a supervised joint self-supervised method to construct contrastive sample pairs, and finally constructs a supervised contrastive loss for semantic space measurement and optimization. [Results] On the ChnSentiCorp dataset, the five mainstream neural network models optimized by this method achieved F1 value improvements of 2.77%-3.82%. [Limitations] Due to limited hardware resources, a larger number of contrastive learning sample pairs were not constructed. [Conclusions] The semantic optimization method can effectively solve problems such as text feature extraction bias and difficult separation of ambiguous semantics, and provide new research ideas for text sentiment analysis tasks. © 2024 Chinese Academy of Sciences. All rights reserved.
引用
收藏
页码:69 / 81
相关论文
共 50 条
  • [41] A multi-strategy contrastive learning framework for weakly supervised semantic segmentation
    Yuan, Kunhao
    Schaefer, Gerald
    Lai, Yu-Kun
    Wang, Yifan
    Liu, Xiyao
    Guan, Lin
    Fang, Hui
    PATTERN RECOGNITION, 2023, 137
  • [42] RL-CSL: A Combinatorial Optimization Method Using Reinforcement Learning and Contrastive Self-Supervised Learning
    Yuan, Zhongju
    Li, Genghui
    Wang, Zhenkun
    Sun, Jianyong
    Cheng, Ran
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2023, 7 (04): : 1010 - 1024
  • [43] Contrastive and consistent feature learning for weakly supervised object localization and semantic segmentation
    Ki, Minsong
    Uh, Youngjung
    Lee, Wonyoung
    Byun, Hyeran
    NEUROCOMPUTING, 2021, 445 : 244 - 254
  • [44] Self-supervised Learning with Local Contrastive Loss for Detection and Semantic Segmentation
    Islam, Ashraful
    Lundell, Ben
    Sawhney, Harpreet
    Sinha, Sudipta N.
    Morales, Peter
    Radke, Richard J.
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 5613 - 5622
  • [45] PRCL: Probabilistic Representation Contrastive Learning for Semi-Supervised Semantic Segmentation
    Xie, Haoyu
    Wang, Changqi
    Zhao, Jian
    Liu, Yang
    Dan, Jun
    Fu, Chong
    Sun, Baigui
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, 132 (10) : 4343 - 4361
  • [46] An optic disk semantic segmentation method based on weakly supervised learning
    Pan, Feng
    Lu, Zheng
    Chen, Dali
    Xue, Dingyu
    PROCEEDINGS OF THE 32ND 2020 CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2020), 2020, : 4791 - 4794
  • [47] CONTRASTIVE SELF-SUPERVISED LEARNING FOR TEXT-INDEPENDENT SPEAKER VERIFICATION
    Zhang, Haoran
    Zou, Yuexian
    Wang, Helin
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 6713 - 6717
  • [48] A Simple and Effective Usage of Self-supervised Contrastive Learning for Text Clustering
    Shi, Haoxiang
    Wang, Cen
    Sakai, Tetsuya
    2021 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2021, : 315 - 320
  • [49] SimSCL: A Simple Fully-Supervised Contrastive Learning Framework for Text Representation
    Moukafih, Youness
    Ghanem, Abdelghani
    Abidi, Karima
    Sbihi, Nada
    Ghogho, Mounir
    Smaili, Kamel
    AI 2021: ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, 13151 : 728 - 738
  • [50] Text Classification Method Based On Semi-Supervised Transfer Learning
    Yu, Xiaosheng
    Zhang, Hehuan
    Li, Jing
    2021 21ST INTERNATIONAL CONFERENCE ON SOFTWARE QUALITY, RELIABILITY AND SECURITY COMPANION (QRS-C 2021), 2021, : 388 - 394