A multi-label social short text classification method based on contrastive learning and improved ml-KNN

被引:3
|
作者
Tian, Gang [1 ]
Wang, Jiachang [1 ]
Wang, Rui [2 ]
Zhao, Guangxin [1 ]
He, Cheng [1 ]
机构
[1] Shandong Univ Sci & Technol, Coll Comp Sci & Engn, Qingdao, Peoples R China
[2] Shandong Univ Sci & Technol, Coll Energy & Min Engn, Qingdao, Peoples R China
关键词
contrastive learning; deep learning; improved ml-KNN; multi-label text classification;
D O I
10.1111/exsy.13547
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Short texts on social platforms often have the problems of diverse categories and semantic sparsity, making it challenging to identify the diverse intentions of users. To address this issue, this article proposes a multi-label social short text classification method (IML-CL) based on contrastive learning and improved ml-KNN. First, a contrastive learning approach is employed to train a multi-label text classification model. This approach improves semantic sparsity by leveraging the knowledge from the existing samples to enrich the feature representation of short texts. Simultaneously, an improved ml-KNN algorithm is developed to enhance the accuracy of label prediction. This algorithm utilizes a two-layer nearest neighbor rule and introduces a penalty function and weight optimization. Next, the model generates the feature representation for the test sample and predicts its label. Additionally, the improved ml-KNN algorithm retrieves neighbors of the test sample and uses their label information for prediction. Finally, the two predictions are combined to obtain the final prediction, which accurately identifies the user's intention. The experimental results demonstrate that, on the dataset constructed in this article, the IML-CL method effectively boosts the performance of the baseline model.
引用
收藏
页数:19
相关论文
共 50 条
  • [41] Text GCN-SW-KNN: a novel collaborative training multi-label classification method for WMS application themes by considering geographic semantics
    Wei, Zhengyang
    Gui, Zhipeng
    Zhang, Min
    Yang, Zelong
    Mei, Yuao
    Wu, Huayi
    Liu, Hongbo
    Yu, Jing
    BIG EARTH DATA, 2021, 5 (01) : 66 - 89
  • [42] DRTN: Dual Relation Transformer Network with feature erasure and contrastive learning for multi-label image classification
    Zhou, Wei
    Lin, Kang
    Zheng, Zhijie
    Chen, Dihu
    Su, Tao
    Hu, Haifeng
    NEURAL NETWORKS, 2025, 187
  • [43] A Hybrid Model Based on Convolutional Neural Network and Long Short-Term Memory for Multi-label Text Classification
    Hamed Khataei Maragheh
    Farhad Soleimanian Gharehchopogh
    Kambiz Majidzadeh
    Amin Babazadeh Sangar
    Neural Processing Letters, 56
  • [44] A Hybrid Model Based on Convolutional Neural Network and Long Short-Term Memory for Multi-label Text Classification
    Maragheh, Hamed Khataei
    Gharehchopogh, Farhad Soleimanian
    Majidzadeh, Kambiz
    Sangar, Amin Babazadeh
    NEURAL PROCESSING LETTERS, 2024, 56 (02)
  • [45] An R-Transformer_BiLSTM Model Based on Attention for Multi-label Text Classification
    Yaoyao Yan
    Fang’ai Liu
    Xuqiang Zhuang
    Jie Ju
    Neural Processing Letters, 2023, 55 : 1293 - 1316
  • [46] LAR-SiCo: recommending law articles based on multi-label text classification
    Hua Zhao
    Xiaoqian Li
    Qingtian Zeng
    Zhenqi Zou
    Jinguo Liang
    International Journal of Machine Learning and Cybernetics, 2025, 16 (5) : 3927 - 3941
  • [47] An R-Transformer_BiLSTM Model Based on Attention for Multi-label Text Classification
    Yan, Yaoyao
    Liu, Fang'ai
    Zhuang, Xuqiang
    Ju, Jie
    NEURAL PROCESSING LETTERS, 2023, 55 (02) : 1293 - 1316
  • [48] A Deep Learning-Based Approach for Multi-Label Emotion Classification in Tweets
    Jabreel, Mohammed
    Moreno, Antonio
    APPLIED SCIENCES-BASEL, 2019, 9 (06):
  • [49] LA-HCN: Label-based Attention for Hierarchical Multi-label Text Classification Neural Network
    Zhang, Xinyi
    Xu, Jiahao
    Soh, Charlie
    Chen, Lihui
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 187
  • [50] Incorporating Label Co-Occurrence Into Neural Network-Based Models for Multi-Label Text Classification
    Yao, Jiaqi
    Wang, Keren
    Yan, Jikun
    IEEE ACCESS, 2019, 7 : 183580 - 183588