Research on Policy Tools Classification Based on ChatGPT Augmentation and Supervised Contrastive Learning

被引：0
|
作者：
Hu, Zhiqiang [1 ]
Li, Pengjun [1 ]
Wang, Jinlong [1 ]
Xiong, Xiaoyun [1 ]
机构：
[1] School of Information and Control Engineering, Qingdao University of Technology, Shandong, Qingdao,266525, China
来源：
Computer Engineering and Applications | 2024年 / 60卷 / 07期
关键词：
The classification of policy tools is an important dimension in the quantification and analysis of policy texts. Due to the scarcity of training data; models are prone to overfitting; resulting in reduced prediction confidence and an increased risk of misclassification. Therefore; policy tool classification method based on ChatGPT augmentation and supervised contrastive learning is proposed. The method consists of two stages: pre-training language model fine-tuning and ChatGPT decision augmentation. In the first stage; ChatGPT; a large language model; augments policy texts to increase the training dataset; while supervised contrastive learning fine-tune the RoBERTa model to improve classification performance. In the second stage; ChatGPT assists in the decision-making process for low confidence texts through the pretrained language model and reduces the risk of misclassifying similar texts. Experiments on the digital industry policy tools classification dataset and the Tnews dataset show that the proposed method surpasses mainstream research approaches and can effectively improve the performance of the base model; with a more significant improvement observed when the training samples are limited. © 2024 Journal of Computer Engineering and Applications Beijing Co; Ltd; Science Press. All rights reserved;
D O I：
10.3778/j.issn.1002-8331.2308-0354
中图分类号：
学科分类号：
摘要：
引用
收藏
页码：292 / 305
相关论文
共 50 条
  • [1] Multi-Augmentation-Based Contrastive Learning for Semi-Supervised Learning
    Wang, Jie
    Yang, Jie
    He, Jiafan
    Peng, Dongliang
    ALGORITHMS, 2024, 17 (03)
  • [2] Supervised Contrastive Learning for Product Classification
    Azizi, Sahel
    Fang, Uno
    Adibi, Sasan
    Li, Jianxin
    ADVANCED DATA MINING AND APPLICATIONS, ADMA 2021, PT II, 2022, 13088 : 341 - 355
  • [3] Supervised Contrastive Learning-Based Classification for Hyperspectral Image
    Huang, Lingbo
    Chen, Yushi
    He, Xin
    Ghamisi, Pedram
    REMOTE SENSING, 2022, 14 (21)
  • [4] Research on Classification and Identification of Crack Faults in Steam Turbine Blades Based on Supervised Contrastive Learning
    Zhang, Qinglei
    Tang, Laifeng
    Qin, Jiyun
    Duan, Jianguo
    Zhou, Ying
    ENTROPY, 2024, 26 (11)
  • [5] Contrastive learning with text augmentation for text classification
    Jia, Ouyang
    Huang, Huimin
    Ren, Jiaxin
    Xie, Luodi
    Xiao, Yinyin
    APPLIED INTELLIGENCE, 2023, 53 (16) : 19522 - 19531
  • [6] Contrastive learning with text augmentation for text classification
    Ouyang Jia
    Huimin Huang
    Jiaxin Ren
    Luodi Xie
    Yinyin Xiao
    Applied Intelligence, 2023, 53 : 19522 - 19531
  • [7] MANIFOLD AUGMENTATION BASED SELF-SUPERVISED CONTRASTIVE LEARNING FOR FEW-SHOT REMOTE SENSING SCENE CLASSIFICATION
    Sheng, Yunrui
    Xiao, Liang
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 2239 - 2242
  • [8] Contrastive learning based on linguistic knowledge and adaptive augmentation for text classification
    Zhang, Shaokang
    Ran, Ning
    KNOWLEDGE-BASED SYSTEMS, 2024, 300
  • [9] Image classification framework based on contrastive self-supervised learning
    Zhao H.-W.
    Zhang J.-R.
    Zhu J.-P.
    Li H.
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2022, 52 (08): : 1850 - 1856
  • [10] A supervised contrastive learning-based model for image emotion classification
    Sun, Jianshan
    Zhang, Qing
    Yuan, Kun
    Jiang, Yuanchun
    Chen, Xinran
    WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS, 2024, 27 (03):
12345