Multi-Label Text Classification Based on Contrastive and Correlation Learning

被引:0
作者
Yang, Shuo [1 ]
Gao, Shu [1 ]
机构
[1] Wuhan Univ Technol, Sch Comp Sci & Artificial Intelligence, Wuhan 430070, Hubei, Peoples R China
来源
PROCEEDINGS OF 2024 3RD INTERNATIONAL CONFERENCE ON CYBER SECURITY, ARTIFICIAL INTELLIGENCE AND DIGITAL ECONOMY, CSAIDE 2024 | 2024年
基金
中国国家自然科学基金;
关键词
multi-label text classification; label correlation; contrastive learning; graph attention mechanism; label semantics;
D O I
10.1145/3672919.3672979
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi-label text classification plays a crucial role in various domains. However, accurately capturing complex inter-label relationships and delving into the semantic information between labels and text remains a challenging problem. Therefore, we propose a multi-label text classification method based on contrastive and correlation learning. By introducing contrastive learning into multi-label text classification tasks, it enhances the distinctiveness and expressiveness of text and label features. In the extraction of label features, external knowledge from Wikipedia is incorporated and various embedding methods are employed to extract label information, enabling a deeper exploration of label semantics. Meanwhile, GAT is used to more accurately extract inter-label correlations. In the prediction module, an improved label correlation network is introduced to further consider label relevance. Experimental results demonstrate the feasibility and effectiveness of the proposed method on two publicly available datasets, AAPD and RCV1. Compared to state-of-the-art models, our method achieves a 0.5%-1.5% improvement in micro-F1 metrics, validating the efficacy of the approach.
引用
收藏
页码:325 / 330
页数:6
相关论文
共 20 条
[1]  
Bai J., 2022, PMLR, V162, P1383, DOI DOI 10.48550/ARXIV.2112.00976
[2]   Collaborative Learning of Label Semantics and Deep Label-Specific Features for Multi-Label Classification [J].
Hang, Jun-Yi ;
Zhang, Min-Ling .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (12) :9860-9871
[3]   Label-representative graph convolutional network for multi-label text classification [J].
Huy-The Vu ;
Minh-Tien Nguyen ;
Van-Chien Nguyen ;
Minh-Hieu Pham ;
Van-Quyet Nguyen ;
Van-Hau Nguyen .
APPLIED INTELLIGENCE, 2023, 53 (12) :14759-14774
[4]  
Khosla P, 2020, ADV NEUR IN, V33
[5]  
Li Leping, 2023, 2023 26th International Conference on Computer Supported Cooperative Work in Design (CSCWD), P612, DOI 10.1109/CSCWD57460.2023.10152790
[6]  
Lin NK, 2023, FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2023), P8730
[7]   Co-attention network with label embedding for text classification [J].
Liu, Minqian ;
Liu, Lizhao ;
Cao, Junyi ;
Du, Qing .
NEUROCOMPUTING, 2022, 471 :61-69
[8]  
Liu YH, 2019, Arxiv, DOI [arXiv:1907.11692, DOI 10.48550/ARXIV.1907.11692]
[9]  
Ma K, 2023, ICASSP 2023 2023 IEE, P1
[10]   MULTI-RELATION MESSAGE PASSING FOR MULTI-LABEL TEXT CLASSIFICATION [J].
Ozmen, Muberra ;
Zhang, Hao ;
Wang, Pengyun ;
Coates, Mark .
2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, :3583-3587