A ROBUST CONTRASTIVE ALIGNMENT METHOD FOR MULTI-DOMAIN TEXT CLASSIFICATION

被引:4
作者
Li, Xuefeng [1 ]
Lei, Hao [1 ]
Wang, Liwen [1 ]
Dong, Guanting [1 ]
Zhao, Jinzheng [2 ]
Liu, Jiachi [1 ]
Xu, Weiran [1 ]
Zhang, Chunyun [3 ]
机构
[1] Beijing Univ Posts & Telecommun, Beijing, Peoples R China
[2] Univ Surrey, Sch Comp Sci & Elect Engn, Guildford, Surrey, England
[3] Shandong Univ Finance & Econ, Jinan, Peoples R China
来源
2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP) | 2022年
关键词
Feature alignment; contrastive learning; robust training;
D O I
10.1109/ICASSP43922.2022.9747192
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Multi-domain text classification can automatically classify texts in various scenarios. Due to the diversity of human languages, texts with the same label in different domains may differ greatly, which brings challenges to the multidomain text classification. Current advanced methods use the private-shared paradigm, capturing domain-shared features by a shared encoder, and training a private encoder for each domain to extract domain-specific features. However, in realistic scenarios, these methods suffer from inefficiency as new domains are constantly emerging. In this paper, we propose a robust contrastive alignment method to align text classification features of various domains in the same feature space by supervised contrastive learning. By this means, we only need two universal feature extractors to achieve multidomain text classification. Extensive experimental results show that our method performs on par with or sometimes better than the state-of-the-art method, which uses the complex multi-classifier in a private-shared framework.
引用
收藏
页码:7827 / 7831
页数:5
相关论文
共 17 条
[1]  
Aitchison Laurence, 2021, ARXIV210702495
[2]  
[Anonymous], 2012, P 50 ANN M ASS COMP
[3]  
Blitzer J., 2007, ACL
[4]  
Chen Xilun, 2018, MULTINOMIAL ADVERSAR
[5]  
Devlin Jacob, 2018, CoRR
[6]  
Khosla P, 2020, ADV NEUR IN, V33
[7]  
Liu P., 2017, Adversarial multi-task learning for text classification
[8]   An Improved Kalman Filter for TOA Localization using Maximum Correntropy Criterion [J].
Qi, Yue ;
Ji, Mengmeng ;
Xu, Cheng ;
Wan, Jiawang ;
He, Jie .
2019 28TH WIRELESS AND OPTICAL COMMUNICATIONS CONFERENCE (WOCC), 2019, :501-504
[9]  
Tsai Yao-Hung Hubert, 2021, CONDITIONAL CONTRAST
[10]  
Wang LW, 2021, 2021 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL-HLT 2021), P3740