A ROBUST CONTRASTIVE ALIGNMENT METHOD FOR MULTI-DOMAIN TEXT CLASSIFICATION

被引:4
|
作者
Li, Xuefeng [1 ]
Lei, Hao [1 ]
Wang, Liwen [1 ]
Dong, Guanting [1 ]
Zhao, Jinzheng [2 ]
Liu, Jiachi [1 ]
Xu, Weiran [1 ]
Zhang, Chunyun [3 ]
机构
[1] Beijing Univ Posts & Telecommun, Beijing, Peoples R China
[2] Univ Surrey, Sch Comp Sci & Elect Engn, Guildford, Surrey, England
[3] Shandong Univ Finance & Econ, Jinan, Peoples R China
关键词
Feature alignment; contrastive learning; robust training;
D O I
10.1109/ICASSP43922.2022.9747192
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Multi-domain text classification can automatically classify texts in various scenarios. Due to the diversity of human languages, texts with the same label in different domains may differ greatly, which brings challenges to the multidomain text classification. Current advanced methods use the private-shared paradigm, capturing domain-shared features by a shared encoder, and training a private encoder for each domain to extract domain-specific features. However, in realistic scenarios, these methods suffer from inefficiency as new domains are constantly emerging. In this paper, we propose a robust contrastive alignment method to align text classification features of various domains in the same feature space by supervised contrastive learning. By this means, we only need two universal feature extractors to achieve multidomain text classification. Extensive experimental results show that our method performs on par with or sometimes better than the state-of-the-art method, which uses the complex multi-classifier in a private-shared framework.
引用
收藏
页码:7827 / 7831
页数:5
相关论文
共 50 条
  • [1] DaCon: Multi-Domain Text Classification Using Domain Adversarial Contrastive Learning
    Dai, Yingjun
    El-Roby, Ahmed
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT V, 2023, 14258 : 40 - 52
  • [2] Multi-domain Text-to-Speech Synthesis by Automatic Text Classification
    Alias, Francesc
    Socoro, Joan Claudi
    Sevillano, Xavier
    Iriondo, Ignasi
    Gonzalvo, Xavier
    INTERSPEECH 2006 AND 9TH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE PROCESSING, VOLS 1-5, 2006, : 1304 - 1307
  • [3] Text classification adapted for Multi-domain Text-To-Speech Synthesis
    Alias, Francesc
    Gonzalvo, Xavier
    Sevillano, Xavier
    Claudi Socoro, Joan
    Antonio Montero, Jose
    Garcia, David
    PROCESAMIENTO DEL LENGUAJE NATURAL, 2006, (37): : 267 - 274
  • [4] A Multi-domain Text Classification Method Based on Recurrent Convolution Multi-task Learning
    Xie Jinbao
    Li Jiahui
    Kang Shouqiang
    Wang Qingyan
    Wang Yujing
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2021, 43 (08) : 2395 - 2403
  • [5] Robust multi-domain descriptive text classification leveraging conventional and hybrid deep learning models
    Bhowmik S.
    Sultana S.
    Sajid A.A.
    Reno S.
    Manjrekar A.
    International Journal of Information Technology, 2024, 16 (5) : 3219 - 3231
  • [6] MAXIMUM BATCH FROBENIUS NORM FOR MULTI-DOMAIN TEXT CLASSIFICATION
    Wu, Yuan
    Inkpen, Diana
    El-Roby, Ahmed
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 3763 - 3767
  • [7] Learning Multi-Domain Adversarial Neural Networks for Text Classification
    Ding, Xiao
    Shi, Qiankun
    Cai, Bibo
    Liu, Ting
    Zhao, Yanyan
    Ye, Qiang
    IEEE ACCESS, 2019, 7 : 40323 - 40332
  • [8] MIXUP REGULARIZED ADVERSARIAL NETWORKS FOR MULTI-DOMAIN TEXT CLASSIFICATION
    Wu, Yuan
    Inkpen, Diana
    El-Roby, Ahmed
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 7733 - 7737
  • [9] CDistNet: Perceiving Multi-domain Character Distance for Robust Text Recognition
    Tianlun Zheng
    Zhineng Chen
    Shancheng Fang
    Hongtao Xie
    Yu-Gang Jiang
    International Journal of Computer Vision, 2024, 132 : 300 - 318
  • [10] CDistNet: Perceiving Multi-domain Character Distance for Robust Text Recognition
    Zheng, Tianlun
    Chen, Zhineng
    Fang, Shancheng
    Xie, Hongtao
    Jiang, Yu-Gang
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, 132 (02) : 300 - 318