MIXUP REGULARIZED ADVERSARIAL NETWORKS FOR MULTI-DOMAIN TEXT CLASSIFICATION

被引:9
|
作者
Wu, Yuan [1 ]
Inkpen, Diana [2 ]
El-Roby, Ahmed [1 ]
机构
[1] Carleton Univ, Ottawa, ON, Canada
[2] Univ Ottawa, Ottawa, ON, Canada
来源
2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021) | 2021年
关键词
Multi-domain text classification; mixup; adversarial training;
D O I
10.1109/ICASSP39728.2021.9413441
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Using the shared-private paradigm and adversarial training can significantly improve the performance of multi-domain text classification (MDTC) models. However, there are two issues for the existing methods: First, instances from the multiple domains are not sufficient for domain-invariant feature extraction. Second, aligning on the marginal distributions may lead to a fatal mismatch. In this paper, we propose mixup regularized adversarial networks (MRANs) to address these two issues. More specifically, the domain and category mixup regularizations are introduced to enrich the intrinsic features in the shared latent space and enforce consistent predictions in-between training instances such that the learned features can be more domain-invariant and discriminative. We conduct experiments on two benchmarks: The Amazon review dataset and the FDU-MTL dataset. Our approach on these two datasets yields average accuracies of 87.64% and 89.0% respectively, outperforming all relevant baselines.
引用
收藏
页码:7733 / 7737
页数:5
相关论文
共 50 条
  • [1] Co-Regularized Adversarial Learning for Multi-Domain Text Classification
    Wu, Yuan
    Inkpen, Diana
    El-Roby, Ahmed
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 151, 2022, 151
  • [2] Learning Multi-Domain Adversarial Neural Networks for Text Classification
    Ding, Xiao
    Shi, Qiankun
    Cai, Bibo
    Liu, Ting
    Zhao, Yanyan
    Ye, Qiang
    IEEE ACCESS, 2019, 7 : 40323 - 40332
  • [3] DaCon: Multi-Domain Text Classification Using Domain Adversarial Contrastive Learning
    Dai, Yingjun
    El-Roby, Ahmed
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT V, 2023, 14258 : 40 - 52
  • [4] Dual Adversarial Co-Learning for Multi-Domain Text Classification
    Wu, Yuan
    Guo, Yuhong
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 6438 - 6445
  • [5] Robust Neural Text Classification and Entailment via Mixup Regularized Adversarial Training
    Zhao, Jiahao
    Wei, Penghui
    Mao, Wenji
    SIGIR '21 - PROCEEDINGS OF THE 44TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2021, : 1778 - 1782
  • [6] Margin Discrepancy-Based Adversarial Training for Multi-Domain Text Classification
    Wu, Yuan
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, PT III, NLPCC 2024, 2025, 15361 : 170 - 182
  • [7] Multi-domain Text-to-Speech Synthesis by Automatic Text Classification
    Alias, Francesc
    Socoro, Joan Claudi
    Sevillano, Xavier
    Iriondo, Ignasi
    Gonzalvo, Xavier
    INTERSPEECH 2006 AND 9TH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE PROCESSING, VOLS 1-5, 2006, : 1304 - 1307
  • [8] Text classification adapted for Multi-domain Text-To-Speech Synthesis
    Alias, Francesc
    Gonzalvo, Xavier
    Sevillano, Xavier
    Claudi Socoro, Joan
    Antonio Montero, Jose
    Garcia, David
    PROCESAMIENTO DEL LENGUAJE NATURAL, 2006, (37): : 267 - 274
  • [9] MAXIMUM BATCH FROBENIUS NORM FOR MULTI-DOMAIN TEXT CLASSIFICATION
    Wu, Yuan
    Inkpen, Diana
    El-Roby, Ahmed
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 3763 - 3767
  • [10] A ROBUST CONTRASTIVE ALIGNMENT METHOD FOR MULTI-DOMAIN TEXT CLASSIFICATION
    Li, Xuefeng
    Lei, Hao
    Wang, Liwen
    Dong, Guanting
    Zhao, Jinzheng
    Liu, Jiachi
    Xu, Weiran
    Zhang, Chunyun
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 7827 - 7831