Co-Regularized Adversarial Learning for Multi-Domain Text Classification

被引:0
作者
Wu, Yuan [1 ]
Inkpen, Diana [2 ]
El-Roby, Ahmed [1 ]
机构
[1] Carleton Univ, Ottawa, ON, Canada
[2] Univ Ottawa, Ottawa, ON, Canada
来源
INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 151 | 2022年 / 151卷
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi-domain text classification (MDTC) aims to leverage all available resources from multiple domains to learn a predictive model that can generalize well on these domains. Recently, many MDTC methods adopt adversarial learning, shared-private paradigm, and entropy minimization to yield state-of-the-art results. However, these approaches face three issues: (1) Minimizing domain divergence can not fully guarantee the success of domain alignment; (2) Aligning marginal feature distributions can not fully guarantee the discriminability of the learned features; (3) Standard entropy minimization may make the predictions on unlabeled data over-confident, deteriorating the discriminability of the learned features. In order to address the above issues, we propose a co-regularized adversarial learning (CRAL) mechanism for MDTC. This approach constructs two diverse shared latent spaces, performs domain alignment in each of them, and punishes the disagreements of these two alignments with respect to the predictions on unlabeled data. Moreover, virtual adversarial training (VAT) with entropy minimization is incorporated to impose consistency regularization to the CRAL method. Experiments show that our model outperforms state-of-the-art methods on two MDTC benchmarks.
引用
收藏
页数:12
相关论文
共 50 条
[21]   MAXIMUM BATCH FROBENIUS NORM FOR MULTI-DOMAIN TEXT CLASSIFICATION [J].
Wu, Yuan ;
Inkpen, Diana ;
El-Roby, Ahmed .
2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, :3763-3767
[22]   A ROBUST CONTRASTIVE ALIGNMENT METHOD FOR MULTI-DOMAIN TEXT CLASSIFICATION [J].
Li, Xuefeng ;
Lei, Hao ;
Wang, Liwen ;
Dong, Guanting ;
Zhao, Jinzheng ;
Liu, Jiachi ;
Xu, Weiran ;
Zhang, Chunyun .
2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, :7827-7831
[23]   Adversarial Multi-task Learning for Text Classification [J].
Liu, Pengfei ;
Qiu, Xipeng ;
Huang, Xuanjing .
PROCEEDINGS OF THE 55TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2017), VOL 1, 2017, :1-10
[24]   Robust multi-domain descriptive text classification leveraging conventional and hybrid deep learning models [J].
Bhowmik S. ;
Sultana S. ;
Sajid A.A. ;
Reno S. ;
Manjrekar A. .
International Journal of Information Technology, 2024, 16 (5) :3219-3231
[25]   Compact Feature Learning for Multi-domain Image Classification [J].
Liu, Yajing ;
Tian, Xinmei ;
Li, Ya ;
Xiong, Zhiwei ;
Wu, Feng .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :7186-7194
[26]   Unified Multi-Domain Learning and Data Imputation using Adversarial Autoencoder [J].
Mendes, Andre ;
Togelius, Julian ;
Coelho, Leandro dos Santos .
2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
[27]   JointGAN: Multi-Domain Joint Distribution Learning with Generative Adversarial Nets [J].
Pu, Yunchen ;
Dai, Shuyang ;
Gan, Zhe ;
Wang, Weiyao ;
Wang, Guoyin ;
Zhang, Yizhe ;
Henao, Ricardo ;
Carin, Lawrence .
INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
[28]   MULTITASK GENERATIVE ADVERSARIAL IMITATION LEARNING FOR MULTI-DOMAIN DIALOGUE SYSTEM [J].
Hsu, Chuan-En ;
Rohmatillah, Mahdin ;
Chien, Jen-Tzung .
2021 IEEE AUTOMATIC SPEECH RECOGNITION AND UNDERSTANDING WORKSHOP (ASRU), 2021, :954-961
[29]   Instilling Social to Physical: Co-Regularized Heterogeneous Transfer Learning [J].
Wei, Ying ;
Zhu, Yin ;
Leung, Cane Wing-ki ;
Song, Yangqiu ;
Yang, Qiang .
THIRTIETH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2016, :1338-1344
[30]   Few-shot multi-domain text intent classification with Dynamic Balance Domain Adaptation Meta-learning [J].
Yang, Shun ;
Du, Yajun ;
Liu, Jia ;
Li, Xianyong ;
Chen, Xiaoliang ;
Gao, Hongmei ;
Xie, Chunzhi ;
Li, Yanli .
EXPERT SYSTEMS WITH APPLICATIONS, 2024, 255