A Simple and Efficient Multi-Task Learning Approach for Conditioned Dialogue Generation

被引:0
|
作者
Zeng, Yan [1 ]
Nie, Jian-Yun [1 ]
机构
[1] Univ Montreal, DIRO, Montreal, PQ, Canada
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Conditioned dialogue generation suffers from the scarcity of labeled responses. In this work, we exploit labeled non-dialogue text data related to the condition, which are much easier to collect. We propose a multi-task learning approach to leverage both labeled dialogue and text data. The 3 tasks jointly optimize the same pre-trained Transformer - conditioned dialogue generation task on the labeled dialogue data, conditioned language encoding task and conditioned language generation task on the labeled text data. Experimental results show that our approach outperforms the state-of-the-art models by leveraging the labeled texts, and it also obtains larger improvement in performance comparing to the previous methods to leverage text data.
引用
收藏
页码:4927 / 4939
页数:13
相关论文
共 50 条
  • [31] End-to-end dialogue structure parsing on multi-floor dialogue based on multi-task learning
    Kawano, Seiya
    Yoshino, Koichiro
    Traum, David
    Nakamura, Satoshi
    FRONTIERS IN ROBOTICS AND AI, 2023, 10
  • [32] A Multi-Task Learning Approach for Delayed Feedback Modeling
    Huangfu, Zhigang
    Zhang, Gong-Duo
    Wu, Zhengwei
    Wu, Qintong
    Zhang, Zhiqiang
    Gu, Lihong
    Zhou, Jun
    Gu, Jinjie
    COMPANION PROCEEDINGS OF THE WEB CONFERENCE 2022, WWW 2022 COMPANION, 2022, : 116 - 120
  • [33] AdaShare: Learning What To Share For Efficient Deep Multi-Task Learning
    Sun, Ximeng
    Panda, Rameswar
    Feris, Rogerio
    Saenko, Kate
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS (NEURIPS 2020), 2020, 33
  • [34] ROM: A Robust Online Multi-Task Learning Approach
    Zhang, Chi
    Zhao, Peilin
    Hao, Shuji
    Soh, Yeng Chai
    Lee, Bu Sung
    2016 IEEE 16TH INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2016, : 1341 - 1346
  • [35] Multi-task Learning Approach for Intracranial Hemorrhage Prognosis
    Cobo, Miriam
    Perez del Barrio, Amaia
    Menendez Fernandez-Miranda, Pablo
    Sanz Bellon, Pablo
    Lloret Iglesias, Lara
    Silva, Wilson
    MACHINE LEARNING IN MEDICAL IMAGING, PT II, MLMI 2024, 2025, 15242 : 12 - 21
  • [36] A Multi-Task Learning Approach to Personalized Progression Modeling
    Ghalwash, Mohamed
    Dow, Daby
    2020 8TH IEEE INTERNATIONAL CONFERENCE ON HEALTHCARE INFORMATICS (ICHI 2020), 2020, : 92 - 100
  • [37] Analysis on Compressed Domain: A Multi-Task Learning Approach
    Zhang, Yuefeng
    Jia, Chuanmin
    Chang, Jianhui
    Ma, Siwei
    DCC 2022: 2022 DATA COMPRESSION CONFERENCE (DCC), 2022, : 494 - 494
  • [38] An Information-Theoretic Approach for Multi-task Learning
    Yang, Pei
    Tan, Qi
    Xu, Hao
    Ding, Yehua
    ADVANCED DATA MINING AND APPLICATIONS, PROCEEDINGS, 2009, 5678 : 386 - 396
  • [39] A Kernel Approach to Multi-Task Learning with Task-Specific Kernels
    武威
    李航
    胡云华
    金榕
    Journal of Computer Science & Technology, 2012, 27 (06) : 1289 - 1301
  • [40] A Kernel Approach to Multi-Task Learning with Task-Specific Kernels
    Wei Wu
    Hang Li
    Yun-Hua Hu
    Rong Jin
    Journal of Computer Science and Technology, 2012, 27 : 1289 - 1301