A Simple and Efficient Multi-Task Learning Approach for Conditioned Dialogue Generation

被引:0
|
作者
Zeng, Yan [1 ]
Nie, Jian-Yun [1 ]
机构
[1] Univ Montreal, DIRO, Montreal, PQ, Canada
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Conditioned dialogue generation suffers from the scarcity of labeled responses. In this work, we exploit labeled non-dialogue text data related to the condition, which are much easier to collect. We propose a multi-task learning approach to leverage both labeled dialogue and text data. The 3 tasks jointly optimize the same pre-trained Transformer - conditioned dialogue generation task on the labeled dialogue data, conditioned language encoding task and conditioned language generation task on the labeled text data. Experimental results show that our approach outperforms the state-of-the-art models by leveraging the labeled texts, and it also obtains larger improvement in performance comparing to the previous methods to leverage text data.
引用
收藏
页码:4927 / 4939
页数:13
相关论文
共 50 条
  • [41] A Kernel Approach to Multi-Task Learning with Task-Specific Kernels
    Wu, Wei
    Li, Hang
    Hu, Yun-Hua
    Jin, Rong
    JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2012, 27 (06) : 1289 - 1301
  • [42] Dialogue Act-Aided Backchannel Prediction Using Multi-Task Learning
    Liermann, Wencke
    Park, Yo-Han
    Choi, Yong-Seok
    Lee, Kong Joo
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EMNLP 2023), 2023, : 15073 - 15079
  • [43] Multi-task learning with graph attention networks for multi-domain task-oriented dialogue systems
    Zhao, Meng
    Wang, Lifang
    Jiang, Zejun
    Li, Ronghan
    Lu, Xinyu
    Hu, Zhongtian
    KNOWLEDGE-BASED SYSTEMS, 2023, 259
  • [44] An efficient multi-task learning CNN for driver attention monitoring
    Yang, Dawei
    Wang, Yan
    Wei, Ran
    Guan, Jiapeng
    Huang, Xiaohua
    Cai, Wei
    Jiang, Zhe
    JOURNAL OF SYSTEMS ARCHITECTURE, 2024, 148
  • [45] AutoMTL: A Programming Framework for Automating Efficient Multi-Task Learning
    Zhang, Lijun
    Liu, Xiao
    Guan, Hui
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [46] Efficient Multi-Task Learning via Iterated Single-Task Transfer
    Zentner, K. R.
    Puri, Ujjwal
    Zhang, Yulun
    Julian, Ryan
    Sukhatme, Gaurav S.
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 10141 - 10146
  • [47] Provably Efficient Multi-Task Reinforcement Learning with Model Transfer
    Zhang, Chicheng
    Wang, Zhi
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [48] Communication-Efficient Coded Distributed Multi-Task Learning
    Tang, Hua
    Hu, Haoyang
    Yuan, Kai
    Wu, Youlong
    2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [49] Efficient Multi-Task Asynchronous Federated Learning in Edge Computing
    Cao, Xinyuan
    Ouyang, Tao
    Zhao, Kongyange
    Li, Yousheng
    Chen, Xu
    2024 IEEE/ACM 32ND INTERNATIONAL SYMPOSIUM ON QUALITY OF SERVICE, IWQOS, 2024,
  • [50] Efficient Design Space Exploration with Multi-Task Reinforcement Learning
    Hoffmann, Patrick
    Gorelik, Kirill
    Ivanov, Valentin
    2024 IEEE INTERNATIONAL CONFERENCE ON ADVANCED INTELLIGENT MECHATRONICS, AIM 2024, 2024, : 1378 - 1385