Interpreting open-domain dialogue generation by disentangling latent feature representations

被引:1
|
作者
Wang, Ye [1 ]
Liao, Jingbo [1 ]
Yu, Hong [1 ]
Wang, Guoyin [1 ]
Zhang, Xiaoxia [1 ]
Liu, Li [1 ]
机构
[1] Chongqing Univ Posts & Telecommun, Chongqing Key Lab Computat Intelligence, Chongqing 400065, Peoples R China
来源
NEURAL COMPUTING & APPLICATIONS | 2023年 / 35卷 / 28期
基金
中国国家自然科学基金;
关键词
Deep learning interpretability; Open-domain dialogue; Feature disentanglement;
D O I
10.1007/s00521-023-08815-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Currently end-to-end deep learning based open-domain dialogue systems remain black box models, making it easy to generate irrelevant contents with data-driven models. Specifically, latent variables are highly entangled with different semantics in the latent space due to the lack of priori knowledge to guide the training. To address this problem, this paper proposes to harness the generative model with a priori knowledge through a cognitive approach involving feature disentanglement. Particularly, the model integrates the guided-category knowledge and open-domain dialogue data for the training, leveraging the priori knowledge into the latent space, which enables the model to disentangle the latent variables. Besides, this paper proposes a new metric for open-domain dialogues, which can objectively evaluate the interpretability of the latent space distribution. Finally, this paper validates our model on different datasets and experimentally demonstrate that our model is able to generate higher quality and more interpretable dialogues than other models.
引用
收藏
页码:20855 / 20867
页数:13
相关论文
共 50 条
  • [1] Interpreting open-domain dialogue generation by disentangling latent feature representations
    Ye Wang
    Jingbo Liao
    Hong Yu
    Guoyin Wang
    Xiaoxia Zhang
    Li Liu
    Neural Computing and Applications, 2023, 35 : 20855 - 20867
  • [2] Enhancing the Open-Domain Dialogue Evaluation in Latent Space
    Chan, Zhangming
    Liu, Lemao
    Li, Juntao
    Zhang, Haisong
    Zhao, Dongyan
    Shi, Shuming
    Yan, Rui
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, 2021, : 4889 - 4900
  • [3] Adversarial Evaluation for Open-Domain Dialogue Generation
    Bruni, Elia
    Fernandez, Raquel
    18TH ANNUAL MEETING OF THE SPECIAL INTEREST GROUP ON DISCOURSE AND DIALOGUE (SIGDIAL 2017), 2017, : 284 - 288
  • [4] Towards Diverse, Relevant and Coherent Open-Domain Dialogue Generation via Hybrid Latent Variables
    Sun, Bin
    Li, Yitong
    Mi, Fei
    Wang, Weichao
    Li, Yiwei
    Li, Kan
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 11, 2023, : 13600 - 13608
  • [5] Open Domain Dialogue Generation with Latent Images
    Yang, Ze
    Wu, Wei
    Hu, Huang
    Xu, Can
    Wang, Wei
    Li, Zhoujun
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 14239 - 14247
  • [6] Dynamic Stochastic Decoding Strategy for Open-Domain Dialogue Generation
    Li, Yiwei
    Mi, Fei
    Li, Yitong
    Wang, Yasheng
    Bin Sun
    Feng, Shaoxiong
    Li, Kan
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: ACL 2024, 2024, : 11585 - 11596
  • [7] Towards Holistic and Automatic Evaluation of Open-Domain Dialogue Generation
    Pang, Bo
    Nijkamp, Erik
    Han, Wenjuan
    Zhou, Linqi
    Liu, Yixian
    Tu, Kewei
    58TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2020), 2020, : 3619 - 3629
  • [8] A Randomized Link Transformer for Diverse Open-Domain Dialogue Generation
    Lee, Jing Yang
    Lee, Kong Aik
    Gan, Woon Seng
    PROCEEDINGS OF THE 4TH WORKSHOP ON NLP FOR CONVERSATIONAL AI, 2022, : 1 - 11
  • [9] Leveraging Context for Neural Question Generation in Open-domain Dialogue Systems
    Ling, Yanxiang
    Cai, Fei
    Chen, Honghui
    de Rijke, Maarten
    WEB CONFERENCE 2020: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2020), 2020, : 2486 - 2492
  • [10] Text is NOT Enough: Integrating Visual Impressions into Open-domain Dialogue Generation
    Shen, Lei
    Zhan, Haolan
    Shen, Xin
    Song, Yonghao
    Zhao, Xiaofang
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 4287 - 4296