A New Multi-level Knowledge Retrieval Model for Task-Oriented Dialogue

被引:0
作者
Dong, Xuelian [1 ]
Chen, Jiale [1 ]
Weng, Heng [2 ]
Chen, Zili [3 ]
Wang, Fu Lee [4 ]
Hao, Tianyong [1 ,5 ]
机构
[1] South China Normal Univ, Sch Comp Sci, Guangzhou, Peoples R China
[2] Guangzhou Univ Chinese Med, Affiliated Hosp 2, Guangzhou, Peoples R China
[3] Hong Kong Polytech Univ, Coll Profess & Continuing Educ, Hong Kong, Peoples R China
[4] Hong Kong Metropolitan Univ, Sch Sci & Technol, Hong Kong, Peoples R China
[5] Guangzhou WisTalk Informat Technol Co Ltd, Guangzhou, Peoples R China
来源
NEURAL COMPUTING FOR ADVANCED APPLICATIONS, NCAA 2024, PT III | 2025年 / 2183卷
基金
中国国家自然科学基金;
关键词
Knowledge retrieval; Task-oriented dialogue; Large language model;
D O I
10.1007/978-981-97-7007-6_4
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
One of the main challenges in task-oriented dialogue systems is how to retrieve accurate knowledge from external knowledge bases. Existing methods usually retrieve knowledge and entire entity by utilizing dialogue context, while the correlations between dialogue context and entity attributes are overlook, leading suboptimal knowledge retrieval. Therefore, we introduce a Multi-Level knowledge retrieval model for Task-Oriented Dialogue (MLTOD) consisted of an entity retriever, an attribute retriever, a ranker and a response generator. The entity retriever retrieved entities from knowledge bases and the attribute retriever extracts relevant attributes respectively. The ranker dynamically combines the results from the retrievers to select the most relevant knowledge entities. Then the response generator generates final system response based on the ranking result. In addition, this paper introduces a novel multi-level retrieval mechanism. It considers both entity level and attribute level relevance for coarse to fine knowledge retrieval. Experiments on two publicly available datasets show that our MLTOD model outperforms existing state-of-the-art baseline approaches, validating its effectiveness for task-oriented dialogue.
引用
收藏
页码:46 / 60
页数:15
相关论文
共 31 条
  • [11] Li Z., 2024, Advances in Neural Information Processing Systems, V36
  • [12] Liu YH, 2019, Arxiv, DOI [arXiv:1907.11692, 10.48550/arXiv.1907.11692, DOI 10.48550/ARXIV.1907.11692]
  • [13] Madotto A, 2020, FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2020, P2372
  • [14] Madotto A, 2018, PROCEEDINGS OF THE 56TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL), VOL 1, P1468
  • [15] SCLert: A Span-Based Joint Model for Measurable Quantitative Information Extraction From Chinese Texts
    Mo, Di
    Huang, Bangrui
    Wang, Haitao
    Cao, Xinyu
    Gan, Keqin
    Wei, Jie
    Weng, Heng
    Hao, Tianyong
    [J]. IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2024, 70 (01) : 3361 - 3371
  • [16] BLEU: a method for automatic evaluation of machine translation
    Papineni, K
    Roukos, S
    Ward, T
    Zhu, WJ
    [J]. 40TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, PROCEEDINGS OF THE CONFERENCE, 2002, : 311 - 318
  • [17] Qin BW, 2021, AAAI CONF ARTIF INTE, V35, P13701
  • [18] Qin L., 2020, ACL, P6344
  • [19] Qin LB, 2019, 2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019), P133
  • [20] Raghu D, 2021, FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, P5051