NaturalConv: A Chinese Dialogue Dataset Towards Multi-turn Topic-driven Conversation

被引:0
作者
Wang, Xiaoyang [1 ]
Li, Chen [1 ]
Zhao, Jianqiao [1 ]
Yu, Dong [1 ]
机构
[1] Tencent AI Lab, Bellevue, WA 98004 USA
来源
THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE | 2021年 / 35卷
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a Chinese multi-turn topic-driven conversation dataset, NaturalConv, which allows the participants to chat anything they want as long as any element from the topic is mentioned and the topic shift is smooth. Our corpus contains 19.9K conversations from six domains, and 400K utterances with an average turn number of 20.1. These conversations contain in-depth discussions on related topics or widely natural transition between multiple topics. We believe either way is normal for human conversation. To facilitate the research on this corpus, we provide results of several benchmark models. Comparative results show that for this dataset, our current models are not able to provide significant improvement by introducing background knowledge/topic. Therefore, the proposed dataset should be a good benchmark for further research to evaluate the validity and naturalness of multi-turn conversation systems. Our dataset is available at https://ai.tencent.com/ailab/nlp/dialogue/#datasets.
引用
收藏
页码:14006 / 14014
页数:9
相关论文
共 25 条
  • [1] Adiwardana Daniel, 2020, Towards a Human-like Open-Domain Chatbot
  • [2] Easy Access to the Freebase Dataset
    Bast, Hannah
    Baeurle, Florian
    Buchhold, Bjorn
    Haussmann, Elmar
    [J]. WWW'14 COMPANION: PROCEEDINGS OF THE 23RD INTERNATIONAL CONFERENCE ON WORLD WIDE WEB, 2014, : 95 - 98
  • [3] Cai XQ, 2018, PROC IEEE MICR ELECT, P708, DOI 10.1109/MEMSYS.2018.8346653
  • [4] Devlin J, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P4171
  • [5] Neural Approaches to Conversational AI
    Gao, Jianfeng
    Galley, Michel
    Li, Lihong
    [J]. FOUNDATIONS AND TRENDS IN INFORMATION RETRIEVAL, 2019, 13 (2-3): : 127 - 298
  • [6] Ghazvininejad M, 2018, AAAI CONF ARTIF INTE, P5110
  • [7] Topical-Chat: Towards Knowledge-Grounded Open-Domain Conversations
    Gopalakrishnan, Karthik
    Hedayatnia, Behnam
    Chen, Qinlang
    Gottardi, Anna
    Kwatra, Sanjeev
    Venkatesh, Anu
    Gabriel, Raefer
    Hakkani-Tur, Dilek
    [J]. INTERSPEECH 2019, 2019, : 1891 - 1895
  • [8] Huang M., 2019, ARXIV PREPRINT ARXIV
  • [9] Li J, 2015, ARXIV151003055
  • [10] Liu SM, 2018, PROCEEDINGS OF THE 56TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL), VOL 1, P1489