MA-MRC: A Multi-answer Machine Reading Comprehension Dataset

被引:0
|
作者
Yue, Zhiang [1 ]
Liu, Jingping [2 ]
Zhang, Cong [3 ]
Wang, Chao [4 ]
Jiang, Haiyun [5 ]
Zhang, Yue [2 ]
Tian, Xianyang [2 ]
Cen, Zhedong [2 ]
Xiao, Yanghua [1 ]
Ruan, Tong [2 ]
机构
[1] Fudan Univ, Shanghai, Peoples R China
[2] East China Univ Sci & Technol, Shanghai, Peoples R China
[3] AECC Sichuan Gas Turbine Estab, Mianyang, Sichuan, Peoples R China
[4] Shanghai Univ, Shanghai, Peoples R China
[5] Tencent AI Lab, Shenzhen, Peoples R China
关键词
Machine Reading Comprehension; Multiple Answer; Knowledge Graph;
D O I
10.1145/3539618.3592015
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Machine reading comprehension (MRC) is an essential task for many question-answering applications. However, existing MRC datasets mainly focus on data with single answer and overlook multiple answers, which are common in the real world. In this paper, we aim to construct an MRC dataset with both data of single answer and multiple answers. To achieve this purpose, we design a novel pipeline method: data collection, data cleaning, question generation and test set annotation. Based on these procedures, we construct a high-quality multi-answer MRC dataset (MA-MRC) with 129K question-answer-context samples. We implement a sequence of baselines and carry out extensive experiments on MA-MRC. According to the experimental results, MA-MRC is a challenging dataset, which can facilitate the future research on the multi-answer MRC task(1).
引用
收藏
页码:2144 / 2148
页数:5
相关论文
共 50 条
  • [41] Summarize-then-Answer: Generating Concise Explanations for Multi-hop Reading Comprehension
    Inoue, Naoya
    Trivedi, Harsh
    Sinha, Steven
    Balasubramanian, Niranjan
    Inui, Kentaro
    2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), 2021, : 6064 - 6080
  • [42] Multi-hop Reading Comprehension Learning Method Based on Answer Contrastive Learning
    You, Hao
    Huang, Heyan
    Hu, Yue
    Xu, Yongxiu
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT IV, KSEM 2023, 2023, 14120 : 124 - 139
  • [43] Deep Understanding Based Multi-Document Machine Reading Comprehension
    Ren, Feiliang
    Liu, Yongkang
    Li, Bochao
    Wang, Zhibo
    Guo, Yu
    Liu, Shilei
    Wu, Huimin
    Wang, Jiaqi
    Liu, Chunchao
    Wang, Bingchao
    ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2022, 21 (05)
  • [44] Utilization of Question Categories in Multi-Document Machine Reading Comprehension
    Zheng, Shaomin
    Yang, Meng
    Huang, Yongjie
    Lin, Peiqin
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [45] Multi-task transfer learning for biomedical machine reading comprehension
    Guo, Wenyang
    Du, Yongping
    Zhao, Yiliang
    Ren, Keyan
    INTERNATIONAL JOURNAL OF DATA MINING AND BIOINFORMATICS, 2020, 23 (03) : 234 - 250
  • [46] Multi-task joint training model for machine reading comprehension
    Li, Fangfang
    Shan, Youran
    Mao, Xingliang
    Ren, Xingkai
    Liu, Xiyao
    Zhang, Shichao
    NEUROCOMPUTING, 2022, 488 : 66 - 77
  • [47] FinBERT-MRC: Financial Named Entity Recognition Using BERT Under the Machine Reading Comprehension Paradigm
    Zhang, Yuzhe
    Zhang, Hong
    NEURAL PROCESSING LETTERS, 2023, 55 (06) : 7393 - 7413
  • [48] Select, Answer and Explain: Interpretable Multi-Hop Reading Comprehension over Multiple Documents
    Tu, Ming
    Huang, Kevin
    Wang, Guangtao
    Huang, Jing
    He, Xiaodong
    Zhou, Bowen
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 9073 - 9080
  • [49] MRC-VulLoc: Software source code vulnerability localization based on multi-choice reading comprehension
    Tang, Gaigai
    Yang, Lin
    Zhang, Long
    Kuang, Hongyu
    Wang, Huiqiang
    COMPUTERS & SECURITY, 2024, 141
  • [50] Contrastive heterogeneous graphs learning for multi-hop machine reading comprehension
    Liao, Jinzhi
    Zhao, Xiang
    Li, Xinyi
    Tang, Jiuyang
    Ge, Bin
    WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS, 2022, 25 (03): : 1469 - 1487