Deep learning-based approach for Arabic open domain question answering

被引:9
作者
Alsubhi, Kholoud [1 ]
Jamal, Amani [1 ]
Alhothali, Areej [1 ]
机构
[1] King Abdulaziz Univ, Fac Comp & Informat Technol, Dept Comp Sci, Jeddah, Saudi Arabia
关键词
Arabic open domain question answering; Transformer-based models for question answering; Dense information retrieval approach;
D O I
10.7717/peerj-cs.952
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Open-domain question answering (OpenQA) is one of the most challenging yet widely investigated problems in natural language processing. It aims at building a system that can answer any given question from large-scale unstructured text or structured knowledge-base. To solve this problem, researchers traditionally use information retrieval methods to retrieve the most relevant documents and then use answer extractions techniques to extract the answer or passage from the candidate documents. In recent years, deep learning techniques have shown great success in OpenQA by using dense representation for document retrieval and reading comprehension for answer extraction. However, despite the advancement in the English language OpenQA, other languages such as Arabic have received less attention and are often addressed using traditional methods. In this paper, we use deep learning methods for Arabic OpenQA. The model consists of document retrieval to retrieve passages relevant to a question from large-scale free text resources such as Wikipedia and an answer reader to extract the precise answer to the given question. The model implements dense passage retriever for the passage retrieval task and the AraELECTRA for the reading comprehension task. The result was compared to traditional Arabic OpenQA approaches and deep learning methods in the English OpenQA. The results show that the dense passage retriever outperforms the traditional Term Frequency-Inverse Document Frequency (TF-IDF) information retriever in terms of the top-20 passage retrieval accuracy and improves our end-to-end question answering system in two Arabic question-answering benchmark datasets.
引用
收藏
页数:21
相关论文
共 37 条
  • [31] Teufel S, 2007, TEXT SPEECH LANG TEC, V37, P163
  • [32] Voidful, 2021, VOIDFULDPR CTX ENCOD
  • [33] Wikimedia Foundation, 2021, ARW DUMP PROGR 20210
  • [34] Wu Y., 2016, PREPRINT, DOI [10.48550/ARXIV.1609.08144, DOI 10.48550/ARXIV.1609.08144]
  • [35] Yang W, 2019, NAACL HLT 2019: THE 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES: PROCEEDINGS OF THE DEMONSTRATIONS SESSION, P72
  • [36] Zhang Z., 2018, P 22 C COMPUTATIONAL, P190, DOI DOI 10.18653/V1/K18-1019
  • [37] Zhu F, 2021, ARXIV PREPRINT, DOI [10.48550/arXiv.2101.00774, DOI 10.48550/ARXIV.2101.00774]