Deep learning-based approach for Arabic open domain question answering

被引:9
作者
Alsubhi, Kholoud [1 ]
Jamal, Amani [1 ]
Alhothali, Areej [1 ]
机构
[1] King Abdulaziz Univ, Fac Comp & Informat Technol, Dept Comp Sci, Jeddah, Saudi Arabia
关键词
Arabic open domain question answering; Transformer-based models for question answering; Dense information retrieval approach;
D O I
10.7717/peerj-cs.952
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Open-domain question answering (OpenQA) is one of the most challenging yet widely investigated problems in natural language processing. It aims at building a system that can answer any given question from large-scale unstructured text or structured knowledge-base. To solve this problem, researchers traditionally use information retrieval methods to retrieve the most relevant documents and then use answer extractions techniques to extract the answer or passage from the candidate documents. In recent years, deep learning techniques have shown great success in OpenQA by using dense representation for document retrieval and reading comprehension for answer extraction. However, despite the advancement in the English language OpenQA, other languages such as Arabic have received less attention and are often addressed using traditional methods. In this paper, we use deep learning methods for Arabic OpenQA. The model consists of document retrieval to retrieve passages relevant to a question from large-scale free text resources such as Wikipedia and an answer reader to extract the precise answer to the given question. The model implements dense passage retriever for the passage retrieval task and the AraELECTRA for the reading comprehension task. The result was compared to traditional Arabic OpenQA approaches and deep learning methods in the English OpenQA. The results show that the dense passage retriever outperforms the traditional Term Frequency-Inverse Document Frequency (TF-IDF) information retriever in terms of the top-20 passage retrieval accuracy and improves our end-to-end question answering system in two Arabic question-answering benchmark datasets.
引用
收藏
页数:21
相关论文
共 37 条
  • [1] Ahmed W., 2017, International Journal of Engineering Research, V6, P142
  • [2] Ahmed W, 2017, INT J ADV RES COMPUT, V8, P2849, DOI [10.26483/ijarcs.v8i1.2849, DOI 10.26483/IJARCS.V8I1.2849]
  • [3] Ahmed W., 2016, Int J Comput Eng Res, V12, P18
  • [4] Deep neural network approach for arabic community question answering
    Almiman, Ali
    Osman, Nada
    Torki, Marwan
    [J]. ALEXANDRIA ENGINEERING JOURNAL, 2020, 59 (06) : 4427 - 4434
  • [5] Antoun W, P 6 AR NAT LANG PROC, P191
  • [6] Antoun Wissam, 2020, P 4 WORKSH OP SOURC, P9
  • [7] Attardi W, 2015, WIKIEXTRACTOR
  • [8] Bird Steven., 2008, Proceedings of the Third Workshop on Issues in Teaching Computational Linguistics-TeachCL08, P62, DOI DOI 10.3115/1627306.1627317
  • [9] Briggs J., DENSE PASSAGE RETRIE
  • [10] Reading Wikipedia to Answer Open-Domain Questions
    Chen, Danqi
    Fisch, Adam
    Weston, Jason
    Bordes, Antoine
    [J]. PROCEEDINGS OF THE 55TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2017), VOL 1, 2017, : 1870 - 1879