A Multiple-Choice Machine Reading Comprehension Model with Multi-Granularity Semantic Reasoning

被引:4
作者
Dai, Yu [1 ]
Fu, Yufan [1 ]
Yang, Lei [2 ]
机构
[1] Northeastern Univ, Software Coll, Shenyang 110169, Peoples R China
[2] Northeastern Univ, Comp Sci & Engn, Shenyang 110169, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2021年 / 11卷 / 17期
关键词
natural language processing; machine reading comprehension; semantic reasoning; pre-training model;
D O I
10.3390/app11177945
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
To address the problem of poor semantic reasoning of models in multiple-choice Chinese machine reading comprehension (MRC), this paper proposes an MRC model incorporating multi-granularity semantic reasoning. In this work, we firstly encode articles, questions and candidates to extract global reasoning information; secondly, we use multiple convolution kernels of different sizes to convolve and maximize pooling of the BERT-encoded articles, questions and candidates to extract local semantic reasoning information of different granularities; we then fuse the global information with the local multi-granularity information and use it to make an answer selection. The proposed model can combine the learned multi-granularity semantic information for reasoning, solving the problem of poor semantic reasoning ability of the model, and thus can improve the reasoning ability of machine reading comprehension. The experiments show that the proposed model achieves better performance on the C3 dataset than the benchmark model in semantic reasoning, which verifies the effectiveness of the proposed model in semantic reasoning.
引用
收藏
页数:12
相关论文
共 25 条
[1]  
Basafa H., 2021, ARXIV210503775
[2]  
Beltagy Iz, 2020, ARXIV200405150
[3]  
Charniak E., P 2000 ANLP NAACL WO, VVolume 6, P1
[4]  
Cui Y., 2018, ARXIV181007366
[5]  
Cui Y., 2020, ARXIV201106737
[6]  
Gu Y., 2020, J SOFTW, V20, P2095
[7]  
Hai W., P 53 ANN M ASS COMP
[8]  
Hermann KM, 2015, 29 ANN C NEURAL INFO, V28
[9]  
Hirschman L., P 37 ANN M ASS COMP, P325
[10]  
Lai G., P 2017 C EMP METH NA