Syntax-Aware Sentence Matching with Graph Convolutional Networks

被引:1
作者
Lei, Yangfan [1 ,2 ]
Hu, Yue [1 ,2 ]
Wei, Xiangpeng [1 ,2 ]
Xing, Luxi [1 ,2 ]
Liu, Quanchao [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Informat Engn, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Sch Cyber Secur, Beijing, Peoples R China
来源
KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, KSEM 2019, PT II | 2019年 / 11776卷
关键词
Sentence matching; Dependency parsing; Graph convolutional network;
D O I
10.1007/978-3-030-29563-9_31
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Natural language sentence matching, as a fundamental technology for a variety of tasks, plays a key role in many natural language processing systems. In this article, we propose a new method which incorporates syntactic structure into "matching-aggregation" framework for sentence matching tasks. Our approach can be used in "matching-aggregation" framework efficiently. Concretely speaking, we introduce a multi-channel-GCN layer, which takes both words and the syntactic dependency trees of sentence pair as input to incorporate syntax information to the matching process. We also use a gating mechanism to dynamically combine the raw contextual representation of a sentence with the syntactic representation of the sentence to relieve the noise caused by the potential wrong dependency parsing result. Experimental results on standard benchmark datasets demonstrate that our model makes a substantial improvement over the baseline.
引用
收藏
页码:353 / 364
页数:12
相关论文
共 26 条
[1]  
[Anonymous], 2016, P COLING 2016 26 INT
[2]  
Bahdanau D, 2016, Arxiv, DOI arXiv:1409.0473
[3]  
Bowman SR, 2016, PROCEEDINGS OF THE 54TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 1, P1466
[4]  
Bowman Samuel R., 2015, C EMPIRICAL METHODS, P632, DOI 10.18653/v1/D15-1075
[5]   Enhanced LSTM for Natural Language Inference [J].
Chen, Qian ;
Zhu, Xiaodan ;
Ling, Zhenhua ;
Wei, Si ;
Jiang, Hui ;
Inkpen, Diana .
PROCEEDINGS OF THE 55TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2017), VOL 1, 2017, :1657-1668
[6]  
Cheng J., 2016, P C EMP METH NAT LAN, P551, DOI DOI 10.18653/V1/D16-1053
[7]  
Duvenaudt D, 2015, ADV NEUR IN, V28
[8]  
Gilmer J, 2017, PR MACH LEARN RES, V70
[9]  
Gong Y., 2017, 6 INT C LEARNING REP
[10]  
Graves A, 2012, STUD COMPUT INTELL, V385, P1, DOI [10.1162/neco.1997.9.1.1, 10.1007/978-3-642-24797-2]