A novel sentence similarity model with word embedding based on convolutional neural network

被引:20
作者
Yao, Haipeng [1 ]
Liu, Huiwen [1 ]
Zhang, Peiying [1 ,2 ]
机构
[1] Beijing Univ Posts & Telecommun, State Key Lab Networking & Switching Technol, Beijing 100876, Peoples R China
[2] China Univ Petr, Coll Comp & Commun Engn, Qingdao, Peoples R China
基金
中国国家自然科学基金;
关键词
convolutional neural network; sentence similarity; word embedding;
D O I
10.1002/cpe.4415
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In this paper, we propose an effective model for the similarity metrics of English sentences. In the model, we first make use of word embedding and convolutional neural network (CNN) to produce a sentence vector and then leverage the information of the sentence vector pair to calculate the score of sentence similarity. Considering the case of long-range semantic dependencies between words, we propose a novel method transforming word embeddings to construct the three-dimensional sentence feature tensor. In addition, we incorporate the k-max pooling into the convolutional neural network to adapt to variable lengths of input sentences. The proposed model requires no external resource such as WordNet and parse tree. Meanwhile, it consumes very little time for training. Finally, we carried out extensive simulations to evaluate the performance of our model compared with other state-of-the-art works. Experimental results on SemEval 2014 task (SICK test corpus) indicated that our model can achieve a good performance in the terms of Pearson correlation coefficient, Spearman correlation coefficient, and mean squared errors. Furthermore, experimental results on Microsoft research paraphrase identification (MSRP) indicated that our model can achieve an excellent performance in the terms of F1 and Accuracy.
引用
收藏
页数:12
相关论文
共 35 条
  • [1] [Anonymous], P 8 INT WORKSH SEM E
  • [2] [Anonymous], 2014, INT C NEUR INF PROC
  • [3] [Anonymous], INT C MACH LEARN HEL
  • [4] [Anonymous], 2013, GROUNDED COMPOSITION
  • [5] [Anonymous], 2014, P 2014 C EMP METH NA, DOI DOI 10.3115/V1/D14-1162
  • [6] [Anonymous], 2014, ACL
  • [7] [Anonymous], 2013, COMPUTATION LANGUAGE
  • [8] [Anonymous], 2014, THESIS U WATERLOO
  • [9] [Anonymous], INT C NEUR INF PROC
  • [10] Bestgen Y, 2014, P 8 INT WORKSH SEM E