A semantic matching energy function for learning with multi-relational data Application to word-sense disambiguation

被引:408
作者
Bordes, Antoine [1 ,2 ]
Glorot, Xavier [3 ]
Weston, Jason [4 ]
Bengio, Yoshua [3 ]
机构
[1] Univ Technol Compiegne, Heudiasyc UMR 7253, Compiegne, France
[2] CNRS, Compiegne, France
[3] Univ Montreal, Montreal, PQ, Canada
[4] Google, New York, NY USA
基金
加拿大自然科学与工程研究理事会;
关键词
Neural networks; Multi-relational data; Word-sense disambiguation; REPRESENTATION;
D O I
10.1007/s10994-013-5363-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Large-scale relational learning becomes crucial for handling the huge amounts of structured data generated daily in many application domains ranging from computational biology or information retrieval, to natural language processing. In this paper, we present a new neural network architecture designed to embed multi-relational graphs into a flexible continuous vector space in which the original data is kept and enhanced. The network is trained to encode the semantics of these graphs in order to assign high probabilities to plausible components. We empirically show that it reaches competitive performance in link prediction on standard datasets from the literature as well as on data from a real-world knowledge base (WordNet). In addition, we present how our method can be applied to perform word-sense disambiguation in a context of open-text semantic parsing, where the goal is to learn to assign a structured meaning representation to almost any sentence of free text, demonstrating that it can scale up to tens of thousands of nodes and thousands of types of relation.
引用
收藏
页码:233 / 259
页数:27
相关论文
共 57 条
  • [1] [Anonymous], 2011, ARXIV11021808
  • [2] [Anonymous], P 8 INT C KNOWL BAS
  • [3] [Anonymous], 2010, P 13 INT C ART INT S
  • [4] [Anonymous], 2007, Introduction to Statistical Relational Learning
  • [5] [Anonymous], 2010, P PYTHON SCI COMPUTI
  • [6] [Anonymous], 2012, Proceedings of the 21st international conference on World Wide Web
  • [7] [Anonymous], 2009, Advances in neural information processing systems
  • [8] [Anonymous], P ACL SIGLEX SENSEVA
  • [9] [Anonymous], P INT C LANG RES EV
  • [10] [Anonymous], ICPSR DATA FILE