On Efficiency of Semantic Relation Extraction through Low-dimensional Distributed Representations for Substrings

被引:0
作者
Jin, Zhan [1 ]
Shibata, Chihiro [1 ]
Sun, Jingtao [2 ]
Tago, Kazuya [1 ]
机构
[1] Tokyo Univ Technol, Sch Comp Sci, Hachioji, Tokyo, Japan
[2] Natl Inst Informat, Tokyo, Japan
来源
2015 IEEE 17TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS, 2015 IEEE 7TH INTERNATIONAL SYMPOSIUM ON CYBERSPACE SAFETY AND SECURITY, AND 2015 IEEE 12TH INTERNATIONAL CONFERENCE ON EMBEDDED SOFTWARE AND SYSTEMS (ICESS) | 2015年
关键词
deep learning; NNLMs; word vectors;
D O I
10.1109/HPCC-CSS-ICESS.2015.267
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
By virtue of recent developments in machine learning techniques, higher-level information can now to be extracted from big data. To analyze big data, efficient and smart representations of data achieved by using sufficiently fast algorithms, as well as highly accurate results, are important. In this paper, we focus on extracting multiple semantic relations using lightweight processing through the efficient low-dimensional expression of substrings in text data. We propose an approach to build features for relation classification consisting of only low-dimensional vectors representing substrings between two words, called substring vectors. The experimental results show that, using efficient low-dimensional representations of data and at a small computational cost, our approach achieves a sufficiently high accuracy that is better than most existing approaches. In addition, through experiments, we ensured that mapping substrings to a sufficiently low dimensional space yields better results in terms of both accuracy and efficiency.
引用
收藏
页码:1749 / 1754
页数:6
相关论文
共 14 条
[1]  
[Anonymous], 2013, P 2013 C N AM CHAPTE
[2]   A neural probabilistic language model [J].
Bengio, Y ;
Ducharme, R ;
Vincent, P ;
Jauvin, C .
JOURNAL OF MACHINE LEARNING RESEARCH, 2003, 3 (06) :1137-1155
[3]  
Chen Y., 2010, P 5 INT WORKSH SEM E, P226
[4]  
Fu RJ, 2014, PROCEEDINGS OF THE 52ND ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 1, P1199
[5]  
Hashimoto Kazuma., 2013, EMNLP, P1372
[6]  
Hinton GE, 1986, P 8 ANN C COGN SCI S, P12, DOI DOI 10.1109/69.917563
[7]  
Mikolov T., 2013, CLIN ORTHOPAEDICS RE, Vabs/1301.3781
[8]  
Mintz M., 2009, P JOINT C 47 ANN M A, P1003
[9]  
Nakov P., 2010, P 5 INT WORKSH SEM E, P33
[10]  
Rink B, 2010, P 5 INT WORKSH SEM E