Attention-Based Bidirectional Long Short-Term Memory Networks for Relation Classification

被引:1334
|
作者
Zhou, Peng [1 ]
Shi, Wei [1 ]
Tian, Jun [1 ]
Qi, Zhenyu [1 ]
Li, Bingchen [1 ]
Hao, Hongwei [1 ]
Xu, Bo [1 ]
机构
[1] Chinese Acad Sci, Inst Automat, Beijing, Peoples R China
基金
国家高技术研究发展计划(863计划);
关键词
D O I
10.18653/v1/p16-2034
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Relation classification is an important semantic processing task in the field of natural language processing (NLP). State-of-the-art systems still rely on lexical resources such as WordNet or NLP systems like dependency parser and named entity recognizers (NER) to get high-level features. Another challenge is that important information can appear at any position in the sentence. To tackle these problems, we propose Attention-Based Bidirectional Long Short-Term Memory Networks(Att-BLSTM) to capture the most important semantic information in a sentence. The experimental results on the SemEval-2010 relation classification task show that our method outperforms most of the existing methods, with only word vectors.
引用
收藏
页码:207 / 212
页数:6
相关论文
共 50 条
  • [1] Attention-based Bidirectional Long Short-Term Memory Networks for Relation Classification Using Knowledge Distillation from BERT
    Wang, Zihan
    Yang, Bo
    2020 IEEE INTL CONF ON DEPENDABLE, AUTONOMIC AND SECURE COMPUTING, INTL CONF ON PERVASIVE INTELLIGENCE AND COMPUTING, INTL CONF ON CLOUD AND BIG DATA COMPUTING, INTL CONF ON CYBER SCIENCE AND TECHNOLOGY CONGRESS (DASC/PICOM/CBDCOM/CYBERSCITECH), 2020, : 562 - 568
  • [2] Hyperspectral Image Classification Using Attention-Based Bidirectional Long Short-Term Memory Network
    Mei, Shaohui
    Li, Xingang
    Liu, Xiao
    Cai, Huimin
    Du, Qian
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [3] Biomedical word sense disambiguation with bidirectional long short-term memory and attention-based neural networks
    Canlin Zhang
    Daniel Biś
    Xiuwen Liu
    Zhe He
    BMC Bioinformatics, 20
  • [4] Biomedical word sense disambiguation with bidirectional long short-term memory and attention-based neural networks
    Zhang, Canlin
    Bis, Daniel
    Liu, Xiuwen
    He, Zhe
    BMC BIOINFORMATICS, 2019, 20 (Suppl 16)
  • [5] Image Captioning with Bidirectional Semantic Attention-Based Guiding of Long Short-Term Memory
    Cao, Pengfei
    Yang, Zhongyi
    Sun, Liang
    Liang, Yanchun
    Yang, Mary Qu
    Guan, Renchu
    NEURAL PROCESSING LETTERS, 2019, 50 (01) : 103 - 119
  • [6] Image Captioning with Bidirectional Semantic Attention-Based Guiding of Long Short-Term Memory
    Pengfei Cao
    Zhongyi Yang
    Liang Sun
    Yanchun Liang
    Mary Qu Yang
    Renchu Guan
    Neural Processing Letters, 2019, 50 : 103 - 119
  • [7] Urban Road Traffic Flow Prediction with Attention-Based Convolutional Bidirectional Long Short-Term Memory Networks
    Liu, Zhiquan
    Hu, Yao
    Ding, Xiangying
    TRANSPORTATION RESEARCH RECORD, 2023, 2677 (07) : 449 - 458
  • [8] Modeling citation worthiness by using attention-based bidirectional long short-term memory networks and interpretable models
    Tong Zeng
    Daniel E. Acuna
    Scientometrics, 2020, 124 : 399 - 428
  • [9] Modeling citation worthiness by using attention-based bidirectional long short-term memory networks and interpretable models
    Zeng, Tong
    Acuna, Daniel E.
    SCIENTOMETRICS, 2020, 124 (01) : 399 - 428
  • [10] Relation extraction in Chinese using attention-based bidirectional long short- term networks
    Zhang, Yanzi
    PEERJ COMPUTER SCIENCE, 2023, 9