Fine-grained entity type classification using GRU with self-attention

被引:5
|
作者
Dhrisya K. [1 ]
Remya G. [1 ]
Mohan A. [1 ]
机构
[1] N.S.S College of Engineering, Palakkad, Kerala
关键词
Attention; Classification; GRU; Information extraction; Named entity; NLP;
D O I
10.1007/s41870-020-00499-5
中图分类号
学科分类号
摘要
Natural language processing is an application of a computational technique that allows the machine to process human language. One of the primary tasks of NLP is information extraction that aims to capture important information from the text. Nowadays, the fast-growing web contains a large amount of textual information, requires a technique to extract relevant information. The entity recognition task is a type of information extraction that attempts to find and classify named entities appearing in the unstructured text document. The traditional coarse-grained entity recognition systems often define a less number of pre-defined named entity categories such as person, location, organization, and date. The fine-grained entity type classification model focused to classify the target entities into fine-grained types. Most of the recent works are accomplished with the help of Bidirectional LSTM with an attention mechanism. But due to the complex structure of bidirectional LSTM, these models consume an enormous amount of time for the training process. The existing attention mechanisms are incapable to pick up the correlation between the new word and the previous context. The proposed system resolves this issue by utilizing bidirectional GRU with the self-attention mechanism. The experiment result shows that the novel approach outperforms state-of-the-art methods. © 2020, Bharati Vidyapeeth's Institute of Computer Applications and Management.
引用
收藏
页码:869 / 878
页数:9
相关论文
共 50 条
  • [1] A fine-grained classification method based on self-attention Siamese network
    He Can
    Yuan Guowu
    Wu Hao
    2021 THE 5TH INTERNATIONAL CONFERENCE ON VIDEO AND IMAGE PROCESSING, ICVIP 2021, 2021, : 148 - 154
  • [2] Fine-grained entity type classification with adaptive context
    Liu, Jin
    Wang, Lina
    Zhou, Mingji
    Wang, Jin
    Lee, Sungyoung
    SOFT COMPUTING, 2018, 22 (13) : 4307 - 4318
  • [3] Fine-grained entity type classification with adaptive context
    Jin Liu
    Lina Wang
    Mingji Zhou
    Jin Wang
    Sungyoung Lee
    Soft Computing, 2018, 22 : 4307 - 4318
  • [4] Neural Architectures for Fine-grained Entity Type Classification
    Shimaoka, Sonse
    Stenetorp, Pontus
    Inui, Kentaro
    Riedel, Sebastian
    15TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EACL 2017), VOL 1: LONG PAPERS, 2017, : 1271 - 1280
  • [5] Spatial self-attention network with self-attention distillation for fine-grained image recognitionx2729;
    Baffour, Adu Asare
    Qin, Zhen
    Wang, Yong
    Qin, Zhiguang
    Choo, Kim-Kwang Raymond
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 81
  • [6] Fine-grained Entity Type Classification Based on Transfer Learning
    Feng J.-Z.
    Ma X.-C.
    Zidonghua Xuebao/Acta Automatica Sinica, 2020, 46 (08): : 1759 - 1766
  • [7] Triple Classification Using Regions and Fine-Grained Entity Typing
    Dong, Tiansi
    Wang, Zhigang
    Li, Juanzi
    Bauckhage, Christian
    Cremers, Armin B.
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 77 - 85
  • [8] Self-Attention based fine-grained cross-media hybrid network
    Shan, Wei
    Huang, Dan
    Wang, Jiangtao
    Zou, Feng
    Li, Suwen
    PATTERN RECOGNITION, 2022, 130
  • [9] Multi-Granularity Feature Aggregation with Self-Attention and Spatial Reasoning for Fine-Grained Crop Disease Classification
    Zuo, Xin
    Chu, Jiao
    Shen, Jifeng
    Sun, Jun
    AGRICULTURE-BASEL, 2022, 12 (09):
  • [10] Entity Retrieval Using Fine-Grained Entity Aspects
    Chatterjee, Shubham
    Dietz, Laura
    SIGIR '21 - PROCEEDINGS OF THE 44TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2021, : 1662 - 1666