ADPG: Biomedical entity recognition based on Automatic Dependency Parsing Graph

被引:0
|
作者
Yang, Yumeng [1 ]
Lin, Hongfei [1 ]
Yang, Zhihao [1 ]
Zhang, Yijia [2 ]
Zhao, Di [3 ]
Huai, Shuaiheng [2 ]
机构
[1] Dalian Univ Technol, Sch Comp Sci & Technol, Dalian, Peoples R China
[2] Dalian Maritime Univ, Sch Informat Sci & Technol, Dalian, Peoples R China
[3] Dalian Minzu Univ, Sch Comp Sci & Engn, Dalian, Peoples R China
基金
中国博士后科学基金;
关键词
NER; Tree-transformer; Dependency parsing; Biomedical;
D O I
10.1016/j.jbi.2023.104317
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Named entity recognition is a key task in text mining. In the biomedical field, entity recognition focuses on extracting key information from large-scale biomedical texts for the downstream information extraction task. Biomedical literature contains a large amount of long-dependent text, and previous studies use external syntactic parsing tools to capture word dependencies in sentences to achieve nested biomedical entity recognition. However, the addition of external parsing tools often introduces unnecessary noise to the current auxiliary task and cannot improve the performance of entity recognition in an end-to-end way. Therefore, we propose a novel automatic dependency parsing approach, namely the ADPG model, to fuse syntactic structure information in an end-to-end way to recognize biomedical entities. Specifically, the method is based on a multilayer Tree-Transformer structure to automatically extract the semantic representation and syntactic structure in long-dependent sentences, and then combines a multilayer graph attention neural network (GAT) to extract the dependency paths between words in the syntactic structure to improve the performance of biomedical entity recognition. We evaluated our ADPG model on three biomedical domain and one news domain datasets, and the experimental results demonstrate that our model achieves state-of-the-art results on these four datasets with certain generalization performance. Our model is released on GitHub: https://github.com/Yumeng-Y/ADPG.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Joint Learning of Named Entity Recognition and Dependency Parsing using Separate Datasets
    Akdemir, Arda
    Gungor, Tunga
    COMPUTACION Y SISTEMAS, 2019, 23 (03): : 841 - 850
  • [2] Improving Graph-Based Dependency Parsing Models With Dependency Language Models
    Zhang, Min
    Chen, Wenliang
    Duan, Xiangyu
    Zhang, Rong
    IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2013, 21 (11): : 2313 - 2323
  • [3] Named entity recognition and dependency parsing for better concept extraction in summary obfuscation detection
    Taufiq, Umar
    Pulungan, Reza
    Suyanto, Yohanes
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 217
  • [4] Graph-Based Dependency Parsing with Recursive Neural Network
    Huang, Pingping
    Chang, Baobao
    CHINESE COMPUTATIONAL LINGUISTICS AND NATURAL LANGUAGE PROCESSING BASED ON NATURALLY ANNOTATED BIG DATA (CCL 2015), 2015, 9427 : 227 - 239
  • [5] EVALUATION OF SEMANTIC ROLE LABELING AND DEPENDENCY PARSING OF AUTOMATIC SPEECH RECOGNITION OUTPUT
    Favre, Benoit
    Bohnet, Bernd
    Hakkani-Tuer, Dilek
    2010 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2010, : 5342 - 5345
  • [6] An Empirical Study of Encoders and Decoders in Graph-Based Dependency Parsing
    Wang, Ge
    Hu, Ziyuan
    Hu, Zechuan
    Tu, Kewei
    IEEE ACCESS, 2020, 8 : 35770 - 35776
  • [7] Named Entity Recognition based on a Graph Structure
    Munoz, David
    Perez, Fernando
    Pinto, David
    COMPUTACION Y SISTEMAS, 2020, 24 (02): : 553 - 563
  • [8] Exploring Automatic Feature Selection for Transition-Based Dependency Parsing
    Ballesteros, Miguel
    PROCESAMIENTO DEL LENGUAJE NATURAL, 2013, (51): : 119 - 126
  • [9] Comparison of Named Entity Recognition models based on Neural Network in Biomedical
    Kishwar, Azka
    Batool, Komal
    PROCEEDINGS OF 2021 INTERNATIONAL BHURBAN CONFERENCE ON APPLIED SCIENCES AND TECHNOLOGIES (IBCAST), 2021, : 426 - 431
  • [10] Dependency Parsing-based Entity Relation Extraction over Chinese Complex Text
    Qi, Shanshan
    Zheng, Limin
    Shang, Feiyu
    ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2021, 20 (04)