ADPG: Biomedical entity recognition based on Automatic Dependency Parsing Graph

被引:2
作者
Yang, Yumeng [1 ]
Lin, Hongfei [1 ]
Yang, Zhihao [1 ]
Zhang, Yijia [2 ]
Zhao, Di [3 ]
Huai, Shuaiheng [2 ]
机构
[1] Dalian Univ Technol, Sch Comp Sci & Technol, Dalian, Peoples R China
[2] Dalian Maritime Univ, Sch Informat Sci & Technol, Dalian, Peoples R China
[3] Dalian Minzu Univ, Sch Comp Sci & Engn, Dalian, Peoples R China
基金
中国博士后科学基金;
关键词
NER; Tree-transformer; Dependency parsing; Biomedical;
D O I
10.1016/j.jbi.2023.104317
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Named entity recognition is a key task in text mining. In the biomedical field, entity recognition focuses on extracting key information from large-scale biomedical texts for the downstream information extraction task. Biomedical literature contains a large amount of long-dependent text, and previous studies use external syntactic parsing tools to capture word dependencies in sentences to achieve nested biomedical entity recognition. However, the addition of external parsing tools often introduces unnecessary noise to the current auxiliary task and cannot improve the performance of entity recognition in an end-to-end way. Therefore, we propose a novel automatic dependency parsing approach, namely the ADPG model, to fuse syntactic structure information in an end-to-end way to recognize biomedical entities. Specifically, the method is based on a multilayer Tree-Transformer structure to automatically extract the semantic representation and syntactic structure in long-dependent sentences, and then combines a multilayer graph attention neural network (GAT) to extract the dependency paths between words in the syntactic structure to improve the performance of biomedical entity recognition. We evaluated our ADPG model on three biomedical domain and one news domain datasets, and the experimental results demonstrate that our model achieves state-of-the-art results on these four datasets with certain generalization performance. Our model is released on GitHub: https://github.com/Yumeng-Y/ADPG.
引用
收藏
页数:11
相关论文
共 50 条
[1]   Joint Learning of Named Entity Recognition and Dependency Parsing using Separate Datasets [J].
Akdemir, Arda ;
Gungor, Tunga .
COMPUTACION Y SISTEMAS, 2019, 23 (03) :841-850
[2]   Improving Graph-Based Dependency Parsing Models With Dependency Language Models [J].
Zhang, Min ;
Chen, Wenliang ;
Duan, Xiangyu ;
Zhang, Rong .
IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2013, 21 (11) :2313-2323
[3]   Named entity recognition and dependency parsing for better concept extraction in summary obfuscation detection [J].
Taufiq, Umar ;
Pulungan, Reza ;
Suyanto, Yohanes .
EXPERT SYSTEMS WITH APPLICATIONS, 2023, 217
[4]   Graph-Based Dependency Parsing with Recursive Neural Network [J].
Huang, Pingping ;
Chang, Baobao .
CHINESE COMPUTATIONAL LINGUISTICS AND NATURAL LANGUAGE PROCESSING BASED ON NATURALLY ANNOTATED BIG DATA (CCL 2015), 2015, 9427 :227-239
[5]   EVALUATION OF SEMANTIC ROLE LABELING AND DEPENDENCY PARSING OF AUTOMATIC SPEECH RECOGNITION OUTPUT [J].
Favre, Benoit ;
Bohnet, Bernd ;
Hakkani-Tuer, Dilek .
2010 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2010, :5342-5345
[6]   An Empirical Study of Encoders and Decoders in Graph-Based Dependency Parsing [J].
Wang, Ge ;
Hu, Ziyuan ;
Hu, Zechuan ;
Tu, Kewei .
IEEE ACCESS, 2020, 8 :35770-35776
[7]   Exploring Automatic Feature Selection for Transition-Based Dependency Parsing [J].
Ballesteros, Miguel .
PROCESAMIENTO DEL LENGUAJE NATURAL, 2013, (51) :119-126
[8]   Named Entity Recognition based on a Graph Structure [J].
Munoz, David ;
Perez, Fernando ;
Pinto, David .
COMPUTACION Y SISTEMAS, 2020, 24 (02) :553-563
[9]   Comparison of Named Entity Recognition models based on Neural Network in Biomedical [J].
Kishwar, Azka ;
Batool, Komal .
PROCEEDINGS OF 2021 INTERNATIONAL BHURBAN CONFERENCE ON APPLIED SCIENCES AND TECHNOLOGIES (IBCAST), 2021, :426-431
[10]   Dependency Parsing-based Entity Relation Extraction over Chinese Complex Text [J].
Qi, Shanshan ;
Zheng, Limin ;
Shang, Feiyu .
ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2021, 20 (04)