Biomedical document relation extraction with prompt learning and KNN

被引:3
作者
Zhao, Di [1 ]
Yang, Yumeng [2 ]
Chen, Peng [2 ]
Meng, Jiana [1 ]
Sun, Shichang [1 ]
Wang, Jian [2 ]
Lin, Hongfei [2 ]
机构
[1] Dalian Minzu Univ, Sch Comp Sci & Engn, Dalian 116650, Peoples R China
[2] Dalian Univ Technol, Sch Comp Sci & Technol, Dalian 116024, Peoples R China
基金
中国国家自然科学基金;
关键词
Document relation extraction; Prompt learning; Pretrained language model; KNN;
D O I
10.1016/j.jbi.2023.104459
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Document-level relation extraction is designed to recognize connections between entities a cross sentences or between sentences. The current mainstream document relation extraction model is mainly based on the graph method or combined with the pre-trained language model, which leads to the relatively complex process of the whole workflow. In this work, we propose biomedical relation extraction based on prompt learning to avoid complex relation extraction processes and obtain decent performance. Particularity, we present a model that combines prompt learning with T5 for document relation extraction, by integrating a mask template mechanism into the model. In addition, this work also proposes a few-shot relation extraction method based on the K-nearest neighbor (KNN) algorithm with prompt learning. We select similar semantic labels through KNN, and subsequently conduct the relation extraction. The results acquired from two biomedical document benchmarks indicate that our model can improve the learning of document semantic information, achieving improvements in the relation F1 score of 3.1% on CDR.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] Integrating graph convolutional networks to enhance prompt learning for biomedical relation extraction
    Guo, Bocheng
    Meng, Jiana
    Zhao, Di
    Jia, Xiangxing
    Chu, Yonghe
    Lin, Hongfei
    JOURNAL OF BIOMEDICAL INFORMATICS, 2024, 157
  • [2] Prompt-Learning for Cross-Lingual Relation Extraction
    Hsu, Chiaming
    Zan, Changtong
    Ding, Liang
    Wang, Longyue
    Wang, Xiaoting
    Liu, Weifeng
    Lin, Fu
    Hu, Wenbin
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [3] An Event Extraction Method Based on Template Prompt Learning
    Chen N.
    Li X.
    Data Analysis and Knowledge Discovery, 2023, 7 (06) : 86 - 98
  • [4] Cue prompt adapting model for relation extraction
    Wang, Kai
    Chen, Yanping
    Wen, Kunjian
    Wei, Chao
    Dong, Bo
    Zheng, Qinghua
    Qin, Yongbin
    CONNECTION SCIENCE, 2023, 35 (01)
  • [5] Prompt-Based Joint Contrastive Learning for Zero-Shot Relation Extraction
    Zou, Jianjian
    Xiao, Yuhui
    Zhou, Sichi
    Li, Wei
    Yang, Qun
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, PT I, NLPCC 2024, 2025, 15359 : 419 - 431
  • [6] Few-Shot Relation Extraction Through Prompt With Relation Information and Multi-Level Contrastive Learning
    Dong, Ye
    Yang, Rong
    Liu, Junbao
    Qin, Xizhong
    IEEE ACCESS, 2024, 12 : 123352 - 123361
  • [7] Is Prompt the Future? A Survey of Evolution of Relation Extraction Approach Using Deep Learning and Big Data
    Zhu, Zhen
    Wang, Liting
    Gu, Dongmei
    Wu, Hong
    Janfada, Behrooz
    Minaei-Bidgoli, Behrouz
    INTERNATIONAL JOURNAL OF INFORMATION TECHNOLOGIES AND SYSTEMS APPROACH, 2023, 16 (01) : 1172 - 1189
  • [8] KNN based machine learning approach for text and document mining
    Institute of technology Gopeshwar, Chamoli, Uttarakhand, India
    不详
    不详
    不详
    1600, Science and Engineering Research Support Society (07): : 61 - 70
  • [9] Multi-Relation Extraction for Cybersecurity Based on Ontology Rule-Enhanced Prompt Learning
    Wang, Fei
    Ding, Zhaoyun
    Liu, Kai
    Xin, Lehai
    Zhao, Yu
    Zhou, Yun
    ELECTRONICS, 2024, 13 (12)
  • [10] PTCAS: Prompt tuning with continuous answer search for relation extraction
    Chen, Yang
    Shi, Bowen
    Xu, Ke
    INFORMATION SCIENCES, 2024, 659