Biomedical document relation extraction with prompt learning and KNN

被引:3
作者
Zhao, Di [1 ]
Yang, Yumeng [2 ]
Chen, Peng [2 ]
Meng, Jiana [1 ]
Sun, Shichang [1 ]
Wang, Jian [2 ]
Lin, Hongfei [2 ]
机构
[1] Dalian Minzu Univ, Sch Comp Sci & Engn, Dalian 116650, Peoples R China
[2] Dalian Univ Technol, Sch Comp Sci & Technol, Dalian 116024, Peoples R China
基金
中国国家自然科学基金;
关键词
Document relation extraction; Prompt learning; Pretrained language model; KNN;
D O I
10.1016/j.jbi.2023.104459
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Document-level relation extraction is designed to recognize connections between entities a cross sentences or between sentences. The current mainstream document relation extraction model is mainly based on the graph method or combined with the pre-trained language model, which leads to the relatively complex process of the whole workflow. In this work, we propose biomedical relation extraction based on prompt learning to avoid complex relation extraction processes and obtain decent performance. Particularity, we present a model that combines prompt learning with T5 for document relation extraction, by integrating a mask template mechanism into the model. In addition, this work also proposes a few-shot relation extraction method based on the K-nearest neighbor (KNN) algorithm with prompt learning. We select similar semantic labels through KNN, and subsequently conduct the relation extraction. The results acquired from two biomedical document benchmarks indicate that our model can improve the learning of document semantic information, achieving improvements in the relation F1 score of 3.1% on CDR.
引用
收藏
页数:8
相关论文
共 50 条
  • [21] Medical Decision Tree Extraction: A Prompt Based Dual Contrastive Learning Method
    Jiang, Yiwen
    Yu, Hao
    Fu, Xingyue
    HEALTH INFORMATION PROCESSING. EVALUATION TRACK PAPERS, 2023, 1773 : 103 - 116
  • [22] Personalized Prompt Learning for Explainable Recommendation
    Li, Lei
    Zhang, Yongfeng
    Chen, Li
    ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2023, 41 (04)
  • [23] GAP: A novel Generative context-Aware Prompt-tuning method for relation extraction
    Chen, Zhenbin
    Li, Zhixin
    Zeng, Yufei
    Zhang, Canlong
    Ma, Huifang
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 248
  • [24] iterPrompt: An iterative prompt-tuning method for nested relation extraction with dynamic assignment strategy
    Mai, Chengcheng
    Wang, Yuxiang
    Gong, Ziyu
    Wang, Hanxiang
    Luo, Kaiwen
    Yuan, Chunfeng
    Huang, Yihua
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 254
  • [25] Continuous Prompt Enhanced Biomedical Entity Normalization
    Lai, Zhaohong
    Fu, Biao
    Wei, Shangfei
    Shi, Xiaodong
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, NLPCC 2022, PT II, 2022, 13552 : 61 - 72
  • [26] Document-level relation extraction with multi-semantic knowledge interaction
    Hou, Wenlong
    Wu, Wenda
    Liu, Xianhui
    Zhao, Weidong
    INFORMATION SCIENCES, 2024, 679
  • [27] Deep learning models for spatial relation extraction in text
    Wu, Kehan
    Zhang, Xueying
    Dang, Yulong
    Ye, Peng
    GEO-SPATIAL INFORMATION SCIENCE, 2023, 26 (01) : 58 - 70
  • [28] Virtual prompt pre-training for prototype-based few-shot relation extraction
    He, Kai
    Huang, Yucheng
    Mao, Rui
    Gong, Tieliang
    Li, Chen
    Cambria, Erik
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 213
  • [29] Few-shot biomedical relation extraction using data augmentation and domain information
    Guo, Bocheng
    Zhao, Di
    Dong, Xin
    Meng, Jiana
    Lin, Hongfei
    NEUROCOMPUTING, 2024, 595
  • [30] Fake news detection via knowledgeable prompt learning
    Jiang, Gongyao
    Liu, Shuang
    Zhao, Yu
    Sun, Yueheng
    Zhang, Meishan
    INFORMATION PROCESSING & MANAGEMENT, 2022, 59 (05)