Biomedical temporal knowledge graph reasoning via contrastive adversarial learning

被引:0
作者
Li, Wenchu [1 ]
Zhou, Huiwei [1 ]
Yao, Weihong [1 ]
Wang, Lanlan [1 ]
机构
[1] Dalian Univ Technol, Sch Comp Sci & Technol, Dalian, Peoples R China
来源
2024 5TH INTERNATIONAL CONFERENCE ON COMPUTING, NETWORKS AND INTERNET OF THINGS, CNIOT 2024 | 2024年
关键词
Temporal knowledge graph reasoning; Contrastive learning; Adversarial training; Natural language processing;
D O I
10.1145/3670105.3670113
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In the biomedical domain, Temporal knowledge graph (TKG) has emerged as a valuable method to capture dynamic evolutional relationships and predict future associations between entities. However, entity representations that evolve over time are more difficult to learn compared to static representations, especially for those entities that lack historical information or emerge recently. In this paper, we propose a novel Contrastive Adversarial Learning (CAL) framework for TKG reasoning in biomedical domain. We utilize adversarial training approach to increase entity samples, in order to enhance robustness and generalization ability of the model. Contrastive learning is also adopted to more accurately distinguish different entities that change over time. Specifically, we first construct three biomedical TKGs mainly based on the Comparative Toxicogenomics Database (CTD). Then, an evolution encoder is adopted to obtain temporal evolutional embeddings of entities. Next, we generate adversarial samples for entity embeddings by adding a perturbation to each of them. Finally, the obtained adversarial samples are used for contrastive learning to capture the temporal evolution of entity relationships. Experiments on three biomedical datasets show that our CAL framework achieves state-of-the-art performance.
引用
收藏
页码:43 / 48
页数:6
相关论文
共 18 条
[1]  
Dasgupta SS, 2018, 2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), P2001
[2]   Comparative Toxicogenomics Database (CTD): update 2021 [J].
Davis, Allan Peter ;
Grondin, Cynthia J. ;
Johnson, Robin J. ;
Sciaky, Daniela ;
Wiegers, Jolene ;
Wiegers, Thomas C. ;
Mattingly, Carolyn J. .
NUCLEIC ACIDS RESEARCH, 2021, 49 (D1) :D1138-D1143
[3]  
Dettmers T, 2018, AAAI CONF ARTIF INTE, P1811
[4]  
Gao TY, 2021, 2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), P6894
[5]  
García-Durán A, 2018, 2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), P4816
[6]  
Hadsell R, 2006, 2006 IEEE COMP SOC C, V2, P1735
[7]   AdCo: Adversarial Contrast for Efficient Learning of Unsupervised Representations from Self-Trained Negative Adversaries [J].
Hu, Qianjiang ;
Wang, Xiao ;
Hu, Wei ;
Qi, Guo-Jun .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :1074-1083
[8]  
Jin W, 2020, PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), P6669
[9]  
Kurakin A., 2017, ARTIF INTELL SAF SEC
[10]   Deriving Validity Time in Knowledge Graph [J].
Leblay, Julien ;
Chekol, Melisachew Wudage .
COMPANION PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE 2018 (WWW 2018), 2018, :1771-1776