Out-of-Distribution Node Detection Based on Graph Heat Kernel Diffusion

被引:0
作者
Li, Fangfang [1 ]
Wang, Yangshuai [1 ]
Du, Xinyu [1 ]
Li, Xiaohua [1 ]
Yu, Ge [1 ]
机构
[1] Northeastern Univ, Sch Comp Sci & Engn, Shenyang 110169, Peoples R China
关键词
out-of-distribution; graph diffusion; regularization; graph neural network;
D O I
10.3390/math12182942
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Over the past few years, there has been a surge in research attention towards tasks involving graph data, largely due to the impressive performance demonstrated by graph neural networks (GNNs) in handling such information. Currently, out-of-distribution (OOD) detection in graphs is a hot research topic. The goal of graph OOD detection is to identify nodes or new graphs that differ from the training data distribution, primarily in terms of attributes and structures. OOD detection is crucial for enhancing the stability, security, and robustness of models. In various applications, such as biological networks and financial fraud, graph OOD detection can help models identify anomalies or unforeseen situations, thereby enabling appropriate responses. In node-level OOD detection, existing models typically only consider first-order neighbors. This paper introduces graph diffusion to the OOD detection task for the first time, proposing the HOOD model, a graph diffusion-based OOD node detection algorithm. Specifically, the original graph is processed through graph diffusion to obtain a new graph that can directly capture high-order neighbor information, overcoming the limitation that message passing must go through first-order neighbors. The new graph is then sparsified using a top-k approach. Based on entropy information, regularization is employed to ensure the uncertainty of OOD nodes, thereby giving these nodes higher scores and enabling the model to effectively detect OOD nodes while ensuring the accuracy of in-distribution node classification. Experimental results demonstrate that the HOOD model outperforms existing methods in both node classification and OOD detection tasks on multiple benchmarks, highlighting its robustness and effectiveness.
引用
收藏
页数:16
相关论文
共 30 条
  • [1] Charpentier Bertrand, 2021, ADV NEUR IN, V34
  • [2] PME: Projected Metric Embedding on Heterogeneous Networks for Link Prediction
    Chen, Hongxu
    Yin, Hongzhi
    Wang, Weiqing
    Wang, Hao
    Quoc Viet Hung Nguyen
    Li, Xue
    [J]. KDD'18: PROCEEDINGS OF THE 24TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2018, : 1177 - 1186
  • [3] Dai EY, 2023, Arxiv, DOI [arXiv:2204.08570, 10.48550/arXiv.2204.08570, DOI 10.48550/ARXIV.2204.08570]
  • [4] Graph Learning: A Survey
    Xia F.
    Sun K.
    Yu S.
    Aziz A.
    Wan L.
    Pan S.
    Liu H.
    [J]. IEEE Transactions on Artificial Intelligence, 2021, 2 (02): : 109 - 127
  • [5] Gasteiger J., 2019, Adv. Neural Inf. Process. Syst, V32, DOI [10.48550/arXiv.1706.02216, DOI 10.48550/ARXIV.1706.02216]
  • [6] Hamilton WL, 2017, ADV NEUR IN, V30
  • [7] A Causality-Aligned Structure Rationalization Scheme Against Adversarial Biased Perturbations for Graph Neural Networks
    Jia, Ju
    Ma, Siqi
    Liu, Yang
    Wang, Lina
    Deng, Robert H.
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 : 59 - 73
  • [8] Ju W, 2024, Arxiv, DOI [arXiv:2403.04468, 10.48550/arXiv.2403.04468]
  • [9] Kondor R. I., 2002, P 19 INT C MACH LEAR, P315
  • [10] Diffusion maps and coarse-graining: A unified framework for dimensionality reduction, graph partitioning, and data set parameterization
    Lafon, Stephane
    Lee, Ann B.
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2006, 28 (09) : 1393 - 1403