A realistic model extraction attack against graph neural networks

被引:2
作者
Guan, Faqian [1 ]
Zhu, Tianqing [2 ]
Tong, Hanjin [1 ]
Zhou, Wanlei [2 ]
机构
[1] China Univ Geosci Wuhan, Sch Comp Sci, Wuhan 430074, Hubei, Peoples R China
[2] City Univ Macau, Fac Data Sci, Macau 999078, Peoples R China
关键词
Black-box; Fewer queries; Graph neural networks; Incorrect labels; Model extraction attack;
D O I
10.1016/j.knosys.2024.112144
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Model extraction attacks are considered to be a significant avenue of vulnerability in machine learning. In model extraction attacks, the attacker repeatedly queries a victim model so as to train a surrogate model that can mimic the output of the victim model. Graph neural networks (GNNs), which are designed to process graph data, were previously thought to be less sensitive to such attacks. This is because, in black -box settings, attackers only have limited access to the victim model. Also, the number of queries any one user can make within a given time window is usually restricted and within this finite number of responses some of the information may contain errors. Yet training a useful surrogate model not only requires a substantial number of queries, but incorrect node labels appearing in the victim GNN's responses is highly problematic. However, in this paper, we demonstrate that GNNs may have a similar vulnerability to model extraction attacks as a normal machine learning model. Our proposed method of extraction addresses the issue of incorrect node labels while also significantly reducing the number of required queries required to train a well -performing model. With this method, GNN extraction attacks are actually highly practical in the real world. Specifically, our proposed methodology incorporates an edge prediction module that introduces potential edges into the original graph data. This module links incorrectly labeled nodes with more accurately labeled ones, thereby mitigating the impact of incorrect labels. And, by increasing the number of possible edges, our approach enables the surrogate model to better leverage the graph's structure, enhancing the contribution of the labeled nodes and allowing the model extraction attack to be executed with fewer queries. Our experiments demonstrate a significant performance improvement over existing approaches, especially in a black -box setting. As such, this research shows that GNNs are also vulnerable to model extraction attacks in real -world scenarios.
引用
收藏
页数:14
相关论文
共 44 条
  • [1] Graph Neural Networks With Convolutional ARMA Filters
    Bianchi, Filippo Maria
    Grattarola, Daniele
    Livi, Lorenzo
    Alippi, Cesare
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (07) : 3496 - 3507
  • [2] KGTN: Knowledge Graph Transformer Network for explainable multi-category item recommendation
    Chang, Chao
    Zhou, Junming
    Weng, Yu
    Zeng, Xiangwei
    Wu, Zhengyang
    Wang, Chang-Dong
    Tang, Yong
    [J]. KNOWLEDGE-BASED SYSTEMS, 2023, 278
  • [3] Chen W., 2021, GLSVLSI 21, P21
  • [4] D- DAE: Defense-Penetrating Model Extraction Attacks
    Chen, Yanjiao
    Guan, Rui
    Gong, Xueluan
    Dong, Jianshuo
    Xue, Meng
    [J]. 2023 IEEE SYMPOSIUM ON SECURITY AND PRIVACY, SP, 2023, : 382 - 399
  • [5] NRGNN: Learning a Label Noise-Resistant Graph Neural Network on Sparsely and Noisily Labeled Graphs
    Dai, Enyan
    Aggarwal, Charu
    Wang, Suhang
    [J]. KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, : 227 - 236
  • [6] DeFazio David, 2019, arXiv
  • [7] Graph Neural Networks for Social Recommendation
    Fan, Wenqi
    Ma, Yao
    Li, Qing
    He, Yuan
    Zhao, Eric
    Tang, Jiliang
    Yin, Dawei
    [J]. WEB CONFERENCE 2019: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2019), 2019, : 417 - 426
  • [8] Fredrikson M, 2014, PROCEEDINGS OF THE 23RD USENIX SECURITY SYMPOSIUM, P17
  • [9] Trustworthiness-aware knowledge graph representation for recommendation
    Ge, Yan
    Ma, Jun
    Zhang, Li
    Li, Xiang
    Lu, Haiping
    [J]. KNOWLEDGE-BASED SYSTEMS, 2023, 278
  • [10] Gilmer J, 2017, PR MACH LEARN RES, V70