Position-aware and structure emb e dding networks for deep graph matching

被引:6
作者
Chen, Dongdong [1 ]
Dai, Yuxing [2 ]
Zhang, Lichi [1 ]
Zhang, Zhihong [2 ]
Hancock, Edwin R. [3 ]
机构
[1] Shanghai Jiao Tong Univ, Shanghai 20030, Peoples R China
[2] Xiamen Univ, Xiamen 361005, Fujian, Peoples R China
[3] Univ York, York YO10 5DD, England
关键词
Graph Matching; Graph Embedding; Deep Neural Network;
D O I
10.1016/j.patcog.2022.109242
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Graph matching refers to the process of establishing node correspondences based on edge-to-edge con-straints between graph nodes. This can be formulated as a combinatorial optimization problem under node permutation and pairwise consistency constraints. The main challenge of graph matching is to ef-fectively find the correct match while reducing the ambiguities produced by similar nodes and edges. In this paper, we present a novel end-to-end neural framework that converts graph matching to a linear assignment problem in a high-dimensional space. This is combined with relative position information at the node level, and high-order structural arrangement information at the subgraph level. By capturing the relative position attributes of nodes between different graphs and the subgraph structural arrangement attributes, we can improve the performance of graph matching tasks, and establish reliable node-to-node correspondences. Our method can be generalized to any graph embedding setting, which can be used as components to deal with various graph matching problems answered with deep learning methods. We validate our method on several real-world tasks, by providing ablation studies to evaluate the generaliza-tion capability across different categories. We also compare state-of-the-art alternatives to demonstrate performance.(c) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:15
相关论文
共 40 条
[1]  
[Anonymous], 2010, International journal of computer vision, DOI DOI 10.1007/s11263-009-0275-4
[2]   On Weisfeiler-Leman invariance: Subgraph counts and related graph properties [J].
Arvind, V. ;
Fuhlbrueck, Frank ;
Koebler, Johannes ;
Verbitsky, Oleg .
JOURNAL OF COMPUTER AND SYSTEM SCIENCES, 2020, 113 :42-59
[3]   Efficient matching and indexing of graph models in content-based retrieval [J].
Berretti, S ;
Del Bimbo, A ;
Vicario, E .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2001, 23 (10) :1089-1105
[4]  
Burger W., 2022, Digital Image Processing: An Algorithmic Introduction, P709
[5]   Learning Graph Matching [J].
Caetano, Tiberio S. ;
McAuley, Julian J. ;
Cheng, Li ;
Le, Quoc V. ;
Smola, Alex J. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2009, 31 (06) :1048-1058
[6]   Deep feature augmentation for occluded image classification [J].
Cen, Feng ;
Zhao, Xiaoyu ;
Li, Wuzhuang ;
Wang, Guanghui .
PATTERN RECOGNITION, 2021, 111
[7]   Cross-modal Graph Matching Network for Image-text Retrieval [J].
Cheng, Yuhao ;
Zhu, Xiaoguang ;
Qian, Jiuchao ;
Wen, Fei ;
Liu, Peilin .
ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2022, 18 (04)
[8]   Learning Graphs to Match [J].
Cho, Minsu ;
Alahari, Karteek ;
Ponce, Jean .
2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, :25-32
[9]  
Defferrard M, 2016, ADV NEUR IN, V29
[10]   A Method for Improving CNN-Based Image Recognition Using DCGAN [J].
Fang, Wei ;
Zhang, Feihong ;
Sheng, Victor S. ;
Ding, Yewen .
CMC-COMPUTERS MATERIALS & CONTINUA, 2018, 57 (01) :167-178