Graph Convolutional Network Hashing

被引:120
作者
Zhou, Xiang [1 ,2 ]
Shen, Fumin [1 ,2 ]
Liu, Li [3 ]
Liu, Wei [4 ]
Nie, Liqiang [5 ]
Yang, Yang [1 ,2 ]
Shen, Heng Tao [1 ,2 ]
机构
[1] Univ Elect Sci & Technol China, Ctr Future Multimedia, Chengdu 610051, Peoples R China
[2] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu 610051, Peoples R China
[3] Incept Inst Artificial Intelligence, Abu Dhabi, U Arab Emirates
[4] Tencent AI Lab, Shenzhen 518057, Peoples R China
[5] Shandong Univ, Sch Comp Sci & Technol, Qingdao 266237, Peoples R China
基金
中国国家自然科学基金;
关键词
Binary codes; Convolutional codes; Semantics; Automatic generation control; Optimization; Training; Graph convolutional network (GCN); hashing; image retrieval; nearest neighbor search; IMAGE RETRIEVAL; REPRESENTATION; QUANTIZATION;
D O I
10.1109/TCYB.2018.2883970
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, graph-based hashing that learns similarity-preserving binary codes via an affinity graph has been extensively studied for large-scale image retrieval. However, most graph-based hashing methods resort to intractable binary quadratic programs, making them unscalable to massive data. In this paper, we propose a novel graph convolutional network-based hashing framework, dubbed GCNH, which directly carries out spectral convolution operations on both an image set and an affinity graph built over the set, naturally yielding similarity-preserving binary embedding. GCNH fundamentally differs from conventional graph hashing methods which adopt an affinity graph as the only learning guidance in an objective function to pursue the binary embedding. As the core ingredient of GCNH, we introduce an intuitive asymmetric graph convolutional (AGC) layer to simultaneously convolve the anchor graph, input data, and convolutional filters. By virtue of the AGC layer, GCNH well addresses the issues of scalability and out-of-sample extension when leveraging affinity graphs for hashing. As a use case of our GCNH, we particularly study the semisupervised hashing scenario in this paper. Comprehensive image retrieval evaluations on the CIFAR-10, NUS-WIDE, and ImageNet datasets demonstrate the consistent advantages of GCNH over the state-of-the-art methods given limited labeled data.
引用
收藏
页码:1460 / 1472
页数:13
相关论文
共 83 条
[11]   Histograms of oriented gradients for human detection [J].
Dalal, N ;
Triggs, B .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2005, :886-893
[12]  
Defferrard M, 2016, ADV NEUR IN, V29
[13]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[14]  
Gionis A, 1999, PROCEEDINGS OF THE TWENTY-FIFTH INTERNATIONAL CONFERENCE ON VERY LARGE DATA BASES, P518
[15]   Automatic Chemical Design Using a Data-Driven Continuous Representation of Molecules [J].
Gomez-Bombarelli, Rafael ;
Wei, Jennifer N. ;
Duvenaud, David ;
Hernandez-Lobato, Jose Miguel ;
Sanchez-Lengeling, Benjamin ;
Sheberla, Dennis ;
Aguilera-Iparraguirre, Jorge ;
Hirzel, Timothy D. ;
Adams, Ryan P. ;
Aspuru-Guzik, Alan .
ACS CENTRAL SCIENCE, 2018, 4 (02) :268-276
[16]  
Gong YC, 2011, PROC CVPR IEEE, P817, DOI 10.1109/CVPR.2011.5995432
[17]   Robust Quantization for General Similarity Search [J].
Guo, Yuchen ;
Ding, Guiguang ;
Han, Jungong .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (02) :949-963
[18]   Wavelets on graphs via spectral graph theory [J].
Hammond, David K. ;
Vandergheynst, Pierre ;
Gribonval, Remi .
APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2011, 30 (02) :129-150
[19]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[20]   Hashing as Tie-Aware Learning to Rank [J].
He, Kun ;
Cakir, Fatih ;
Bargal, Sarah Adel ;
Sclaroff, Stan .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :4023-4032