Distributed Graph Hashing

被引:21
作者
Wang, Shengnan [1 ,2 ]
Li, Chunguang [1 ,2 ]
Shen, Hui-Liang [1 ,2 ]
机构
[1] Zhejiang Univ, Coll Informat Sci & Elect Engn, Hangzhou 310027, Zhejiang, Peoples R China
[2] Zhejiang Univ, Zhejiang Prov Key Lab Informat Proc Commun & Netw, Hangzhou 310027, Zhejiang, Peoples R China
基金
中国国家自然科学基金;
关键词
Alternating direction method of multipliers (ADMMs); distributed hashing; graph hashing; large-scale image retrieval; learning to hash (LH); ITERATIVE QUANTIZATION; PROCRUSTEAN APPROACH; BIG DATA; RETRIEVAL; SEARCH;
D O I
10.1109/TCYB.2018.2816791
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, hashing-based approximate nearest neighbors search has attracted considerable attention, especially in big data applications, due to its low computation cost and fast retrieval speed. In the literature, most of the existing hashing algorithms are centralized. However, in many large-scale applications, the data are often stored or collected in a distributed manner. In this situation, the centralized hashing methods are not suitable for learning hash functions. In this paper, we consider the distributed learning to hash problem. We propose a novel distributed graph hashing model for learning efficient hash functions based on the data distributed across multiple agents over network. The graph hashing model involves a graph matrix, which contains the similarity information in the original space. We show that the graph matrix in the proposed distributed hashing model can be decomposed into multiple local graph matrices, and each local graph matrix can be constructed by a specific agent independently, with moderate communication and computation cost. Then, the whole objective function of the distributed hashing model can be represented by the sum of local objective functions of multiple agents, and the hashing problem can be formulated as a nonconvex constrained distributed optimization problem. For tractability, we transform the nonconvex constrained distributed optimization problem into an equivalent bi-convex distributed optimization problem. Then we propose two algorithms based on the idea of alternating direction method of multipliers to solve this problem in a distributed manner. We show that the proposed two algorithms have moderate communication and computational complexities, and both of them are scalable. Experiments on benchmark datasets are given to demonstrate the effectiveness of the proposed methods.
引用
收藏
页码:1896 / 1908
页数:13
相关论文
共 55 条
[1]  
[Anonymous], 2016, PROC CVPR IEEE, DOI DOI 10.1109/CVPR.2016.553
[2]   Distributed optimization and statistical learning via the alternating direction method of multipliers [J].
Boyd S. ;
Parikh N. ;
Chu E. ;
Peleato B. ;
Eckstein J. .
Foundations and Trends in Machine Learning, 2010, 3 (01) :1-122
[3]   Distributed model predictive control [J].
Camponogara, Eduardo ;
Jia, Dong ;
Krogh, Bruce H. ;
Talukdar, Sarosh .
IEEE Control Systems Magazine, 2002, 22 (01) :44-52
[4]   Binary Hashing for Approximate Nearest Neighbor Search on Big Data: A Survey [J].
Cao, Yuan ;
Qi, Heng ;
Zhou, Wenrui ;
Kato, Jien ;
Li, Keqiu ;
Liu, Xiulong ;
Gui, Jie .
IEEE ACCESS, 2018, 6 :2039-2054
[5]   Spectral Embedded Hashing for Scalable Image Retrieval [J].
Chen, Lin ;
Xu, Dong ;
Tsang, Ivor Wai-Hung ;
Li, Xuelong .
IEEE TRANSACTIONS ON CYBERNETICS, 2014, 44 (07) :1180-1190
[6]   Adaptive Distributed Outlier Detection for WSNs [J].
De Paola, Alessandra ;
Gaglio, Salvatore ;
Lo Re, Giuseppe ;
Milazzo, Fabrizio ;
Ortolani, Marco .
IEEE TRANSACTIONS ON CYBERNETICS, 2015, 45 (05) :888-899
[7]   Discriminative Dictionary Learning With Common Label Alignment for Cross-Modal Retrieval [J].
Deng, Cheng ;
Tang, Xu ;
Yan, Junchi ;
Liu, Wei ;
Gao, Xinbo .
IEEE TRANSACTIONS ON MULTIMEDIA, 2016, 18 (02) :208-218
[8]  
Forero PA, 2010, J MACH LEARN RES, V11, P1663
[9]  
Gionis A, 1999, PROCEEDINGS OF THE TWENTY-FIFTH INTERNATIONAL CONFERENCE ON VERY LARGE DATA BASES, P518
[10]   Iterative Quantization: A Procrustean Approach to Learning Binary Codes for Large-Scale Image Retrieval [J].
Gong, Yunchao ;
Lazebnik, Svetlana ;
Gordo, Albert ;
Perronnin, Florent .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (12) :2916-2929