Deep supervised hashing with hard example pairs optimization for image retrieval

被引:3
作者
Su, Hai [1 ]
Han, Meiyin [1 ]
Liang, Junle [2 ]
Liang, Jun [1 ]
Yu, Songsen [1 ]
机构
[1] South China Normal Univ, Sch Software, Taoyuan East Rd, Foshan 528225, Guangdong, Peoples R China
[2] Syracuse Univ, Coll Engn & Comp Sci, South Crouse Ave, Syracuse, NY 13255 USA
关键词
Image retrieval; Deep hashing; Hard example pairs;
D O I
10.1007/s00371-022-02668-y
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Compared with the traditional hashing methods, deep hashing methods generate hash codes with rich semantic information and greatly improve the performances in the image retrieval field. However, it is unsatisfied for current deep hashing methods to predict the similarity of hard example pairs. There exist two main factors affecting the ability of learning these pairs, which are weak key features extraction and the shortage of hard example pairs. In this paper, we give a novel end-to-end model to extract the key feature and obtain hash code with the accurate semantic information. In addition, we redesign an indicator to assess the hard degree of pairs and update penalty weights of them in the proposed hard pair-wise loss. It effectively alleviates the shortage problem. Experimental results on CIFAR-10 and NUS-WIDE demonstrate that our model outperformances the mainstream hashing-based image retrieval methods.
引用
收藏
页码:5405 / 5420
页数:16
相关论文
共 60 条
[1]  
[Anonymous], 2011, P 28 INT C MACH LEAR
[2]   DSHPoolF: deep supervised hashing based on selective pool feature map for image retrieval [J].
Arulmozhi, P. ;
Abirami, S. .
VISUAL COMPUTER, 2021, 37 (08) :2391-2405
[3]   Airport Detection Using End-to-End Convolutional Neural Network with Hard Example Mining [J].
Cai, Bowen ;
Jiang, Zhiguo ;
Zhang, Haopeng ;
Zhao, Danpei ;
Yao, Yuan .
REMOTE SENSING, 2017, 9 (11)
[4]   Deep Cauchy Hashing for Hamming Space Retrieval [J].
Cao, Yue ;
Long, Mingsheng ;
Liu, Bin ;
Wang, Jianmin .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :1229-1237
[5]   HashNet: Deep Learning to Hash by Continuation [J].
Cao, Zhangjie ;
Long, Mingsheng ;
Wang, Jianmin ;
Yu, Philip S. .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :5609-5618
[6]   CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification [J].
Chen, Chun-Fu ;
Fan, Quanfu ;
Panda, Rameswar .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :347-356
[7]   Class-discriminative focal loss for extreme imbalanced multiclass object detection towards autonomous driving [J].
Chen, Guancheng ;
Qin, Huabiao .
VISUAL COMPUTER, 2022, 38 (03) :1051-1063
[8]   Deep discrete hashing with pairwise correlation learning [J].
Chen, Yaxiong ;
Lu, Xiaoqiang .
NEUROCOMPUTING, 2020, 385 :111-121
[9]   Object Detection Based on Mult-Layer Convolution Feature Fusion and Online Hard Example Mining [J].
Chu, Jun ;
Guo, Zhixian ;
Leng, Lu .
IEEE ACCESS, 2018, 6 :19959-19967
[10]  
Ge J., 2019, ARXIV