Fine-grained similarity semantic preserving deep hashing for cross-modal retrieval

被引:0
|
作者
Li, Guoyou [1 ]
Peng, Qingjun [2 ]
Zou, Dexu [2 ]
Yang, Jinyue [2 ]
Shu, Zhenqiu [3 ]
机构
[1] Yunnan Power Grid Corp, Kunming, Peoples R China
[2] Yunnan Power Grid Corp, Elect Power Res Inst, Kunming, Peoples R China
[3] Kunming Univ Sci & Technol, Fac Informat Engn & Automat, Kunming, Peoples R China
基金
中国国家自然科学基金;
关键词
cross-modal fusion; similarity semantic preserving; quantization loss; deep hashing; intra-modal similarity; inter-modal similarity; fine-grained similarity; NETWORK;
D O I
10.3389/fphy.2023.1194573
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
Cross-modal hashing methods have received wide attention in cross-modal retrieval owing to their advantages in computational efficiency and storage cost. However, most existing deep cross-modal hashing methods cannot employ both intra-modal and inter-modal similarities to guide the learning of hash codes and ignore the quantization loss of hash codes, simultaneously. To solve the above problems, we propose a fine-grained similarity semantic preserving deep hashing (FSSPDH) for cross-modal retrieval. Firstly, this proposed method learns different hash codes for different modalities to preserve the intrinsic property of each modality. Secondly, the fine-grained similarity matrix is constructed by using labels and data features, which not only maintains the similarity between and within modalities. In addition, quantization loss is used to learn hash codes and thus effectively reduce information loss caused during the quantization procedure. A large number of experiments on three public datasets demonstrate the advantage of the proposed FSSPDH method.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Deep cross-modal hashing with fine-grained similarity
    Yangdong Chen
    Jiaqi Quan
    Yuejie Zhang
    Rui Feng
    Tao Zhang
    Applied Intelligence, 2023, 53 : 28954 - 28973
  • [2] Deep cross-modal hashing with fine-grained similarity
    Chen, Yangdong
    Quan, Jiaqi
    Zhang, Yuejie
    Feng, Rui
    Zhang, Tao
    APPLIED INTELLIGENCE, 2023, 53 (23) : 28954 - 28973
  • [3] Deep Self-Supervised Hashing With Fine-Grained Similarity Mining for Cross-Modal Retrieval
    Han, Lijun
    Wang, Renlin
    Chen, Chunlei
    Zhang, Huihui
    Zhang, Yujie
    Zhang, Wenfeng
    IEEE ACCESS, 2024, 12 : 31756 - 31770
  • [4] Deep Multiscale Fine-Grained Hashing for Remote Sensing Cross-Modal Retrieval
    Huang, Jiaxiang
    Feng, Yong
    Zhou, Mingliang
    Xiong, Xiancai
    Wang, Yongheng
    Qiang, Baohua
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [5] Deep semantic similarity adversarial hashing for cross-modal retrieval
    Qiang, Haopeng
    Wan, Yuan
    Xiang, Lun
    Meng, Xiaojing
    NEUROCOMPUTING, 2020, 400 : 24 - 33
  • [6] Deep attentional fine-grained similarity network with adversarial learning for cross-modal retrieval
    Qingrong Cheng
    Xiaodong Gu
    Multimedia Tools and Applications, 2020, 79 : 31401 - 31428
  • [7] Deep attentional fine-grained similarity network with adversarial learning for cross-modal retrieval
    Cheng, Qingrong
    Gu, Xiaodong
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (41-42) : 31401 - 31428
  • [8] Generalized Semantic Preserving Hashing for Cross-Modal Retrieval
    Mandal, Devraj
    Chaudhury, Kunal N.
    Biswas, Soma
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (01) : 102 - 112
  • [9] Deep Semantic-Preserving Ordinal Hashing for Cross-Modal Similarity Search
    Jin, Lu
    Li, Kai
    Li, Zechao
    Xiao, Fu
    Qi, Guo-Jun
    Tang, Jinhui
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (05) : 1429 - 1440
  • [10] Deep Semantic-Preserving Reconstruction Hashing for Unsupervised Cross-Modal Retrieval
    Cheng, Shuli
    Wang, Liejun
    Du, Anyu
    ENTROPY, 2020, 22 (11) : 1 - 22