Efficient discrete cross-modal hashing with semantic correlations and similarity preserving

被引:6
|
作者
Yang, Fan [1 ]
Zhang, Qiaoxi [1 ]
Ma, Fumin [1 ]
Ding, Xiaojian [1 ]
Liu, Yufeng [1 ]
Tong, Deyu [1 ]
机构
[1] Nanjing Univ Finance & Econ, Coll Informat Engn, Nanjing 210023, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Cross-modal retrieval; Discrete optimization; Multi-modal; Matrix factorization; Supervised information; ROBUST; CODES;
D O I
10.1016/j.ins.2023.119222
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With its merits in query speed and memory footprint, hashing has elicited considerable monument in cross-media similarity retrieval applications. Many label-dependent supervised hashing methods have been proposed for similarity searching across modality boundaries. However, the current cross-modal hashing (CMH) works are subjected to severe information loss, and their performances may dramatically degrade because of the expensive costs of constructing affinity graphs, inadequate mining of label information, and disregarding label correlations. To facilitate these problems, we propose an Efficient Discrete Cross-Modal Hashing (EDCH) in which an asymmetric model is introduced, which not only conveys external semantic information via embedding high-order labels but also preserves internal modality attributes by introducing binary representations and common subspace. To fully use label semantic information, we integrate the semantic supervised intersection scheme and the category correlations embedding in a shallow framework. Moreover, we elaborately develop an efficient and effective discrete optimization strategy to learn binary representations and a novel mutual linear projection to strengthen the capability and effectiveness of hash functions. Comprehensive experiments are conducted on three representative datasets to evaluate our method. The results validated that our method achieved promising and competitive retrieval performance and surpasses several typical and cutting-edge approaches.
引用
收藏
页数:21
相关论文
共 50 条
  • [21] Discrete semantic embedding hashing for scalable cross-modal retrieval
    Liu, Junjie
    Fei, Lunke
    Jia, Wei
    Zhao, Shuping
    Wen, Jie
    Teng, Shaohua
    Zhang, Wei
    2021 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2021, : 1461 - 1467
  • [22] Discrete cross-modal hashing with relaxation and label semantic guidance
    Teng, Shaohua
    Huang, Wenbiao
    Wu, Naiqi
    Du, Guanglong
    Chen, Tongbao
    Zhang, Wei
    Teng, Luyao
    WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS, 2024, 27 (01):
  • [23] Fast Asymmetric and Discrete Cross-Modal Hashing With Semantic Consistency
    Teng, Shaohua
    Ning, Chengzhen
    Zhang, Wei
    Wu, NaiQi
    Zeng, Ying
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2023, 10 (02) : 577 - 589
  • [24] Discrete cross-modal hashing with relaxation and label semantic guidance
    Shaohua Teng
    Wenbiao Huang
    Naiqi Wu
    Guanglong Du
    Tongbao Chen
    Wei Zhang
    Luyao Teng
    World Wide Web, 2024, 27
  • [25] Discrete cross-modal hashing with relaxation and label semantic guidance
    Teng, Shaohua
    Huang, Wenbiao
    Wu, Naiqi
    Du, Guanglong
    Chen, Tongbao
    Zhang, Wei
    Teng, Luyao
    World Wide Web, 2024, 27 (01)
  • [26] Discrete Semantic Matrix Factorization Hashing for Cross-Modal Retrieval
    Qin, Jianyang
    Fei, Lunke
    Teng, Shaohua
    Zhang, Wei
    Liu, Dongning
    Zhao, Genping
    Yuan, Haoliang
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 1550 - 1557
  • [27] A Two-Step Cross-Modal Hashing by Exploiting Label Correlations and Preserving Similarity in Both Steps
    Chen, Zhen-Duo
    Wang, Yongxin
    Li, Hui-Qiong
    Luo, Xin
    Nie, Liqiang
    Xu, Xin-Shun
    PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 1694 - 1702
  • [28] Hashing for Cross-Modal Similarity Retrieval
    Liu, Yao
    Yuan, Yanhong
    Huang, Qiaoli
    Huang, Zhixing
    2015 11TH INTERNATIONAL CONFERENCE ON SEMANTICS, KNOWLEDGE AND GRIDS (SKG), 2015, : 1 - 8
  • [29] Asymmetric cross-modal hashing with high-level semantic similarity
    Yang, Fan
    Liu, Yufeng
    Ding, Xiaojian
    Ma, Fumin
    Cao, Jie
    PATTERN RECOGNITION, 2022, 130
  • [30] Asymmetric cross-modal hashing with high-level semantic similarity
    Yang, Fan
    Liu, Yufeng
    Ding, Xiaojian
    Ma, Fumin
    Cao, Jie
    PATTERN RECOGNITION, 2022, 130