Efficient discrete cross-modal hashing with semantic correlations and similarity preserving

被引:6
|
作者
Yang, Fan [1 ]
Zhang, Qiaoxi [1 ]
Ma, Fumin [1 ]
Ding, Xiaojian [1 ]
Liu, Yufeng [1 ]
Tong, Deyu [1 ]
机构
[1] Nanjing Univ Finance & Econ, Coll Informat Engn, Nanjing 210023, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Cross-modal retrieval; Discrete optimization; Multi-modal; Matrix factorization; Supervised information; ROBUST; CODES;
D O I
10.1016/j.ins.2023.119222
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With its merits in query speed and memory footprint, hashing has elicited considerable monument in cross-media similarity retrieval applications. Many label-dependent supervised hashing methods have been proposed for similarity searching across modality boundaries. However, the current cross-modal hashing (CMH) works are subjected to severe information loss, and their performances may dramatically degrade because of the expensive costs of constructing affinity graphs, inadequate mining of label information, and disregarding label correlations. To facilitate these problems, we propose an Efficient Discrete Cross-Modal Hashing (EDCH) in which an asymmetric model is introduced, which not only conveys external semantic information via embedding high-order labels but also preserves internal modality attributes by introducing binary representations and common subspace. To fully use label semantic information, we integrate the semantic supervised intersection scheme and the category correlations embedding in a shallow framework. Moreover, we elaborately develop an efficient and effective discrete optimization strategy to learn binary representations and a novel mutual linear projection to strengthen the capability and effectiveness of hash functions. Comprehensive experiments are conducted on three representative datasets to evaluate our method. The results validated that our method achieved promising and competitive retrieval performance and surpasses several typical and cutting-edge approaches.
引用
收藏
页数:21
相关论文
共 50 条
  • [31] Semantic deep cross-modal hashing
    Lin, Qiubin
    Cao, Wenming
    He, Zhihai
    He, Zhiquan
    NEUROCOMPUTING, 2020, 396 (396) : 113 - 122
  • [32] Semantic Boosting Cross-Modal Hashing for efficient multimedia retrieval
    Wang, Ke
    Tang, Jun
    Wang, Nian
    Shao, Ling
    INFORMATION SCIENCES, 2016, 330 : 199 - 210
  • [33] Category correlations embedded semantic centers hashing for cross-modal retrieval
    Fan, Wentao
    Yang, Chenwen
    Luo, Kaiyi
    Zhang, Min
    Li, Huaxiong
    INFORMATION SCIENCES, 2024, 683
  • [34] Deep Cross-modal Hashing Based on Intra-modal Similarity and Semantic Preservation
    Li T.
    Liu L.
    Data Analysis and Knowledge Discovery, 2023, 7 (05) : 105 - 115
  • [35] Asymmetric Discrete Cross-Modal Hashing
    Luo, Xin
    Zhang, Peng-Fei
    Wu, Ye
    Chen, Zhen-Duo
    Huang, Hua-Junjie
    Xu, Xin-Shun
    ICMR '18: PROCEEDINGS OF THE 2018 ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, 2018, : 204 - 212
  • [36] Latent semantic-enhanced discrete hashing for cross-modal retrieval
    Yun Liu
    Shujuan Ji
    Qiang Fu
    Jianli Zhao
    Zhongying Zhao
    Maoguo Gong
    Applied Intelligence, 2022, 52 : 16004 - 16020
  • [37] Latent semantic-enhanced discrete hashing for cross-modal retrieval
    Liu, Yun
    Ji, Shujuan
    Fu, Qiang
    Zhao, Jianli
    Zhao, Zhongying
    Gong, Maoguo
    APPLIED INTELLIGENCE, 2022, 52 (14) : 16004 - 16020
  • [38] Fast Discrete Cross-modal Hashing With Regressing From Semantic Labels
    Liu, Xingbo
    Nie, Xiushan
    Zeng, Wenjun
    Cui, Chaoran
    Zhu, Lei
    Yin, Yilong
    PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 1662 - 1669
  • [39] Discrete online cross-modal hashing
    Zhan, Yu-Wei
    Wang, Yongxin
    Sun, Yu
    Wu, Xiao-Ming
    Luo, Xin
    Xu, Xin-Shun
    PATTERN RECOGNITION, 2022, 122
  • [40] Two-Stage Asymmetric Similarity Preserving Hashing for Cross-Modal Retrieval
    Huang, Junfan
    Kang, Peipei
    Han, Na
    Chen, Yonghao
    Fang, Xiaozhao
    Gao, Hongbo
    Zhou, Guoxu
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (01) : 429 - 444