Correlation embedding semantic-enhanced hashing for multimedia retrieval

被引:0
作者
Chen, Yunfei [1 ]
Long, Yitian [2 ]
Yang, Zhan [1 ]
Long, Jun [1 ]
机构
[1] Cent South Univ, Big Data Inst, Sch Comp Sci & Engn, Changsha 410000, Hunan, Peoples R China
[2] Vanderbilt Univ, Data Sci Inst, Nashville, TN 37235 USA
基金
中国国家自然科学基金;
关键词
Multimedia retrieval; Semantic-enhanced similarity; Correlation embedding hashing; Semantic correlation information; RECONSTRUCTION;
D O I
10.1016/j.imavis.2025.105421
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to its feature extraction and information processing advantages, deep hashing has achieved significant success in multimedia retrieval. Currently, mainstream unsupervised multimedia hashing methods do not incorporate associative relationship information as part of the original features in generating hash codes, and their similarity measurements do not consider the transitivity of similarity. To address these challenges, we propose the Correlation Embedding Semantic-Enhanced Hashing (CESEH) for multimedia retrieval, which primarily consists of a semantic-enhanced similarity construction module and a correlation embedding hashing module. First, the semantic-enhanced similarity construction module generates a semantically enriched similarity matrix by thoroughly exploring similarity adjacency relationships and deep semantic associations within the original data. Next, the correlation embedding hashing module integrates semantic-enhanced similarity information with intra-modal semantic information, achieves precise correlation embedding and preserves semantic information integrity. Extensive experiments on three widely-used datasets demonstrate that the CESEH method outperforms state-of-the-art unsupervised hashing methods in both retrieval accuracy and robustness. The code is available at https://github.com/YunfeiChenMY/CESEH.
引用
收藏
页数:11
相关论文
共 55 条
[1]  
[Anonymous], 2011, 22 INT JOINT C ART I, DOI DOI 10.5591/978-1-57735-516-8/IJCAI11-23
[2]  
[Anonymous], 2008, P 1 ACM INT C MULTIM
[3]   A new perceptual hashing method for verification and identity classification of occluded faces [J].
Biswas, Rubel ;
Gonzalez-Castro, Victor ;
Fidalgo, Eduardo ;
Alegre, Enrique .
IMAGE AND VISION COMPUTING, 2021, 113
[4]   Structure-aware contrastive hashing for unsupervised cross-modal retrieval [J].
Cui, Jinrong ;
He, Zhipeng ;
Huang, Qiong ;
Fu, Yulu ;
Li, Yuting ;
Wen, Jie .
NEURAL NETWORKS, 2024, 174
[5]   Collective Matrix Factorization Hashing for Multimodal Data [J].
Ding, Guiguang ;
Guo, Yuchen ;
Zhou, Jile .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :2083-2090
[6]   Deep attention sampling hashing for efficient image retrieval [J].
Feng, Hao ;
Wang, Nian ;
Zhao, Fa ;
Huo, Wei .
NEUROCOMPUTING, 2023, 559
[7]   Unsupervised Video Hashing with Multi-granularity Contextualization and Multi-structure Preservation [J].
Hao, Yanbin ;
Duan, Jingru ;
Zhang, Hao ;
Zhu, Bin ;
Zhou, Pengyuan ;
He, Xiangnan .
PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, :3754-3763
[8]   Deep Binary Reconstruction for Cross-Modal Hashing [J].
Hu, Di ;
Nie, Feiping ;
Li, Xuelong .
IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (04) :973-985
[9]   Unsupervised Contrastive Cross-Modal Hashing [J].
Hu, Peng ;
Zhu, Hongyuan ;
Lin, Jie ;
Peng, Dezhong ;
Zhao, Yin-Ping ;
Peng, Xi .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (03) :3877-3889
[10]   An optimized deep supervised hashing model for fast image retrieval [J].
Hussain, Abid ;
Li, Heng-Chao ;
Ali, Danish ;
Ali, Muqadar ;
Abbas, Fakhar ;
Hussain, Mehboob .
IMAGE AND VISION COMPUTING, 2023, 133