Correlation embedding semantic-enhanced hashing for multimedia retrieval

被引:0
作者
Chen, Yunfei [1 ]
Long, Yitian [2 ]
Yang, Zhan [1 ]
Long, Jun [1 ]
机构
[1] Cent South Univ, Big Data Inst, Sch Comp Sci & Engn, Changsha 410000, Hunan, Peoples R China
[2] Vanderbilt Univ, Data Sci Inst, Nashville, TN 37235 USA
基金
中国国家自然科学基金;
关键词
Multimedia retrieval; Semantic-enhanced similarity; Correlation embedding hashing; Semantic correlation information; RECONSTRUCTION;
D O I
10.1016/j.imavis.2025.105421
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to its feature extraction and information processing advantages, deep hashing has achieved significant success in multimedia retrieval. Currently, mainstream unsupervised multimedia hashing methods do not incorporate associative relationship information as part of the original features in generating hash codes, and their similarity measurements do not consider the transitivity of similarity. To address these challenges, we propose the Correlation Embedding Semantic-Enhanced Hashing (CESEH) for multimedia retrieval, which primarily consists of a semantic-enhanced similarity construction module and a correlation embedding hashing module. First, the semantic-enhanced similarity construction module generates a semantically enriched similarity matrix by thoroughly exploring similarity adjacency relationships and deep semantic associations within the original data. Next, the correlation embedding hashing module integrates semantic-enhanced similarity information with intra-modal semantic information, achieves precise correlation embedding and preserves semantic information integrity. Extensive experiments on three widely-used datasets demonstrate that the CESEH method outperforms state-of-the-art unsupervised hashing methods in both retrieval accuracy and robustness. The code is available at https://github.com/YunfeiChenMY/CESEH.
引用
收藏
页数:11
相关论文
共 55 条
[31]   Unsupervised Hashing with Contrastive Learning by Exploiting Similarity Knowledge and Hidden Structure of Data [J].
Song, Zhenpeng ;
Su, Qinliang ;
Chen, Jiayang .
PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, :6350-6358
[32]   Deep Joint-Semantics Reconstructing Hashing for Large-Scale Unsupervised Cross-Modal Retrieval [J].
Su, Shupeng ;
Zhong, Zhisheng ;
Zhang, Chao .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :3027-3035
[33]   Learning From Expert: Vision-Language Knowledge Distillation for Unsupervised Cross-Modal Hashing Retrieval [J].
Sun, Lina ;
Li, Yewen ;
Dong, Yumin .
PROCEEDINGS OF THE 2023 ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2023, 2023, :499-507
[34]  
Tan J., 2024, IEEE Trans. Multimed., P1
[35]   Joint Specifics and Dual-Semantic Hashing Learning for Cross-Modal Retrieval [J].
Teng, Shaohua ;
Lin, Shengjie ;
Teng, Luyao ;
Wu, Naiqi ;
Zheng, Zefeng ;
Fei, Lunke ;
Zhang, Wei .
NEUROCOMPUTING, 2024, 565
[36]   Supervised adaptive similarity consistent latent representation hashing [J].
Wang, Hongbin ;
Chen, Rui ;
Shu, Zhenqiu ;
Zhang, Yafei ;
Li, Huafeng .
NEUROCOMPUTING, 2024, 570
[37]   Deep Hashing with Minimal-Distance-Separated Hash Centers [J].
Wang, Liangdao ;
Pan, Yan ;
Liu, Cong ;
Lai, Hanjiang ;
Yin, Jian ;
Liu, Ye .
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, :23455-23464
[38]   Unsupervised Hashing Retrieval via Efficient Correlation Distillation [J].
Xi, Zhang ;
Wang, Xiumei ;
Cheng, Peitao .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (07) :3529-3541
[39]   When CLIP meets cross-modal hashing retrieval: A new strong baseline [J].
Xia, Xinyu ;
Dong, Guohua ;
Li, Fengling ;
Zhu, Lei ;
Ying, Xiaomin .
INFORMATION FUSION, 2023, 100
[40]   Similarity Graph-correlation Reconstruction Network for unsupervised cross-modal hashing [J].
Yao, Dan ;
Li, Zhixin ;
Li, Bo ;
Zhang, Canlong ;
Ma, Huifang .
EXPERT SYSTEMS WITH APPLICATIONS, 2024, 237