Deep multi-query video retrieval

被引:0
|
作者
Akbacak E. [1 ]
Vural C. [2 ]
机构
[1] Engineering Faculty, Computer Engineering, Haliç University, Güzeltepe Mahallesi, 15 Temmuz Şehitler Caddesi, Eyüp/Istanbul
[2] Engineering Faculty, Department of Electrical and Electronics Engineering, Marmara University, Aydinevler Mah., Maltepe/Istanbul
关键词
Multi-query video retrieval; Pareto optimization; Video hashing;
D O I
10.1016/j.jvcir.2022.103501
中图分类号
学科分类号
摘要
Video retrieval methods have been developed for a single query. Multi-query video retrieval problem has not been investigated yet. In this study, an efficient and fast multi-query video retrieval framework is developed. Query videos are assumed to be related to more than one semantic. The framework supports an arbitrary number of video queries. The method is built upon using binary video hash codes. As a result, it is fast and requires a lower storage space. Database and query hash codes are generated by a deep hashing method that not only generates hash codes but also predicts query labels when they are chosen outside the database. The retrieval is based on the Pareto front multi-objective optimization method. Re-ranking performed on the retrieved videos by using non-binary deep features increases the retrieval accuracy considerably. Simulations carried out on two multi-label video databases show that the proposed method is efficient and fast in terms of retrieval accuracy and time. © 2022 Elsevier Inc.
引用
收藏
相关论文
共 50 条
  • [1] Multi-query Video Retrieval
    Wang, Zeyu
    Wu, Yu
    Narasimhan, Karthik
    Russakovsky, Olga
    COMPUTER VISION - ECCV 2022, PT XIV, 2022, 13674 : 233 - 249
  • [2] Multi-Query Video Retrieval Based on Deep Learning and Pareto Optimality
    Vural, Cabir
    Akbacak, Enver
    2020 28TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2020,
  • [3] Multi-Query Image Retrieval Based on Deep Learning and Pareto Optimality
    Vural, Cabir
    Akbacak, Enver
    2020 28TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2020,
  • [4] Effective Multi-Query Expansions: Collaborative Deep Networks for Robust Landmark Retrieval
    Wang, Yang
    Lin, Xuemin
    Wu, Lin
    Zhang, Wenjie
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (03) : 1393 - 1404
  • [5] Hierarchical matching and reasoning for multi-query image retrieval
    Ji, Zhong
    Li, Zhihao
    Zhang, Yan
    Wang, Haoran
    Pang, Yanwei
    Li, Xuelong
    NEURAL NETWORKS, 2024, 173
  • [6] Multi-Query Parallel Field Ranking for image retrieval
    Yang, Ji
    Xu, Bin
    Lin, Binbin
    He, Xiaofei
    NEUROCOMPUTING, 2014, 135 : 192 - 202
  • [7] Effective Multi-Query Expansions: Robust Landmark Retrieval
    Wang, Yang
    Lin, Xuemin
    Wu, Lin
    Zhang, Wenjie
    MM'15: PROCEEDINGS OF THE 2015 ACM MULTIMEDIA CONFERENCE, 2015, : 79 - 88
  • [8] Multi-Query Image Retrieval using CNN and SIFT Features
    Huang, Shiuan
    Hang, Hsueh-Ming
    2017 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC 2017), 2017, : 1026 - 1034
  • [9] Interest point selection by topology coherence for multi-query image retrieval
    Xiaomeng Wu
    Kunio Kashino
    Multimedia Tools and Applications, 2015, 74 : 7147 - 7180
  • [10] Modeling Multi-query Retrieval Tasks Using Density Matrix Transformation
    Li, Qiuchi
    Li, Jingfei
    Zhang, Peng
    Song, Dawei
    SIGIR 2015: PROCEEDINGS OF THE 38TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2015, : 871 - 874