Deep feature enhancing and selecting network for weakly supervised temporal action localization

被引:1
|
作者
Yu, Jiaruo [1 ]
Ge, Yongxin [1 ]
Qin, Xiaolei [1 ]
Li, Ziqiang [1 ]
Huang, Sheng [1 ]
Chen, Feiyu [2 ]
机构
[1] Chongqing Univ, Sch Big Data & Software Engn, Chongqing, Peoples R China
[2] Natl Ctr Appl Math Chongqing, Chongqing, Peoples R China
基金
中国国家自然科学基金;
关键词
Weakly supervised; Temporal action localization; Deep learning;
D O I
10.1016/j.jvcir.2021.103276
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Weakly supervised temporal action localization is a challenging computer vision problem that uses only video-level labels and lacks the supervision of temporal annotations. In this task, the majority of existing methods usually identify the most discriminative snippets and ignore other relevant snippets. To address this problem, we propose a deep feature enhancing and selecting network. It generates multiple masks for both capturing more complete temporal interval of actions and keeping its high classification accuracy. After that, we further propose a novel selection strategy to balance the influence of multiple masks and improve the model performance. In the experiments, we evaluate the proposed method on the THUMOS'14 and ActivityNet datasets, and the results show the effectiveness of our approach for weakly supervised temporal action localization.
引用
收藏
页数:8
相关论文
共 50 条
  • [31] Integration of Global and Local Knowledge for Foreground Enhancing in Weakly Supervised Temporal Action Localization
    Zhang, Tianyi
    Li, Ronglu
    Feng, Pengming
    Zhang, Rubo
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 8476 - 8487
  • [32] Weakly Supervised Temporal Action Localization by Multi-Stage Fusion Network
    Shen, Zhengyang
    Wang, Feng
    Dai, Jin
    IEEE ACCESS, 2020, 8 : 17287 - 17298
  • [33] Progressive enhancement network with pseudo labels for weakly supervised temporal action localization
    Wang, Qingyun
    Song, Yan
    Zou, Rong
    Shu, Xiangbo
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2022, 87
  • [34] Weakly-supervised Temporal Action Localization with Adaptive Clustering and Refining Network
    Ren, Hao
    Ran, Wu
    Liu, Xingson
    Ren, Haoran
    Lu, Hong
    Zhang, Rui
    Jin, Cheng
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 1008 - 1013
  • [35] Weakly Supervised Localization Using Deep Feature Maps
    Bency, Archith John
    Kwon, Heesung
    Lee, Hyungtae
    Karthikeyan, S.
    Manjunath, B. S.
    COMPUTER VISION - ECCV 2016, PT I, 2016, 9905 : 714 - 731
  • [36] Weakly-supervised temporal action localization: a survey
    AbdulRahman Baraka
    Mohd Halim Mohd Noor
    Neural Computing and Applications, 2022, 34 : 8479 - 8499
  • [37] Weakly-supervised temporal action localization: a survey
    Baraka, AbdulRahman
    Noor, Mohd Halim Mohd
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (11): : 8479 - 8499
  • [38] Two-Branch Relational Prototypical Network for Weakly Supervised Temporal Action Localization
    Huang, Linjiang
    Huang, Yan
    Ouyang, Wanli
    Wang, Liang
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (09) : 5729 - 5746
  • [39] GRAPH REGULARIZATION NETWORK WITH SEMANTIC AFFINITY FOR WEAKLY-SUPERVISED TEMPORAL ACTION LOCALIZATION
    Park, Jungin
    Lee, Jiyoung
    Jeon, Sangryul
    Kim, Seungryong
    Sohn, Kwanghoon
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 3701 - 3705
  • [40] Fusion detection network with discriminative enhancement for weakly-supervised temporal action localization
    Liu, Yuanyuan
    Zhu, Hong
    Ren, Haohao
    Shi, Jing
    Wang, Dong
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 238