Deep feature enhancing and selecting network for weakly supervised temporal action localization

被引:1
|
作者
Yu, Jiaruo [1 ]
Ge, Yongxin [1 ]
Qin, Xiaolei [1 ]
Li, Ziqiang [1 ]
Huang, Sheng [1 ]
Chen, Feiyu [2 ]
机构
[1] Chongqing Univ, Sch Big Data & Software Engn, Chongqing, Peoples R China
[2] Natl Ctr Appl Math Chongqing, Chongqing, Peoples R China
基金
中国国家自然科学基金;
关键词
Weakly supervised; Temporal action localization; Deep learning;
D O I
10.1016/j.jvcir.2021.103276
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Weakly supervised temporal action localization is a challenging computer vision problem that uses only video-level labels and lacks the supervision of temporal annotations. In this task, the majority of existing methods usually identify the most discriminative snippets and ignore other relevant snippets. To address this problem, we propose a deep feature enhancing and selecting network. It generates multiple masks for both capturing more complete temporal interval of actions and keeping its high classification accuracy. After that, we further propose a novel selection strategy to balance the influence of multiple masks and improve the model performance. In the experiments, we evaluate the proposed method on the THUMOS'14 and ActivityNet datasets, and the results show the effectiveness of our approach for weakly supervised temporal action localization.
引用
收藏
页数:8
相关论文
共 50 条
  • [41] Snippet-to-Prototype Contrastive Consensus Network for Weakly Supervised Temporal Action Localization
    Shao, Yuxiang
    Zhang, Feifei
    Xu, Changsheng
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 6717 - 6729
  • [42] Temporal RPN Learning for Weakly-Supervised Temporal Action Localization
    Huang, Jing
    Kong, Ming
    Chen, Luyuan
    Liang, Tian
    Zhu, Qiang
    ASIAN CONFERENCE ON MACHINE LEARNING, VOL 222, 2023, 222
  • [43] Multiple Temporal Pooling Mechanisms for Weakly Supervised Temporal Action Localization
    Dou, Peng
    Zeng, Ying
    Wang, Zhuoqun
    Hu, Haifeng
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2023, 19 (03)
  • [44] ACTION RELATIONAL GRAPH FOR WEAKLY-SUPERVISED TEMPORAL ACTION LOCALIZATION
    Cheng, Yi
    Sun, Ying
    Lin, Dongyun
    Lim, Joo-Hwee
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 2563 - 2567
  • [45] A Novel Action Saliency and Context-Aware Network for Weakly-Supervised Temporal Action Localization
    Zhao, Yibo
    Zhang, Hua
    Gao, Zan
    Gao, Wenjie
    Wang, Meng
    Chen, Shengyong
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 8253 - 8266
  • [46] Weakly-supervised Temporal Action Localization by Uncertainty Modeling
    Lee, Pilhyeon
    Wang, Jinglu
    Lu, Yan
    Byun, Hyeran
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 1854 - 1862
  • [47] Bilateral Relation Distillation for Weakly Supervised Temporal Action Localization
    Xu, Zhe
    Wei, Kun
    Yang, Erkun
    Deng, Cheng
    Liu, Wei
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (10) : 11458 - 11471
  • [48] Weakly Supervised Temporal Action Localization Based on Contrastive Learning
    Hou Y.
    Li Y.
    Guo Z.
    Tianjin Daxue Xuebao (Ziran Kexue yu Gongcheng Jishu Ban)/Journal of Tianjin University Science and Technology, 2023, 56 (01): : 73 - 80
  • [49] Weakly supervised temporal action localization with proxy metric modeling
    Hongsheng Xu
    Zihan Chen
    Yu Zhang
    Xin Geng
    Siya Mi
    Zhihong Yang
    Frontiers of Computer Science, 2023, 17
  • [50] Weakly supervised temporal action localization with proxy metric modeling
    XU Hongsheng
    CHEN Zihan
    ZHANG Yu
    GENG Xin
    MI Siya
    YANG Zhihong
    Frontiers of Computer Science, 2023, 17 (02)