Deep feature enhancing and selecting network for weakly supervised temporal action localization

被引:1
|
作者
Yu, Jiaruo [1 ]
Ge, Yongxin [1 ]
Qin, Xiaolei [1 ]
Li, Ziqiang [1 ]
Huang, Sheng [1 ]
Chen, Feiyu [2 ]
机构
[1] Chongqing Univ, Sch Big Data & Software Engn, Chongqing, Peoples R China
[2] Natl Ctr Appl Math Chongqing, Chongqing, Peoples R China
基金
中国国家自然科学基金;
关键词
Weakly supervised; Temporal action localization; Deep learning;
D O I
10.1016/j.jvcir.2021.103276
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Weakly supervised temporal action localization is a challenging computer vision problem that uses only video-level labels and lacks the supervision of temporal annotations. In this task, the majority of existing methods usually identify the most discriminative snippets and ignore other relevant snippets. To address this problem, we propose a deep feature enhancing and selecting network. It generates multiple masks for both capturing more complete temporal interval of actions and keeping its high classification accuracy. After that, we further propose a novel selection strategy to balance the influence of multiple masks and improve the model performance. In the experiments, we evaluate the proposed method on the THUMOS'14 and ActivityNet datasets, and the results show the effectiveness of our approach for weakly supervised temporal action localization.
引用
收藏
页数:8
相关论文
共 50 条
  • [21] Background Suppression Network for Weakly-Supervised Temporal Action Localization
    Lee, Pilhyeon
    Uh, Youngjung
    Byun, Hyeran
    THIRTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THE THIRTY-SECOND INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE AND THE TENTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 34 : 11320 - 11327
  • [22] Cascaded Pyramid Mining Network for Weakly Supervised Temporal Action Localization
    Su, Haisheng
    Zhao, Xu
    Lin, Tianwei
    COMPUTER VISION - ACCV 2018, PT II, 2019, 11362 : 558 - 574
  • [23] Weakly supervised temporal action localization: a survey
    Li, Ronglu
    Zhang, Tianyi
    Zhang, Rubo
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (32) : 78361 - 78386
  • [24] Temporal Dropout for Weakly Supervised Action Localization
    Xie, Chi
    Zhuang, Zikun
    Zhao, Shengjie
    Liang, Shuang
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2023, 19 (03)
  • [25] Action Shuffling for Weakly Supervised Temporal Localization
    Zhang, Xiao-Yu
    Shi, Haichao
    Li, Changsheng
    Shi, Xinchu
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 4447 - 4457
  • [26] ACGNet: Action Complement Graph Network for Weakly-Supervised Temporal Action Localization
    Yang, Zichen
    Qin, Jie
    Huang, Di
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 3090 - 3098
  • [27] Collaborative Foreground, Background, and Action Modeling Network for Weakly Supervised Temporal Action Localization
    Moniruzzaman, Md.
    Yin, Zhaozheng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (11) : 6939 - 6951
  • [28] ACSNet: Action-Context Separation Network for Weakly Supervised Temporal Action Localization
    Liu, Ziyi
    Wang, Le
    Zhang, Qilin
    Tang, Wei
    Yuan, Junsong
    Zheng, Nanning
    Hua, Gang
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 2233 - 2241
  • [29] PFWNet: Pretraining neural network via feature jigsaw puzzle for weakly-supervised temporal action localization
    Wang, Binglu
    Zhao, Yongqiang
    Zhang, Yani
    NEUROCOMPUTING, 2021, 443 : 162 - 173
  • [30] Weakly-Supervised Temporal Action Localization by Inferring Salient Snippet-Feature
    Yun, Wulian
    Qi, Mengshi
    Wang, Chuanming
    Ma, Huadong
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 7, 2024, : 6908 - 6916