Accelerating temporal action proposal generation via high performance computing

被引:0
|
作者
Tian Wang
Shiye Lei
Youyou Jiang
Choi Chang
Hichem Snoussi
Guangcun Shan
Yao Fu
机构
[1] Beihang University,Institute of Artificial Intelligence
[2] Beihang University,School of Automation Science and Electrical Engineering
[3] Tsinghua University,School of Software
[4] Gachon University,Department of Computer Engineering
[5] University of Technology of Troyes,Institute Charles Delaunay
[6] Beihang University,LM2S FRE CNRS 2019
[7] Chinese Academy of Sciences,School of Instrumentation Science and Opto
来源
Frontiers of Computer Science | 2022年 / 16卷
关键词
temporal convolution; temporal action proposal eneration; deep learning;
D O I
暂无
中图分类号
学科分类号
摘要
Temporal action proposal generation aims to output the starting and ending times of each potential action for long videos and often suffers from high computation cost. To address the issue, we propose a new temporal convolution network called Multipath Temporal ConvNet (MTCN). In our work, one novel high performance ring parallel architecture based is further introduced into temporal action proposal generation in order to respond to the requirements of large memory occupation and a large number of videos. Remarkably, the total data transmission is reduced by adding a connection between multiple-computing load in the newly developed architecture. Compared to the traditional Parameter Server architecture, our parallel architecture has higher efficiency on temporal action detection tasks with multiple GPUs. We conduct experiments on ActivityNet-1.3 and THUMOS14, where our method outperforms-other state-of-art temporal action detection methods with high recall and high temporal precision. In addition, a time metric is further proposed here to evaluate the speed performancein the distributed training process.
引用
收藏
相关论文
共 50 条
  • [1] Accelerating temporal action proposal generation via high performance computing
    Wang, Tian
    Lei, Shiye
    Jiang, Youyou
    Chang, Choi
    Snoussi, Hichem
    Shan, Guangcun
    Fu, Yao
    FRONTIERS OF COMPUTER SCIENCE, 2022, 16 (04)
  • [2] Accelerating temporal action proposal generation via high performance computing
    Tian WANG
    Shiye LEI
    Youyou JIANG
    Choi CHANG
    Hichem SNOUSSI
    Guangcun SHAN
    Yao FU
    Frontiers of Computer Science, 2022, 16 (04) : 61 - 70
  • [3] TEMPORAL ACTION PROPOSAL GENERATION VIA DEEP FEATURE ENHANCEMENT
    Hsieh, He-Yen
    Chen, Ding-Jie
    Liu, Tyng-Luh
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 1391 - 1395
  • [4] Cascaded Boundary Network for High-Quality Temporal Action Proposal Generation
    Xu, Liang
    Wang, Xinggang
    Liu, Wenyu
    Feng, Bin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (10) : 3702 - 3713
  • [5] BSN: Boundary Sensitive Network for Temporal Action Proposal Generation
    Lin, Tianwei
    Zhao, Xu
    Su, Haisheng
    Wang, Chongjing
    Yang, Ming
    COMPUTER VISION - ECCV 2018, PT IV, 2018, 11208 : 3 - 21
  • [6] Joint Learning of Local and Global Context for Temporal Action Proposal Generation
    Lin, Tianwei
    Zhao, Xu
    Su, Haisheng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (12) : 4899 - 4912
  • [7] Detecting action tubes via spatial action estimation and temporal path inference
    Li, Nannan
    Huang, Jingjia
    Li, Thomas
    Guo, Huiwen
    Li, Ge
    NEUROCOMPUTING, 2018, 311 : 65 - 77
  • [8] Edge AI: On-Demand Accelerating Deep Neural Network Inference via Edge Computing
    Li, En
    Zeng, Liekang
    Zhou, Zhi
    Chen, Xu
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (01) : 447 - 457
  • [9] Myths and legends in high-performance computing
    Matsuoka, Satoshi
    Domke, Jens
    Wahib, Mohamed
    Drozd, Aleksandr
    Hoefler, Torsten
    INTERNATIONAL JOURNAL OF HIGH PERFORMANCE COMPUTING APPLICATIONS, 2023, 37 (3-4) : 245 - 259
  • [10] High-Performance Statistical Computing in the Computing Environments of the 2020s
    Ko, Seyoon
    Zhou, Hua
    Zhou, Jin J.
    Won, Joong-Ho
    STATISTICAL SCIENCE, 2022, 37 (04) : 494 - 518