SlowFast Networks for Video Recognition

被引:2105
作者
Feichtenhofer, Christoph [1 ]
Fan, Haoqi [1 ]
Malik, Jitendra [1 ]
He, Kaiming [1 ]
机构
[1] Facebook AI Res FAIR, Menlo Pk, CA 94025 USA
来源
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019) | 2019年
关键词
FORM;
D O I
10.1109/ICCV.2019.00630
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present SlowFast networks for video recognition. Our model involves (i) a Slow pathway, operating at low frame rate, to capture spatial semantics, and (ii) a Fast pathway, operating at high frame rate, to capture motion at fine temporal resolution. The Fast pathway can be made very lightweight by reducing its channel capacity, yet can learn useful temporal information for video recognition. Our models achieve strong performance for both action classification and detection in video, and large improvements are pin-pointed as contributions by our SlowFast concept.
引用
收藏
页码:6201 / 6210
页数:10
相关论文
共 60 条
  • [1] SPATIOTEMPORAL ENERGY MODELS FOR THE PERCEPTION OF MOTION
    ADELSON, EH
    BERGEN, JR
    [J]. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 1985, 2 (02) : 284 - 299
  • [2] [Anonymous], 2008, P CVPR
  • [3] [Anonymous], 2015, Arxiv.Org, DOI DOI 10.3389/FPSYG.2013.00124
  • [4] Carreira J., 2019, CoRR
  • [5] Carreira J, 2018, ARXIV
  • [6] Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset
    Carreira, Joao
    Zisserman, Andrew
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 4724 - 4733
  • [7] Christoph R., 2016, Advances in neural information processing systems, P3476
  • [8] Human detection using oriented histograms of flow and appearance
    Dalal, Navneet
    Triggs, Bill
    Schmid, Cordelia
    [J]. COMPUTER VISION - ECCV 2006, PT 2, PROCEEDINGS, 2006, 3952 : 428 - 441
  • [9] Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
  • [10] SPATIAL AND TEMPORAL CONTRAST SENSITIVITIES OF NEURONS IN LATERAL GENICULATE-NUCLEUS OF MACAQUE
    DERRINGTON, AM
    LENNIE, P
    [J]. JOURNAL OF PHYSIOLOGY-LONDON, 1984, 357 (DEC): : 219 - 240