Aggregated Residual Transformations for Deep Neural Networks

被引:7395
作者
Xie, Saining [1 ]
Girshick, Ross [2 ]
Dollar, Piotr [2 ]
Tu, Zhuowen [1 ]
He, Kaiming [2 ]
机构
[1] Univ Calif San Diego, La Jolla, CA 92093 USA
[2] Facebook AI Res, La Jolla, CA USA
来源
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017) | 2017年
基金
美国国家科学基金会;
关键词
D O I
10.1109/CVPR.2017.634
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a simple, highly modularized network architecture for image classification. Our network is constructed by repeating a building block that aggregates a set of transformations with the same topology. Our simple design results in a homogeneous, multi-branch architecture that has only a few hyper-parameters to set. This strategy exposes a new dimension, which we call "cardinality" (the size of the set of transformations), as an essential factor in addition to the dimensions of depth and width. On the ImageNet-1K dataset, we empirically show that even under the restricted condition of maintaining complexity, increasing cardinality is able to improve classification accuracy. Moreover, increasing cardinality is more effective than going deeper or wider when we increase the capacity. Our models, named ResNeXt, are the foundations of our entry to the ILSVRC 2016 classification task in which we secured 2nd place. We further investigate ResNeXt on an ImageNet-5K set and the COCO detection set, also showing better results than its ResNet counterpart. The code and models are publicly available online(1).
引用
收藏
页码:5987 / 5995
页数:9
相关论文
共 43 条
  • [1] [Anonymous], 2016, NIPS
  • [2] [Anonymous], 2014, ICLR
  • [3] [Anonymous], 2004, IJCV
  • [4] [Anonymous], 2 INT C LEARN REPR
  • [5] [Anonymous], 2015, NIPS
  • [6] [Anonymous], 2014, ICML
  • [7] [Anonymous], 2016, ICLR
  • [8] [Anonymous], 2014, EUROPEAN C COMPUTER
  • [9] [Anonymous], 2016, ICLR WORKSH
  • [10] [Anonymous], 2015, arXiv: Learning