Gait Recognition via Effective Global-Local Feature Representation and Local Temporal Aggregation

被引:185
作者
Lin, Beibei [1 ]
Zhang, Shunli [1 ]
Yu, Xin [2 ]
机构
[1] Beijing Jiaotong Univ, Beijing, Peoples R China
[2] Univ Technol Sydney, Sydney, NSW, Australia
来源
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021) | 2021年
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
D O I
10.1109/ICCV48922.2021.01438
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Gait recognition is one of the most important biometric technologies and has been applied in many fields. Recent gait recognition frameworks represent each gait frame by descriptors extracted from either global appearances or local regions of humans. However, the representations based on global information often neglect the details of the gait frame, while local region based descriptors cannot capture the relations among neighboring regions, thus reducing their discriminativeness. In this paper, we propose a novel feature extraction and fusion framework to achieve discriminative feature representations for gait recognition. Towards this goal, we take advantage of both global visual information and local region details and develop a Global and Local Feature Extractor (GLFE). Specifically, our GLFE module is composed of our newly designed multiple global and local convolutional layers (GLConv) to ensemble global and local features in a principle manner. Furthermore, we present a novel operation, namely Local Temporal Aggregation (LTA), to further preserve the spatial information by reducing the temporal resolution to obtain higher spatial resolution. With the help of our GLFE and LTA, our method significantly improves the discriminativeness of our visual features, thus improving the gait recognition performance. Extensive experiments demonstrate that our proposed method outperforms state-of-theart gait recognition methods on two popular datasets.
引用
收藏
页码:14628 / 14636
页数:9
相关论文
共 28 条
[1]  
Ariyanto G., 2011, P INT JOINT C BIOM, P1, DOI [10.1109/IJCB.2011.6117582, DOI 10.1109/IJCB.2011.6117582]
[2]   View-independent human motion classification using image-based reconstruction [J].
Bodor, R. ;
Drenner, A. ;
Fehr, D. ;
Malsoud, O. ;
Papanikolopoulos, N. .
IMAGE AND VISION COMPUTING, 2009, 27 (08) :1194-1206
[3]  
Chao HQ, 2019, AAAI CONF ARTIF INTE, P8126
[4]   Biometric recognition by gait: A survey of modalities and features [J].
Connor, Patrick ;
Ross, Arun .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2018, 167 :1-27
[5]   GaitPart: Temporal Part-based Model for Gait Recognition [J].
Fan, Chao ;
Peng, Yunjie ;
Cao, Chunshui ;
Liu, Xu ;
Hou, Saihui ;
Chi, Jiannan ;
Huang, Yongzhen ;
Li, Qing ;
He, Zhiqiang .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :14213-14221
[6]   Self-Calibrating View-Invariant Gait Biometrics [J].
Goffredo, Michela ;
Bouchrika, Imed ;
Carter, John N. ;
Nixon, Mark S. .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2010, 40 (04) :997-1008
[7]   Multi-Task GANs for View-Specific Feature Learning in Gait Recognition [J].
He, Yiwei ;
Zhang, Junping ;
Shan, Hongming ;
Wang, Liang .
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2019, 14 (01) :102-113
[8]  
Hermans Alexander, 2017, Defense of the Triplet loss
[9]   Gait Lateral Network: Learning Discriminative and Compact Representations for Gait Recognition [J].
Hou, Saihui ;
Cao, Chunshui ;
Liu, Xu ;
Huang, Yongzhen .
COMPUTER VISION - ECCV 2020, PT IX, 2020, 12354 :382-398
[10]   View-Invariant Discriminative Projection for Multi-View Gait-Based Human Identification [J].
Hu, Maodi ;
Wang, Yunhong ;
Zhang, Zhaoxiang ;
Little, James J. ;
Huang, Di .
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2013, 8 (12) :2034-2045