Gait Recognition from Drone Videos

被引:0
作者
Cai, Yang [1 ]
Kiefel, Justin [1 ]
Wu, Xiangyu [1 ]
机构
[1] Carnegie Mellon Univ, Pittsburgh, PA 15213 USA
来源
ADVANCES IN USABILITY, USER EXPERIENCE, WEARABLE AND ASSISTIVE TECHNOLOGY, AHFE 2021 | 2021年 / 275卷
关键词
Gait recognition; Pose estimation; Activity recognition; Human activities; Drone; Learn-on-the-fly; Machine learning; Artificial intelligence; Vision;
D O I
10.1007/978-3-030-80091-8_46
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Gait recognition is important in humanitarian assistance and disaster relief (HADR) missions. It is challenging to detect human pose and recognize the gait from a drone video in distance due to low-resolution in human-figures, dynamic pose transition, and figure-to-figure and figure-to-background interaction. Conventional pose estimation methods often fail to register proper gaits from drone footages. In this study, In this study, we explore the Adaptive Pose Estimation (APE) method that incorporates drone flight data and camera pose estimation to improve the pose estimation in drone videos. We also explore the novel methods to estimate the drone camera pose with Google Earth 3D model and to reduce the "phantom poses" with "amputation filter." Our results show that the pose estimation accuracy increases 36% and the recognition rate for six gaits reaches 91.7% on average.
引用
收藏
页码:391 / 399
页数:9
相关论文
共 14 条
[1]  
[Anonymous], CSVVIEW WEBSITE LINK
[2]  
Bhanu B, 2011, ADV PATTERN RECOGNIT, P1, DOI 10.1007/978-0-85729-124-0
[3]  
Cao Z, 2019, Arxiv, DOI arXiv:1812.08008
[4]  
Engel J, 1988, STAT NEERL, V42, P233, DOI [10.1111/j.1467-9574.1988.tb01238.x.1988, DOI 10.1111/J.1467-9574.1988.TB01238.X]
[5]   Regularization Paths for Generalized Linear Models via Coordinate Descent [J].
Friedman, Jerome ;
Hastie, Trevor ;
Tibshirani, Rob .
JOURNAL OF STATISTICAL SOFTWARE, 2010, 33 (01) :1-22
[6]   Geometric loss functions for camera pose regression with deep learning [J].
Kendall, Alex ;
Cipolla, Roberto .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6555-6564
[7]   PoseNet: A Convolutional Network for Real-Time 6-DOF Camera Relocalization [J].
Kendall, Alex ;
Grimes, Matthew ;
Cipolla, Roberto .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :2938-2946
[8]  
Malis E., 2007, Deeper understanding of the homography decomposition for vision-based control
[9]  
McConville JT., 1980, ANTHROPOMETRIC RELAT, DOI [10.21236/ada097238, DOI 10.1073/PNAS.0710346105]
[10]   Pitch and Roll Camera Orientation From a Single 2D Image Using Convolutional Neural Networks [J].
Olmschenk, Greg ;
Tang, Hao ;
Zhu, Zhigang .
2017 14TH CONFERENCE ON COMPUTER AND ROBOT VISION (CRV 2017), 2017, :261-268