DE-TGN: Uncertainty-Aware Human Motion Forecasting Using Deep Ensembles

被引:5
作者
Eltouny, Kareem A. [1 ]
Liu, Wansong [2 ]
Tian, Sibo [2 ]
Zheng, Minghui [2 ]
Liang, Xiao [1 ]
机构
[1] SUNY Buffalo, Civil Struct & Environm Engn Dept, Buffalo, NY 14260 USA
[2] SUNY Buffalo, Mech & Aerosp Engn Dept, Buffalo, NY 14260 USA
基金
美国国家科学基金会;
关键词
Human motion prediction; deep learning; deepensembles; human-robot collaboration (HRC);
D O I
10.1109/LRA.2024.3354628
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Ensuring the safety of human workers in a collaborative environment with robots is of utmost importance. Although accurate pose prediction models can help prevent collisions between human workers and robots, they are still susceptible to critical errors. In this study, we propose a novel approach called deep ensembles of temporal graph neural networks (DE-TGN) that not only accurately forecast human motion but also provide a measure of prediction uncertainty. By leveraging deep ensembles and employing stochastic Monte-Carlo dropout sampling, we construct a volumetric field representing a range of potential future human poses based on covariance ellipsoids. To validate our framework, we conducted experiments using three motion capture datasets including Human3.6M, and two human-robot interaction scenarios, achieving state-of-the-art prediction error. Moreover, we discovered that deep ensembles not only enable us to quantify uncertainty but also improve the accuracy of our predictions.
引用
收藏
页码:2192 / 2199
页数:8
相关论文
共 32 条
[1]   A Spatio-temporal Transformer for 3D Human Motion Prediction [J].
Aksan, Emre ;
Kaufmann, Manuel ;
Cao, Peng ;
Hilliges, Otmar .
2021 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2021), 2021, :565-574
[2]   A Stochastic Conditioning Scheme for Diverse Human Motion Prediction [J].
Aliakbarian, Sadegh ;
Saleh, Fatemeh Sadat ;
Salzmann, Mathieu ;
Petersson, Lars ;
Gould, Stephen .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :5222-5231
[3]  
Ba J. L., 2016, NEURAL INF PROCESS S
[4]  
Bai SJ, 2018, Arxiv, DOI [arXiv:1803.01271, DOI 10.48550/ARXIV.1803.01271]
[5]   HP-GAN: Probabilistic 3D human motion prediction via GAN [J].
Barsoum, Emad ;
Kender, John ;
Liu, Zicheng .
PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, :1499-1508
[6]   Deep representation learning for human motion prediction and classification [J].
Butepage, Judith ;
Black, Michael J. ;
Kragic, Danica ;
Kjellstrom, Hedvig .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1591-1599
[7]   Learning Dynamic Relationships for 3D Human Motion Prediction [J].
Cui, Qiongjie ;
Sun, Huaijiang ;
Yang, Fei .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :6518-6526
[8]  
Fort S., 2019, ARXIV PREPRINT ARXIV
[9]   Recurrent Network Models for Human Dynamics [J].
Fragkiadaki, Katerina ;
Levine, Sergey ;
Felsen, Panna ;
Malik, Jitendra .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :4346-4354
[10]  
Gal Y, 2016, PR MACH LEARN RES, V48