Attention! A Lightweight 2D Hand Pose Estimation Approach

被引:43
作者
Santavas, Nicholas [1 ]
Kansizoglou, Ioannis [1 ]
Bampis, Loukas [1 ]
Karakasis, Evangelos [1 ]
Gasteratos, Antonios [1 ]
机构
[1] Democritus Univ Thrace, Lab Robot & Automat, Dept Prod & Management Engn, Xanthi 67100, Greece
关键词
Pose estimation; Computer architecture; Feature extraction; Two dimensional displays; Sensors; Convolution; Task analysis; 2D hand pose estimation; holistic regression; self-attention; human pose estimation;
D O I
10.1109/JSEN.2020.3018172
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Vision based human pose estimation is an non-invasive technology for Human-Computer Interaction (HCI). The direct use of the hand as an input device provides an attractive interaction method, with no need for specialized sensing equipment, such as exoskeletons, gloves etc, but a camera. Traditionally, HCI is employed in various applications spreading in areas including manufacturing, surgery, entertainment industry and architecture, to mention a few. Deployment of vision based human pose estimation algorithms can give a breath of innovation to these applications. In this article, we present a novel Convolutional Neural Network architecture, reinforced with a Self-Attention module. Our proposed model can be deployed on an embedded system due to its lightweight nature with just 1.9 Million parameters. The source code and qualitative results are publicly available.
引用
收藏
页码:11488 / 11496
页数:9
相关论文
共 43 条
[1]  
Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
[2]  
[Anonymous], 2016, ARXIV161007214
[3]  
Azulay Aharon., 2018, 180512177 ARXIV
[4]   Attention Augmented Convolutional Networks [J].
Bello, Irwan ;
Zoph, Barret ;
Vaswani, Ashish ;
Shlens, Jonathon ;
Le, Quoc V. .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :3285-3294
[5]   3D Hand Shape and Pose from Images in the Wild [J].
Boukhayma, Adnane ;
de Bem, Rodrigo ;
Torr, Philip H. S. .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :10835-10844
[6]   OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields [J].
Cao, Zhe ;
Hidalgo, Gines ;
Simon, Tomas ;
Wei, Shih-En ;
Sheikh, Yaser .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (01) :172-186
[7]   Pose guided structured region ensemble network for cascaded hand pose estimation [J].
Chen, Xinghao ;
Wang, Guijin ;
Guo, Hengkai ;
Zhang, Cairong .
NEUROCOMPUTING, 2020, 395 (395) :138-149
[8]   Dense 3D Regression for Hand Pose Estimation [J].
Wan, Chengde ;
Probst, Thomas ;
Van Gool, Luc ;
Yao, Angela .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :5147-5156
[9]   Face and Emotion Recognition with Neural Networks on Mobile Devices: Practical Implementation on Different Platforms [J].
Efremova, Natalia ;
Patkin, Mikhail ;
Sokolov, Denis .
2019 14TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2019), 2019, :616-620
[10]  
Engstrom Logan, 2019, INT C MACH LEARN, P1802