ROpenPose: A Rapider OpenPose Model for Astronaut Operation Attitude Detection

被引:25
作者
Wu, Edmond Q. [1 ,2 ]
Tang, Zhi-Ri [3 ]
Xiong, Pengwen [4 ]
Wei, Chuan-Feng [5 ]
Song, Aiguo [6 ]
Zhu, Li-Min [7 ]
机构
[1] Shanghai Jiao Tong Univ, Minist Educ, Key Lab Syst Control & Informat Proc, Shanghai 200240, Peoples R China
[2] China Natl Aeronaut Radio Elect Res Inst, Sci & Technol Avion Integrat Lab, Shanghai, Peoples R China
[3] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[4] Nanchang Univ, Sch Informat Engn, Nanchang 330031, Jiangxi, Peoples R China
[5] CAST, Inst Manned Space Syst Engn, Human Space Flight Syst Engn Div, Beijing 100863, Peoples R China
[6] Southeast Univ, Sch Instrument Sci & Engn, Nanjing 210096, Peoples R China
[7] Shanghai Jiao Tong Univ, Sch Mech Engn, State Key Lab Mech Syst & Vibrat, Shanghai 200240, Peoples R China
基金
中国国家自然科学基金;
关键词
Convolution; Pose estimation; Monitoring; Neural networks; Deep learning; Navigation; Kernel; Astronauts; deep learning; OpenPose; posture detection; weightless environment; POSE ESTIMATION;
D O I
10.1109/TIE.2020.3048285
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article proposes a rapider OpenPose model (ROpenPose) to solve the posture detection problem of astronauts in a space capsule in a weightless environment. The ROpenPose model has three innovations as follows: 1) It uses MobileNets instead of VGG-19 to achieve lighter calculations while ensuring the accuracy of model recognition. 2) Three small convolution kernels replace the large convolution kernel of the original OpenPose, which significantly reduces the computational complexity of the model. 3) Through the parameter sharing of a convolution process, the original two-branch structure is changed to a single-branch structure, which obviously improves the calculation speed of the model. A residual network is proposed to suppress the hidden danger of gradient disappearance. The deployment of ROpenPose greatly improves astronauts' detection efficiency while ensuring their high detection performance, and thereby realizing the real-time monitoring of their operation attitude. Experimental results show that ROpenPose runs at speed higher than and detection performance comparable to a number of the existing state-of-the-art models.
引用
收藏
页码:1043 / 1052
页数:10
相关论文
共 33 条
[1]  
Martinez AA, 2017, INT SYMP COMPUT EDUC
[2]  
[Anonymous], 2017, P 31 INT C NEUR INF
[3]   Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields [J].
Cao, Zhe ;
Simon, Tomas ;
Wei, Shih-En ;
Sheikh, Yaser .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1302-1310
[4]   Human Pose Estimation with Iterative Error Feedback [J].
Carreira, Joao ;
Agrawal, Pulkit ;
Fragkiadaki, Katerina ;
Malik, Jitendra .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :4733-4742
[5]  
Chen Xianjie, 2014, Advances in Neural Information Processing Systems, V27
[6]   Cascaded Pyramid Network for Multi-Person Pose Estimation [J].
Chen, Yilun ;
Wang, Zhicheng ;
Peng, Yuxiang ;
Zhang, Zhiqiang ;
Yu, Gang ;
Sun, Jian .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :7103-7112
[7]   Adversarial PoseNet: A Structure-aware Convolutional Network for Human Pose Estimation [J].
Chen, Yu ;
Shen, Chunhua ;
Wei, Xiu-Shen ;
Liu, Lingqiao ;
Yang, Jian .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :1221-1230
[8]   Multi-Context Attention for Human Pose Estimation [J].
Chu, Xiao ;
Yang, Wei ;
Ouyang, Wanli ;
Ma, Cheng ;
Yuille, Alan L. ;
Wang, Xiaogang .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5669-5678
[9]   Deep Learning Based 2D Human Pose Estimation: A Survey [J].
Dang, Qi ;
Yin, Jianqin ;
Wang, Bin ;
Zheng, Wenqing .
TSINGHUA SCIENCE AND TECHNOLOGY, 2019, 24 (06) :663-676
[10]   RMPE: Regional Multi-Person Pose Estimation [J].
Fang, Hao-Shu ;
Xie, Shuqin ;
Tai, Yu-Wing ;
Lu, Cewu .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :2353-2362