DESNet: Real-time human pose estimation for sports applications combining IoT and deep learning

被引:2
作者
Huang, Rongbao [1 ]
Zhang, Bo [1 ]
Yao, Zhixin [2 ,3 ,4 ]
Xie, Bojun [5 ]
Guo, Jia [6 ]
机构
[1] Hebei Finance Univ, Dept Phys Educ & Teaching, Baoding 071000, Peoples R China
[2] LinYi Univ, Sch Phys Educ & Hlth, Linyi 276000, Shandong, Peoples R China
[3] Pai Chai Univ, Dept Sports, Daejeon 35345, South Korea
[4] Pai Chai Univ, Leisure Serv, Daejeon 35345, South Korea
[5] Hebei Univ, Coll Math & Informat Sci, Baoding 071000, Hebei, Peoples R China
[6] Hebei Finance Univ, Sch Informat Engn & Comp Sci, Baoding 071000, Hebei, Peoples R China
关键词
Real-time human pose estimation; Sports training feedback; IoT integration; DESNet; Dynamic Multi-Scale Context; Squeeze-and-Excitation; NETWORK;
D O I
10.1016/j.aej.2024.10.010
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
With the rapid development of IoT technology, real-time human pose estimation has become increasingly important in sports training feedback systems. However, current methods often fall short in balancing high accuracy with low computational resource requirements, especially in resource-constrained environments. Deep learning has shown significant potential in enhancing computer vision tasks, including human pose estimation. In this study, we propose DESNet, an improved EfficientHRNet model that integrates IoT technology. DESNet combines Dynamic Multi-Scale Context (DMC) modules and Squeeze-and-Excitation (SE) modules, and utilizes IoT for real-time data collection, transmission, and processing. Experimental results show that DESNet achieves an average precision (AP) of 74.8% on the COCO dataset and a PCKh (Percentage of Correct Keypoints with head-normalized) of 90.9% on the MPII dataset, outperforming existing lightweight models. The integration of deep learning and IoT technology not only improves the accuracy and efficiency of human pose estimation but also significantly enhances the timeliness and robustness of feedback in sports training applications. Our findings demonstrate that DESNet is a powerful tool for real-time human pose analysis, offering promising solutions for intelligent sports training and rehabilitation systems.
引用
收藏
页码:293 / 306
页数:14
相关论文
共 50 条
[41]   A real-time foreign object detection method based on deep learning in complex open railway environments [J].
Zhang, Binlin ;
Yang, Qing ;
Chen, Fengkui ;
Gao, Dexin .
JOURNAL OF REAL-TIME IMAGE PROCESSING, 2024, 21 (05)
[42]   A deep learning method for real-time bias correction of wind field forecasts in the Western North Pacific [J].
Zhang, Wei ;
Jiang, Yueyue ;
Dong, Junyu ;
Song, Xiaojiang ;
Pang, Renbo ;
Guoan, Boyu ;
Yu, Hui .
ATMOSPHERIC RESEARCH, 2023, 284
[43]   A real-time semantic visual SLAM for dynamic environment based on deep learning and dynamic probabilistic propagation [J].
Chen, Liang ;
Ling, Zhi ;
Gao, Yu ;
Sun, Rongchuan ;
Jin, Sheng .
COMPLEX & INTELLIGENT SYSTEMS, 2023, 9 (05) :5653-5677
[44]   Multi-criteria and real-time control of continuous battery cell production steps using deep learning [J].
Rohkohl, Erik ;
Schoenemann, Malte ;
Bodrov, Yury ;
Herrmann, Christoph .
ADVANCES IN INDUSTRIAL AND MANUFACTURING ENGINEERING, 2023, 6
[45]   Personalized route recommendation for ride-hailing with deep inverse reinforcement learning and real-time traffic conditions [J].
Liu, Shan ;
Jiang, Hai .
TRANSPORTATION RESEARCH PART E-LOGISTICS AND TRANSPORTATION REVIEW, 2022, 164
[46]   Advancing PCB Quality Control: Harnessing YOLOv8 Deep Learning for Real-Time Fault Detection [J].
Khan, Rehman Ullah ;
Shah, Fazal ;
Khan, Ahmad Ali ;
Tahir, Hamza .
CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 81 (01) :345-367
[47]   Branchy Deep Learning Based Real-Time Defect Detection Under Edge-Cloud Fusion Architecture [J].
Wang, Jing ;
Wu, Yi ;
Chen, Yang-Quan .
IEEE TRANSACTIONS ON CLOUD COMPUTING, 2023, 11 (03) :3301-3313
[48]   Online Real-Time Analysis of Data Streams Based on an Incremental High-Order Deep Learning Model [J].
Li, Yuliang ;
Zhang, Min ;
Wang, Wei .
IEEE ACCESS, 2018, 6 :77615-77623
[49]   Deep Learning Based Real-Time Semantic Segmentation of Cerebral Vessels and Cranial Nerves in Microvascular Decompression Scenes [J].
Bai, Ruifeng ;
Liu, Xinrui ;
Jiang, Shan ;
Sun, Haijiang .
CELLS, 2022, 11 (11)
[50]   Real-time hydrogen release and dispersion modelling of hydrogen refuelling station by using deep learning probability approach [J].
Li, Junjie ;
Xie, Weikang ;
Li, Huihao ;
Qian, Xiaoyuan ;
Shi, Jihao ;
Xie, Zonghao ;
Wang, Qing ;
Zhang, Xinqi ;
Chen, Guoming .
INTERNATIONAL JOURNAL OF HYDROGEN ENERGY, 2024, 51 :794-806