DESNet: Real-time human pose estimation for sports applications combining IoT and deep learning

被引:2
作者
Huang, Rongbao [1 ]
Zhang, Bo [1 ]
Yao, Zhixin [2 ,3 ,4 ]
Xie, Bojun [5 ]
Guo, Jia [6 ]
机构
[1] Hebei Finance Univ, Dept Phys Educ & Teaching, Baoding 071000, Peoples R China
[2] LinYi Univ, Sch Phys Educ & Hlth, Linyi 276000, Shandong, Peoples R China
[3] Pai Chai Univ, Dept Sports, Daejeon 35345, South Korea
[4] Pai Chai Univ, Leisure Serv, Daejeon 35345, South Korea
[5] Hebei Univ, Coll Math & Informat Sci, Baoding 071000, Hebei, Peoples R China
[6] Hebei Finance Univ, Sch Informat Engn & Comp Sci, Baoding 071000, Hebei, Peoples R China
关键词
Real-time human pose estimation; Sports training feedback; IoT integration; DESNet; Dynamic Multi-Scale Context; Squeeze-and-Excitation; NETWORK;
D O I
10.1016/j.aej.2024.10.010
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
With the rapid development of IoT technology, real-time human pose estimation has become increasingly important in sports training feedback systems. However, current methods often fall short in balancing high accuracy with low computational resource requirements, especially in resource-constrained environments. Deep learning has shown significant potential in enhancing computer vision tasks, including human pose estimation. In this study, we propose DESNet, an improved EfficientHRNet model that integrates IoT technology. DESNet combines Dynamic Multi-Scale Context (DMC) modules and Squeeze-and-Excitation (SE) modules, and utilizes IoT for real-time data collection, transmission, and processing. Experimental results show that DESNet achieves an average precision (AP) of 74.8% on the COCO dataset and a PCKh (Percentage of Correct Keypoints with head-normalized) of 90.9% on the MPII dataset, outperforming existing lightweight models. The integration of deep learning and IoT technology not only improves the accuracy and efficiency of human pose estimation but also significantly enhances the timeliness and robustness of feedback in sports training applications. Our findings demonstrate that DESNet is a powerful tool for real-time human pose analysis, offering promising solutions for intelligent sports training and rehabilitation systems.
引用
收藏
页码:293 / 306
页数:14
相关论文
共 50 条
[21]   Real-time power prediction approach for turbine using deep learning techniques [J].
Sun, Lei ;
Liu, Tianyuan ;
Xie, Yonghui ;
Zhang, Di ;
Xia, Xinlei .
ENERGY, 2021, 233
[22]   Real-time Transportation Prediction Correction using Reconstruction Error in Deep Learning [J].
Liu, Shuai ;
Song, Guojie ;
Huang, Wenhao .
ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2020, 14 (02)
[23]   Real-Time Semantic Image Segmentation with Deep Learning for Autonomous Driving: A Survey [J].
Papadeas, Ilias ;
Tsochatzidis, Lazaros ;
Amanatiadis, Angelos ;
Pratikakis, Ioannis .
APPLIED SCIENCES-BASEL, 2021, 11 (19)
[24]   An IoT-Based Deep Learning Framework for Real-Time Detection of COVID-19 through Chest X-ray Images [J].
Karmakar, Mithun ;
Choudhury, Bikramjit ;
Patowary, Ranjan ;
Nag, Amitava .
COMPUTERS, 2023, 12 (01)
[25]   Real-Time Bearing Fault Diagnosis of Induction Motors with Accelerated Deep Learning Approach [J].
Afrasiabi, Shahabodin ;
Afrasiabi, Mousa ;
Parang, Benyamin ;
Mohammadi, Mohammad .
2019 10TH INTERNATIONAL POWER ELECTRONICS, DRIVE SYSTEMS AND TECHNOLOGIES CONFERENCE (PEDSTC), 2019, :155-159
[26]   Real-time Reconstruction of EEG Signals from Compressive Measurements via Deep Learning [J].
Majumdar, Angshul ;
Ward, Rabab .
2016 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2016, :2856-2863
[27]   Towards Improving Real-Time Surveillance Systems with Enhancement Techniques for Deep Learning Models [J].
Vijoli, Ioana ;
Vancea, Cristian-Cosmin .
2024 IEEE 20TH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTER COMMUNICATION AND PROCESSING, ICCP 2024, 2024, :317-324
[28]   SafeSmartDrive: Real-Time Traffic Environment Detection and Driver Behavior Monitoring With Machine and Deep Learning [J].
Bouhsissin, Soukaina ;
Sael, Nawal ;
Benabbou, Faouzia ;
Soultana, Abdelfettah ;
Jannani, Ayoub .
IEEE ACCESS, 2024, 12 :169499-169517
[29]   Proteus: A Difficulty-aware Deep Learning Framework for Real-time Malicious Traffic Detection [J].
Cui, Chupeng ;
Li, Qing ;
Xie, Guorui ;
Li, Ruoyu ;
Zhao, Dan ;
Yuan, Zhenhui ;
Jiang, Yong .
2024 IEEE 32ND INTERNATIONAL CONFERENCE ON NETWORK PROTOCOLS, ICNP, 2024,
[30]   Semantic-Based Optimization of Deep Learning for Efficient Real-Time Medical Image Segmentation [J].
Wei, Zhenkun ;
Liu, Jia ;
Yao, Yu .
INTERNATIONAL JOURNAL ON SEMANTIC WEB AND INFORMATION SYSTEMS, 2024, 20 (01)