DESNet: Real-time human pose estimation for sports applications combining IoT and deep learning

被引:2
作者
Huang, Rongbao [1 ]
Zhang, Bo [1 ]
Yao, Zhixin [2 ,3 ,4 ]
Xie, Bojun [5 ]
Guo, Jia [6 ]
机构
[1] Hebei Finance Univ, Dept Phys Educ & Teaching, Baoding 071000, Peoples R China
[2] LinYi Univ, Sch Phys Educ & Hlth, Linyi 276000, Shandong, Peoples R China
[3] Pai Chai Univ, Dept Sports, Daejeon 35345, South Korea
[4] Pai Chai Univ, Leisure Serv, Daejeon 35345, South Korea
[5] Hebei Univ, Coll Math & Informat Sci, Baoding 071000, Hebei, Peoples R China
[6] Hebei Finance Univ, Sch Informat Engn & Comp Sci, Baoding 071000, Hebei, Peoples R China
关键词
Real-time human pose estimation; Sports training feedback; IoT integration; DESNet; Dynamic Multi-Scale Context; Squeeze-and-Excitation; NETWORK;
D O I
10.1016/j.aej.2024.10.010
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
With the rapid development of IoT technology, real-time human pose estimation has become increasingly important in sports training feedback systems. However, current methods often fall short in balancing high accuracy with low computational resource requirements, especially in resource-constrained environments. Deep learning has shown significant potential in enhancing computer vision tasks, including human pose estimation. In this study, we propose DESNet, an improved EfficientHRNet model that integrates IoT technology. DESNet combines Dynamic Multi-Scale Context (DMC) modules and Squeeze-and-Excitation (SE) modules, and utilizes IoT for real-time data collection, transmission, and processing. Experimental results show that DESNet achieves an average precision (AP) of 74.8% on the COCO dataset and a PCKh (Percentage of Correct Keypoints with head-normalized) of 90.9% on the MPII dataset, outperforming existing lightweight models. The integration of deep learning and IoT technology not only improves the accuracy and efficiency of human pose estimation but also significantly enhances the timeliness and robustness of feedback in sports training applications. Our findings demonstrate that DESNet is a powerful tool for real-time human pose analysis, offering promising solutions for intelligent sports training and rehabilitation systems.
引用
收藏
页码:293 / 306
页数:14
相关论文
共 50 条
[31]   Deep Learning Method for Real-Time Fire Detection System for Urban Fire Monitoring and Control [J].
Yang, Wenyang ;
Wu, Yesen ;
Chow, Steven Kwok Keung .
INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2024, 17 (01)
[32]   Real-time underwater object detection technology for complex underwater environments based on deep learning [J].
Zhou, Hui ;
Kong, Meiwei ;
Yuan, Hexiang ;
Pan, Yanyan ;
Wang, Xinru ;
Chen, Rong ;
Lu, Weiheng ;
Wang, Ruizhi ;
Yang, Qunhui .
ECOLOGICAL INFORMATICS, 2024, 82
[33]   Deep-Learning-Based Real-Time Visual Pollution Detection in Urban and Textile Environments [J].
Titu, Md Fahim Shahoriar ;
Chowdhury, Abdul Aziz ;
Haque, S. M. Rezwanul ;
Khan, Riasat .
SCI, 2024, 6 (01)
[34]   Hybrid deep learning model for in-field pest detection on real-time field monitoring [J].
Chodey, Madhuri Devi ;
Shariff, C. Noorullah .
JOURNAL OF PLANT DISEASES AND PROTECTION, 2022, 129 (03) :635-650
[35]   A Deep Learning Image-Based Sensor for Real-Time Crystal Size Distribution Characterization [J].
Manee, V. ;
Zhu, W. ;
Romagnoli, J. A. .
INDUSTRIAL & ENGINEERING CHEMISTRY RESEARCH, 2019, 58 (51) :23175-23186
[36]   Real-Time Wind Power Forecast Error Estimation Based on Eigenvalue Extraction by Dictionary Learning [J].
Han Li ;
Li Mingze ;
Wang Xuesong ;
Cheng Yuhu .
CHINESE JOURNAL OF ELECTRONICS, 2019, 28 (02) :349-356
[37]   HAR-DeepConvLG: Hybrid deep learning-based model for human activity recognition in IoT applications [J].
Ding, Weiping ;
Abdel-Basset, Mohamed ;
Mohamed, Reda .
INFORMATION SCIENCES, 2023, 646
[38]   Machine-Learning-Based Real-Time Multi-Camera Vehicle Tracking and Travel-Time Estimation [J].
Huang, Xiaohui ;
He, Pan ;
Rangarajan, Anand ;
Ranka, Sanjay .
JOURNAL OF IMAGING, 2022, 8 (04)
[39]   Real-Time Neural MPC: Deep Learning Model Predictive Control for Quadrotors and Agile Robotic Platforms [J].
Salzmann, Tim ;
Kaufmann, Elia ;
Arrizabalaga, Jon ;
Pavone, Marco ;
Scaramuzza, Davide ;
Ryll, Markus .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (04) :2397-2404
[40]   Light3DPose: Real-time Multi-Person 3D Pose Estimation from Multiple Views [J].
Elmi, Alessi ;
Mazzini, Davide ;
Tortella, Pietro .
2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, :2755-2762