Physiotherapy-based human activity recognition using deep learning

被引:5
作者
Deotale, Disha [1 ]
Verma, Madhushi [2 ]
Suresh, P. [3 ]
Kumar, Neeraj [4 ,5 ,6 ,7 ,8 ]
机构
[1] GH Raisoni Coll Engn & Management, Dept Artificial Intelligence, Pune, Maharashtra, India
[2] Bennett Univ, Sch Comp Sci Engn & Technol, Greater Noida, India
[3] Muthoot Inst Technol & Sci, CIDRIE, Kochi, India
[4] Thapar Univ Patiala Punjab, Dept Comp Sci & Engn, Dehra Dun, Uttarakhand, India
[5] Univ Petr & Energy Studies, Sch Comp Sci, Dehra Dun, Uttarakhand, India
[6] Lebanese Amer Univ, Dept Elect & Comp Engn, Beirut, Lebanon
[7] Chandigarh Univ, Gharuan, India
[8] King Abdulaziz Univ, Fac Comp & IT, Jeddah, Saudi Arabia
关键词
Human activity recognition; Deep learning; Long short-term memory physiotherapy videos; CLASSIFICATION; RADAR; TERM;
D O I
10.1007/s00521-023-08307-4
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Nowadays, continuous human activity recognition is being studied broadly by investigators for diverse applications. However, the studies based on physiotherapy action tracking from the physiotherapy video dataset are limited. Hence, the physiotherapy dataset has been considered in this present study. Moreover, deep learning-based (DL) neural networks have promoted the enhancement of activity detection study to become an essential technique. DL-based neural networks, such as long short-term memory, can automatically acquire the significant features from the physiotherapy video of sub-activity and main activity. Nevertheless, some physiotherapy videos are inappropriate and correspond to insignificant actions. Consequently, these insignificant actions can cause the recognition of continuous movements. Therefore, a novel strawberry-based recurrent neural framework is proposed to address this issue. Here, a physiotherapy video is taken as the input, and this dataset consists of several actions. Consequently, all the steps are done by one single person. So, the proposed design initially identifies all subactivities based on that sub-activities, and the main physiotherapy actions were classified. After that, repeated action counts and their starting and ending times are evaluated. Finally, the present study's design is considered in terms of performance metrics. Three things are mentioned in this article. First the class determines whether the human body is static, dynamic, or transitional, which class indicates the position of action. To recognize the main activity, it is important to first identify all subactivities in the physiotherapy video. Then, you should count the number of times each sub-activity was performed and how long it took overall. The proposed model was implemented using the Python platform, and the results were compared with the existing models. The proposed model shows higher recognition accuracy in comparison.
引用
收藏
页码:11431 / 11444
页数:14
相关论文
共 36 条
[1]  
Ahad M.A.R., 2020, IOT SENSORBASED ACTI
[2]   Human activity recognition using improved complete ensemble EMD with adaptive noise and long short-term memory neural networks [J].
Altuve, Miguel ;
Lizarazo, Paula ;
Villamizar, Javier .
BIOCYBERNETICS AND BIOMEDICAL ENGINEERING, 2020, 40 (03) :901-909
[3]   Vision-based human activity recognition: a survey [J].
Beddiar, Djamila Romaissa ;
Nini, Brahim ;
Sabokrou, Mohammad ;
Hadid, Abdenour .
MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (41-42) :30509-30555
[4]   Human activity monitoring system based on wearable sEMG and accelerometer wireless sensor nodes [J].
Biagetti, Giorgio ;
Crippa, Paolo ;
Falaschetti, Laura ;
Orcioni, Simone ;
Turchetti, Claudio .
BIOMEDICAL ENGINEERING ONLINE, 2018, 17
[5]   Deep Learning for Sensor-based Human Activity Recognition: Overview, Challenges, and Opportunities [J].
Chen, Kaixuan ;
Zhang, Dalin ;
Yao, Lina ;
Guo, Bin ;
Yu, Zhiwen ;
Liu, Yunhao .
ACM COMPUTING SURVEYS, 2021, 54 (04)
[6]   Performance Analysis of Smartphone-Sensor Behavior for Human Activity Recognition [J].
Chen, Yufei ;
Shen, Chao .
IEEE ACCESS, 2017, 5 :3095-3110
[7]   A novel challenge into Multimedia Cultural Heritage: an integrated approach to support cultural information enrichment [J].
Chianese, Angelo ;
Marulli, Fiammetta ;
Piccialli, Francesco ;
Valente, Isabella .
2013 INTERNATIONAL CONFERENCE ON SIGNAL-IMAGE TECHNOLOGY & INTERNET-BASED SYSTEMS (SITIS), 2013, :217-224
[8]   Sensor Data Acquisition and Multimodal Sensor Fusion for Human Activity Recognition Using Deep Learning [J].
Chung, Seungeun ;
Lim, Jiyoun ;
Noh, Kyoung Ju ;
Kim, Gague ;
Jeong, Hyuntae .
SENSORS, 2019, 19 (07)
[9]   Attentive or Not? Toward a Machine Learning Approach to Assessing Students' Visible Engagement in Classroom Instruction [J].
Goldberg, Patricia ;
Suemer, Oemer ;
Stuermer, Kathleen ;
Wagner, Wolfgang ;
Goellner, Richard ;
Gerjets, Peter ;
Kasneci, Enkelejda ;
Trautwein, Ulrich .
EDUCATIONAL PSYCHOLOGY REVIEW, 2021, 33 (01) :27-49
[10]   On the Generalization and Reliability of Single Radar-Based Human Activity Recognition [J].
Gorji, Ali ;
Khalid, Habib-Ur-Rehman ;
Bourdoux, Andre ;
Sahli, Hichem .
IEEE ACCESS, 2021, 9 (85334-85349) :85334-85349