PhaseMix: A Periodic Motion Fusion Method for Adult Spinal Deformity Classification

被引:0
作者
Chen, Kaixu [1 ]
Xu, Jiayi [2 ]
Asada, Tomoyuki [3 ,4 ]
Miura, Kousei [3 ]
Sakashita, Kotaro [3 ]
Sunami, Takahiro [3 ]
Kadone, Hideki [3 ,5 ]
Yamazaki, Masashi [3 ]
Ienaga, Naoto [6 ]
Kuroda, Yoshihiro [6 ]
机构
[1] Univ Tsukuba, Degree Programs Syst & Informat Engn, Tsukuba 3058577, Japan
[2] Univ Tokyo, Res Ctr Adv Sci & Technol, Tokyo 1138654, Japan
[3] Univ Tsukuba, Inst Med, Dept Orthopaed Surg, Tsukuba 3058577, Japan
[4] Hosp Special Surg, New York, NY 10021 USA
[5] Univ Tsukuba, Ctr Cybern Res, Tsukuba 3058577, Japan
[6] Univ Tsukuba, Inst Syst & Informat Engn, Tsukuba 3058577, Japan
关键词
Legged locomotion; Feature extraction; Accuracy; Human activity recognition; Reviews; Face recognition; Diseases; Deep learning; Cameras; Surgery; Medical services; Adult spinal deformity; deep learning; human action recognition; healthcare; gait posture; periodic motion; motion symmetry; LEVEL IMAGE FUSION; GAIT ANALYSIS; RADIOGRAPHIC PARAMETERS; QUANTITATIVE-ANALYSIS; ALIGNMENT;
D O I
10.1109/ACCESS.2024.3479165
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Human gait plays a crucial role in medical diagnostics, particularly in the context of adult spinal deformities (ASD). Recent research has applied deep-learning techniques to process video data for ASD diagnosis. Although this method successfully captured dynamic postural information, it does not account for the periodicity and symmetry of motion, particularly the periodicity of gait and the inherent symmetry of locomotor postures in the gait cycle. This omission may have led to the loss of critical information necessary for an accurate diagnosis. To resolve this issue, we present a method that can effectively capture cycle and action symmetry information in motion and exploit the characteristics of gait motion. The proposed method is subsequently trained using the fused data within the deep learning model. Our experiments, performed on a video dataset consisting of 81 patients, showed that our method outperformed baseline approaches. The proposed method achieved an accuracy of 71.43, precision of 72.80, and F1 score of 71.15. The complete set of codes, models, and results can be accessed from the GitHub repository: https://github.com/ChenKaiXuSan/Skeleton_ASD_PyTorch. In this study, we present an innovative video-based approach to support clinical diagnoses of gait disorders, with a focus on periodic motion and postural symmetry. The application of deep learning in diagnostic methods has been enhanced by utilizing the kinematic properties of walking movements. The experimental results demonstrate that the proposed method can provide more accurate diagnostic results when using limited video data.
引用
收藏
页码:152358 / 152376
页数:19
相关论文
共 50 条
[1]  
Abd Rahman SZ, 2016, 2016 INTERNATIONAL CONFERENCE ON ADVANCES IN ELECTRICAL, ELECTRONIC AND SYSTEMS ENGINEERING (ICAEES), P125, DOI 10.1109/ICAEES.2016.7888022
[2]   The relationship between spinal alignment and activity of paravertebral muscle during gait in patients with adult spinal deformity: a retrospective study [J].
Asada, Tomoyuki ;
Miura, Kousei ;
Kadone, Hideki ;
Sakashita, Kotaro ;
Funayama, Toru ;
Takahashi, Hiroshi ;
Noguchi, Hiroshi ;
Sato, Kosuke ;
Eto, Fumihiko ;
Gamada, Hisanori ;
Inomata, Kento ;
Koda, Masao ;
Yamazaki, Masashi .
BMC MUSCULOSKELETAL DISORDERS, 2023, 24 (01)
[3]   Can Proximal Junctional Kyphosis after Surgery for Adult Spinal Deformity Be Predicted by Preoperative Dynamic Sagittal Alignment Change with 3D Gait Analysis? A Case-Control Study [J].
Asada, Tomoyuki ;
Miura, Kousei ;
Koda, Masao ;
Kadone, Hideki ;
Funayama, Toru ;
Takahashi, Hiroshi ;
Noguchi, Hiroshi ;
Shibao, Yosuke ;
Sato, Kosuke ;
Eto, Fumihiko ;
Mataki, Kentaro ;
Yamazaki, Masashi .
JOURNAL OF CLINICAL MEDICINE, 2022, 11 (19)
[4]   Comparison of the postoperative changes in trunk and lower extremity muscle activities between patients with adult spinal deformity and age-matched controls using surface electromyography [J].
Banno, Tomohiro ;
Yamato, Yu ;
Nojima, Osamu ;
Hasegawa, Tomohiko ;
Yoshida, Go ;
Arima, Hideyuki ;
Oe, Shin ;
Ushirozako, Hiroki ;
Yamada, Tomohiro ;
Ide, Koichiro ;
Watanabe, Yu ;
Yamauchi, Katsuya ;
Matsuyama, Yukihiro .
SPINE DEFORMITY, 2022, 10 (01) :141-149
[5]   Feature-level fusion approaches based on multimodal EEG data for depression recognition [J].
Cai, Hanshu ;
Qu, Zhidiao ;
Li, Zhe ;
Zhang, Yi ;
Hu, Xiping ;
Hu, Bin .
INFORMATION FUSION, 2020, 59 (59) :127-138
[6]  
Chattopadhyay A, 2018, Arxiv, DOI arXiv:1710.11063
[7]   Improving Human Action Recognition Using Fusion of Depth Camera and Inertial Sensors [J].
Chen, Chen ;
Jafari, Roozbeh ;
Kehtarnavaz, Nasser .
IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2015, 45 (01) :51-61
[8]   Image Fusion Algorithm at Pixel Level Based on Edge Detection [J].
Chen, Jiming ;
Chen, Liping ;
Shabaz, Mohammad .
JOURNAL OF HEALTHCARE ENGINEERING, 2021, 2021
[9]   Two-stage video-based convolutional neural networks for adult spinal deformity classification [J].
Chen, Kaixu ;
Asada, Tomoyuki ;
Ienaga, Naoto ;
Miura, Kousei ;
Sakashita, Kotaro ;
Sunami, Takahiro ;
Kadone, Hideki ;
Yamazaki, Masashi ;
Kuroda, Yoshihiro .
FRONTIERS IN NEUROSCIENCE, 2023, 17
[10]   The reliability of quantitative analysis on digital images of the scoliotic spine [J].
Cheung, J ;
Wever, DJ ;
Veldhuizen, AG ;
Klein, JP ;
Verdonck, B ;
Nijlunsing, R ;
Cool, JC ;
Van Horn, JR .
EUROPEAN SPINE JOURNAL, 2002, 11 (06) :535-542