A lightweight multi-scale convolutional attention network for lower limb motion recognition with transfer learning

被引:2
作者
Ling, Liuyi [1 ,2 ,3 ]
Wei, Liyu [1 ]
Feng, Bin [1 ]
Lin, Zhu [3 ]
Jin, Li [1 ]
Wang, Yiwen [1 ]
Li, Weixiao [3 ]
机构
[1] Anhui Univ Sci & Technol, Sch Artificial Intelligence, Huainan 232001, Peoples R China
[2] Anhui Univ Sci & Technol, Inst Environm Friendly Mat & Occupat Hlth, Wuhu 241003, Peoples R China
[3] Anhui Univ Sci & Technol, Sch Elect & Informat Engn, Huainan 232001, Peoples R China
关键词
Wearable robots; Surface electromyography; Intention recognition; Deep learning; Transfer learning;
D O I
10.1016/j.bspc.2024.106803
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Surface electromyography (sEMG) signals can directly reflect intention of human motion, therefore are widely used in motion recognition and robot control. However, the accuracy of recognizing lower limb gait patterns tends to decrease when applying a pre-trained model to new users. Additionally, gathering sufficient data from new users to calibrate a new model in practical applications is challenging. To address this issue, this study proposes a lightweight deep learning model that utilizes multi-scale depthwise convolution to extract multi- scale features from multi-channel sEMG signals. An attention mechanism is employed to fuse these features across channels. A transfer learning strategy involves transferring the parameters of the feature extractor from the pre-trained model to the target model. The label classifier is fine-tuned using limited data from unseen subjects. The experimental results show that the proposed model can effectively extract the features from sparse multi-channel sEMG signals and accurately identify motion intentions of lower limbs. The average recognition accuracies achieved on the Gravity dataset and ENABL3S dataset are 91.49% and 93.07%, respectively. The proposed model outperforms the baseline model in terms of recognition accuracy and training time burden. Moreover, our proposed transfer learning approach has greater efficiency compared with a training model specialized for each new users from scratch, which owes to its ability to achieve satisfactory recognition accuracy within a short calibration time by utilizing only six repetitions of training data. The research provides a viable solution to address the issue of data scarcity in practical applications and enhance user-friendliness.
引用
收藏
页数:11
相关论文
共 50 条
[31]   Lightweight silkworm recognition based on Multi-scale feature fusion [J].
Wen, Chunming ;
Wen, Jie ;
Li, Jianheng ;
Luo, Yunyun ;
Chen, Minbo ;
Xiao, Zhanpeng ;
Xu, Qing ;
Liang, Xiang ;
An, Hui .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2022, 200
[32]   MSAPVT: a multi-scale attention pyramid vision transformer network for large-scale fruit recognition [J].
Rao, Yao ;
Li, Chaofeng ;
Xu, Feiran ;
Guo, Ya .
JOURNAL OF FOOD MEASUREMENT AND CHARACTERIZATION, 2024, 18 (11) :9233-9251
[33]   An efficient fault classification method in solar photovoltaic modules using transfer learning and multi-scale convolutional neural network [J].
Korkmaz, Deniz ;
Acikgoz, Hakan .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2022, 113
[34]   Colon polyp detection based on multi-scale and multi-level feature fusion and lightweight convolutional neural network [J].
Li, Yiyang ;
Zhao, Jiayi ;
Yu, Ruoyi ;
Liu, Huixiang ;
Liang, Shuang ;
Gu, Yu .
Shengwu Yixue Gongchengxue Zazhi/Journal of Biomedical Engineering, 2024, 41 (05) :911-918
[35]   Recognition of Punctured Convolutional Codes Based on Multi-scale CNN [J].
Yang, Jie ;
Yan, Changyi ;
Ma, Ying ;
He, Yixin ;
Yang, Jie .
2023 IEEE 98TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2023-FALL, 2023,
[36]   Vehicle-logo Recognition Based on Convolutional Neural Network with Multi-scale Parallel Layers [J].
Zhang, Su-wen ;
Zhang, Yong-hui ;
Yang, Jie ;
Li, Song-bin .
INTERNATIONAL CONFERENCE ON COMPUTER, MECHATRONICS AND ELECTRONIC ENGINEERING (CMEE 2016), 2016,
[37]   Multi-scale spatial–temporal convolutional neural network for skeleton-based action recognition [J].
Qin Cheng ;
Jun Cheng ;
Ziliang Ren ;
Qieshi Zhang ;
Jianming Liu .
Pattern Analysis and Applications, 2023, 26 (3) :1303-1315
[38]   Lightweight sparse optoacoustic image reconstruction via an attention-driven multi-scale wavelet network [J].
Zhao, Xudong ;
Hu, Shuguo ;
Yang, Qiang ;
Zhang, Zhiwei ;
Guo, Qianjin ;
Niu, Chaojun .
PHOTOACOUSTICS, 2025, 42
[39]   Transferring scale-independent features to support multi-scale object recognition with deep convolutional neural network [J].
Zhou, Xiran .
26TH ACM SIGSPATIAL INTERNATIONAL CONFERENCE ON ADVANCES IN GEOGRAPHIC INFORMATION SYSTEMS (ACM SIGSPATIAL GIS 2018), 2018, :614-615
[40]   Multi-scale Fusion Attention Network for Polyp Segmentation [J].
Huang, Dongjin ;
Han, Kaili ;
Xi, Yongjie ;
Che, Wenqi .
NEURAL INFORMATION PROCESSING, ICONIP 2021, PT VI, 2022, 1517 :160-167