DEEP REINFORCEMENT LEARNING FOR MYOELECTRIC CONTROL OF UPPER LIMB MOVEMENTS

被引:0
|
作者
Santos, Mafalda [1 ]
Kokkinogenis, Zafeiris [1 ]
Rossetti, Rosaldo J. F. [1 ]
机构
[1] Univ Porto FEUP, Artificial Intelligence & Comp Sci Lab LIACC, Dept Informat Engn DEI, Fac Engn, Rua Dr Roberto Frias, P-4200465 Porto, Portugal
来源
36TH ANNUAL EUROPEAN SIMULATION AND MODELLING CONFERENCE, ESM 2022 | 2022年
关键词
Deep Reinforcement Learning; Control Problem; Upper Limb Model;
D O I
暂无
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Limb dysfunction and, in some cases, even amputation is a reality that several people worldwide have to face on a daily basis. The objective of this research is to implement a Deep Reinforcement Learning model capable of moving a virtual arm in response to a person's brain activity. It also aims to explore and study the advantages and limitations of using these approaches to solve control problems in prosthetic robotics. With this in mind, the implementation structure can be divided into three main components. Firstly, processing the data that consists of electromyography (EMG) signals from the bicep and tricep muscles. Afterwards, the development and analysis of a supervised learning approach followed by different Reinforcement Learning scenarios. Finally, the work also addresses the generalisation problem by testing the performance of a trained model when facing a new subject's EMG signals. According to this analysis, the algorithm that offered the best results was a Deep Deterministic Policy Gradient version optimised for sample efficiency. It showed great potential to be used in real-life scenarios. However, when approaching the generalisation, this same algorithm showed inferior results, suggesting that further research is required.
引用
收藏
页码:145 / 149
页数:5
相关论文
共 50 条
  • [1] Control of chaotic systems by deep reinforcement learning
    Bucci, M. A.
    Semeraro, O.
    Allauzen, A.
    Wisniewski, G.
    Cordier, L.
    Mathelin, L.
    PROCEEDINGS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES, 2019, 475 (2231):
  • [2] Deep Reinforcement Learning to Assist Command and Control
    Park, Song Jun
    Vindiola, Manuel M.
    Logie, Anne C.
    Narayanan, Priya
    Davies, Jared
    ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING FOR MULTI-DOMAIN OPERATIONS APPLICATIONS IV, 2022, 12113
  • [3] Framework for Control and Deep Reinforcement Learning in Traffic
    Wu, Cathy
    Parvate, Kanaad
    Kheterpal, Nishant
    Dickstein, Leah
    Mehta, Ankur
    Vinitsky, Eugene
    Bayen, Alexandre M.
    2017 IEEE 20TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2017,
  • [4] Deep Reinforcement Learning for RAN Optimization and Control
    Chen, Yu
    Chen, Jie
    Krishnamurthi, Ganesh
    Yang, Huijing
    Wang, Huahui
    Zhao, Wenjie
    2021 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2021,
  • [5] Neural Malware Control with Deep Reinforcement Learning
    Wang, Yu
    Stokes, Jack W.
    Marinescu, Mady
    MILCOM 2019 - 2019 IEEE MILITARY COMMUNICATIONS CONFERENCE (MILCOM), 2019,
  • [6] Satellite Attitude Control with Deep Reinforcement Learning
    Gao, Duozhi
    Zhang, Haibo
    Li, Chuanjiang
    Gao, Xinzhou
    2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 4095 - 4101
  • [7] Deep reinforcement learning control of hydraulic fracturing
    Bangi, Mohammed Saad Faizan
    Kwon, Joseph Sang-Il
    COMPUTERS & CHEMICAL ENGINEERING, 2021, 154
  • [8] Robust walking control of a lower limb rehabilitation exoskeleton coupled with a musculoskeletal model via deep reinforcement learning
    Luo, Shuzhen
    Androwis, Ghaith
    Adamovich, Sergei
    Nunez, Erick
    Su, Hao
    Zhou, Xianlian
    JOURNAL OF NEUROENGINEERING AND REHABILITATION, 2023, 20 (01)
  • [9] Robust walking control of a lower limb rehabilitation exoskeleton coupled with a musculoskeletal model via deep reinforcement learning
    Shuzhen Luo
    Ghaith Androwis
    Sergei Adamovich
    Erick Nunez
    Hao Su
    Xianlian Zhou
    Journal of NeuroEngineering and Rehabilitation, 20
  • [10] A survey on deep learning and deep reinforcement learning in robotics with a tutorial on deep reinforcement learning
    Morales, Eduardo F.
    Murrieta-Cid, Rafael
    Becerra, Israel
    Esquivel-Basaldua, Marco A.
    INTELLIGENT SERVICE ROBOTICS, 2021, 14 (05) : 773 - 805