Human-machine interface for two-dimensional steering control with the auricular muscles

被引:7
作者
Pinheiro, Daniel J. L. L. [1 ,2 ]
Faber, Jean [1 ,3 ]
Micera, Silvestro [2 ,4 ]
Shokur, Solaiman [2 ]
机构
[1] Univ Fed Sao Paulo, Dept Neurol & Neurosurg, Div Neurosci, Neuroengn & Neurocognit Lab,Escola Paulista Med, Sao Paulo, Brazil
[2] Ecole Polytech Fed Lausanne, Inst Neuro 10, Translat Neural Engn Lab, Geneva, Switzerland
[3] Univ Fed Sao Paulo, Div Biomed Engn, Neuroengn Lab, Inst Ciencia & Tecnol, Sao Jose Dos Campos, Brazil
[4] Inst BioRobot Interdisciplinary Hlth Ctr, Scuola Super St Anna, Dept Excellence Robot & AI, Pisa, Italy
基金
瑞士国家科学基金会;
关键词
Neuroprosthetics; human-machine interface; auricular muscle; motor decoding; steering control; FACIAL ELECTROMYOGRAPHY; COMPUTER-INTERFACE; HEAD ORIENTATION; CURSOR CONTROL; INDIVIDUALS; PERFORMANCE; SYSTEM;
D O I
10.3389/fnbot.2023.1154427
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Human-machine interfaces (HMIs) can be used to decode a user's motor intention to control an external device. People that suffer from motor disabilities, such as spinal cord injury, can benefit from the uses of these interfaces. While many solutions can be found in this direction, there is still room for improvement both from a decoding, hardware, and subject-motor learning perspective. Here we show, in a series of experiments with non-disabled participants, a novel decoding and training paradigm allowing naive participants to use their auricular muscles (AM) to control two degrees of freedom with a virtual cursor. AMs are particularly interesting because they are vestigial muscles and are often preserved after neurological diseases. Our method relies on the use of surface electromyographic records and the use of contraction levels of both AMs to modulate the velocity and direction of a cursor in a two-dimensional paradigm. We used a locking mechanism to fix the current position of each axis separately to enable the user to stop the cursor at a certain location. A five-session training procedure (20-30 min per session) with a 2D center-out task was performed by five volunteers. All participants increased their success rate (Initial: 52.78 +/- 5.56%; Final: 72.22 +/- 6.67%; median +/- median absolute deviation) and their trajectory performances throughout the training. We implemented a dual task with visual distractors to assess the mental challenge of controlling while executing another task; our results suggest that the participants could perform the task in cognitively demanding conditions (success rate of 66.67 +/- 5.56%). Finally, using the Nasa Task Load Index questionnaire, we found that participants reported lower mental demand and effort in the last two sessions. To summarize, all subjects could learn to control the movement of a cursor with two degrees of freedom using their AM, with a low impact on the cognitive load. Our study is a first step in developing AM-based decoders for HMIs for people with motor disabilities, such as spinal cord injury.
引用
收藏
页数:12
相关论文
共 48 条
[1]   Intrafascicular peripheral nerve stimulation produces fine functional hand movements in primates [J].
Badi, Marion ;
Wurth, Sophie ;
Scarpato, Ilaria ;
Roussinova, Evgenia ;
Losanno, Elena ;
Bogaard, Andrew ;
Delacombaz, Maude ;
Borgognon, Simon ;
Cvancara, Paul ;
Fallegger, Florian ;
Su, David K. ;
Schmidlin, Eric ;
Courtine, Gregoire ;
Bloch, Jocelyne ;
Lacour, Stephanie P. ;
Stieglitz, Thomas ;
Rouiller, Eric M. ;
Capogrosso, Marco ;
Micera, Silvestro .
SCIENCE TRANSLATIONAL MEDICINE, 2021, 13 (617)
[2]   HiBSO Hip Exoskeleton: Toward a Wearable and Autonomous Design [J].
Baud, R. ;
Ortlieb, A. ;
Olivier, J. ;
Bouri, M. ;
Bleuler, H. .
NEW TRENDS IN MEDICAL AND SERVICE ROBOTS: DESIGN, ANALYSIS AND CONTROL, 2018, 48 :185-195
[3]   An exoskeleton controlled by an epidural wireless brain-machine interface in a tetraplegic patient: a proof-of-concept demonstration [J].
Benabid, Alim Louis ;
Costecalde, Thomas ;
Eliseyev, Andrey ;
Charvet, Guillaume ;
Verney, Alexandre ;
Karakas, Serpil ;
Foerster, Michael ;
Lambert, Aurelien ;
Moriniere, Boris ;
Abroug, Neil ;
Schaeffer, Marie-Caroline ;
Moly, Alexandre ;
Sauter-Starace, Fabien ;
Ratel, David ;
Moro, Cecile ;
Torres-Martinez, Napoleon ;
Langar, Lilia ;
Oddoux, Manuela ;
Polosan, Mircea ;
Pezzani, Stephane ;
Auboiroux, Vincent ;
Aksenova, Tetiana ;
Mestais, Corinne ;
Chabardes, Stephan .
LANCET NEUROLOGY, 2019, 18 (12) :1112-1122
[4]   A Human-Machine Interface Based on Eye Tracking for Controlling and Monitoring a Smart Home Using the Internet of Things [J].
Bissoli, Alexandre ;
Lavino-Junior, Daniel ;
Sime, Mariana ;
Encarnacao, Lucas ;
Bastos-Filho, Teodiano .
SENSORS, 2019, 19 (04)
[5]   A Facial Electromyography Activity Detection Method in Silent Speech Recognition [J].
Cai, Huihui ;
Zhang, Yakun ;
Xie, Liang ;
Yan, Huijiong ;
Qin, Wei ;
Yan, Ye ;
Yin, Erwei ;
Xu, Minpeng ;
Ming, Dong .
2021 INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE BIG DATA AND INTELLIGENT SYSTEMS (HPBD&IS), 2021, :246-251
[6]   Long-term stability of neural prosthetic control signals from silicon cortical arrays in rhesus macaque motor cortex [J].
Chestek, Cynthia A. ;
Gilja, Vikash ;
Nuyujukian, Paul ;
Foster, Justin D. ;
Fan, Joline M. ;
Kaufman, Matthew T. ;
Churchland, Mark M. ;
Rivera-Alvidrez, Zuley ;
Cunningham, John P. ;
Ryu, Stephen I. ;
Shenoy, Krishna V. .
JOURNAL OF NEURAL ENGINEERING, 2011, 8 (04)
[7]   Integrated electromyogram and eye-gaze tracking cursor control system for computer users with motor disabilities [J].
Chin, Craig A. ;
Barreto, Armando ;
Cremades, J. Gualberto ;
Adjouadi, Malek .
JOURNAL OF REHABILITATION RESEARCH AND DEVELOPMENT, 2008, 45 (01) :161-174
[8]   Discrete Versus Continuous Mapping of Facial Electromyography for Human-Machine Interface Control: Performance and Training Effects [J].
Cler, Meredith J. ;
Stepp, Cara E. .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2015, 23 (04) :572-580
[9]   The neural resource allocation problem when enhancing human bodies with extra robotic limbs [J].
Dominijanni, Giulia ;
Shokur, Solaiman ;
Salvietti, Gionata ;
Buehler, Sarah ;
Palmerini, Erica ;
Rossi, Simone ;
De Vignemont, Frederique ;
d'Avella, Andrea ;
Makin, Tamar R. ;
Prattichizzo, Domenico ;
Micera, Silvestro .
NATURE MACHINE INTELLIGENCE, 2021, 3 (10) :850-860
[10]   Toward EEG-Based BCI Applications for Industry 4.0: Challenges and Possible Applications [J].
Douibi, Khalida ;
Le Bars, Solene ;
Lemontey, Alice ;
Nag, Lipsa ;
Balp, Rodrigo ;
Breda, Gabriele .
FRONTIERS IN HUMAN NEUROSCIENCE, 2021, 15