Integration of a BCI with a Hand Tracking System and a Motorized Robotic Arm to Improve Decoding of Brain Signals Related to Hand and Finger Movements

被引:2
|
作者
Placidi, Giuseppe [1 ]
De Gasperis, Giovanni [2 ]
Mignosi, Filippo [2 ]
Polsinelli, Matteo [1 ]
Spezialetti, Matteo [2 ]
机构
[1] Univ Aquila, Dept MeSVA, A2VI Lab, Via Vetoio Coppito, I-67100 Laquila, Italy
[2] Univ Aquila, Dept DISIM, Via Vetoio Coppito, I-67100 Laquila, Italy
来源
ADVANCES IN VISUAL COMPUTING (ISVC 2021), PT I | 2021年 / 13017卷
关键词
Sensory-motor BCI; Computer vision; Virtual glove; Hand tracking; Robots; Neuroscience; Brain signal decoding; COMPUTER-INTERFACE; IMAGERY;
D O I
10.1007/978-3-030-90439-5_24
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Nowadays, most of the functional relationships between brain signals and the corresponding complex hand/fingers movements (cause, effect, feedback) are not yet completely understood. In the last years it has been assisted to important advances in Brain Computer Interfaces (BCI), computer vision (CV)-based tracking systems and Robots, especially due to: hardware improvements and miniaturization; increasing pursuit of intelligent and real time tracking systems; fast design, prototyping and production of consumer robots facilitated by 3D printing technologies. We present an integrated system composed by a BCI, a CV-based hand tracking system and a motorized robotic arm reproducing the hand and the forearm of a person (scale 1:1). The proposal is to synchronize and to monitor the brain activity during complex hand and fingers movements (interpreted and reproduced in real time on a numerical hand model by the tracking system). Further, we aim at recognizing the brain signals which give rise to specific movements and, finally, at using them for producing the corresponding movements on the robotic arm. Different scenarios and potential use-cases are reported and their usefulness discussed.
引用
收藏
页码:305 / 315
页数:11
相关论文
共 1 条
  • [1] Training in Use of Brain-Machine Interface-Controlled Robotic Hand Improves Accuracy Decoding Two Types of Hand Movements
    Fukuma, Ryohei
    Yanagisawa, Takufumi
    Yokoi, Hiroshi
    Hirata, Masayuki
    Yoshimine, Toshiki
    Saitoh, Youichi
    Kamitani, Yukiyasu
    Kishima, Haruhiko
    FRONTIERS IN NEUROSCIENCE, 2018, 12