Shared Intelligence for Robot Teleoperation via BMI

被引:16
作者
Beraldo, Gloria [1 ,2 ]
Tonin, Luca [1 ]
Millan, Jose del R. [3 ,4 ,5 ]
Menegatti, Emanuele [1 ]
机构
[1] Univ Padua, Dept Informat Engn, Intelligent Autonomous Syst Lab IAS Lab, I-35131 Padua, Italy
[2] CNR, Inst Cognit Sci & Technol, I-00185 Rome, Italy
[3] Univ Texas Austin, Dept Elect & Comp Engn, Austin, TX 78712 USA
[4] Univ Texas Austin, Dept Neurol, Austin, TX 78712 USA
[5] Ecole Polytech Fed Lausanne, Defitech Chair Brain Machine Interface, Campus Biotech, CH-1202 Geneva, Switzerland
关键词
Robots; Navigation; Mobile robots; Robot sensing systems; Task analysis; Trajectory; Decoding; Behavior based architecture; brain-machine interface (BMI); motor imagery; neurorobotics; shared intelligence; teleoperation; BRAIN-COMPUTER INTERFACES; ACTUATED WHEELCHAIR; COMMUNICATION; PEOPLE; BCI;
D O I
10.1109/THMS.2021.3137035
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article proposes a novel shared intelligence system for brain-machine interface (BMI) teleoperated mobile robots where user's intention and robot's intelligence are concurrent elements equally participating in the decision process. We designed the system to rely on policies guiding the robot's behavior according to the current situation. We hypothesized that the fusion of these policies would lead to the identification of the next, most probable, location of the robot in accordance with the user's expectations. We asked 13 healthy subjects to evaluate the system during teleoperated navigation tasks in a crowded office environment with a keyboard (reliable interface) and with 2-class motor imagery (MI) BMI (uncertain control channel). Experimental results show that our shared intelligence system 1) allows users to efficiently teleoperate the robot in both control modalities; 2) it ensures a level of BMI navigation performances comparable to the keyboard control; 3) it actively assists BMI users in accomplishing the tasks. These results highlight the importance of investigating advanced human-machine interaction (HMI) strategies and introducing robotic intelligence to improve the performances of BMI actuated devices.
引用
收藏
页码:400 / 409
页数:10
相关论文
共 45 条
  • [1] Akinola I, 2017, 2017 IEEE-RAS 17TH INTERNATIONAL CONFERENCE ON HUMANOID ROBOTICS (HUMANOIDS), P219, DOI 10.1109/HUMANOIDS.2017.8246878
  • [2] Ba-Viet Ngo, 2020, 2020 5th International Conference on Green Technology and Sustainable Development (GTSD), P219, DOI 10.1109/GTSD50082.2020.9303149
  • [3] Berardinelli N. H., 2018, PROC IEEE GLOBECOM W, P1, DOI DOI 10.1109/GLOCOMW.2018.8644245
  • [4] Carlson T, 2012, IEEE SYS MAN CYBERN, P3339, DOI 10.1109/ICSMC.2012.6378307
  • [5] Carlson T, 2012, IEEE INT C INT ROBOT, P5444, DOI 10.1109/IROS.2012.6386299
  • [6] Collaborative Control for a Robotic Wheelchair: Evaluation of Performance, Attention, and Workload
    Carlson, Tom
    Demiris, Yiannis
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2012, 42 (03): : 876 - 888
  • [7] Advances in Neuroprosthetic Learning and Control
    Carmena, Jose M.
    [J]. PLOS BIOLOGY, 2013, 11 (05)
  • [8] Brain-computer interfaces for communication and rehabilitation
    Chaudhary, Ujwal
    Birbaumer, Niels
    Ramos-Murguialday, Ander
    [J]. NATURE REVIEWS NEUROLOGY, 2016, 12 (09) : 513 - 525
  • [9] Non-invasive brain-computer interface system: Towards its application as assistive technology
    Cincotti, Febo
    Mattia, Donatella
    Aloise, Fabio
    Bufalari, Simona
    Schalk, Gerwin
    Oriolo, Giuseppe
    Cherubini, Andrea
    Marciani, Maria Grazia
    Babiloni, Fabio
    [J]. BRAIN RESEARCH BULLETIN, 2008, 75 (06) : 796 - 803
  • [10] A Self-Paced BCI With a Collaborative Controller for Highly Reliable Wheelchair Driving: Experimental Tests With Physically Disabled Individuals
    Cruz, Aniana
    Pires, Gabriel
    Lopes, Ana
    Carona, Carlos
    Nunes, Urbano J.
    [J]. IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2021, 51 (02) : 109 - 119