Function block-based human-robot collaborative assembly driven by brainwaves

被引：25

作者：

Wang, Lihui ^{[1
]}

Liu, Sichao ^{[1
]}

Cooper, Clayton ^{[2
]}

Wang, Xi Vincent ^{[1
]}

Gao, Robert X. ^{[2
]}

机构：

[1] KTH Royal Inst Technol, Dept Prod Engn, Stockholm, Sweden

[2] Case Western Reserve Univ, Dept Mech & Aerosp Engn, Cleveland, OH 44106 USA

来源：

CIRP ANNALS-MANUFACTURING TECHNOLOGY | 2021年 / 70卷 / 01期

基金：

美国国家科学基金会;

关键词：

Assembly; Human-robot collaboration; Brainwaves;

D O I：

10.1016/j.cirp.2021.04.091

中图分类号：

T [工业技术];

学科分类号：

08 ;

摘要：

As an emerging communication modality, brainwaves can be used to control robots for seamless assembly, especially in noisy environments where voice recognition is not reliable or when an operator is occupied with other tasks and unable to make gestures. This paper investigates human-robot collaborative assembly based on function blocks and driven by brainwaves. Using wavelet transform, brainwaves measured by EEG sensors are converted to time-frequency images and subsequently classified by a convolutional neural network (CNN) as commands to trigger a network of function blocks for assembly actions. The effectiveness of the system is experimentally validated through an engine-assembly case study. (c) 2021 CIRP. Published by Elsevier Ltd. All rights reserved.

引用

页码：5 / 8

页数：4

共 16 条

[1] Intuitive Adaptive Orientation Control for Enhanced Human-Robot Interaction [J].

Campeau-Lecours, Alexandre ;

Cote-Allard, Ulysse ;

Dinh-Son Vu ;

Routhier, Francois ;

Gosselin, Benoit ;

Gosselin, Clement .

IEEE TRANSACTIONS ON ROBOTICS, 2019, 35 (02) :509-520

[2]

Canziani A., 2016, ARXIV PREPRINT ARXIV

[3] Neuroengineering challenges of fusing robotics and neuroscience [J].

Cheng, Gordon ;

Ehrlich, Stefan K. ;

Lebedev, Mikhail ;

Nicolelis, Miguel A. L. .

SCIENCE ROBOTICS, 2020, 5 (49)

[4]

Gao RX, 2011, WAVELETS: THEORY AND APPLICATIONS FOR MANUFACTURING, P1, DOI 10.1007/978-1-4419-1545-0

[5] Innovative control of assembly systems and lines [J].

Krueger, J. ;

Wang, L. ;

Verl, A. ;

Bauernhansl, T. ;

Carpanzano, E. ;

Makris, S. ;

Fleischer, J. ;

Reinhart, G. ;

Franke, J. ;

Pellegrinelli, S. .

CIRP ANNALS-MANUFACTURING TECHNOLOGY, 2017, 66 (02) :707-730

[6] Sensorless haptic control for human-robot collaborative assembly [J].

Liu, Sichao ;

Wang, Lihui ;

Wang, Xi Vincent .

CIRP JOURNAL OF MANUFACTURING SCIENCE AND TECHNOLOGY, 2021, 32 :132-144

[7]

Lyu G, 2020, IEEE T IND INFORM, V3203, P1

[8] A Brain-Robot Interaction System by Fusing Human and Machine Intelligence [J].

Mao, Xiaoqian ;

Li, Wei ;

Lei, Chengwei ;

Jin, Jing ;

Duan, Feng ;

Chen, Sherry .

IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2019, 27 (03) :533-542

[9] Brainwaves driven human-robot collaborative assembly [J].

Mohammed, Abdullah ;

Wang, Lihui .

CIRP ANNALS-MANUFACTURING TECHNOLOGY, 2018, 67 (01) :13-16

[10]

Simonyan K, 2015, Arxiv, DOI arXiv:1409.1556

← 1 2 →