A human-machine interface based on single channel EOG and patchable sensor

被引:32
作者
Guo, Xuhong [1 ]
Pei, Weihua [1 ]
Wang, Yijun [1 ]
Chen, Yuanfang [1 ]
Zhang, He [1 ]
Wu, Xian [1 ]
Yang, Xiaowei [1 ]
Chen, Hongda [1 ]
Liu, Yuanyuan [2 ]
Liu, Ruicong [2 ]
机构
[1] Chinese Acad Sci, CAS Ctr Excellence Brain Sci & Intelligence Techn, Inst Semicond, Beijing, Peoples R China
[2] Chinese Acad Sci, Engn Res Ctr Semicond Integrated Technol, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Flexible patchable sensor; Electrooculography; Human-machine interface; ELECTROOCULOGRAPHY; SYSTEM;
D O I
10.1016/j.bspc.2016.06.018
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Goal: This study demonstrates that single channel electrooculography (EOG) recorded by ultrathin and flexible electrodes can be practically used to control computer or machine, with the aid of proper recognition algorithms and efficient controlling methods. Methods: First, micro-fabrication process and transfer technology were used to develop a patchable sensor including three electrodes (a measurement electrode, a ground electrode, and a reference electrode). Each electrode was composed of golden ribbon in the form of a filamentary serpentine mesh to provide conformal contact of skin and stretchability. Second, EOG was recorded by the proposed sensor installed above the eyebrow. The peak and trough of eye movement signals were extracted as features to recognize three types of eye movements (blink, upward and downward) using a threshold-based recognition algorithm. Finally, a human-machine interface (HMI) system was realized by converting eye movements to computer commands including scroll up, scroll down, and close. To verify the effectiveness of the system, eight subjects were trained to use their eye movements to navigate a document on the screen. Results: The sensor was approximately triangular with a 5 cm side-length and a 70 um thickness. The electrode can be stretched to 10% longer without any damage. The weight of the sensor was 180 mg. The demonstration system was capable of making continuous controls with an average accuracy of 84%. Conclusion: Single channel EOG recorded with a patchable sensor is feasible for developing a wearable HMI system. The proposed system provides a comfortable user experience, a stable control method and a simple systematic framework for developing practical HMI systems. (C) 2016 Elsevier Ltd. All rights reserved.
引用
收藏
页码:98 / 105
页数:8
相关论文
共 21 条
[1]   A Novel Biometric Approach for Human Identification and Verification Using Eye Blinking Signal [J].
Abo-Zahhad, M. ;
Ahmed, Sabah M. ;
Abbas, Sherif N. .
IEEE SIGNAL PROCESSING LETTERS, 2015, 22 (07) :876-880
[2]  
Ang A.M.S., 2015, 7 ANN INT IEEE EMBS, P865
[3]   Online classification algorithm for eye-movement-based communication systems using two temporal EEG sensors [J].
Belkacem, Abdelkader Nasreddine ;
Shin, Duk ;
Kambara, Hiroyuki ;
Yoshimura, Natsue ;
Koike, Yasuharu .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2015, 16 :40-47
[4]  
Bo Ning, 2012, Intelligent Robotics and Applications. Proceedings of the 5th International Conference, ICIRA 2012, P579, DOI 10.1007/978-3-642-33509-9_58
[5]   EOG-based Human-Computer Interface system development [J].
Deng, Lawrence Y. ;
Hsu, Chun-Liang ;
Lin, Tzu-Ching ;
Tuan, Jui-Sen ;
Chang, Shih-Ming .
EXPERT SYSTEMS WITH APPLICATIONS, 2010, 37 (04) :3337-3343
[6]   Preliminary technological assessment of microneedles-based dry electrodes for biopotential monitoring in clinical examinations [J].
Forvi, Elena ;
Bedoni, Marzia ;
Carabalona, Roberta ;
Soncini, Monica ;
Mazzoleni, Paolo ;
Rizzo, Francesco ;
O'Mahony, Conor ;
Morasso, Carlo ;
Cassara, Domenico Giorgio ;
Gramatica, Furio .
SENSORS AND ACTUATORS A-PHYSICAL, 2012, 180 :177-186
[7]   Biosensor Technologies for Augmented Brain-Computer Interfaces in the Next Decades [J].
Liao, Lun-De ;
Lin, Chin-Teng ;
McDowell, Kaleb ;
Wickenden, Alma E. ;
Gramann, Klaus ;
Jung, Tzyy-Ping ;
Ko, Li-Wei ;
Chang, Jyh-Yeong .
PROCEEDINGS OF THE IEEE, 2012, 100 :1553-1566
[8]   An online brain-computer interface using non-flashing visual evoked potentials [J].
Liu, Tao ;
Goldberg, Leslie ;
Gao, Shangkai ;
Hong, Bo .
JOURNAL OF NEURAL ENGINEERING, 2010, 7 (03)
[9]   Internet browsing application based on electrooculography for disabled people [J].
Lledo, L. D. ;
Ubeda, A. ;
Ianez, E. ;
Azorin, J. M. .
EXPERT SYSTEMS WITH APPLICATIONS, 2013, 40 (07) :2640-2648
[10]   A Novel EOG/EEG Hybrid Human-Machine Interface Adopting Eye Movements and ERPs: Application to Robot Control [J].
Ma, Jiaxin ;
Zhang, Yu ;
Cichocki, Andrzej ;
Matsuno, Fumitoshi .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2015, 62 (03) :876-889