Residual Self-Calibrated Network With Multi-Scale Channel Attention for Accurate EOG-Based Eye Movement Classification

被引:0
作者
Zeng, Zheng [1 ]
Tao, Linkai [2 ]
Su, Ruizhi [1 ]
Tuheti, Adili [1 ]
Huang, Hao [1 ]
Chen, Chen [3 ,4 ]
Chen, Wei [5 ]
机构
[1] Fudan Univ, Ctr Intelligent Med Elect, Sch Informat Sci & Technol, Shanghai 200433, Peoples R China
[2] Eindhoven Univ Technol, Dept Ind Design, NL-5600 MB Eindhoven, Netherlands
[3] Fudan Univ, Shanghai Pudong Hosp, Pudong Med Ctr, Ctr Med Res & Innovat, Shanghai 201399, Peoples R China
[4] Fudan Univ, Human Phenome Inst, Shanghai 201203, Peoples R China
[5] Univ Sydney, Sch Biomed Engn, Camperdown, NSW 2050, Australia
基金
中国国家自然科学基金;
关键词
Electrooculography; Feature extraction; Electromagnetic compatibility; Electrodes; Accuracy; Convolution; Task analysis; Deep learning; electrooculogram (EOG); eye movement classification (EMC); residual self-calibrated network combined with multi-scale channel attention (RSCA);
D O I
10.1109/JBHI.2024.3432930
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, Electrooculography-based Human-Computer Interaction (EOG-HCI) technology has gained widespread attention in industrial areas, including assistive robots, augmented reality in gaming, etc. However, as the fundamental step of EOG-HCI, accurate eye movement classification (EMC) still faces a significant challenge, where their constraints in extracting discriminative features limit the performance of most existing works. To address this issue, a Residual Self-Calibrated Network with Multi-Scale Channel Attention (RSCA), focusing on efficient feature extraction and enhancement is proposed. The RSCA network first employs three self-calibrated convolution blocks within a hierarchical residual framework to fully extract the discriminative multi-scale features. Then, a multi-scale channel attention module adaptively weights the learned features to screen out the discriminative representation by aggregating the multi-scale context information along the channel dimension, thus further boosting the performance. Comprehensive experiments were performed using 5 public datasets and 7 prevailing methods for comparative validation. The results confirm that the RSCA network outperforms all other methods significantly, establishing a state-of-the-art benchmark for EOG-based EMC. Furthermore, thorough ablation analyses confirm the effectiveness of the employed modules within the RSCA network, providing valuable insights for the design of EOG-based deep models.
引用
收藏
页码:118 / 127
页数:10
相关论文
共 33 条
[1]   A comparison of EOG baseline drift mitigation techniques [J].
Barbara, Nathaniel ;
Camilleri, Tracey A. ;
Camilleri, Kenneth P. .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2020, 57
[2]   Attentional Feature Fusion [J].
Dai, Yimian ;
Gieseke, Fabian ;
Oehmcke, Stefan ;
Wu, Yiquan ;
Barnard, Kobus .
2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, :3559-3568
[3]   Res2Net: A New Multi-Scale Backbone Architecture [J].
Gao, Shang-Hua ;
Cheng, Ming-Ming ;
Zhao, Kai ;
Zhang, Xin-Yu ;
Yang, Ming-Hsuan ;
Torr, Philip .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (02) :652-662
[4]   Generative Adversarial Networks [J].
Goodfellow, Ian ;
Pouget-Abadie, Jean ;
Mirza, Mehdi ;
Xu, Bing ;
Warde-Farley, David ;
Ozair, Sherjil ;
Courville, Aaron ;
Bengio, Yoshua .
COMMUNICATIONS OF THE ACM, 2020, 63 (11) :139-144
[5]   Feasibility of Using Electrooculography-Based Eye-Trackers for Neuromarketing Applications [J].
Ha, Jisoo ;
Choi, Kang-Min ;
Im, Chang-Hwan .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
[6]   Low-Noise Magnetic Coil System for Recording 3-D Eye Movements [J].
Hageman, Kristin N. ;
Chow, Margaret R. ;
Roberts, Dale C. ;
Della Santina, Charles C. .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
[7]   Deep Multi-Scale Fusion of Convolutional Neural Networks for EMG-Based Movement Estimation [J].
Hajian, Gelareh ;
Morin, Evelyn .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2022, 30 :486-495
[8]   Uncertainty-Aware Gaze Tracking for Assisted Living Environments [J].
Her, Paris ;
Manderle, Logan ;
Dias, Philipe A. ;
Medeiros, Henry ;
Odone, Francesca .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 :2335-2347
[9]   An EOG-Based Human-Machine Interface for Wheelchair Control [J].
Huang, Qiyun ;
He, Shenghong ;
Wang, Qihong ;
Gu, Zhenghui ;
Peng, Nengneng ;
Li, Kai ;
Zhang, Yuandong ;
Shao, Ming ;
Li, Yuanqing .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2018, 65 (09) :2023-2032
[10]   Towards Reading Trackers in the Wild: Detecting Reading Activities by EOG Glasses and Deep Neural Networks [J].
Ishimaru, Shoya ;
Kise, Koichi ;
Hoshika, Kensuke ;
Dengel, Andreas ;
Kunze, Kai .
PROCEEDINGS OF THE 2017 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2017 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS (UBICOMP/ISWC '17 ADJUNCT), 2017, :704-711