DSCNN-CAU: Deep-Learning-Based Mental Activity Classification for IoT Implementation Toward Portable BCI

被引:13
作者
Saini, Manali [1 ]
Satija, Udit [2 ]
Upadhayay, Madhur Deo [1 ]
机构
[1] Shiv Nadar Univ, Dept Elect Engn, Greater Noida 201314, India
[2] Indian Inst Technol Patna, Dept Elect Engn, Patna 801103, India
关键词
Electroencephalography; Task analysis; Feature extraction; Databases; Deep learning; Brain modeling; Arithmetic; Convolutional neural network (CNN); electroencephalogram (EEG); Internet of Things (IoT); mental activity classification (MAC); TensorFlow lite (TFLite); EEG; SYSTEM; HEALTH; ATTENTION; INTERNET; SUBJECT; MODEL; TASK;
D O I
10.1109/JIOT.2022.3232481
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Mental activity classification (MAC) based on electroencephalogram (EEG) is used in the brain-computer interface (BCI) and neurofeedback applications. For this purpose, machine learning and deep learning (DL) techniques are utilized in the previous studies. However, in real time, there is a need to deploy these techniques on Internet of Things (IoT)-enabled mobile devices for portability. Toward this aspect, we propose DL-based MAC using a depthwise separable convolutional neural network with a custom attention unit (DSCNN-CAU) and IoT implementation using a smartphone for portable BCI applications. The performance assessment on EEG signals from two public and two self-acquired databases demonstrates that the overall accuracies of 99.25%, 95.00%, and 91.50%, 89.25% are obtained, respectively. Evaluation results on smartphone depict that most of the real-time recorded EEG signals in self-acquired databases are classified correctly. Further comparative analysis demonstrates that the proposed model and the IoT implementation outperform the existing techniques in terms of accuracy, robustness against artifacts, latency, and battery current dissipation. A total current of 21 mAh is dissipated in EEG signal recording, processing, and event-based transmission to the server, and low latency of 71 ms is achieved in MAC. Further analysis of cross-database performance enables the selection of the $F_{P1}$ channel for real-time MAC in IoT-based scenarios.
引用
收藏
页码:8944 / 8957
页数:14
相关论文
共 59 条
  • [1] EEG-Based Transceiver Design With Data Decomposition for Healthcare IoT Applications
    Abdellatif, Alaa Awad
    Khafagy, Mohammad Galal
    Mohamed, Amr
    Chiasserini, Carla-Fabiana
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2018, 5 (05): : 3569 - 3579
  • [2] Anderson C. W., 1996, Solving Engineering Problems with Neural Networks. Proceedings of the International Conference on Engineering Applications of Neural Networks (EANN'96), P407
  • [3] Optimizing Motor Intention Detection With Deep Learning: Towards Management of Intraoperative Awareness
    Avilov, Oleksii
    Rimbert, Sebastien
    Popov, Anton
    Bougrain, Laurent
    [J]. IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2021, 68 (10) : 3087 - 3097
  • [4] Bai ZY, 2019, Arxiv, DOI arXiv:1910.03023
  • [5] A Hardware/Software Prototype of EEG-based BCI System for Home Device Control
    Belwafi, Kais
    Ghaffari, Fakhreddine
    Djemal, Ridha
    Romain, Olivier
    [J]. JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 2017, 89 (02): : 263 - 279
  • [6] Enabling IoT for In-Home Rehabilitation: Accelerometer Signals Classification Methods for Activity and Movement Recognition
    Bisio, Igor
    Delfino, Alessandro
    Lavagetto, Fabio
    Sciarrone, Andrea
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2017, 4 (01): : 135 - 146
  • [7] Smartphone-Centric Ambient Assisted Living Platform for Patients Suffering from Co-Morbidities Monitoring
    Bisio, Igor
    Lavagetto, Fabio
    Marchese, Mario
    Sciarrone, Andrea
    [J]. IEEE COMMUNICATIONS MAGAZINE, 2015, 53 (01) : 34 - 41
  • [8] A smartphone-centric platform for remote health monitoring of heart failure
    Bisio, Igor
    Lavagetto, Fabio
    Marchese, Mario
    Sciarrone, Andrea
    [J]. INTERNATIONAL JOURNAL OF COMMUNICATION SYSTEMS, 2015, 28 (11) : 1753 - 1771
  • [9] Machine Learning in Resource-Scarce Embedded Systems, FPGAs, and End-Devices: A Survey
    Branco, Sergio
    Ferreira, Andre G.
    Cabral, Jorge
    [J]. ELECTRONICS, 2019, 8 (11)
  • [10] ASYMMETRIES IN ELECTROENCEPHALOGRAM ASSOCIATED WITH CEREBRAL DOMINANCE
    BUTLER, SR
    GLASS, A
    [J]. ELECTROENCEPHALOGRAPHY AND CLINICAL NEUROPHYSIOLOGY, 1974, 36 (05): : 481 - 491