Neural decoding of electrocorticographic signals using dynamic mode decomposition

被引:19
|
作者
Shiraishi, Yoshiyuki [1 ]
Kawahara, Yoshinobu [2 ,3 ]
Yamashita, Okito [2 ,4 ]
Fukuma, Ryohei [1 ,5 ]
Yamamoto, Shota [5 ]
Saitoh, Youichi [5 ,6 ]
Kishima, Haruhiko [5 ]
Yanagisawa, Takufumi [1 ,5 ,7 ]
机构
[1] Osaka Univ, Inst Adv Cocreat Studies, 2-2 Yamadaoka, Suita, Osaka 5650871, Japan
[2] RIKEN, Ctr Adv Intelligence Project, Chuo Ku, Nihonbashi 1 Chome Mitsui Bldg,15th Floor, Tokyo 1030027, Japan
[3] Kyushu Univ, Inst Math Ind, Nishi Ku, 744 Motooka, Fukuoka 8190395, Japan
[4] ATR Neural Informat Anal Labs, Dept Computat Brain Imaging, 2-2-2 Hikaridai, Seika, Kyoto 6190288, Japan
[5] Osaka Univ, Dept Neurosurg, Grad Sch Med, 2-2 Yamadaoka, Suita, Osaka 5650871, Japan
[6] Osaka Univ, Dept Neuromodulat & Neurosurg, Grad Sch Med, 2-2 Yamadaoka, Suita, Osaka 5650871, Japan
[7] ATR Computat Neurosci Labs, Dept Neuroinformat, 2-2-2 Hikaridai, Seika, Kyoto 6190288, Japan
基金
日本科学技术振兴机构;
关键词
dynamic mode decomposition; electrocorticography; neural decoding; Grassmann kernel; principal angle; BRAIN-COMPUTER INTERFACE; GRASP;
D O I
10.1088/1741-2552/ab8910
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Objective. Brain-computer interfaces (BCIs) using electrocorticographic (ECoG) signals have been developed to restore the communication function of severely paralyzed patients. However, the limited amount of information derived from ECoG signals hinders their clinical applications. We aimed to develop a method to decode ECoG signals using spatiotemporal patterns characterizing movement types to increase the amount of information gained from these signals. Approach. Previous studies have demonstrated that motor information could be decoded using powers of specific frequency bands of the ECoG signals estimated by fast Fourier transform (FFT) or wavelet analysis. However, because FFT is evaluated for each channel, the temporal and spatial patterns among channels are difficult to evaluate. Here, we used dynamic mode decomposition (DMD) to evaluate the spatiotemporal pattern of ECoG signals and evaluated the accuracy of motor decoding with the DMD modes. We used ECoG signals during three types of hand movements, which were recorded from 11 patients implanted with subdural electrodes. From the signals at the time of the movements, the modes and powers were evaluated by DMD and FFT and were decoded using support vector machine. We used the Grassmann kernel to evaluate the distance between modes estimated by DMD (DMD mode). In addition, we decoded the DMD modes, in which the phase components were shuffled, to compare the classification accuracy. Main results. The decoding accuracy using DMD modes was significantly better than that using FFT powers. The accuracy significantly decreased when the phases of the DMD mode were shuffled. Among the frequency bands, the DMD mode at approximately 100 Hz demonstrated the highest classification accuracy. Significance. DMD successfully captured the spatiotemporal patterns characterizing the movement types and contributed to improving the decoding accuracy. This method can be applied to improve BCIs to help severely paralyzed patients communicate.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Decoding three-dimensional reaching movements using electrocorticographic signals in humans
    Bundy, David T.
    Pahwa, Mrinal
    Szrama, Nicholas
    Leuthardt, Eric C.
    JOURNAL OF NEURAL ENGINEERING, 2016, 13 (02)
  • [2] Decoding flexion of individual fingers using electrocorticographic signals in humans
    Kubanek, J.
    Miller, K. J.
    Ojemann, J. G.
    Wolpaw, J. R.
    Schalk, G.
    JOURNAL OF NEURAL ENGINEERING, 2009, 6 (06)
  • [3] Decoding fingertip trajectory from electrocorticographic signals in humans
    Nakanishi, Yasuhiko
    Yanagisawa, Takufumi
    Shin, Duk
    Chen, Chao
    Kambara, Hiroyuki
    Yoshimura, Natsue
    Fukuma, Ryohei
    Kishima, Haruhiko
    Hirata, Masayuki
    Koike, Yasuharu
    NEUROSCIENCE RESEARCH, 2014, 85 : 20 - 27
  • [4] Decoding Action Planning of three-dimensional Movements Using Electrocorticographic signals
    Yang, Yu Jin
    Kim, June Sic
    Chung, Chun Kee
    2023 11TH INTERNATIONAL WINTER CONFERENCE ON BRAIN-COMPUTER INTERFACE, BCI, 2023,
  • [5] Decoding vowels and consonants in spoken and imagined words using electrocorticographic signals in humans
    Pei, Xiaomei
    Barbour, Dennis L.
    Leuthardt, Eric C.
    Schalk, Gerwin
    JOURNAL OF NEURAL ENGINEERING, 2011, 8 (04)
  • [6] Classification of Epileptic EEG Signals Using Dynamic Mode Decomposition
    Cura, Ozlem Karabiber
    Pehlivan, Sude
    Akan, Aydin
    2020 28TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2020,
  • [7] Decoding Multi-Class EEG Signals of Hand Movement Using Multivariate Empirical Mode Decomposition and Convolutional Neural Network
    Tao, Yi
    Xu, Weiwei
    Wang, Guangming
    Yuan, Ziwen
    Wang, Maode
    Houston, Michael
    Zhang, Yingchun
    Chen, Badong
    Yan, Xiangguo
    Wang, Gang
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2022, 30 : 2754 - 2763
  • [8] Decoding micro-electrocorticographic signals by using explainable 3D convolutional neural network to predict finger movements
    Kuo, Chao-Hung
    Liu, Guan-Tze
    Lee, Chi-En
    Wu, Jing
    Casimo, Kaitlyn
    Weaver, Kurt E.
    Lo, Yu-Chun
    Chen, You-Yin
    Huang, Wen-Cheng
    Ojemann, Jeffrey G.
    JOURNAL OF NEUROSCIENCE METHODS, 2024, 411
  • [9] Decoding Semantic Information from Human Electrocorticographic (ECoG) Signals
    Wang, Wei
    Degenhart, Alan D.
    Sudre, Gustavo P.
    Pomerleau, Dean A.
    Tyler-Kabara, Elizabeth C.
    2011 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2011, : 6294 - 6298
  • [10] Prior knowledge improves decoding of finger flexion from electrocorticographic signals
    Wang, Z.
    Ji, Q.
    Miller, K. J.
    Schalk, Gerwin
    FRONTIERS IN NEUROSCIENCE, 2011, 5