Preliminary study for intonation classification of imagined speech for brain-computer interface applications

被引:0
作者
Casso, Isabel [1 ]
Rouillard, Jose [2 ]
Si-Mohammed, Hakim [2 ]
Betrouni, Nacim [3 ]
Cabestaing, Francois [2 ]
Basirat, Anahita [1 ]
机构
[1] Univ Lille, CNRS, UMR 9193, SCALab, F-59000 Lille, France
[2] Univ Lille, CNRS, Cent Lille, UMR 9189,CRIStAL, F-59000 Lille, France
[3] Univ Lille, CHU Lille, INSERM, U1172,Lille Neurosci & Cognit, F-59000 Lille, France
来源
2022 30TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2022) | 2022年
关键词
Intonation; imagined speech; EEG; brain-computer interfaces; prosody;
D O I
暂无
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
In the current study, we focused on decoding speech prosody from EEG. Prosody (i.e., melody and rhythm of speech) is important during communication as it allows to convey emotion and meaning. However, it has received little attention in the field of brain-computer interfaces. To address this issue, we contrasted the production of two syllables, "ba" and "da", produced mentally as an affirmation (e.g., "ba.") or a question (e.g., "ba?") using two different intonations. We focused on spectral features. After classification in the time-frequency domain, we found above chance-level accuracies in specific frequency ranges of the alpha band (7-12 Hz) early on during the production phase. We also obtained above chance-level results on a range of the low-beta band (16-20 Hz) during a late time window. Based on the visual inspection of topographies and the literature, we suggest that the results during the early time window, but not that during the late time window, reflect a genuine difference between imagined affirmation and question production. Future studies should provide more information about neural markers and underlying neuro-cognitive processes to improve the understanding of the imagined intonation production. This would pave the way for the development of speech-based BCI capable of differentiating intonation and prosody in general.
引用
收藏
页码:1238 / 1242
页数:5
相关论文
共 50 条
[21]   Demystifying Cognitive Informatics and its Applications in Brain-Computer Interface [J].
Sharma, Prakash Chandra ;
Raja, Rohit ;
Vishwakarma, Santosh Kumar ;
Shankar, Venkatesh Gauri .
WIRELESS PERSONAL COMMUNICATIONS, 2023, 129 (02) :1343-1368
[22]   Demystifying Cognitive Informatics and its Applications in Brain-Computer Interface [J].
Prakash Chandra Sharma ;
Rohit Raja ;
Santosh Kumar Vishwakarma ;
Venkatesh Gauri Shankar .
Wireless Personal Communications, 2023, 129 :1343-1368
[23]   Editorial: Datasets for brain-computer interface applications, volume II [J].
Daly, Ian ;
Matran-Fernandez, Ana ;
Lebedev, Mikhail A. ;
Kuebler, Andrea ;
Valeriani, Davide .
FRONTIERS IN NEUROSCIENCE, 2025, 19
[24]   Exploring inter-trial coherence for inner speech classification in EEG-based brain-computer interface [J].
Lopez-Bernal, Diego ;
Balderas, David ;
Ponce, Pedro ;
Molina, Arturo .
JOURNAL OF NEURAL ENGINEERING, 2024, 21 (02)
[25]   A Noninvasive Brain-Computer Interface for Real-Time Speech Synthesis: The Importance of Multimodal Feedback [J].
Brumberg, Jonathan S. ;
Pitt, Kevin M. ;
Burnison, Jeremy D. .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2018, 26 (04) :874-881
[26]   A Novel Classification Method for Motor Imagery Based on Brain-Computer Interface [J].
Chen, Chih-Yu ;
Wu, Chun-Wei ;
Lin, Chin-Teng ;
Chen, Shi-An .
PROCEEDINGS OF THE 2014 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2014, :4099-4102
[27]   Binarization Methods for Motor-Imagery Brain-Computer Interface Classification [J].
Hersche, Michael ;
Benini, Luca ;
Rahimi, Abbas .
IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2020, 10 (04) :567-577
[28]   Decoding Imagined Speech and Computer Control using Brain Waves [J].
Singh, Abhiram ;
Gumaste, Ashwin .
JOURNAL OF NEUROSCIENCE METHODS, 2021, 358
[29]   Research on the EEG Recognition for Brain-Computer Interface of Speech Based on DIVA Model [J].
Zhang, Shaobai ;
Zeng, You .
PROCEEDINGS OF THE 2015 CHINESE INTELLIGENT AUTOMATION CONFERENCE: INTELLIGENT TECHNOLOGY AND SYSTEMS, 2015, 338 :245-256
[30]   Development of a Motor Imagery Based Brain-computer Interface for Humanoid Robot Control Applications [J].
Prakaksita, Narendra ;
Kuo, Chen-Yun ;
Kuo, Chung-Hsien .
PROCEEDINGS 2016 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL TECHNOLOGY (ICIT), 2016, :1607-1613