Preliminary study for intonation classification of imagined speech for brain-computer interface applications

被引:0
|
作者
Casso, Isabel [1 ]
Rouillard, Jose [2 ]
Si-Mohammed, Hakim [2 ]
Betrouni, Nacim [3 ]
Cabestaing, Francois [2 ]
Basirat, Anahita [1 ]
机构
[1] Univ Lille, CNRS, UMR 9193, SCALab, F-59000 Lille, France
[2] Univ Lille, CNRS, Cent Lille, UMR 9189,CRIStAL, F-59000 Lille, France
[3] Univ Lille, CHU Lille, INSERM, U1172,Lille Neurosci & Cognit, F-59000 Lille, France
来源
2022 30TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2022) | 2022年
关键词
Intonation; imagined speech; EEG; brain-computer interfaces; prosody;
D O I
暂无
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
In the current study, we focused on decoding speech prosody from EEG. Prosody (i.e., melody and rhythm of speech) is important during communication as it allows to convey emotion and meaning. However, it has received little attention in the field of brain-computer interfaces. To address this issue, we contrasted the production of two syllables, "ba" and "da", produced mentally as an affirmation (e.g., "ba.") or a question (e.g., "ba?") using two different intonations. We focused on spectral features. After classification in the time-frequency domain, we found above chance-level accuracies in specific frequency ranges of the alpha band (7-12 Hz) early on during the production phase. We also obtained above chance-level results on a range of the low-beta band (16-20 Hz) during a late time window. Based on the visual inspection of topographies and the literature, we suggest that the results during the early time window, but not that during the late time window, reflect a genuine difference between imagined affirmation and question production. Future studies should provide more information about neural markers and underlying neuro-cognitive processes to improve the understanding of the imagined intonation production. This would pave the way for the development of speech-based BCI capable of differentiating intonation and prosody in general.
引用
收藏
页码:1238 / 1242
页数:5
相关论文
共 50 条
  • [1] Preliminary study of a brain-computer interface
    Song, YS
    Ryu, CS
    Yoo, DS
    Choi, SS
    Moon, SS
    Sohn, JH
    WORLD MULTICONFERENCE ON SYSTEMICS, CYBERNETICS AND INFORMATICS, VOL 8, PROCEEDINGS: CONCEPTS AND APPLICATIONS OF SYSTEMICS, CYBERNETICS AND INFORMATICS, 1999, : 222 - 225
  • [2] Development of a ternary hybrid fNIRS-EEG brain-computer interface based on imagined speech
    Sereshkeh, Alborz Rezazadeh
    Yousefi, Rozhin
    Wong, Andrew T.
    Rudzicz, Frank
    Chau, Tom
    BRAIN-COMPUTER INTERFACES, 2019, 6 (04) : 128 - 140
  • [3] Classification of EEG Signals for Brain-Computer Interface Applications: Performance Comparison
    Ilyas, M. Z.
    Saad, P.
    Ahmad, M. I.
    Ghani, A. R. I.
    PROCEEDINGS OF 2016 INTERNATIONAL CONFERENCE ON ROBOTICS, AUTOMATION AND SCIENCES (ICORAS 2016), 2016,
  • [4] Learning to operate an imagined speech Brain-Computer Interface involves the spatial and frequency tuning of neural activity
    Bhadra, Kinkini
    Giraud, Anne-Lise
    Marchesotti, Silvia
    COMMUNICATIONS BIOLOGY, 2025, 8 (01)
  • [5] Significant Neurophysiological Features for fNIRS-EEG Brain-Computer Interfacing of Imagined Speech
    Preedapirat, Sittha
    Wongsawat, Yodchanan
    2022 37TH INTERNATIONAL TECHNICAL CONFERENCE ON CIRCUITS/SYSTEMS, COMPUTERS AND COMMUNICATIONS (ITC-CSCC 2022), 2022, : 309 - 312
  • [6] Brain-computer interface classification based on AdaBoost
    Tian, Yin
    Li, Pei-Yang
    Xu, Peng
    Dianzi Keji Daxue Xuebao/Journal of the University of Electronic Science and Technology of China, 2013, 42 (05): : 791 - 793
  • [7] Editorial: Datasets for Brain-Computer Interface Applications
    Daly, Ian
    Matran-Fernandez, Ana
    Valeriani, Davide
    Lebedev, Mikhail
    Kuebler, Andrea
    FRONTIERS IN NEUROSCIENCE, 2021, 15
  • [8] COMPARISON OF FOUR CLASSIFICATION METHODS FOR BRAIN-COMPUTER INTERFACE
    Frolov, Alexander
    Husek, Dusan
    Bobrov, Pavel
    NEURAL NETWORK WORLD, 2011, 21 (02) : 101 - 115
  • [9] Age and gender classification using brain-computer interface
    Kaur, Barjinder
    Singh, Dinesh
    Roy, Partha Pratim
    NEURAL COMPUTING & APPLICATIONS, 2019, 31 (10) : 5887 - 5900
  • [10] Multiclass Brain-Computer Interface Classification by Riemannian Geometry
    Barachant, Alexandre
    Bonnet, Stephane
    Congedo, Marco
    Jutten, Christian
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2012, 59 (04) : 920 - 928