Investigation on Effect of Speech Imagery EEG Data Augmentation with Actual Speech

被引:0
|
作者
Choi, Jaehoon [1 ]
Kaongoen, Netiwit [1 ]
Jo, Sungho [1 ]
机构
[1] Korea Adv Inst Sci & Technol, Sch Comp, Daejeon, South Korea
来源
10TH INTERNATIONAL WINTER CONFERENCE ON BRAIN-COMPUTER INTERFACE (BCI2022) | 2022年
关键词
Brain-computer interface (BCI); Speech-imagery; Actual speech; data augmentation; CLASSIFICATION;
D O I
10.1109/BCI53720.2022.9735108
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Speech imagery based brain-computer interfaces (BCI) have been researched as a potentially powerful method to provide communication and control without explicit bodily movements. Compared to other BCI systems, speech imagery based BCIs can employ mental tasks directly related to control tasks, making them more intuitive for use in daily-life. However, training data is difficult to collect in sufficient size and number in terms of time and user comfort; preparation time to wear electroencephalogram (EEG) measurement devices are lengthy and the devices themselves are uncomfortable to use, making it difficult for subjects to undergo long training sessions without feeling fatigued. To overcome this problem, we suggest a novel data augmentation method using actual speech data. Based on the similarity between the tasks imagined speech and actual speech, we augment EEG training data of imagined speech with EEG data of actual speech and show significant improvements for two out of three subjects.
引用
收藏
页数:5
相关论文
共 50 条
  • [41] Personalized Adversarial Data Augmentation for Dysarthric and Elderly Speech Recognition
    Jin, Zengrui
    Geng, Mengzhe
    Deng, Jiajun
    Wang, Tianzi
    Hu, Shujie
    Li, Guinan
    Liu, Xunying
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2024, 32 : 413 - 429
  • [42] Audio Augmentation for Speech Recognition
    Ko, Tom
    Peddinti, Vijayaditya
    Povey, Daniel
    Khudanpur, Sanjeev
    16TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2015), VOLS 1-5, 2015, : 3586 - 3589
  • [43] You Do Not Need More Data: Improving End-To-End Speech Recognition by Text-To-Speech Data Augmentation
    Laptev, Aleksandr
    Korostik, Roman
    Svischev, Aleksey
    Andrusenko, Andrei
    Medennikov, Ivan
    Rybin, Sergey
    2020 13TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI 2020), 2020, : 439 - 444
  • [44] Improving Turkish Telephone Speech Recognition with Data Augmentation and Out of Domain Data
    Uslu, Zeynep Gulhan
    Yildirim, Tulay
    2019 16TH INTERNATIONAL MULTI-CONFERENCE ON SYSTEMS, SIGNALS & DEVICES (SSD), 2019, : 176 - 179
  • [45] Speech2EEG: Leveraging Pretrained Speech Model for EEG Signal Recognition
    Zhou, Jinzhao
    Duan, Yiqun
    Zou, Yingying
    Chang, Yu-Cheng
    Wang, Yu-Kai
    Lin, Chin-Teng
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2023, 31 : 2140 - 2153
  • [46] Analysis and classification of hybrid BCI based on motor imagery and speech imagery
    Wang, Li
    Liu, Xiaochu
    Liang, Zhongwei
    Yang, Zhao
    Hu, Xiao
    MEASUREMENT, 2019, 147
  • [47] Impacts of simplifying articulation movements imagery to speech imagery BCI performance
    Guo, Zengzhi
    Chen, Fei
    JOURNAL OF NEURAL ENGINEERING, 2023, 20 (01)
  • [48] Analysis of Speech Imagery using Functional and Effective EEG based Brain Connectivity Parameters
    Chengaiyan, Sandhya
    Anandhan, Kavitha
    INTERNATIONAL JOURNAL OF COGNITIVE INFORMATICS AND NATURAL INTELLIGENCE, 2015, 9 (04) : 33 - 48
  • [49] OPTIMIZATION OF PRE-PROCESSING ROUTINES IN SPEECH IMAGERY-BASED EEG SIGNALS
    Sree, R. Anandha
    Kavitha, A.
    Divya, B.
    JOURNAL OF MECHANICS IN MEDICINE AND BIOLOGY, 2023, 23 (06)
  • [50] Handling emotional speech: a prosody based data augmentation technique for improving neutral speech trained ASR systems
    Pavan Raju Kammili
    B. H. V. S. Ramakrishnam Raju
    A. Sri Krishna
    International Journal of Speech Technology, 2022, 25 : 197 - 204