LOW ALGORITHMIC DELAY IMPLEMENTATION OF CONVOLUTIONAL BEAMFORMER FOR ONLINE JOINT SOURCE SEPARATION AND DEREVERBERATION

被引:0
|
作者
Mo, Kaien [1 ]
Wang, Xianrui [1 ,2 ]
Yang, Yichen [1 ,2 ]
Makino, Shoji [1 ]
Chen, Jingdong [2 ]
机构
[1] Waseda Univ, Grad Sch Informat Prod & Syst, Kitakyushu, Fukuoka, Japan
[2] Northwestern Polytech Univ, Ctr Intelligent Acoust & Immers Commun, Xian, Peoples R China
关键词
Independent vector analysis; weighted prediction error; non-causal sample truncating technique; algorithmic delay;
D O I
10.23919/EUSIPCO63174.2024.10715020
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Blind-audio-source-separation (BASS) techniques, particularly those with low latency, play an important role in a wide range of real-time systems, e.g., hearing aids, in-car hand-free voice communication, real-time human-machine interaction, etc. Most existing BASS algorithms are deduced to run on batch mode, and therefore large latency is unavoidable. Recently, some online algorithms were developed, which achieve separation on a frame-by-frame basis in the short-time-Fourier-transform (STFT) domain and the latency is significantly reduced as compared to those batch methods. However, the latency with these algorithms may still be too long for many real-time systems to bear. To further reduce latency while achieving good separation performance, we propose in this work to integrate a weighted prediction error (WPE) module into a non-causal sample-truncating-based independent vector analysis (NST-IVA). The resulting algorithm can maintain the algorithmic delay as NST-IVA if the delay with WPE is appropriately controlled while achieving significantly better performance, which is validated by simulations.
引用
收藏
页码:912 / 916
页数:5
相关论文
共 45 条
  • [1] BLIND AND NEURAL NETWORK-GUIDED CONVOLUTIONAL BEAMFORMER FOR JOINT DENOISING, DEREVERBERATION, AND SOURCE SEPARATION
    Nakatani, Tomohiro
    Ikeshita, Rintaro
    Kinoshita, Keisuke
    Sawada, Hiroshi
    Araki, Shoko
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 6129 - 6133
  • [2] SIMULTANEOUS DENOISING, DEREVERBERATION, AND SOURCE SEPARATION USING A UNIFIED CONVOLUTIONAL BEAMFORMER
    Nakatani, Tomohiro
    Kinoshita, Keisuke
    Ikeshita, Rintaro
    Sawada, Hiroshi
    Araki, Shoko
    2019 IEEE WORKSHOP ON APPLICATIONS OF SIGNAL PROCESSING TO AUDIO AND ACOUSTICS (WASPAA), 2019, : 224 - 228
  • [3] Implementation and Assessment of Joint Source Separation and Dereverberation
    Moffat, David
    Reiss, Joshua D.
    60TH AES INTERNATIONAL CONFERENCE ON DREAMS (DEREVERBERATION AND REVERBERATION OF AUDIO, MUSIC, AND SPEECH), 2016,
  • [4] LOW LATENCY ONLINE BLIND SOURCE SEPARATION BASED ON JOINT OPTIMIZATION WITH BLIND DEREVERBERATION
    Ueda, Tetsuya
    Nakatani, Tomohiro
    Ikeshita, Rintaro
    Kinoshita, Keisuke
    Araki, Shoko
    Makino, Shoji
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 506 - 510
  • [5] Low Latency Online Source Separation and Noise Reduction Based on Joint Optimization with Dereverberation
    Ueda, Tetsuya
    Nakatani, Tomohiro
    Ikeshita, Rintaro
    Kinoshita, Keisuke
    Araki, Shoko
    Makino, Shoji
    29TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2021), 2021, : 1000 - 1004
  • [6] Joint Multichannel Blind Speech Separation and Dereverberation: A Real-Time Algorithmic Implementation
    Rotili, Rudy
    De Simone, Claudio
    Perelli, Alessandro
    Cifani, Simone
    Squartini, Stefano
    ADVANCED INTELLIGENT COMPUTING THEORIES AND APPLICATIONS, 2010, 93 : 85 - 93
  • [7] Online blind source separation and dereverberation of speech based on a joint diagonalizability constraint
    Yu, Ho-Gun
    Kim, Do-Hui
    Song, Min-Hwan
    Park, Hyung-Min
    JOURNAL OF THE ACOUSTICAL SOCIETY OF KOREA, 2021, 40 (05): : 503 - 514
  • [8] Joint Online Multichannel Acoustic Echo Cancellation, Speech Dereverberation and Source Separation
    Na, Yueyue
    Wang, Ziteng
    Liu, Zhang
    Tian, Biao
    Fu, Qiang
    INTERSPEECH 2021, 2021, : 1144 - 1148
  • [9] A low-complexity joint optimization of blind source separation and dereverberation
    Wang T.
    Yang F.
    Yang J.
    Shengxue Xuebao/Acta Acustica, 2024, 49 (01): : 163 - 170
  • [10] CONVOLUTIONAL WEIGHTED MINIMUM MEAN SQUARE ERROR FILTER FOR JOINT SOURCE SEPARATION AND DEREVERBERATION
    Fras, Mieszko
    Witkowski, Marcin
    Kowalczyk, Konrad
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 286 - 290