Time-Frequency Bins Selection for Direction of Arrival Estimation Based on Speech Presence Probability Learning

被引:1
作者
Zhang, Qinzheng [1 ,2 ]
Wang, Haiyan [1 ,3 ]
Jensen, Jesper Rindom [2 ]
Tao, Shuai [2 ]
Christensen, Mads Graesboll [2 ]
机构
[1] Northwestern Polytech Univ, Sch Marine Sci & Technol, Xian 710072, Peoples R China
[2] Aalborg Univ, Audio Anal Lab, CREATE, DK-9000 Aalborg, Denmark
[3] Shaanxi Univ Sci & Technol, Sch Elect Informat & Artificial Intelligence, Xian 710021, Peoples R China
基金
中国国家自然科学基金;
关键词
Broadband DOA estimation; A posteriori speech presence probability; Out-of-label task; Deep learning; NOISE; LOCALIZATION; SYSTEM; DOA;
D O I
10.1007/s00034-023-02586-x
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With the development of deep learning techniques, the field of direction of arrival (DOA) estimation has also made significant progress. However, the accuracy of DOA estimation using end-to-end neural networks (NNs) heavily relies on the classification step of the networks, which necessitates the use of large and representative datasets. Additionally, conventional speech presence probability (SPP) estimation methods based on the ideal ratio mask (IRM) may misclassify time-frequency (T-F) bins dominated by non-speech and noise, which hinders the accurate extraction of directional information. To improve the robustness of existing DOA estimation algorithms, this paper proposes a DOA estimation method with T-F bin selection. In terms of output, instead of using IRM-based SPP, our proposed approach focuses on the a posteriori SPP, a deliberate choice aimed at circumventing potential confusion. For input optimization, we construct features that encompass spatial, temporal, and directional information concurrently, and these are coupled with a frequency bin-wise recurrent neural network (RNN) model to attain precise multi-channel SPP estimation. Subsequently, these SPP estimates are utilized to extract local information for DOA estimation. Moreover, the cascaded structure ensures that the model has the ability to complete out-of-label tasks, effectively reducing the dataset requirements by training only a subset of direction information to achieve omnidirectional DOA estimation. Besides, this contributes to the algorithm's ability to eliminate its reliance on the step size, setting it apart from other end-to-end methods. Simulation results validate that the proposed method achieves higher accuracy and lower error compared to both NN-based end-to-end approaches and traditional full-band approaches under various conditions of reverberation and signal-to-noise ratio.
引用
收藏
页码:2961 / 2981
页数:21
相关论文
共 41 条
  • [11] Source localization in reverberant environments: Modeling and statistical analysis
    Gustafsson, T
    Rao, BD
    Trivedi, M
    [J]. IEEE TRANSACTIONS ON SPEECH AND AUDIO PROCESSING, 2003, 11 (06): : 791 - 803
  • [12] Habets E., 2006, ROOM IMPULSE RESPONS
  • [13] Hadad E, 2014, 2014 14TH INTERNATIONAL WORKSHOP ON ACOUSTIC SIGNAL ENHANCEMENT (IWAENC), P313, DOI 10.1109/IWAENC.2014.6954309
  • [14] Huang GP, 2020, INT CONF ACOUST SPEE, P211, DOI [10.1109/icassp40776.2020.9052988, 10.1109/ICASSP40776.2020.9052988]
  • [15] A Simple Theory and New Method of Differential Beamforming With Uniform Linear Microphone Arrays
    Huang, Gongping
    Benesty, Jacob
    Cohen, Israel
    Chen, Jingdong
    [J]. IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2020, 28 : 1079 - 1093
  • [16] Insights Into Frequency-Invariant Beamforming With Concentric Circular Microphone Arrays
    Huang, Gongping
    Chen, Jingdong
    Benesty, Jacob
    [J]. IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2018, 26 (12) : 2305 - 2318
  • [17] On the Design of Frequency-Invariant Beampatterns With Uniform Circular Microphone Arrays
    Huang, Gongping
    Benesty, Jacob
    Chen, Jingdong
    [J]. IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2017, 25 (05) : 1140 - 1153
  • [18] Direction-of-arrival estimation of passive acoustic sources in reverberant environments based on the Householder transformation
    Huang, Gongping
    Chen, Jingdong
    Benesty, Jacob
    [J]. JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2015, 138 (05) : 3053 - 3060
  • [19] Jensen JR, 2016, INT CONF ACOUST SPEE, P176, DOI 10.1109/ICASSP.2016.7471660
  • [20] Nonlinear Least Squares Methods for Joint DOA and Pitch Estimation
    Jensen, Jesper Rindom
    Christensen, Mads Graesboll
    Jensen, Soren Holdt
    [J]. IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2013, 21 (05): : 923 - 933