Time-Frequency Filter Bank: A Simple Approach for Audio and Music Separation

被引:9
作者
Yang, Ning [1 ]
Usman, Muhammad [2 ]
He, Xiangjian [2 ]
Jan, Mian Ahmad [3 ]
Zhang, Liming [4 ]
机构
[1] Northwestern Polytech Univ, Sch Automat, Xian 710072, Shaanxi, Peoples R China
[2] Univ Technol Sydney, Sch Elect & Data Engn, Ultimo, NSW 2007, Australia
[3] Abdul Wali Khan Univ, Dept Comp Sci, Mardan 23200, Pakistan
[4] Univ Macau, Sch Comp Sci, Zhuhai 999078, Peoples R China
关键词
Blind Source Separation; Short Time Fourier Transform; OverLap-Add; SIR; SDR; BLIND SOURCE SEPARATION; FOURIER-TRANSFORM; BAYESIAN NONPARAMETRICS; SPEECH ENHANCEMENT; MIXTURES; SIGNALS; MODEL; STFT; DECOMPOSITION; FACTORIZATION;
D O I
10.1109/ACCESS.2017.2761741
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Blind Source Separation techniques are widely used in the field of wireless communication for a very long time to extract signals of interest from a set of multiple signals without training data. In this paper, we investigate the problem of separation of the human voice from a mixture of human voice and sounds from different musical instruments. The human voice may be a singing voice in a song or may be a part of some news, broadcast by a channel with background music. This paper proposes a generalized Short Time Fourier Transform (STFT)-based technique, combined with filter bank to extract vocals from background music. The main purpose is to design a filter bank and to eliminate background aliasing errors with best reconstruction conditions, having approximated scaling factors. Stereo signals in time-frequency domain are used in experiments. The input stereo signals are processed in the form of frames and passed through the proposed STFT-based technique. The output of the STFT-based technique is passed through the filter bank to minimize the background aliasing errors. For reconstruction, first an inverse STFT is applied and then the signals are reconstructed by the OverLap-Add method to get the final output, containing vocals only. The experiments show that the proposed approach performs better than the other state-of-the-art approaches, in terms of Signal-to-Interference Ratio (SIR) and Signal-to-Distortion Ratio (SDR), respectively.
引用
收藏
页码:27114 / 27125
页数:12
相关论文
共 47 条
[1]   Musical Source Clustering and Identification in Polyphonic Audio [J].
Arora, Vipul ;
Behera, Laxmidhar .
IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2014, 22 (06) :1003-1012
[2]   Learning a Discriminative Dictionary for Single-Channel Speech Separation [J].
Bao, Guangzhao ;
Xu, Yangfei ;
Ye, Zhongfu .
IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2014, 22 (07) :1130-1138
[3]  
Cohen L., 1995, Time-frequency analysis, V299
[4]   Fundamental Initial Frequency and Frequency Rate Estimation of Random-Amplitude Harmonic Chirps [J].
Doweck, Yaron ;
Amar, Alon ;
Cohen, Israel .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2015, 63 (23) :6213-6228
[5]  
Fevotte C, 2005, TECH REP
[6]   Time-Frequency Filtering Based on Spectrogram Zeros [J].
Flandrin, Patrick .
IEEE SIGNAL PROCESSING LETTERS, 2015, 22 (11) :2137-2141
[7]   Blind Source Separation by Entropy Rate Minimization [J].
Fu, Geng-Shen ;
Phlypo, Ronald ;
Anderson, Matthew ;
Li, Xi-Lin ;
Adali, Tuelay .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2014, 62 (16) :4245-4255
[8]   Unsupervised Single-Channel Separation of Nonstationary Signals Using Gammatone Filterbank and Itakura-Saito Nonnegative Matrix Two-Dimensional Factorizations [J].
Gao, Bin ;
Woo, W. L. ;
Dlay, S. S. .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2013, 60 (03) :662-675
[9]  
Garofolo J., 1993, 4930 NAT I STAND TEC
[10]  
Hoeg W., 2004, DIGIAL AUDIO BROADCA