Joint Multi-Pitch Detection Using Harmonic Envelope Estimation for Polyphonic Music Transcription

被引:26
作者
Benetos, Emmanouil [1 ]
Dixon, Simon [1 ]
机构
[1] Queen Mary Univ London, Sch Elect Engn & Comp Sci, Ctr Digital Mus, London E1 4NS, England
关键词
Automatic music transcription; harmonic envelope estimation; conditional random fields (CRFs); resonator time-frequency image; SEPARATION;
D O I
10.1109/JSTSP.2011.2162394
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, a method for automatic transcription of music signals based on joint multiple-F0 estimation is proposed. As a time-frequency representation, the constant-Q resonator time-frequency image is employed, while a novel noise suppression technique based on pink noise assumption is applied in a preprocessing step. In the multiple-F0 estimation stage, the optimal tuning and inharmonicity parameters are computed and a salience function is proposed in order to select pitch candidates. For each pitch candidate combination, an overlapping partial treatment procedure is used, which is based on a novel spectral envelope estimation procedure for the log-frequency domain, in order to compute the harmonic envelope of candidate pitches. In order to select the optimal pitch combination for each time frame, a score function is proposed which combines spectral and temporal characteristics of the candidate pitches and also aims to suppress harmonic errors. For postprocessing, hidden Markov models (HMMs) and conditional random fields (CRFs) trained on MIDI data are employed, in order to boost transcription accuracy. The system was trained on isolated piano sounds from the MAPS database and was tested on classic and jazz recordings from the RWC database, as well as on recordings from a Disklavier piano. A comparison with several state-of-the-art systems is provided using a variety of error metrics, where encouraging results are indicated.
引用
收藏
页码:1111 / 1123
页数:13
相关论文
共 41 条
  • [1] [Anonymous], ISCA TUT RES WORKSH
  • [2] [Anonymous], 2006, Computational Auditory Scene Analysis: Principles, Algorithms, and Applications
  • [3] Weighted maximum likelihood autoregressive and moving average spectrum modeling
    Badeau, Roland
    David, Bertrand
    [J]. 2008 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, VOLS 1-12, 2008, : 3761 - 3764
  • [4] BELLO JP, 2003, THESIS U LONDON LOND
  • [5] BENETOS E, 2010, P MUS INF RETR EV EX
  • [6] BENETOS E, 2010, ISCA TUT RES WORKSH, P13
  • [7] Computer identification of musical instruments using pattern recognition with cepstral coefficients as features
    Brown, JC
    [J]. JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 1999, 105 (03) : 1933 - 1941
  • [8] CANADASQUESADA F, 2010, J NEW MUSIC RES, V39, P93
  • [9] DELATHAUWER L, 1997, THESIS KU LEUVEN LEU
  • [10] DHAES W, 2003, P INT COMP MUS C SEP