VoxCeleb: a large-scale speaker identification dataset

被引:1448
作者
Nagrani, Arsha [1 ]
Chung, Joon Son [1 ]
Zisserman, Andrew [1 ]
机构
[1] Univ Oxford, Dept Engn Sci, Visual Geometry Grp, Oxford, England
来源
18TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2017), VOLS 1-6: SITUATED INTERACTION | 2017年
基金
英国工程与自然科学研究理事会;
关键词
speaker identification; speaker verification; large-scale; dataset; convolutional neural network;
D O I
10.21437/Interspeech.2017-950
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Most existing datasets for speaker identification contain samples obtained under quite constrained conditions, and are usually hand-annotated, hence limited in size. The goal of this paper is to generate a large scale text-independent speaker identification dataset collected 'in the wild'. We make two contributions. First, we propose a fully automated pipeline based on computer vision techniques to create the dataset from open-source media. Our pipeline involves obtaining videos from YouTube; performing active speaker verification using a two-stream synchronization Convolutional Neural Network (CNN), and confirming the identity of the speaker using CNN based facial recognition. We use this pipeline to curate VoxCeleb which contains hundreds of thousands of 'real world' utterances for over 1,000 celebrities. Our second contribution is to apply and compare various state of the art speaker identification techniques on our dataset to establish baseline performance. We show that a CNN based architecture obtains the best performance for both identification and verification.
引用
收藏
页码:2616 / 2620
页数:5
相关论文
共 41 条
[11]   Lip Reading in the Wild [J].
Chung, Joon Son ;
Zisserman, Andrew .
COMPUTER VISION - ACCV 2016, PT II, 2017, 10112 :87-103
[12]  
Chung Joon Son, 2016, LECT NOTES COMPUT SC, DOI DOI 10.1007/978-3-319-54427-4_19
[13]   Front-End Factor Analysis for Speaker Verification [J].
Dehak, Najim ;
Kenny, Patrick J. ;
Dehak, Reda ;
Dumouchel, Pierre ;
Ouellet, Pierre .
IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2011, 19 (04) :788-798
[14]   Taking the bite out of automated naming of characters in TV video [J].
Everingham, Mark ;
Sivic, Josef ;
Zisserman, Andrew .
IMAGE AND VISION COMPUTING, 2009, 27 (05) :545-559
[15]  
Fisher W., 1986, PROC DARPA WORKSHOP, P93
[16]  
Garofolo JS, 1993, 93 NASA STI REC
[17]  
Godfrey J. J., 1992, ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech and Signal Processing (Cat. No.92CH3103-9), P517, DOI 10.1109/ICASSP.1992.225858
[18]  
Hansen J. H., 2001, INTERSPEECH, P905
[19]  
He K., 2016, P IEEE C COMPUTER VI, P770, DOI DOI 10.1109/CVPR.2016.90
[20]   POLYCOST: A telephone-speech database for speaker recognition [J].
Hennebert, J ;
Melin, H ;
Petrovska, D ;
Genoud, D .
SPEECH COMMUNICATION, 2000, 31 (2-3) :265-270