MEBeauty: a multi-ethnic facial beauty dataset in-the-wild

被引:10
作者
Lebedeva, Irina [1 ]
Guo, Yi [1 ]
Ying, Fangli [1 ]
机构
[1] East China Univ Sci & Technol, Sch Informat Sci & Engn, Shanghai 200237, Peoples R China
关键词
Facial beauty prediction; Deep learning; Robust loss functions; Knowledge transfer; Regression; ATTRACTIVENESS; CLASSIFICATION; BENCHMARK;
D O I
10.1007/s00521-021-06535-0
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Although facial beauty prediction (FBP) has achieved high accuracy on images captured in a constrained environment, it is still a challenging task on face images in-the-wild. Moreover, there is no FBP benchmark dataset that includes images with various ethnic, age, gender properties and unrestricted in terms of face expression and pose. In this work, the issue of FBP in real-life scenario is addressed and a multi-ethnic facial beauty dataset, namely MEBeauty, is introduced. All face images are captured in an unconstrained environment and rated by volunteers with various ethnicity, age and gender in order to avoid any cultural and social biases in beauty perception. Different well-known CNNs with layer-wise transfer learning are performed on the dataset. Moreover, the evaluation of knowledge learning from the face recognition task across FBP is conducted. The expected high number of aberrant and outlier faces is considered and the use of various robust loss functions in order to learn deep regression networks for facial beauty prediction is evaluated. Several FBP frameworks are performed on the proposed dataset and widely-used SCUT-FBP 5500 in order to compare their effectiveness on face images in constrained and unconstrained environments.
引用
收藏
页码:14169 / 14183
页数:15
相关论文
共 52 条
[1]  
Aarabi P, 2002, IEEE SYS MAN CYBERN, P2644
[2]   On the Borders of Harmful and Helpful Beauty Biases: The Biasing Effects of Physical Attractiveness Depend on Sex and Ethnicity [J].
Agthe, Maria ;
Strobel, Maria ;
Spoerrle, Matthias ;
Pfundmair, Michaela ;
Maner, Jon K. .
EVOLUTIONARY PSYCHOLOGY, 2016, 14 (02) :1-14
[3]  
[Anonymous], 2012, PROC CVPR IEEE
[4]   Effective training of convolutional neural networks for face-based gender and age prediction [J].
Antipov, Grigory ;
Baccouche, Moez ;
Berrani, Sid-Ahmed ;
Dugelay, Jean-Luc .
PATTERN RECOGNITION, 2017, 72 :15-26
[5]   Deep Learning for Facial Beauty Prediction [J].
Cao, Kerang ;
Choi, Kwang-nam ;
Jung, Hoekyung ;
Duan, Lini .
INFORMATION, 2020, 11 (08)
[6]   VGGFace2: A dataset for recognising faces across pose and age [J].
Cao, Qiong ;
Shen, Li ;
Xie, Weidi ;
Parkhi, Omkar M. ;
Zisserman, Andrew .
PROCEEDINGS 2018 13TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE & GESTURE RECOGNITION (FG 2018), 2018, :67-74
[7]   A Bi-Prototype Theory of Facial Attractiveness [J].
Chang, Fu ;
Chou, Chien-Hsing .
NEURAL COMPUTATION, 2009, 21 (03) :890-910
[8]  
Chen FM, 2010, LECT NOTES COMPUT SC, V6165, P21, DOI 10.1007/978-3-642-13923-9_3
[9]   Xception: Deep Learning with Depthwise Separable Convolutions [J].
Chollet, Francois .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1800-1807
[10]  
De Vries H, 2015, DEEP LEARN WORKSH IC