Personalized facial beauty assessment: a meta-learning approach

被引:5
作者
Lebedeva, Irina [1 ]
Ying, Fangli [2 ,5 ]
Gu, Yi [2 ,3 ,4 ]
机构
[1] East China Univ Sci & Technol, Sch Informat Sci & Engn, Shanghai 200237, Peoples R China
[2] East China Univ Sci & Technol, Dept Comp Sci & Engn, Shanghai 200237, Peoples R China
[3] Business Intelligence & Visualizat Res Ctr, Natl Engn Lab Big Data Distribut & Exchange Techn, Shanghai 200436, Peoples R China
[4] Shanghai Engn Res Ctr Big Data & Internet Audienc, Shanghai 200072, Peoples R China
[5] East China Univ Sci & Technol, State Key Lab Bioreactor Engn, Shanghai 200237, Peoples R China
关键词
Meta-learning; Facial beauty prediction; Deep learning; ATTRACTIVENESS; CLASSIFICATION; BENCHMARK;
D O I
10.1007/s00371-021-02387-w
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Automatic facial beauty assessment has recently attracted a growing interest and achieved impressive results. However, despite the obvious subjectivity of beauty perception, most studies are addressed to predict generic or universal beauty and only few works investigate an individual's preferences in facial attractiveness. Unlike universal beauty assessment, an effective personalized method is required to produce a reasonable accuracy on a small amount of training images as the number of annotated samples from an individual is limited in real-world applications. In this work, a novel personalized facial beauty assessment approach based on meta-learning is introduced. First of all, beauty preferences shared by an extensive number of individuals are learnt during meta-training. Then, the model is adapted to a new individual with a few rated image samples in the meta-testing phase. The experiments are conducted on a facial beauty dataset that includes faces of various ethnic, gender, age groups and rated by hundreds of volunteers with different social and cultural backgrounds. The results demonstrate that the proposed method is capable of effectively learning personal beauty preferences from a limited number of annotated images and outperforms the facial beauty prediction state-of-the-art on quantitative comparisons.
引用
收藏
页码:1095 / 1107
页数:13
相关论文
共 62 条
[1]  
Aarabi P, 2002, IEEE SYS MAN CYBERN, P2644
[2]   On the Borders of Harmful and Helpful Beauty Biases: The Biasing Effects of Physical Attractiveness Depend on Sex and Ethnicity [J].
Agthe, Maria ;
Strobel, Maria ;
Spoerrle, Matthias ;
Pfundmair, Michaela ;
Maner, Jon K. .
EVOLUTIONARY PSYCHOLOGY, 2016, 14 (02) :1-14
[3]  
Altwaijry H, 2013, IEEE WORK APP COMP, P117, DOI 10.1109/WACV.2013.6475008
[4]   Deep Learning for Facial Beauty Prediction [J].
Cao, Kerang ;
Choi, Kwang-nam ;
Jung, Hoekyung ;
Duan, Lini .
INFORMATION, 2020, 11 (08)
[5]   VGGFace2: A dataset for recognising faces across pose and age [J].
Cao, Qiong ;
Shen, Li ;
Xie, Weidi ;
Parkhi, Omkar M. ;
Zisserman, Andrew .
PROCEEDINGS 2018 13TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE & GESTURE RECOGNITION (FG 2018), 2018, :67-74
[6]  
Chen FM, 2010, LECT NOTES COMPUT SC, V6165, P21, DOI 10.1007/978-3-642-13923-9_3
[7]   Personalized image quality assessment with Social-Sensed aesthetic preference [J].
Cui, Chaoran ;
Yang, Wenya ;
Shi, Cheng ;
Wang, Meng ;
Nie, Xiushan ;
Yin, Yilong .
INFORMATION SCIENCES, 2020, 512 :780-794
[8]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[9]   Efficient deep discriminant embedding: Application to face beauty prediction and classification [J].
Dornaika, F. ;
Moujahid, A. ;
Wang, K. ;
Feng, X. .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2020, 95
[10]   Image-based face beauty analysis via graph-based semi-supervised learning [J].
Dornaika, F. ;
Elorza, A. ;
Wang, K. ;
Arganda-Carreras, I. .
MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (3-4) :3005-3030