Personalized facial beauty assessment: a meta-learning approach

被引:5
作者
Lebedeva, Irina [1 ]
Ying, Fangli [2 ,5 ]
Gu, Yi [2 ,3 ,4 ]
机构
[1] East China Univ Sci & Technol, Sch Informat Sci & Engn, Shanghai 200237, Peoples R China
[2] East China Univ Sci & Technol, Dept Comp Sci & Engn, Shanghai 200237, Peoples R China
[3] Business Intelligence & Visualizat Res Ctr, Natl Engn Lab Big Data Distribut & Exchange Techn, Shanghai 200436, Peoples R China
[4] Shanghai Engn Res Ctr Big Data & Internet Audienc, Shanghai 200072, Peoples R China
[5] East China Univ Sci & Technol, State Key Lab Bioreactor Engn, Shanghai 200237, Peoples R China
关键词
Meta-learning; Facial beauty prediction; Deep learning; ATTRACTIVENESS; CLASSIFICATION; BENCHMARK;
D O I
10.1007/s00371-021-02387-w
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Automatic facial beauty assessment has recently attracted a growing interest and achieved impressive results. However, despite the obvious subjectivity of beauty perception, most studies are addressed to predict generic or universal beauty and only few works investigate an individual's preferences in facial attractiveness. Unlike universal beauty assessment, an effective personalized method is required to produce a reasonable accuracy on a small amount of training images as the number of annotated samples from an individual is limited in real-world applications. In this work, a novel personalized facial beauty assessment approach based on meta-learning is introduced. First of all, beauty preferences shared by an extensive number of individuals are learnt during meta-training. Then, the model is adapted to a new individual with a few rated image samples in the meta-testing phase. The experiments are conducted on a facial beauty dataset that includes faces of various ethnic, gender, age groups and rated by hundreds of volunteers with different social and cultural backgrounds. The results demonstrate that the proposed method is capable of effectively learning personal beauty preferences from a limited number of annotated images and outperforms the facial beauty prediction state-of-the-art on quantitative comparisons.
引用
收藏
页码:1095 / 1107
页数:13
相关论文
共 62 条
[31]   Deep Learning Face Attributes in the Wild [J].
Liu, Ziwei ;
Luo, Ping ;
Wang, Xiaogang ;
Tang, Xiaoou .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :3730-3738
[32]   Meta-learning on Heterogeneous Information Networks for Cold-start Recommendation [J].
Lu, Yuanfu ;
Fang, Yuan ;
Shi, Chuan .
KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, :1563-1573
[33]   Automatic Classification of Chinese Female Facial Beauty using Support Vector Machine [J].
Mao, Huiyun ;
Jin, Lianwen ;
Du, Minghui .
2009 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC 2009), VOLS 1-9, 2009, :4842-4846
[34]  
Murray N, 2012, PROC CVPR IEEE, P2408, DOI 10.1109/CVPR.2012.6247954
[35]  
Nguyen T. V., 2012, P 20 ACM INT C MULT, P239
[36]  
ODonovan P., 2014, P WORKSH COMP AESTH, P33, DOI DOI 10.1145/2630099.2630100
[37]   Personalized Image Aesthetics [J].
Ren, Jian ;
Shen, Xiaohui ;
Lin, Zhe ;
Mech, Radomir ;
Foran, David J. .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :638-647
[38]   Personalised Aesthetics with Residual Adapters [J].
Rodriguez-Pardo, Carlos ;
Bilen, Hakan .
PATTERN RECOGNITION AND IMAGE ANALYSIS, PT I, 2020, 11867 :508-520
[39]   Same like it hot - visual guidance fur preference prediction [J].
Rothe, Rasmus ;
Tirrtofte, Radu ;
Van Gool, Luc .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :5553-5561
[40]  
Shi SJ, 2019, INT CONF ACOUST SPEE, P4045, DOI [10.1109/icassp.2019.8683112, 10.1109/ICASSP.2019.8683112]