Data-Driven Facial Beauty Analysis: Prediction, Retrieval and Manipulation

被引:26
作者
Chen, Fangmei [1 ]
Xiao, Xihua [2 ]
Zhang, David [3 ,4 ]
机构
[1] Tsinghua Univ, Dept Elect Engn, Grad Sch Shenzhen, Beijing 100084, Peoples R China
[2] Harbin Inst Technol, Dept Comp Sci & Technol, Shenzhen Grad Sch, Shenzhen 518055, Peoples R China
[3] Hong Kong Polytech Univ, Dept Comp, Kowloon, Hong Kong, Peoples R China
[4] Hong Kong Polytech Univ, Shenzhen Sch, Kowloon, Hong Kong, Peoples R China
关键词
Face beautification; facial beauty analysis; face representation; beauty model; SEXUAL-DIMORPHISM; ATTRACTIVENESS; SYMMETRY; AVERAGENESS; JUDGMENTS; MODELS; SHAPE;
D O I
10.1109/TAFFC.2016.2599534
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
h Facial beauty analysis becomes an emerging research area due to many potential applications, such as aesthetic surgery plan, cosmetic industry, photo retouching, and entertainment. In this paper, we propose a data-driven facial beauty analysis framework that contains three application modules: prediction, retrieval, and manipulation. A beauty model is the core of the framework. With carefully designed features, the model can be built for different purposes. For prediction, we combine several low-level face representations and high-level features to form a feature vector and perform feature selection to optimize the feature set. The model built with the optimized feature set outperforms state-of-the-art methods. Then, we discuss two scenarios of beauty-oriented face retrieval: for recommendation and for beautification. Finally, we propose two approaches for facial beauty manipulation. One is an exemplar-based approach that uses the retrieved results. The other is a model-based approach that modifies facial features along the gradient of the beauty model. In this case, the model is built with the shape or appearance feature. Experimental results show that the exemplar-based approach is better for shape beautification; the model-based approach is suitable for texture beautification; and the combination of them can increase the attractiveness of a query face robustly.
引用
收藏
页码:205 / 216
页数:12
相关论文
共 43 条
[1]   Face description with local binary patterns:: Application to face recognition [J].
Ahonen, Timo ;
Hadid, Abdenour ;
Pietikainen, Matti .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2006, 28 (12) :2037-2041
[2]  
[Anonymous], 2016, PICBEAUTY GOOGLE PLA
[3]  
[Anonymous], 2013, STATISTICS
[4]  
[Anonymous], 2012, PREDICTION CANDIDATE
[5]  
[Anonymous], 2014, PCANET SIMPLE DEEP L
[6]  
[Anonymous], 1973, Pattern Classification and Scene Analysis
[7]  
[Anonymous], 1986, Stat. Sci.
[8]   LIBSVM: A Library for Support Vector Machines [J].
Chang, Chih-Chung ;
Lin, Chih-Jen .
ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2011, 2 (03)
[9]   A New Hypothesis on Facial Beauty Perception [J].
Chen, Fangmei ;
Xu, Yong ;
Zhang, David .
ACM TRANSACTIONS ON APPLIED PERCEPTION, 2014, 11 (02)
[10]  
Cherkassky V, 1997, IEEE Trans Neural Netw, V8, P1564, DOI 10.1109/TNN.1997.641482