Wow! You Are So Beautiful Today!

被引:40
作者
Liu, Luoqi [1 ]
Xing, Junliang [2 ]
Liu, Si [1 ]
Xu, Hui [3 ]
Zhou, Xi [3 ]
Yan, Shuicheng [1 ]
机构
[1] Natl Univ Singapore, Singapore 117548, Singapore
[2] Chinese Acad Sci, Inst Automat, Beijing 100864, Peoples R China
[3] Chinese Acad Sci, Chongqing Inst Green & Intelligent Technol, Beijing 100864, Peoples R China
关键词
Algorithms; Experimentation; Performance; Beauty recommendation; beauty synthesis; multiple tree-structured super-graphs model;
D O I
10.1145/2659234
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Beauty e-Experts, a fully automatic system for makeover recommendation and synthesis, is developed in this work. The makeover recommendation and synthesis system simultaneously considers many kinds of makeover items on hairstyle and makeup. Given a user-provided frontal face image with short/bound hair and no/light makeup, the Beauty e-Experts system not only recommends the most suitable hairdo and makeup, but also synthesizes the virtual hairdo and makeup effects. To acquire enough knowledge for beauty modeling, we built the Beauty e-Experts Database, which contains 1,505 female photos with a variety of attributes annotated with different discrete values. We organize these attributes into two different categories, beauty attributes and beauty-related attributes. Beauty attributes refer to those values that are changeable during the makeover process and thus need to be recommended by the system. Beauty-related attributes are those values that cannot be changed during the makeup process but can help the system to perform recommendation. Based on this Beauty e-Experts Dataset, two problems are addressed for the Beauty e-Experts system: what to recommend and how to wear it, which describes a similar process of selecting hairstyle and cosmetics in daily life. For the what-to-recommend problem, we propose a multiple tree-structured supergraph model to explore the complex relationships among high-level beauty attributes, mid-level beauty-related attributes, and low-level image features. Based on this model, the most compatible beauty attributes for a given facial image can be efficiently inferred. For the how-to-wear-it problem, an effective and efficient facial image synthesis module is designed to seamlessly synthesize the recommended makeovers into the user facial image. We have conducted extensive experiments on testing images of various conditions to evaluate and analyze the proposed system. The experimental results well demonstrate the effectiveness and efficiency of the proposed system.
引用
收藏
页数:22
相关论文
共 36 条
[1]   Face description with local binary patterns:: Application to face recognition [J].
Ahonen, Timo ;
Hadid, Abdenour ;
Pietikainen, Matti .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2006, 28 (12) :2037-2041
[2]  
[Anonymous], 2002, P ACM SIGKDD KDD 200, DOI 10.1145/775047.775067
[3]  
[Anonymous], P IEEE C COMP VIS PA
[4]  
AUCOIN Kevyn., 2000, Face Forward
[5]   Shape matching and object recognition using shape contexts [J].
Belongie, S ;
Malik, J ;
Puzicha, J .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (04) :509-522
[6]  
Bookstein Fred L., 1989, IEEE T PATTERN ANAL, V3
[7]   Fast approximate energy minimization via graph cuts [J].
Boykov, Y ;
Veksler, O ;
Zabih, R .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2001, 23 (11) :1222-1239
[8]   LIBSVM: A Library for Support Vector Machines [J].
Chang, Chih-Chung ;
Lin, Chih-Jen .
ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2011, 2 (03)
[9]  
Chen Fangmei, 2010, P INT C MED BIOM
[10]  
Chow C., 1968, IEEE T INF THEORY