A Mixed Reality Virtual Clothes Try-On System

被引:61
作者
Yuan, Miaolong [1 ]
Khan, Ishtiaq Rasool [2 ]
Farbiz, Farzam [1 ]
Yao, Susu [1 ]
Niswar, Arthur [1 ]
Foo, Min-Hui [1 ]
机构
[1] ASTAR, Inst Infocomm Res, Singapore 138632, Singapore
[2] King Abdulaziz Univ, Fac Comp & Informat Technol, Jeddah 21413, Saudi Arabia
关键词
3D-2D alignment; body customization; mixed reality; skin color matching and real-time cloth simulation; virtual try-on; ACCEPTANCE;
D O I
10.1109/TMM.2013.2280560
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Virtual try-on of clothes has received much attention recently due to its commercial potential. It can be used for online shopping or intelligent recommendation to narrow down the selections to a few designs and sizes. In this paper, we present a mixed reality system for 3D virtual clothes try-on that enables a user to see herself wearing virtual clothes while looking at a mirror display, without taking off her actual clothes. The user can select various virtual clothes for trying-on. The system physically simulates the selected virtual clothes on the user's body in real-time and the user can see virtual clothes fitting on the her mirror image from various angles as she moves. The major contribution of this paper is that we automatically customize an invisible (or partially visible) avatar based on the user's body size and the skin color and use it for proper clothes fitting, alignment and clothes simulation in our virtual try-on system. We present three scenarios: i) virtual clothes on the avatar, ii) virtual clothes on the user's image and iii) virtual clothes on the avatar blended with the user's face image. We have conducted a user study to evaluate the effectiveness of these three solutions from the end user's perception of quality attributes, cognitive attributes and attitude towards using. The user study shows that among these three scenarios, the second one is most preferred by the users and for 50% of them the experience they had with our system was sufficient to make the purchase decision for the outfits they virtually tried-on.
引用
收藏
页码:1958 / 1968
页数:11
相关论文
共 35 条
[1]  
Allen B, 2002, ACM T GRAPHIC, V21, P612, DOI 10.1145/566570.566626
[2]   SCAPE: Shape Completion and Animation of People [J].
Anguelov, D ;
Srinivasan, P ;
Koller, D ;
Thrun, S ;
Rodgers, J ;
Davis, J .
ACM TRANSACTIONS ON GRAPHICS, 2005, 24 (03) :408-416
[3]  
Conover W. J., 1999, Wiley Series in Probability and Statistics
[4]  
Cordier F., 2001, P VIRT REAL INT C LA
[5]  
Cui Y., 2012, P ACCV WORKSH COL DE
[7]  
Eisert P., 2011, IEEE COMSOC MMTC E L, V6, P37
[8]  
Fiala M, 2007, IEEE VIRTUAL REALITY 2007, PROCEEDINGS, P251
[9]  
Hauswiesner S, 2011, P 10 INT C VIRT REAL, P23, DOI DOI 10.1145/2087756.2087759
[10]  
Hilsmann A., 2009, P MIR 2009 COMP VIS