LA-VITON: A Network for Looking-Attractive Virtual Try-On

被引:31
作者
Lee, Hyug Jae [1 ]
Lee, Rokkyu [1 ]
Kang, Minseok [1 ]
Cho, Myounghoon [1 ]
Park, Gunhan [1 ]
机构
[1] NHN Corp, Seongnam Si, South Korea
来源
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW) | 2019年
关键词
D O I
10.1109/ICCVW.2019.00381
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose an image-based virtual try-on network, LA-VITON, which allows the generation of high fidelity try-on images that preserves both the overall appearance and the characteristics of clothing items. The proposed network consists of two modules: Geometric Matching Module (GMM) and Try-On Module (TOM). To warp in-shop clothing item to the desired image of a person with high accuracy in GMM, grid interval consistency loss and an occlusion handling technique are proposed. Grid interval consistency loss regularizes transformation to prevent distortion of patterns in clothes and an occlusion handling technique encourages proper warping despite target bodies are covered by hair or arms. The following TOM synthesizes the final try-on image of the target person seamlessly with the warped clothes from GMM. Extensive experiments on fashion datasets show that the proposed method outperforms the state-of-the-art methods.
引用
收藏
页码:3129 / 3132
页数:4
相关论文
共 9 条
[1]  
[Anonymous], 2017, ADV NEURAL INFORM PR, DOI DOI 10.1109/ICSGEA.2017.74
[2]   Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields [J].
Cao, Zhe ;
Simon, Tomas ;
Wei, Shih-En ;
Sheikh, Yaser .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1302-1310
[3]   Look into Person: Self-supervised Structure-sensitive Learning and A New Benchmark for Human Parsing [J].
Gong, Ke ;
Liang, Xiaodan ;
Zhang, Dongyu ;
Shen, Xiaohui ;
Lin, Liang .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6757-6765
[4]   VITON: An Image-based Virtual Try-on Network [J].
Han, Xintong ;
Wu, Zuxuan ;
Wu, Zhe ;
Yu, Ruichi ;
Davis, Larry S. .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :7543-7552
[5]  
Koltun V, 2015, ARXIV PREPRINT ARXIV
[6]  
Miyato T., 2018, INT C LEARNING REPRE
[7]   Convolutional neural network architecture for geometric matching [J].
Rocco, Ignacio ;
Arandjelovic, Relja ;
Sivic, Josef .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :39-48
[8]  
Wang Bochao, 2018, ECCV
[9]   Be Your Own Prada: Fashion Synthesis with Structural Coherence [J].
Zhu, Shizhan ;
Fidler, Sanja ;
Urtasun, Raquel ;
Lin, Dahua ;
Loy, Chen Change .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :1689-1697