Image-based Virtual Try-on via Channel Attention and Appearance Flow

被引:0
作者
He, Chao [1 ]
Liu, Rong [2 ]
E, Jinxuan [1 ]
Liu, Ming [1 ]
机构
[1] Cent China Normal Univ, Sch Comp Sci, Wuhan, Peoples R China
[2] Cent China Normal Univ, Coll Phys Sci & Technol, Wuhan, Peoples R China
来源
2024 5TH INTERNATIONAL CONFERENCE ON COMPUTING, NETWORKS AND INTERNET OF THINGS, CNIOT 2024 | 2024年
关键词
appearance flow; virtual try-on; channel attention;
D O I
10.1145/3670105.3670138
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Virtual try-on is an image generation task for changing characters' clothes while preserving the characters' and the cloth's original attributes. Existing methods usually apply the traditional appearance flow method, which is susceptible to complex body postures or occlusions, leading to unclear texture of target clothing or distorted limbs of characters. We apply a StyleGAN-based(generative adversarial network) flow generator to estimate appearance flow, which provides more global information to overcome the issue. Additionally, more local information is captured to refine the appearance flow by adopting the channel attention mechanism. Qualitative and quantitative experiments demonstrate that our model can generate more realistic images.
引用
收藏
页码:198 / 203
页数:6
相关论文
共 27 条
[1]   ZFlow: Gated Appearance Flow-based Virtual Try-on with 3D Priors [J].
Chopra, Ayush ;
Jain, Rishabh ;
Hemani, Mayur ;
Krishnamurthy, Balaji .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :5413-5422
[2]   ResUNet-a: A deep learning framework for semantic segmentation of remotely sensed data [J].
Diakogiannis, Foivos, I ;
Waldner, Francois ;
Caccetta, Peter ;
Wu, Chen .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 162 :94-114
[3]  
Duchon Jean, 1977, Constructive theory of functions of several variables, P85
[4]   Disentangled Cycle Consistency for Highly-realistic Virtual Try-On [J].
Ge, Chongjian ;
Song, Yibing ;
Ge, Yuying ;
Yang, Han ;
Liu, Wei ;
Luo, Ping .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :16923-16932
[5]   Parser-Free Virtual Try-on via Distilling Appearance Flows [J].
Ge, Yuying ;
Song, Yibing ;
Zhang, Ruimao ;
Ge, Chongjian ;
Liu, Wei ;
Luo, Ping .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :8481-8489
[6]   DRAPE: DRessing Any PErson [J].
Guan, Peng ;
Reiss, Loretta ;
Hirshberg, David A. ;
Weiss, Alexander ;
Black, Michael J. .
ACM TRANSACTIONS ON GRAPHICS, 2012, 31 (04)
[7]   ClothFlow: A Flow-Based Model for Clothed Person Generation [J].
Han, Xintong ;
Hu, Xiaojun ;
Huang, Weilin ;
Scott, Matthew R. .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :10470-10479
[8]   VITON: An Image-based Virtual Try-on Network [J].
Han, Xintong ;
Wu, Zuxuan ;
Wu, Zhe ;
Yu, Ruichi ;
Davis, Larry S. .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :7543-7552
[9]   Style-Based Global Appearance Flow for Virtual Try-On [J].
He, Sen ;
Song, Yi-Zhe ;
Xiang, Tao .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :3460-3469
[10]   Disentangled Lifespan Face Synthesis [J].
He, Sen ;
Liao, Wentong ;
Yang, Michael Ying ;
Song, Yi-Zhe ;
Rosenhahn, Bodo ;
Xiang, Tao .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :3857-3866