Face Editing Based on Facial Recognition Features

被引:46
作者
Ning, Xin [1 ]
Xu, Shaohui [2 ]
Nan, Fangzhe [2 ]
Zeng, Qingliang [2 ]
Wang, Chen [3 ]
Cai, Weiwei [4 ,5 ]
Li, Weijun [6 ,7 ,8 ]
Jiang, Yizhang [9 ]
机构
[1] Chinese Acad Sci, Inst Semicond, Lab Artificial Neural Networks & High Speed Circui, Beijing 100083, Peoples R China
[2] Wave Grp, Cognit Comp Technol Joint Lab, Beijing 102208, Peoples R China
[3] Beihang Univ, Sch Comp Sci, Beijing 100190, Peoples R China
[4] Jiangnan Univ, Sch Artificial Intelligence & Comp Sci, Wuxi 214122, Peoples R China
[5] No Arizona Univ, Grad Sch, Flagstaff, AZ 86011 USA
[6] Chinese Acad Sci, Inst Semicond, Beijing 100083, Peoples R China
[7] Univ Chinese Acad Sci, Ctr Mat Sci & Optoelect Engn, Beijing 100049, Peoples R China
[8] Univ Chinese Acad Sci, Sch Integrated Circuits, Beijing 100049, Peoples R China
[9] Jiangnan Univ, Sch Digital Media, Wuxi 214122, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Faces; Generators; Task analysis; Face recognition; Hybrid fiber coaxial cables; Aerospace electronics; Face editing; global precedence; homology continuity; human cognitive characteristics; PERCEPTION;
D O I
10.1109/TCDS.2022.3182650
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Face editing generates a face image with the target attributes without changing the identity or other information. Current methods have achieved considerable performance; however, they cannot effectively retain the face's identity and semantic information while controlling the attribute intensity. Inspired by two human cognitive characteristics, namely, the principle of global precedence and the principle of homology continuity, we propose a novel face editing approach called the information retention and intensity control generative adversarial network (IricGAN). It includes a learnable hierarchical feature combination (HFC) function, which can construct a sample's source space through multiscale feature mixing; it can guarantee the integrity of the source space while significantly compressing the network. Additionally, the attribute regression module (ARM) can decouple different attribute paradigms in the source space to ensure the correct modification of the required attributes and preserve the other areas. The gradual process of modifying the face attributes can be simulated by applying different control strengths in the source space. In face editing experiments, both qualitative and quantitative results demonstrate that IricGAN achieves the best overall results among state-of-the-art alternatives. Target attributes can be continuously modified by refeeding the relationship of the source space and the image, and the independence of each attribute can be retained to the greatest extent. IricGAN:https://github.com/nanfangzhe/IricGAN.
引用
收藏
页码:774 / 783
页数:10
相关论文
共 61 条
[1]  
Abdal R, 2020, PROC CVPR IEEE, P8293, DOI 10.1109/CVPR42600.2020.00832
[2]   Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space? [J].
Abdal, Rameen ;
Qin, Yipeng ;
Wonka, Peter .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :4431-4440
[3]  
[Anonymous], 1998, The central nervous system of vertebrates
[4]  
[Anonymous], 2017, P IEEE C COMP VIS PA
[5]   Seeing What a GAN Cannot Generate [J].
Bau, David ;
Zhu, Jun-Yan ;
Wulff, Jonas ;
Peebles, William ;
Strobelt, Hendrik ;
Zhou, Bolei ;
Torralba, Antonio .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :4501-4510
[6]  
Bau David, 2019, ICLR WORKSHOP
[7]   Robot Multimodal Object Perception and Recognition: Synthetic Maturation of Sensorimotor Learning in Embodied Systems [J].
Braud, Raphael ;
Giagkos, Alexandros ;
Shaw, Patricia ;
Lee, Mark ;
Shen, Qiang .
IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2021, 13 (02) :416-428
[8]  
Lipton ZC, 2017, Arxiv, DOI arXiv:1702.04782
[9]   TOPOLOGICAL-STRUCTURE IN VISUAL-PERCEPTION [J].
CHEN, L .
SCIENCE, 1982, 218 (4573) :699-700
[10]   Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images [J].
Cheng, Gong ;
Zhou, Peicheng ;
Han, Junwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (12) :7405-7415