Exploiting Visual Artifacts to Expose Deepfakes and Face Manipulations

被引:421
作者
Matern, Falko [1 ]
Riess, Christian [1 ]
Stamminger, Marc [1 ]
机构
[1] Friedrich Alexander Univ Erlangen Nuremberg, Erlangen, Germany
来源
2019 IEEE WINTER APPLICATIONS OF COMPUTER VISION WORKSHOPS (WACVW) | 2019年
关键词
D O I
10.1109/WACVW.2019.00020
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
High quality face editing in videos is a growing concern and spreads distrust in video content. However, upon closer examination, many face editing algorithms exhibit artifacts that resemble classical computer vision issues that stem from face tracking and editing. As a consequence, we wonder how difficult it is to expose artificial faces from current generators? To this end, we review current facial editing methods and several characteristic artifacts from their processing pipelines. We also show that relatively simple visual artifacts can be already quite effective in exposing such manipulations, including Deepfakes and Face2Face. Since the methods are based on visual features, they are easily explicable also to non-technical experts. The methods are easy to implement and offer capabilities for rapid adjustment to new manipulation types with little data available. Despite their simplicity, the methods are able to achieve AUC values of up to 0.866.
引用
收藏
页码:83 / 92
页数:10
相关论文
共 42 条
[1]  
[Anonymous], 2018, ADV NEURAL INFORM PR
[2]  
[Anonymous], 2018, PROC NEURIPS
[3]  
[Anonymous], TECHNICAL REPORT
[4]  
[Anonymous], 2018, The Guardian
[5]  
[Anonymous], ACM T GRAPH
[6]  
[Anonymous], 2018, P IEEE C COMP VIS PA
[7]  
[Anonymous], 2016, ARXIV160508803CSSTAT
[8]  
[Anonymous], 2014, ARXIV
[9]  
[Anonymous], 2017, 2017 IEEE WORKSHOP I
[10]  
[Anonymous], 2018, ICTU OCULI EXPOSING