Deepfake Video Detection through Optical Flow based CNN

被引:182
作者
Amerini, Irene [1 ]
Galteri, Leonardo [1 ]
Caldelli, Roberto [1 ,2 ]
Del Bimbo, Alberto [1 ]
机构
[1] Univ Florence, Media Integrat & Commun Ctr MICC, Florence, Italy
[2] Natl Interuniv Consortium Telecommun CNIT, Parma, Italy
来源
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW) | 2019年
关键词
D O I
10.1109/ICCVW.2019.00152
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent advances in visual media technology have led to new tools for processing and, above all, generating multimedia contents. In particular, modern AI-based technologies have provided easy-to-use tools to create extremely realistic manipulated videos. Such synthetic videos, named Deep Fakes, may constitute a serious threat to attack the reputation of public subjects or to address the general opinion on a certain event. According to this, being able to individuate this kind of fake information becomes fundamental. In this work, a new forensic technique able to discern between fake and original video sequences is given; unlike other state-of-the-art methods which resorts at single video frames, we propose the adoption of optical flow fields to exploit possible inter-frame dissimilarities. Such a clue is then used as feature to be learned by CNN classifiers. Preliminary results obtained on FaceForensics++ dataset highlight very promising performances.
引用
收藏
页码:1205 / 1207
页数:3
相关论文
共 14 条
[1]  
Afchar D., 2018, MesoNet: a compact facial video forgery detection network, P1, DOI DOI 10.1109/WIFS.2018.8630761
[2]  
Agarwal S., 2019, P IEEE C COMP VIS PA, V1, P38
[3]   Regularization of optic flow estimates by means of weighted vector median filtering [J].
Alparone, L ;
Barni, M ;
Bartolini, F ;
Caldelli, R .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 1999, 8 (10) :1462-1467
[4]  
[Anonymous], 2017, CoRR
[5]  
[Anonymous], 2018, ACM T GRAPH, DOI DOI 10.1145/3180491
[6]   The computation of optical flow [J].
Beauchemin, SS ;
Barron, JL .
ACM COMPUTING SURVEYS, 1995, 27 (03) :433-467
[7]  
He K., 2016, CVPR, DOI [10.1109/CVPR.2016.90, DOI 10.1109/CVPR.2016.90]
[8]   Low-Latency Video Semantic Segmentation [J].
Li, Yule ;
Shi, Jianping ;
Lin, Dahua .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :5997-6005
[9]  
Rossler Andreas, 2018, FACEFORENSICS LARGE
[10]  
Rossler Andreas., 2019, CORR