Exposing DeepFake Videos Using Attention Based Convolutional LSTM Network

被引:12
作者
Su, Yishan [1 ]
Xia, Huawei [1 ]
Liang, Qi [2 ]
Nie, Weizhi [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Tianjin Univ, Sch Microelect, Tianjin 300072, Peoples R China
基金
中国国家自然科学基金;
关键词
DeepFake detection; Convolutional LSTM; Attention;
D O I
10.1007/s11063-021-10588-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The detection of face tampering in videos created by artificial intelligence techniques (commonly known as the Deep Fakes) has become an important and challenging task in network security defense. In this paper, we propose a novel attention-based deep fake video detection method, which captures the sharp changes in terms of the facial features caused by the composite video. We utilize the convolutional long short-term memory to extract both spatial and temporal information of DeeFake videos. Meanwhile, we apply the attention mechanism to emphasize the specific facial area of each video frame. Finally, we design a decoder to further fusion multiple frames information for more accurate detection results. Experimental results and comparisons with state-of-the-art methods demonstrate that our framework achieves superior performance.
引用
收藏
页码:4159 / 4175
页数:17
相关论文
共 50 条
[11]  
Hochreiter S., 1997, Neural Computation, V9, P1735
[12]   Multimodal Face-Pose Estimation With Multitask Manifold Deep Learning [J].
Hong, Chaoqun ;
Yu, Jun ;
Zhang, Jian ;
Jin, Xiongnan ;
Lee, Kyong-Ho .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2019, 15 (07) :3952-3961
[13]  
Kalchbrenner N., 2016, ICLR, P1
[14]   ImageNet Classification with Deep Convolutional Neural Networks [J].
Krizhevsky, Alex ;
Sutskever, Ilya ;
Hinton, Geoffrey E. .
COMMUNICATIONS OF THE ACM, 2017, 60 (06) :84-90
[15]   Understanding and improving deep learning-based rolling bearing fault diagnosis with attention mechanism [J].
Li, Xiang ;
Zhang, Wei ;
Ding, Qian .
SIGNAL PROCESSING, 2019, 161 :136-154
[16]  
[李艳歌 Li Yange], 2018, [高分子通报, Polymer Bulletin], P46
[17]  
Li YZ, 2018, IEEE INT WORKS INFOR
[18]  
Ma YK, 2018, AAAI CONF ARTIF INTE, P5876
[19]   Exploiting Visual Artifacts to Expose Deepfakes and Face Manipulations [J].
Matern, Falko ;
Riess, Christian ;
Stamminger, Marc .
2019 IEEE WINTER APPLICATIONS OF COMPUTER VISION WORKSHOPS (WACVW), 2019, :83-92
[20]  
McCloskey Scott, 2018, arXiv