Exposing DeepFake Videos Using Attention Based Convolutional LSTM Network

被引:12
作者
Su, Yishan [1 ]
Xia, Huawei [1 ]
Liang, Qi [2 ]
Nie, Weizhi [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Tianjin Univ, Sch Microelect, Tianjin 300072, Peoples R China
基金
中国国家自然科学基金;
关键词
DeepFake detection; Convolutional LSTM; Attention;
D O I
10.1007/s11063-021-10588-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The detection of face tampering in videos created by artificial intelligence techniques (commonly known as the Deep Fakes) has become an important and challenging task in network security defense. In this paper, we propose a novel attention-based deep fake video detection method, which captures the sharp changes in terms of the facial features caused by the composite video. We utilize the convolutional long short-term memory to extract both spatial and temporal information of DeeFake videos. Meanwhile, we apply the attention mechanism to emphasize the specific facial area of each video frame. Finally, we design a decoder to further fusion multiple frames information for more accurate detection results. Experimental results and comparisons with state-of-the-art methods demonstrate that our framework achieves superior performance.
引用
收藏
页码:4159 / 4175
页数:17
相关论文
共 50 条
[1]  
Afchar D, 2018, IEEE INT WORKS INFOR
[2]   A secure and robust hash-based scheme for image authentication [J].
Ahmed, Fawad ;
Siyal, M. Y. ;
Abbas, Vali Uddin .
SIGNAL PROCESSING, 2010, 90 (05) :1456-1470
[3]  
Amerini Irene, 2020, IH&MMSec '20: Proceedings of the 2020 ACM Workshop on Information Hiding and Multimedia Security, P97, DOI 10.1145/3369412.3395070
[4]   Deepfake Video Detection through Optical Flow based CNN [J].
Amerini, Irene ;
Galteri, Leonardo ;
Caldelli, Roberto ;
Del Bimbo, Alberto .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, :1205-1207
[5]   Social Network Identification Through Image Classification With CNN [J].
Amerini, Irene ;
Li, Chang-Tsun ;
Caldelli, Roberto .
IEEE ACCESS, 2019, 7 :35264-35273
[6]  
Barret Z, 2017, 5 INT C LEARN REPR I
[7]  
Chung J., 2014, P NIPS 2014 WORKSH D
[8]   Predicting Human Eye Fixations via an LSTM-Based Saliency Attentive Model [J].
Cornia, Marcella ;
Baraldi, Lorenzo ;
Serra, Giuseppe ;
Cucchiara, Rita .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (10) :5142-5154
[9]  
Güera D, 2018, 2018 15TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE (AVSS), P127
[10]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778