An Attention Network for Detection of Spliced Video Objects Inspired by Manipulated Visual Social Media Privacy Sensitive Issues Using NV2CIR Dataset

被引:0
作者
Das, Santanu [1 ]
Roy, Sourav Dey [1 ]
Bhowmik, Mrinal Kanti [2 ,3 ]
机构
[1] Tripura Univ, Dept Comp Sci & Engn, Suryamaninagar Tripura 799022, India
[2] NYU, NYU Ctr Cybersecur CCS, Tandon Sch Engn, Comp Sci & Engn Dept, New York, NY 11201 USA
[3] Tripura Univ, Comp Sci & Engn Dept, Suryamaninagar Tripura 799022, India
来源
IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS | 2025年
关键词
Forgery; Splicing; Privacy; Forensics; Visualization; Government; Reviews; Night vision; Identity theft; Feature extraction; Forgery detection; night vision; NV2CIR; performance evaluation; video forgery;
D O I
10.1109/TCSS.2024.3523047
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Even though forgery detection is a well matured topic, reporting on the same for detection of forgery in night time outdoor scenes is not explored to date. Despite the lack of appropriate benchmark video datasets for forgery detection at night time using infrared (IR) video modality, we designed a novel ground truth annotated forged video dataset named as "NV2CIR (Night Vision Video Forensic Challenges based IR Forged Dataset)" in real-world night time situations. The dataset contains various 310 infrared imaging based forged videos (i.e., object based forgery, interframe forgery, and intraframe forgery) and their corresponding 310 authentic videos. The article also proposed a novel framework named as "AFOD-Net (attention guided fake object detection network)" for localization of spliced objects in night vision outdoor scenarios. The proposed network employs a long short term memory (LSTM) module and our proposed spliced object attention module (SOA) so as to precisely localize the spatio-temporal spliced regions. Experimental results show that AFOD-Net significantly improves the performance for localizing the spliced objects on our designed spliced video dataset with mean average precision (mAP) of 85.16%.
引用
收藏
页数:22
相关论文
共 87 条
[1]  
Afchar D, 2018, IEEE INT WORKS INFOR
[2]   Development of a tampering dataset for forensic investigation [J].
Al-Sanjary, Omar Ismael ;
Ahmed, Ahmed Abdullah ;
Sulong, Ghazali .
FORENSIC SCIENCE INTERNATIONAL, 2016, 266 :565-572
[3]   Sequential and Patch Analyses for Object Removal Video Forgery Detection and Localization [J].
Aloraini, Mohammed ;
Sharifzadeh, Mehdi ;
Schonfeld, Dan .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (03) :917-930
[4]  
[Anonymous], 2020, Medium
[5]  
[Anonymous], Filmora 9
[6]  
[Anonymous], ADOBE
[7]   Detection and localization of inter-frame video forgeries based on inconsistency in correlation distribution between Haralick coded frames [J].
Bakas, Jamimamul ;
Naskar, Ruchira ;
Dixit, Rahul .
MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (04) :4905-4935
[8]  
Barad ZJ, 2020, INT CONF ADVAN COMPU, P571, DOI [10.1109/ICACCS48705.2020.9074408, 10.1109/icaccs48705.2020.9074408]
[9]  
Chen LC, 2017, Arxiv, DOI [arXiv:1706.05587, DOI 10.48550/ARXIV.1706.05587]
[10]  
Croomes R., 2013, The News Courier