An Attention Network for Detection of Spliced Video Objects Inspired by Manipulated Visual Social Media Privacy Sensitive Issues Using NV2CIR Dataset

被引:0
作者
Das, Santanu [1 ]
Roy, Sourav Dey [1 ]
Bhowmik, Mrinal Kanti [2 ,3 ]
机构
[1] Tripura Univ, Dept Comp Sci & Engn, Suryamaninagar Tripura 799022, India
[2] NYU, NYU Ctr Cybersecur CCS, Tandon Sch Engn, Comp Sci & Engn Dept, New York, NY 11201 USA
[3] Tripura Univ, Comp Sci & Engn Dept, Suryamaninagar Tripura 799022, India
来源
IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS | 2025年
关键词
Forgery; Splicing; Privacy; Forensics; Visualization; Government; Reviews; Night vision; Identity theft; Feature extraction; Forgery detection; night vision; NV2CIR; performance evaluation; video forgery;
D O I
10.1109/TCSS.2024.3523047
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Even though forgery detection is a well matured topic, reporting on the same for detection of forgery in night time outdoor scenes is not explored to date. Despite the lack of appropriate benchmark video datasets for forgery detection at night time using infrared (IR) video modality, we designed a novel ground truth annotated forged video dataset named as "NV2CIR (Night Vision Video Forensic Challenges based IR Forged Dataset)" in real-world night time situations. The dataset contains various 310 infrared imaging based forged videos (i.e., object based forgery, interframe forgery, and intraframe forgery) and their corresponding 310 authentic videos. The article also proposed a novel framework named as "AFOD-Net (attention guided fake object detection network)" for localization of spliced objects in night vision outdoor scenarios. The proposed network employs a long short term memory (LSTM) module and our proposed spliced object attention module (SOA) so as to precisely localize the spatio-temporal spliced regions. Experimental results show that AFOD-Net significantly improves the performance for localizing the spliced objects on our designed spliced video dataset with mean average precision (mAP) of 85.16%.
引用
收藏
页数:22
相关论文
共 87 条
[21]   RGBT tracking: A comprehensive review [J].
Feng, Mingzheng ;
Su, Jianbo .
INFORMATION FUSION, 2024, 110
[22]  
filmibeat, FILMIBIT
[23]  
Gao BL, 2018, Arxiv, DOI arXiv:1704.00805
[24]   Unified Information Fusion Network for Multi-Modal RGB-D and RGB-T Salient Object Detection [J].
Gao, Wei ;
Liao, Guibiao ;
Ma, Siwei ;
Li, Ge ;
Liang, Yongsheng ;
Lin, Weisi .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (04) :2091-2106
[25]   Fast R-CNN [J].
Girshick, Ross .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1440-1448
[26]   Rich feature hierarchies for accurate object detection and semantic segmentation [J].
Girshick, Ross ;
Donahue, Jeff ;
Darrell, Trevor ;
Malik, Jitendra .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :580-587
[27]  
github, GITHUB
[28]  
GRIP, About us
[29]   A New Method to Detect Splicing Image Forgery Using Convolutional Neural Network [J].
Hosny, Khalid M. ;
Mortda, Akram M. ;
Lashin, Nabil A. ;
Fouda, Mostafa M. .
APPLIED SCIENCES-BASEL, 2023, 13 (03)
[30]  
Instagram, About Instagram