Video source identification using machine learning: A case study of 16 instant messaging applications

被引:0
作者
Yang, Hyomin [1 ]
Kim, Junho [1 ]
Park, Jungheum [1 ]
机构
[1] Korea Univ, Sch Cybersecur, Seoul, South Korea
来源
FORENSIC SCIENCE INTERNATIONAL-DIGITAL INVESTIGATION | 2024年 / 50卷
关键词
Digital forensics; Multimedia forensics; AVC; HEVC; Source identification; Machine learning; CAMERA-IDENTIFICATION; INTEGRITY; AUTHENTICATION; FORENSICS;
D O I
10.1016/j.fsidi.2024.301812
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, there has been a notable increase in the prevalence of cybercrimes related to video content, including the distribution of illegal videos and the sharing of copyrighted material. This has led to the growing importance of identifying the source of video files to trace the owner of the files involved in the incident or identify the distributor. Previous research has concentrated on revealing the device (brand and/or model) that "originally" created a video file. This has been achieved by analysing the pattern noise generated by the image sensor in the camera, the storage structural features of the file, and the metadata patterns. However, due to the widespread use of mobile environments, instant messaging applications (IMAs) such as Telegram and Wire have been utilized to share illegal videos, which can result in the loss of information from the original file due to re-encoding at the application level, depending on the transmission settings. Consequently, it is necessary to extend the scope of existing research to identify the various applications that are capable of re-encoding video files in transit. Furthermore, it is essential to determine whether there are features that can be leveraged to distinguish them from the source identification perspective. In this paper, we propose a machine learning-based methodology for classifying the source application by extracting various features stored in the storage format and internal metadata of video files. To conduct this study, we analyzed 16 IMAs that are widely used in mobile environments and generated a total of 1974 sample videos, taking into account both the transmission options and encoding settings offered by each IMA. The training and testing results on this dataset indicate that the ExtraTrees model achieved an identification accuracy of approximately 99.96 %. Furthermore, we developed a proof-of-concept tool based on the proposed method, which extracts the suggested features from videos and queries a pre-trained model. This tool is released as open-source software for the community.
引用
收藏
页数:9
相关论文
共 40 条
  • [1] Comparative Analysis of a Deep Convolutional Neural Network for Source Camera Identification
    Ahmed, Farah
    Khelifi, Fouad
    Lawgaly, Ashref
    Bouridane, Ahmed
    [J]. PROCEEDINGS OF 2019 IEEE 12TH INTERNATIONAL CONFERENCE ON GLOBAL SECURITY, SAFETY AND SUSTAINABILITY (ICGS3-2019), 2019, : 99 - 104
  • [2] Aizvorski, 2014, h264bitstream
  • [3] PRNU-Net: a Deep Learning Approach for Source Camera Model Identification based on Videos Taken with Smartphone
    Akbari, Younes
    Almaadeed, Noor
    Al-Maadeed, Somaya
    Khelifi, Fouad
    Bouridane, Ahmed
    [J]. 2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 599 - 605
  • [4] Video Source Characterization Using Encoding and Encapsulation Characteristics
    Altinisik, Enes
    Sencar, Husrev Taha
    Tabaa, Diram
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2022, 17 : 3211 - 3224
  • [5] Source Camera Verification for Strongly Stabilized Videos
    Altinisik, Enes
    Sencar, Husrev Taha
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2021, 16 : 643 - 657
  • [6] LEARNING DOUBLE-COMPRESSION VIDEO FINGERPRINTS LEFT FROM SOCIAL-MEDIA PLATFORMS
    Amerini, Irene
    Anagnostopoulos, Aris
    Maiano, Luca
    Celsi, Lorenzo Ricciardi
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 2530 - 2534
  • [7] Dealing with video source identification in social networks
    Amerini, Irene
    Caldelli, Roberto
    Del Mastio, Andrea
    Di Fuccia, Andrea
    Molinari, Cristiano
    Rizzo, Anna Paola
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2017, 57 : 1 - 7
  • [8] Video source camera identification using fusion of texture features and noise fingerprint
    Anmol, Tigga
    Sitara, K.
    [J]. FORENSIC SCIENCE INTERNATIONAL-DIGITAL INVESTIGATION, 2024, 49
  • [9] Apple Computer I, 2001, Quicktime file format specification
  • [10] Bennabhaktula G. S., 2022, Social Netw. Comput. Sci, V3, P316