Harmonizing Image Forgery Detection & Localization: Fusion of Complementary Approaches

被引:1
作者
Mareen, Hannes [1 ]
De Neve, Louis [1 ]
Lambert, Peter [1 ]
Van Wallendael, Glenn [1 ]
机构
[1] Ghent Univ Imec, Internet Technol & Data Sci Lab IDLab, B-9052 Ghent, Belgium
关键词
multimedia forensics; image forgery detection; image forgery localization; fusion; complementariness;
D O I
10.3390/jimaging10010004
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
Image manipulation is easier than ever, often facilitated using accessible AI-based tools. This poses significant risks when used to disseminate disinformation, false evidence, or fraud, which highlights the need for image forgery detection and localization methods to combat this issue. While some recent detection methods demonstrate good performance, there is still a significant gap to be closed to consistently and accurately detect image manipulations in the wild. This paper aims to enhance forgery detection and localization by combining existing detection methods that complement each other. First, we analyze these methods' complementarity, with an objective measurement of complementariness, and calculation of a target performance value using a theoretical oracle fusion. Then, we propose a novel fusion method that combines the existing methods' outputs. The proposed fusion method is trained using a Generative Adversarial Network architecture. Our experiments demonstrate improved detection and localization performance on a variety of datasets. Although our fusion method is hindered by a lack of generalization, this is a common problem in supervised learning, and hence a motivation for future work. In conclusion, this work deepens our understanding of forgery detection methods' complementariness and how to harmonize them. As such, we contribute to better protection against image manipulations and the battle against disinformation.
引用
收藏
页数:20
相关论文
共 47 条
  • [1] Barni M, 2017, EUR SIGNAL PR CONF, P281, DOI 10.23919/EUSIPCO.2017.8081213
  • [2] Image Forgery Localization via Block-Grained Analysis of JPEG Artifacts
    Bianchi, Tiziano
    Piva, Alessandro
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2012, 7 (03) : 1003 - 1017
  • [3] Bianchi T, 2011, INT CONF ACOUST SPEE, P2444
  • [4] Charitidis P., 2021, P 2021 INT C CONTENT
  • [5] On the Generalization of Deep Learning Models in Video Deepfake Detection
    Coccomini, Davide Alessandro
    Caldelli, Roberto
    Falchi, Fabrizio
    Gennaro, Claudio
    [J]. JOURNAL OF IMAGING, 2023, 9 (05)
  • [6] Noiseprint: A CNN-Based Camera Model Fingerprint
    Cozzolino, Davide
    Verdoliva, Luisa
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2020, 15 (01) : 144 - 159
  • [7] Exposing Digital Image Forgeries by Illumination Color Classification
    de Carvalho, Tiago Jose
    Riess, Christian
    Angelopoulou, Elli
    Pedrini, Helio
    Rocha, Anderson de Rezende
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2013, 8 (07) : 1182 - 1194
  • [8] Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929
  • [9] A Framework for Decision Fusion in Image Forensics Based on Dempster-Shafer Theory of Evidence
    Fontani, Marco
    Bianchi, Tiziano
    De Rosa, Alessia
    Piva, Alessandro
    Barni, Mauro
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2013, 8 (04) : 593 - 607
  • [10] Ghosh A., 2019, P CVPR WORKSH LONG B, P72