Edge-aware Regional Message Passing Controller for Image Forgery Localization

被引:43
作者
Li, Dong [1 ]
Zhu, Jiaying [1 ]
Wang, Menglu [1 ]
Liu, Jiawei [1 ]
Fu, Xueyang [1 ]
Zha, Zheng-Jun [1 ]
机构
[1] Univ Sci & Technol China, Hefei, Peoples R China
来源
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) | 2023年
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
D O I
10.1109/CVPR52729.2023.00795
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Digital image authenticity has promoted research on image forgery localization. Although deep learning-based methods achieve remarkable progress, most of them usually suffer from severe feature coupling between the forged and authentic regions. In this work, we propose a two-step Edge-aware Regional Message Passing Controlling strategy to address the above issue. Specifically, the first step is to account for fully exploiting the edge information. It consists of two core designs: context-enhanced graph construction and threshold-adaptive differentiable binarization edge algorithm. The former assembles the global semantic information to distinguish the features between the forged and authentic regions, while the latter stands on the output of the former to provide the learnable edges. In the second step, guided by the learnable edges, a region message passing controller is devised to weaken the message passing between the forged and authentic regions. In this way, our ERMPC is capable of explicitly modeling the inconsistency between the forged and authentic regions and enabling it to perform well on refined forged images. Extensive experiments on several challenging benchmarks show that our method is superior to state-of-the-art image forgery localization methods qualitatively and quantitatively.
引用
收藏
页码:8222 / 8232
页数:11
相关论文
共 64 条
[1]   Sequential and Patch Analyses for Object Removal Video Forgery Detection and Localization [J].
Aloraini, Mohammed ;
Sharifzadeh, Mehdi ;
Schonfeld, Dan .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (03) :917-930
[2]   Localization of JPEG double compression through multi-domain convolutional neural networks [J].
Amerini, Irene ;
Uricchio, Tiberio ;
Ballan, Lamberto ;
Caldelli, Roberto .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1865-1871
[3]   Tampering Detection and Localization through Clustering of Camera-Based CNN Features [J].
Bondi, Luca ;
Lameri, Silvia ;
Guera, David ;
Bestagini, Paolo ;
Delp, Edward J. ;
Tubaro, Stefano .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1855-1864
[4]  
Chen LC, 2017, Arxiv, DOI [arXiv:1706.05587, 10.48550/arXiv.1706.05587]
[5]   Image Manipulation Detection by Multi-View Multi-Scale Supervision [J].
Chen, Xinru ;
Dong, Chengbo ;
Ji, Jiaqi ;
Cao, Juan ;
Li, Xirong .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :14165-14173
[6]   Multi-Label Image Recognition with Graph Convolutional Networks [J].
Chen, Zhao-Min ;
Wei, Xiu-Shen ;
Wang, Peng ;
Guo, Yanwen .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :5172-5181
[7]   High-Resolution Image Harmonization via Collaborative Dual Transformations [J].
Cong, Wenyan ;
Tao, Xinhao ;
Niu, Li ;
Liang, Jing ;
Gao, Xuesong ;
Sun, Qihao ;
Zhang, Liqing .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :18449-18458
[8]   Efficient Dense-Field Copy-Move Forgery Detection [J].
Cozzolino, Davide ;
Poggi, Giovanni ;
Verdoliva, Luisa .
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2015, 10 (11) :2284-2297
[9]   Noiseprint: A CNN-Based Camera Model Fingerprint [J].
Cozzolino, Davide ;
Verdoliva, Luisa .
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2020, 15 (01) :144-159
[10]  
Cozzolino D, 2015, IEEE INT WORKS INFOR