Image Manipulation Localization Using SpatialChannel Fusion Excitation and Fine-Grained Feature Enhancement

被引:0
|
作者
Li, Fengyong [1 ]
Zhai, Huajun [1 ]
Zhang, Xinpeng [2 ]
Qin, Chuan [3 ]
机构
[1] Shanghai Univ Elect Power, Coll Comp Sci & Technol, Shanghai 201306, Peoples R China
[2] Fudan Univ, Sch Comp Sci, Shanghai 200433, Peoples R China
[3] Univ Shanghai Sci & Technol, Sch Opt Elect & Comp Engn, Shanghai 200093, Peoples R China
基金
上海市自然科学基金; 中国国家自然科学基金;
关键词
Detection testing; feature enhancement; fusion excitation; image forgery; image manipulation detection; SURFACE-PLASMON RESONANCE; REFRACTIVE-INDEX; SENSORS;
D O I
10.1109/TIM.2023.3338703
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The purpose of image manipulation detection is to classify and locate tampered regions in digital images. Most existing manipulation localization methods usually rely on certain tampering traces hidden in manipulated images. This dependency, however, may damage the generalization and postprocessing capabilities of the detection model because the tampered content in the image may be weakened by postprocessing operations. To address the aforementioned problem, we propose a new image manipulation localization scheme by introducing spatial-channel fusion excitation and fine-grained feature enhancement (FFE). We first design a feature enhancement module to enhance fine-grained features in red green blue (RGB) streams, which can improve the localization accuracy of tampering regions by capturing different-scale local and global information of images. Furthermore, a fusion excitation strategy is introduced to efficiently fuse features from both spatial and channel domains. Our fusion strategy can simultaneously process image spatial and channel information, significantly enhancing the model's differentiation capability between tampered and nontampered regions. Extensive experiments demonstrate that the proposed method can provide effective localization capability for multiscale manipulation regions over different image sets and outperform most of the state-of-the-art schemes in terms of detection accuracy, generalization, and robustness.
引用
收藏
页码:1 / 14
页数:14
相关论文
共 50 条
  • [31] Partial Multimodal Hashing Based on Fine-grained Feature Fusion
    Yin Z.-Z.
    Li B.-H.
    Wang M.
    Huang R.-L.
    Wu W.-L.
    Wang H.-F.
    Ruan Jian Xue Bao/Journal of Software, 2024, 35 (03): : 1074 - 1089
  • [32] FFEDet: Fine-Grained Feature Enhancement for Small Object Detection
    Zhao, Feiyue
    Zhang, Jianwei
    Zhang, Guoqing
    REMOTE SENSING, 2024, 16 (11)
  • [33] A dual-branch feature fusion neural network for fish image fine-grained recognition
    Geng, Xu
    Gao, Jinxiong
    Zhang, Yonghui
    Wang, Rong
    VISUAL COMPUTER, 2024, 40 (10): : 6883 - 6896
  • [34] Foreground-Background Partitioning and Feature Fusion for Weakly Supervised Fine-Grained Image Recognition
    Liu, Chenglin
    Li, Jiuliang
    Chen, Yanmin
    Luo, Jun
    Zhou, Mengyao
    Yang, Jian
    Li, Zhenfei
    PATTERN RECOGNITION AND COMPUTER VISION, PT III, PRCV 2024, 2025, 15033 : 17 - 30
  • [35] Correction: Fine-grained image recognition method for digital media based on feature enhancement strategy
    Tieyu Zhou
    Linyi Gao
    Ranjun Hua
    Junhong Zhou
    Jinao Li
    Yawen Guo
    Yan Zhang
    Neural Computing and Applications, 2024, 36 : 2337 - 2337
  • [36] Spatial-frequency feature fusion network for small dataset fine-grained image classification
    Guo, Yongfei
    Li, Bo
    Zhang, Wenyue
    Dong, Weilong
    SCIENTIFIC REPORTS, 2025, 15 (01):
  • [37] Improve Fine-Grained Feature Learning in Fine-Grained DataSet GAI
    Wang, Hai Peng
    Geng, Zhi Qing
    IEEE ACCESS, 2025, 13 : 12777 - 12788
  • [38] Discriminative Feature Mining and Enhancement Network for Low-Resolution Fine-Grained Image Recognition
    Yan, Tiantian
    Li, Haojie
    Sun, Baoli
    Wang, Zhihui
    Luo, Zhongxuan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (08) : 5319 - 5330
  • [39] Fine-Grained Clothing Image Classification by Style Feature Description
    Wu M.
    Liu L.
    Fu X.
    Liu L.
    Huang Q.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2019, 31 (05): : 780 - 791
  • [40] Discriminative feature mining hashing for fine-grained image retrieval
    Lang, Wenxi
    Sun, Han
    Xu, Can
    Liu, Ningzhong
    Zhou, Huiyu
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2022, 87