Image Manipulation Localization Using SpatialChannel Fusion Excitation and Fine-Grained Feature Enhancement

被引:0
|
作者
Li, Fengyong [1 ]
Zhai, Huajun [1 ]
Zhang, Xinpeng [2 ]
Qin, Chuan [3 ]
机构
[1] Shanghai Univ Elect Power, Coll Comp Sci & Technol, Shanghai 201306, Peoples R China
[2] Fudan Univ, Sch Comp Sci, Shanghai 200433, Peoples R China
[3] Univ Shanghai Sci & Technol, Sch Opt Elect & Comp Engn, Shanghai 200093, Peoples R China
基金
上海市自然科学基金; 中国国家自然科学基金;
关键词
Detection testing; feature enhancement; fusion excitation; image forgery; image manipulation detection; SURFACE-PLASMON RESONANCE; REFRACTIVE-INDEX; SENSORS;
D O I
10.1109/TIM.2023.3338703
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The purpose of image manipulation detection is to classify and locate tampered regions in digital images. Most existing manipulation localization methods usually rely on certain tampering traces hidden in manipulated images. This dependency, however, may damage the generalization and postprocessing capabilities of the detection model because the tampered content in the image may be weakened by postprocessing operations. To address the aforementioned problem, we propose a new image manipulation localization scheme by introducing spatial-channel fusion excitation and fine-grained feature enhancement (FFE). We first design a feature enhancement module to enhance fine-grained features in red green blue (RGB) streams, which can improve the localization accuracy of tampering regions by capturing different-scale local and global information of images. Furthermore, a fusion excitation strategy is introduced to efficiently fuse features from both spatial and channel domains. Our fusion strategy can simultaneously process image spatial and channel information, significantly enhancing the model's differentiation capability between tampered and nontampered regions. Extensive experiments demonstrate that the proposed method can provide effective localization capability for multiscale manipulation regions over different image sets and outperform most of the state-of-the-art schemes in terms of detection accuracy, generalization, and robustness.
引用
收藏
页码:1 / 14
页数:14
相关论文
共 50 条
  • [21] Fine-grained image recognition method for digital media based on feature enhancement strategy
    Zhou, Tieyu
    Gao, Linyi
    Hua, Ranjun
    Zhou, Junhong
    Li, Jinao
    Guo, Yawen
    Zhang, Yan
    NEURAL COMPUTING & APPLICATIONS, 2023, 36 (5): : 2323 - 2335
  • [22] Fine-grained image recognition method for digital media based on feature enhancement strategy
    Tieyu Zhou
    Linyi Gao
    Ranjun Hua
    Junhong Zhou
    Jinao Li
    Yawen Guo
    Yan Zhang
    Neural Computing and Applications, 2024, 36 : 2323 - 2335
  • [23] From coarse to fine: multi-level feature fusion network for fine-grained image retrieval
    Wang, Shijie
    Wang, Zhihui
    Wang, Ning
    Wang, Hong
    Li, Haojie
    MULTIMEDIA SYSTEMS, 2022, 28 (04) : 1515 - 1528
  • [24] Feature relocation network for fine-grained image classification
    Zhao, Peng
    Li, Yi
    Tang, Baowei
    Liu, Huiting
    Yao, Sheng
    NEURAL NETWORKS, 2023, 161 : 306 - 317
  • [25] From coarse to fine: multi-level feature fusion network for fine-grained image retrieval
    Shijie Wang
    Zhihui Wang
    Ning Wang
    Hong Wang
    Haojie Li
    Multimedia Systems, 2022, 28 : 1515 - 1528
  • [26] Fine-Grained Image Editing Using ControlNet: Expanding Possibilities in Visual Manipulation
    Xu, Longfei
    Huang, Hongbo
    Zhao, Yushuang
    Pan, Shuwen
    Zheng, Yaolin
    Yan, Xiaoxu
    Huang, Linkai
    Wu, Lishan
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT VI, ICIC 2024, 2024, 14867 : 27 - 38
  • [27] Hierarchical Fine-Grained Image Forgery Detection and Localization
    Guo, Xiao
    Liu, Xiaohong
    Ren, Zhiyuan
    Grosz, Steven
    Masi, Iacopo
    Liu, Xiaoming
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 3155 - 3165
  • [28] Fine-Grained Image Retrieval via Object Localization
    Wang, Rong
    Zou, Wei
    Wang, Jiajun
    ELECTRONICS, 2023, 12 (10)
  • [29] Multi-Grained Selection and Fusion for Fine-Grained Image Representation
    Jiang, Jianrong
    Wang, Hongxing
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [30] Multi-layer feature fusion and attention enhancement for fine-grained vehicle recognition research
    Zhang, Shouyang
    Zhang, Yong
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2025, 36 (01)