Image Manipulation Localization Using SpatialChannel Fusion Excitation and Fine-Grained Feature Enhancement

被引:0
|
作者
Li, Fengyong [1 ]
Zhai, Huajun [1 ]
Zhang, Xinpeng [2 ]
Qin, Chuan [3 ]
机构
[1] Shanghai Univ Elect Power, Coll Comp Sci & Technol, Shanghai 201306, Peoples R China
[2] Fudan Univ, Sch Comp Sci, Shanghai 200433, Peoples R China
[3] Univ Shanghai Sci & Technol, Sch Opt Elect & Comp Engn, Shanghai 200093, Peoples R China
基金
上海市自然科学基金; 中国国家自然科学基金;
关键词
Detection testing; feature enhancement; fusion excitation; image forgery; image manipulation detection; SURFACE-PLASMON RESONANCE; REFRACTIVE-INDEX; SENSORS;
D O I
10.1109/TIM.2023.3338703
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The purpose of image manipulation detection is to classify and locate tampered regions in digital images. Most existing manipulation localization methods usually rely on certain tampering traces hidden in manipulated images. This dependency, however, may damage the generalization and postprocessing capabilities of the detection model because the tampered content in the image may be weakened by postprocessing operations. To address the aforementioned problem, we propose a new image manipulation localization scheme by introducing spatial-channel fusion excitation and fine-grained feature enhancement (FFE). We first design a feature enhancement module to enhance fine-grained features in red green blue (RGB) streams, which can improve the localization accuracy of tampering regions by capturing different-scale local and global information of images. Furthermore, a fusion excitation strategy is introduced to efficiently fuse features from both spatial and channel domains. Our fusion strategy can simultaneously process image spatial and channel information, significantly enhancing the model's differentiation capability between tampered and nontampered regions. Extensive experiments demonstrate that the proposed method can provide effective localization capability for multiscale manipulation regions over different image sets and outperform most of the state-of-the-art schemes in terms of detection accuracy, generalization, and robustness.
引用
收藏
页码:1 / 14
页数:14
相关论文
共 50 条
  • [41] Fine-grained image analysis via progressive feature learning
    Yan, Yichao
    Ni, Bingbing
    Wei, Huawei
    Yang, Xiaokang
    NEUROCOMPUTING, 2020, 396 (396) : 254 - 265
  • [42] Feature Correlation Residual Network for Fine-Grained Image Recognition
    Xu, Jiazhen
    Wei, Yantao
    Deng, Wei
    IEEE ACCESS, 2020, 8 : 214322 - 214331
  • [43] Learning Semantically Enhanced Feature for Fine-Grained Image Classification
    Luo, Wei
    Zhang, Hengmin
    Li, Jun
    Wei, Xiu-Shen
    IEEE SIGNAL PROCESSING LETTERS, 2020, 27 (27) : 1545 - 1549
  • [44] Fine-Grained Image Classification Algorithm Using Multi-Scale Feature Fusion and Re-Attention Mechanism
    He K.
    Feng X.
    Gao S.
    Ma X.
    Tianjin Daxue Xuebao (Ziran Kexue yu Gongcheng Jishu Ban)/Journal of Tianjin University Science and Technology, 2020, 53 (10): : 1077 - 1085
  • [45] Image Manipulation Localization Using Dual-Shallow Feature Pyramid Fusion and Boundary Contextual Incoherence Enhancement
    Xiang, Yan
    Yuan, Xiaochen
    Zhao, Kaiqi
    Liu, Tong
    Xie, Zhiyao
    Huang, Guoheng
    Li, Jianqing
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024,
  • [46] Edge Feature Enhancement for Fine-Grained Segmentation of Remote Sensing Images
    Chen, Zhenxiang
    Xu, Tingfa
    Pan, Yongzhuo
    Shen, Ning
    Chen, Huan
    Li, Jianan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [47] Detecting Android malware: A multimodal fusion method with fine-grained feature
    Li, Xun
    Liu, Lei
    Liu, Yuzhou
    Liu, Huaxiao
    Information Fusion, 2025, 114
  • [48] Fine-Grained Butterfly Classification Based on Multi-Feature Enhancement
    Jin, Hong
    Sha, Ke
    Xie, Xiaolan
    IEEE ACCESS, 2024, 12 : 29194 - 29203
  • [49] Target Detection Optimization Model Based On Fine-grained Feature Fusion
    Bao, Xianfu
    Qiang, Zanxia
    Bai, Guangyao
    Yang, Rui
    INTERNATIONAL CONFERENCE ON IMAGE PROCESSING AND INTELLIGENT CONTROL (IPIC 2021), 2021, 11928
  • [50] Fine-Grained Feature Enhancement for Object Detection in Remote Sensing Images
    Zhou, Yong
    Wang, Sifan
    Zhao, Jiaqi
    Zhu, Hancheng
    Yao, Rui
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19