Image Manipulation Localization Using SpatialChannel Fusion Excitation and Fine-Grained Feature Enhancement

被引:0
|
作者
Li, Fengyong [1 ]
Zhai, Huajun [1 ]
Zhang, Xinpeng [2 ]
Qin, Chuan [3 ]
机构
[1] Shanghai Univ Elect Power, Coll Comp Sci & Technol, Shanghai 201306, Peoples R China
[2] Fudan Univ, Sch Comp Sci, Shanghai 200433, Peoples R China
[3] Univ Shanghai Sci & Technol, Sch Opt Elect & Comp Engn, Shanghai 200093, Peoples R China
基金
上海市自然科学基金; 中国国家自然科学基金;
关键词
Detection testing; feature enhancement; fusion excitation; image forgery; image manipulation detection; SURFACE-PLASMON RESONANCE; REFRACTIVE-INDEX; SENSORS;
D O I
10.1109/TIM.2023.3338703
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The purpose of image manipulation detection is to classify and locate tampered regions in digital images. Most existing manipulation localization methods usually rely on certain tampering traces hidden in manipulated images. This dependency, however, may damage the generalization and postprocessing capabilities of the detection model because the tampered content in the image may be weakened by postprocessing operations. To address the aforementioned problem, we propose a new image manipulation localization scheme by introducing spatial-channel fusion excitation and fine-grained feature enhancement (FFE). We first design a feature enhancement module to enhance fine-grained features in red green blue (RGB) streams, which can improve the localization accuracy of tampering regions by capturing different-scale local and global information of images. Furthermore, a fusion excitation strategy is introduced to efficiently fuse features from both spatial and channel domains. Our fusion strategy can simultaneously process image spatial and channel information, significantly enhancing the model's differentiation capability between tampered and nontampered regions. Extensive experiments demonstrate that the proposed method can provide effective localization capability for multiscale manipulation regions over different image sets and outperform most of the state-of-the-art schemes in terms of detection accuracy, generalization, and robustness.
引用
收藏
页码:1 / 14
页数:14
相关论文
共 50 条
  • [1] Coordinate feature fusion networks for fine-grained image classification
    Kaiyang Liao
    Gang Huang
    Yuanlin Zheng
    Guangfeng Lin
    Congjun Cao
    Signal, Image and Video Processing, 2023, 17 : 807 - 815
  • [2] Coordinate feature fusion networks for fine-grained image classification
    Liao, Kaiyang
    Huang, Gang
    Zheng, Yuanlin
    Lin, Guangfeng
    Cao, Congjun
    SIGNAL IMAGE AND VIDEO PROCESSING, 2023, 17 (03) : 807 - 815
  • [3] Fine-Grained Image Classification Based on Feature Fusion and Ensemble Learning
    Zhang, Wenli
    Wei, Song
    LASER & OPTOELECTRONICS PROGRESS, 2024, 61 (22)
  • [4] Fine-Grained Image Classification Based on Target Acquisition and Feature Fusion
    Chu, Yan
    Wang, Zhengkui
    Wang, Lina
    Zhao, Qingchao
    Shan, Wen
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT III, 2021, 12817 : 209 - 221
  • [5] Weakly Supervised Fine-Grained Image Classification via Salient Region Localization and Different Layer Feature Fusion
    Chen, Fangxiong
    Huang, Guoheng
    Lan, Jiaying
    Wu, Yanhui
    Pun, Chi-Man
    Ling, Wing-Kuen
    Cheng, Lianglun
    APPLIED SCIENCES-BASEL, 2020, 10 (13):
  • [6] Fine-grained pornographic image recognition with multiple feature fusion transfer learning
    Xinnan Lin
    Feiwei Qin
    Yong Peng
    Yanli Shao
    International Journal of Machine Learning and Cybernetics, 2021, 12 : 73 - 86
  • [7] Fine-grained pornographic image recognition with multiple feature fusion transfer learning
    Lin, Xinnan
    Qin, Feiwei
    Peng, Yong
    Shao, Yanli
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2021, 12 (01) : 73 - 86
  • [8] Multilayer feature fusion with parallel convolutional block for fine-grained image classification
    Wang, Lei
    He, Kai
    Feng, Xu
    Ma, Xitao
    APPLIED INTELLIGENCE, 2022, 52 (03) : 2872 - 2883
  • [9] A cross-granularity feature fusion method for fine-grained image recognition
    Wu, Shan
    Hu, Jun
    Sun, Chen
    Zhong, Fujin
    Zhang, Qinghua
    Wang, Guoyin
    APPLIED INTELLIGENCE, 2025, 55 (01)
  • [10] Multilayer feature fusion with parallel convolutional block for fine-grained image classification
    Lei Wang
    Kai He
    Xu Feng
    Xitao Ma
    Applied Intelligence, 2022, 52 : 2872 - 2883