Obscene image detection using transfer learning and feature fusion

被引:0
作者
Sonali Samal
Rajashree Nayak
Swastik Jena
Bunil Ku. Balabantaray
机构
[1] National Institute of Technology Meghalaya,Computer Science and Engineering
[2] JIS Institute of Advanced Studies and Research,undefined
[3] National Institute of Technology Meghalaya,undefined
来源
Multimedia Tools and Applications | 2023年 / 82卷
关键词
Deep learning; TL; FFP; Pix-2-Pix GAN; Obscene detection;
D O I
暂无
中图分类号
学科分类号
摘要
Deep learning-based methods have been proven excellent performance in detecting pornographic images/videos flooded on social media. However, in a dearth of huge yet well-labeled datasets, these methods may suffer from under/overfitting problems and may exhibit unstable output responses in the classification process. To deal with the issue we have suggested an automatic pornographic image detection method by utilizing transfer learning (TL) and feature fusion. The novelty of our proposed work is TL based feature fusion process (FFP) which enables the removal of hyper-parameter tuning, improves model performance, and lowers the computational burden of the desired model. FFP fuses low-level and mid-level features of the outperforming pre-trained models followed by transferring the learned knowledge to control the classification process. Key contributions of our proposed method are i) generation of a well-labeled obscene image dataset GGOI via Pix-2-Pix GAN architecture for the training of deep learning models ii) modification of model architectures by integrating batch normalization and mixed pooling strategy to obtain training stability (iii) selection of outperforming models to be integrated with the FFP by performing end-to-end detection of obscene images and iv) design of TL based obscene image detection method by retraining the last layer of the fused model. Extensive experimental analyses are performed on benchmark datasets i.e., NPDI, Pornography 2k, and generated GGOI dataset. The proposed TL model with fused MobileNet V2 + DenseNet169 network performs as the state-of-the-art model compared to existing methods and provides average classification accuracy, sensitivity, and F1 score of 98.50%, 98.46% and 98.49% respectively.
引用
收藏
页码:28739 / 28767
页数:28
相关论文
共 50 条
  • [41] A Region-Based Feature Fusion Network for VHR Image Change Detection
    Chen, Pan
    Li, Cong
    Zhang, Bing
    Chen, Zhengchao
    Yang, Xuan
    Lu, Kaixuan
    Zhuang, Lina
    REMOTE SENSING, 2022, 14 (21)
  • [42] A Self-Supervised Residual Feature Learning Model for Multifocus Image Fusion
    Wang, Zeyu
    Li, Xiongfei
    Duan, Haoran
    Zhang, Xiaoli
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 4527 - 4542
  • [43] Color multi-focus image fusion based on transfer learning
    Wang, Yun
    Jin, Xin
    Yang, Jie
    Jiang, Qian
    Tang, Yue
    Wang, Puming
    Lee, Shin-Jye
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2022, 42 (03) : 2083 - 2102
  • [44] Feature Fusion for Leaf Image Classification
    Okuda, Moeri
    Ohshima, Hiroaki
    2022 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (IEEE BIGCOMP 2022), 2022, : 259 - 262
  • [45] Visible and Infrared Image Fusion Using Deep Learning
    Zhang, Xingchen
    Demiris, Yiannis
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (08) : 10535 - 10554
  • [46] A deep learning-based approach for defect detection in powder bed fusion additive manufacturing using transfer learning
    Duman, Burhan
    Ozsoy, Koray
    JOURNAL OF THE FACULTY OF ENGINEERING AND ARCHITECTURE OF GAZI UNIVERSITY, 2022, 37 (01): : 361 - 375
  • [47] Deepfake detection: Enhancing performance with spatiotemporal texture and deep learning feature fusion
    Almestekawy, Abdelwahab
    Zayed, Hala H.
    Taha, Ahmed
    EGYPTIAN INFORMATICS JOURNAL, 2024, 27
  • [48] Vehicle Detection Method Based On Deep Learning and Multi -Layer Feature Fusion
    Zhao Min
    Jia Jian
    Sun Dihua
    Tang Yi
    PROCEEDINGS OF THE 30TH CHINESE CONTROL AND DECISION CONFERENCE (2018 CCDC), 2018, : 5862 - 5867
  • [49] Fusion of Textural and Visual Information for Medical Image Modality Retrieval Using Deep Learning-Based Feature Engineering
    Iqbal, Saeed
    Qureshi, Adnan N.
    Alhussein, Musaed
    Choudhry, Imran Arshad
    Aurangzeb, Khursheed
    Khan, Tariq M.
    IEEE ACCESS, 2023, 11 : 93238 - 93253
  • [50] Fault point detection of IOT using multi-spectral image fusion based on deep learning
    Hou Rui
    Zhao Yunhao
    Tian Shiming
    Yang Yang
    Yang Wenhai
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2019, 64