Copy move and splicing forgery detection using deep convolution neural network, and semantic segmentation

被引:35
作者
Abhishek [1 ]
Jindal, Neeru [1 ]
机构
[1] Thapar Inst Engn & Technol, Elect & Commun Engn Dept, Patiala, Punjab, India
关键词
Copy Move Forgery Detection (CMFD); Splicing Forgery (SF); Machine Learning (ML); Deep Learning (DL); Feature Extraction (FE); LOCALIZATION; COLOR;
D O I
10.1007/s11042-020-09816-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Image forgeries can be detected and localized by using deep convolution neural network, and semantic segmentation. Color illumination is used to apply color map after pre-processing step. To train VGG-16 with two classes using deep convolution neural network transfer learning approach is used. This algorithm classifies image's pixels having a forgery or not. These classified images with color pixel label are trained using semantic segmentation to localize forged pixels. These algorithms are tested on GRIP, DVMM, CMFD, and BSDS300 datasets. All these images are divided into two folders. One folder contains all forged images, and another folder contains labels of forged pixels. The experiment result shows that total accuracy is 0.98482, average accuracy is 0.98581, average IoU is 0.91148, weighted IoU is 0.97193, and average boundary F1 score is 0.86404. The forged pixel accuracy is 0.98698, IoU of the forged pixel is 0.83945, and average boundary F1 score of the forged image is 0.79709. Not Forged pixel accuracy is 0.98463, IoU of not forged pixel is 0.98351 and average boundary F1 score of not forged image is 0.93055. The experiment results show that forged pixel and not forged detection accuracy is above 98%, which is best among other methods.
引用
收藏
页码:3571 / 3599
页数:29
相关论文
共 49 条
[1]   Deep face liveness detection based on nonlinear diffusion using convolution neural network [J].
Alotaibi, Aziz ;
Mahmood, Ausif .
SIGNAL IMAGE AND VIDEO PROCESSING, 2017, 11 (04) :713-720
[2]   Copy-Move Forgery Detection by Matching Triangles of Keypoints [J].
Ardizzone, Edoardo ;
Bruno, Alessandro ;
Mazzola, Giuseppe .
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2015, 10 (10) :2084-2094
[3]   Hybrid LSTM and Encoder-Decoder Architecture for Detection of Image Forgeries [J].
Bappy, Jawadul H. ;
Simons, Cody ;
Nataraj, Lakshmanan ;
Manjunath, B. S. ;
Roy-Chowdhury, Amit K. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (07) :3286-3300
[4]  
Bayar Y, 2016, TRANSYLV REV ADM SCI, P5
[5]   Detection and Localization of Image Forgeries using Resampling Features and Deep Learning [J].
Bunk, Jason ;
Bappy, Jawadul H. ;
Mohammed, Tajuddin Manhar ;
Nataraj, Lakshmanan ;
Flenner, Arjuna ;
Manjunath, B. S. ;
Chandrasekaran, Shivkumar ;
Roy-Chowdhury, Amit K. ;
Peterson, Lawrence .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1881-1889
[6]   Illuminant-Based Transformed Spaces for Image Forensics [J].
Carvalho, Tiago ;
Faria, Fabio A. ;
Pedrini, Helio ;
Torres, Ricardo da S. ;
Rocha, Anderson .
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2016, 11 (04) :720-733
[7]   A forgery detection algorithm for exemplar-based inpainting images using multi-region relation [J].
Chang, I-Cheng ;
Yu, J. Cloud ;
Chang, Chih-Chuan .
IMAGE AND VISION COMPUTING, 2013, 31 (01) :57-71
[8]   A multi-purpose image forensic method using densely connected convolutional neural networks [J].
Chen, Yifang ;
Kang, Xiangui ;
Shi, Yun Q. ;
Wang, Z. Jane .
JOURNAL OF REAL-TIME IMAGE PROCESSING, 2019, 16 (03) :725-740
[10]   An Evaluation of Popular Copy-Move Forgery Detection Approaches [J].
Christlein, Vincent ;
Riess, Christian ;
Jordan, Johannes ;
Riess, Corinna ;
Angelopoulou, Elli .
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2012, 7 (06) :1841-1854