A New Approach for Effective Medical Deepfake Detection in Medical Images

被引:1
作者
Karakose, Mehmet [1 ]
Yetis, Hasan [1 ]
Cecen, Mert [1 ]
机构
[1] Firat Univ, Dept Comp Engn, TR-23119 Elazig, Turkiye
关键词
Medical deepfake image detection; deep learning; convolutional neural networks; YOLO;
D O I
10.1109/ACCESS.2024.3386644
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In today's world, deepfake technology is being used to generate fake images, sounds, and videos from real images and sounds using deep learning and artificial intelligence techniques. It is possible to manipulate medical images with this technology. The manipulation of medical images can lead to incorrect diagnoses by medical professionals, disrupting the functioning of hospitals. As a result of these disruptions, hospitals may experience significant financial and life-threatening problems. In this study, it is aimed to obtain an effective deep learning-based method to detect manipulated medical images. Initially, two distinct datasets are created which contain Knee Osteoarthritis X-ray and lung CT scans. Data pre-processing and augmentation methods are applied for data standardization and variation. The instances in datasets are labeled as real or fake. The medical deepfake distinguish ability of YoloV3, YoloV5nu, YoloV5su, YoloV8n, YoloV8s, YoloV8m, YoloV8l, YoloV8x models tested on these datasets. In the analysis performed, all YOLO models showed almost full success in distinguishing Knee Osteoarthritis X-ray images. In lung CT scan images, although YoloV8 models generally achieved good performance, the YoloV5 models gave the best and worst results. While the best result was obtained from YoloV5su with a recall value of 0.997, the worst result was obtained from the YoloV5nu model with a recall value of 0.91. Furthermore, the best model (YoloV5su) works 60% faster than YoloV8x model, which has the second highest performance. The findings show that YoloV5su can be used for fast and accurate medical deepfake detection.
引用
收藏
页码:52205 / 52214
页数:10
相关论文
共 30 条
[1]   MedNet: Medical deepfakes detection using an improved deep learning approach [J].
Albahli, Saleh ;
Nawaz, Marriam .
MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (16) :48357-48375
[2]   Intelligent Deep Detection Method for Malicious Tampering of Cancer Imagery [J].
Alheeti, Khattab M. Ali ;
Alzahrani, Abdulkareem ;
Khoshnaw, Najmaddin ;
Al-Dosary, Duaa .
2022 7TH INTERNATIONAL CONFERENCE ON DATA SCIENCE AND MACHINE LEARNING APPLICATIONS (CDMA 2022), 2022, :25-28
[3]  
Aslam Yasir, 2019, 2019 International Conference on Smart Systems and Inventive Technology (ICSSIT). Proceedings, P709, DOI 10.1109/ICSSIT46314.2019.8987922
[4]   Automatic normalized digital color staining in the recognition of abnormal blood cells using generative adversarial networks [J].
Barrera, Kevin ;
Rodellar, Jose ;
Alferez, Santiago ;
Merino, Anna .
COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2023, 240
[5]   Automatic generation of artificial images of leukocytes and leukemic cells using generative adversarial networks (syntheticcellgan) [J].
Barrera, Kevin ;
Merino, Anna ;
Molina, Angel ;
Rodellar, Jose .
COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2023, 229
[6]  
Budhiraja M., 2022, IEEE GLOBAL C COMPUT, P1
[7]  
Chen Pingjun, 2018, Mendeley Data, V1, DOI 10.17632/56RMX5BJCR.1
[8]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[9]   Understanding of Object Detection Based on CNN Family and YOLO [J].
Du, Juan .
2ND INTERNATIONAL CONFERENCE ON MACHINE VISION AND INFORMATION TECHNOLOGY (CMVIT 2018), 2018, 1004
[10]  
Dunn J. E., 2018, Imagine You're Having a CT Scan and MalwareAlters the Radiation Levels-It's Doable the Register