Deep Learning Methods for Accurate Skin Cancer Recognition and Mobile Application

被引:54
作者
Kousis, Ioannis [1 ]
Perikos, Isidoros [1 ]
Hatzilygeroudis, Ioannis [1 ]
Virvou, Maria [2 ]
机构
[1] Univ Patras, Dept Comp Engn & Informat, Patras 26504, Greece
[2] Univ Piraeus, Dept Informat, Piraeus 18534, Greece
关键词
skin cancer; melanoma; convolutional neural networks; deep learning; smartphone application; CLASSIFICATION; MELANOMA; IMAGES; ALGORITHMS; DIAGNOSIS; NEVUS;
D O I
10.3390/electronics11091294
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Although many efforts have been made through past years, skin cancer recognition from medical images is still an active area of research aiming at more accurate results. Many efforts have been made in recent years based on deep learning neural networks. Only a few, however, are based on a single deep learning model and targeted to create a mobile application. Contributing to both efforts, first we present a summary of the required medical knowledge on skin cancer, followed by an extensive summary of the most recent related works. Afterwards, we present 11 CNN (convolutional neural network) candidate single architectures. We train and test those 11 CNN architectures, using the HAM10000 dataset, concerning seven skin lesion classes. To face the imbalance problem and the high similarity between images of some skin lesions, we apply data augmentation (during training), transfer learning and fine-tuning. From the 11 CNN architecture configurations, DenseNet169 produced the best results. It achieved an accuracy of 92.25%, a recall (sensitivity) of 93.59% and an F1-score of 93.27%, which outperforms existing state-of-the-art efforts. We used a light version of DenseNet169 in constructing a mobile android application, which was mapped as a two-class model (benign or malignant). A picture is taken via the mobile device camera, and after manual cropping, it is classified into benign or malignant type. The application can also inform the user about the allowed sun exposition time based on the current UV radiation degree, the phototype of the user's skin and the degree of the used sunscreen. In conclusion, we achieved state-of-the-art results in skin cancer recognition based on a single, relatively light deep learning model, which we also used in a mobile application.
引用
收藏
页数:19
相关论文
共 53 条
[1]  
A Ameri, 2020, J Biomed Phys Eng, V10, P801, DOI 10.31661/jbpe.v0i0.2004-1107
[2]   Multiple skin lesions diagnostics via integrated deep convolutional networks for segmentation and classification [J].
Al-masni, Mohammed A. ;
Kim, Dong-Hyun ;
Kim, Tae-Seong .
COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2020, 190 (190)
[3]   Skin Lesion Classification Using Convolutional Neural Network With Novel Regularizer [J].
Albahar, Marwan Ali .
IEEE ACCESS, 2019, 7 :38306-38313
[4]   Melanoma and Nevus Skin Lesion Classification Using Handcraft and Deep Learning Feature Fusion via Mutual Information Measures [J].
Almaraz-Damian, Jose-Agustin ;
Ponomaryov, Volodymyr ;
Sadovnychiy, Sergiy ;
Castillejos-Fernandez, Heydy .
ENTROPY, 2020, 22 (04)
[5]  
Bissoto A., 2018, ARXIV
[6]  
Bissoto A, 2019, ARXIV
[7]   A Survey on Deep Transfer Learning [J].
Tan, Chuanqi ;
Sun, Fuchun ;
Kong, Tao ;
Zhang, Wenchang ;
Yang, Chao ;
Liu, Chunfang .
ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2018, PT III, 2018, 11141 :270-279
[8]   Melanoma skin cancer detection using deep learning and classical machine learning techniques: A hybrid approach [J].
Daghrir, Jinen ;
Tlig, Lotfi ;
Bouchouicha, Moez ;
Sayadi, Mounir .
2020 5TH INTERNATIONAL CONFERENCE ON ADVANCED TECHNOLOGIES FOR SIGNAL AND IMAGE PROCESSING (ATSIP'2020), 2020,
[9]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[10]   The skin cancer classification using deep convolutional neural network [J].
Dorj, Ulzii-Orshikh ;
Lee, Keun-Kwang ;
Choi, Jae-Young ;
Lee, Malrey .
MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (08) :9909-9924