A mobile augmented reality application for supporting real-time skin lesion analysis based on deep learning

被引:11
作者
Francese, Rita [1 ]
Frasca, Maria [1 ]
Risi, Michele [1 ]
Tortora, Genoveffa [1 ]
机构
[1] Univ Salerno, Dept Comp Sci, Via Giovanni Paolo II,132, I-84084 Fisciano, SA, Italy
关键词
Real-time mobile application; Medicine data; Deep learning; Augmented reality; MALIGNANT-MELANOMA; DIAGNOSIS; ALGORITHM; ACCURACY; REMOVAL;
D O I
10.1007/s11554-021-01109-8
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Melanoma is considered the deadliest skin cancer and when it is in an advanced state it is difficult to treat. Diagnoses are visually performed by dermatologists, by naked-eye observation. This paper proposes an augmented reality smartphone application for supporting the dermatologist in the real-time analysis of a skin lesion. The app augments the camera view with information related to the lesion features generally measured by the dermatologist for formulating the diagnosis. The lesion is also classified by a deep learning approach for identifying melanoma. The real-time process adopted for generating the augmented content is described. The real-time performances are also evaluated and a user study is also conducted. Results revealed that the real-time process may be entirely executed on the Smartphone and that the support provided is well judged by the target users.
引用
收藏
页码:1247 / 1259
页数:13
相关论文
共 43 条
[1]   Early diagnosis of cutaneous melanoma - Revisiting the ABCD criteria [J].
Abbasi, NR ;
Shaw, HM ;
Rigel, DS ;
Friedman, RJ ;
McCarthy, WH ;
Osman, I ;
Kopf, AW ;
Polsky, D .
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2004, 292 (22) :2771-2776
[2]   Noninvasive Real-Time Automated Skin Lesion Analysis System for Melanoma Early Detection and Prevention [J].
Abuzaghleh, Omar ;
Barkana, Buket D. ;
Faezipour, Miad .
IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE, 2015, 3
[3]   Automatic Imaging System With Decision Support for Inspection of Pigmented Skin Lesions and Melanoma Diagnosis [J].
Alcon, Jose Fernandez ;
Ciuhu, Calina ;
ten Kate, Warner ;
Heinrich, Adrienne ;
Uzunbajakava, Natallia ;
Krekels, Gertruud ;
Siem, Denny ;
de Haan, Gerard .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2009, 3 (01) :14-25
[4]  
[Anonymous], 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition
[5]  
Apalla Zoe, 2017, Dermatol Pract Concept, V7, P1, DOI 10.5826/dpc.0702a01
[6]  
Ashique K T, 2015, Indian Dermatol Online J, V6, P158, DOI 10.4103/2229-5178.156381
[7]  
Bar Michael, 2012, Dermatol Pract Concept, V2, P13, DOI 10.5826/dpc.0201a03.
[8]   Two Systems for the Detection of Melanomas in Dermoscopy Images Using Texture and Color Features [J].
Barata, Catarina ;
Ruela, Margarida ;
Francisco, Mariana ;
Mendonca, Teresa ;
Marques, Jorge S. .
IEEE SYSTEMS JOURNAL, 2014, 8 (03) :965-979
[9]   Photometric stereo with general, unknown lighting [J].
Basri, Ronen ;
Jacobs, David ;
Kemelmacher, Ira .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2007, 72 (03) :239-257
[10]  
Brooke J., 1996, USABILITY EVALUATION, P189