Explainable skin lesion diagnosis using taxonomies

被引:76
作者
Barata, Catarina [1 ]
Celebi, M. Emre [2 ]
Marques, Jorge S. [1 ]
机构
[1] Inst Super Tecn, Inst Syst & Robot, Lisbon, Portugal
[2] Univ Cent Arkansas, Dept Comp Sci, Conway, AR USA
关键词
Hierarchical deep learning; Explainability; Channel attention; Spatial attention; Safety-critical CADS; Skin cancer; CLASSIFICATION; CANCER;
D O I
10.1016/j.patcog.2020.107413
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep neural networks have rapidly become an indispensable tool in many classification applications. However, the inclusion of deep learning methods in medical diagnostic systems has come at the cost of diminishing their explainability. This significantly reduces the safety of a diagnostic system, since the physician is unable to interpret and validate the output. Therefore, in this work we aim to address this major limitation and improve the explainability of a skin cancer diagnostic system. We propose to lever-age two sources of information: (i) medical knowledge, in particular the taxonomic organization of skin lesions, which will be used to develop a hierarchical neural network; and (ii) recent advances in channel and spatial attention modules, which can identify interpretable features and regions in dermoscopy images. We demonstrate that the proposed approach achieves competitive results in two dermoscopy data sets (ISIC 2017 and 2018) and provides insightful information about its decisions, thus increasing the safety of the model. (c) 2020 Elsevier Ltd. All rights reserved.
引用
收藏
页数:11
相关论文
共 47 条
  • [1] [Anonymous], 2000, Interactive atlas of dermoscopy
  • [2] A survey on automatic image caption generation
    Bai, Shuang
    An, Shan
    [J]. NEUROCOMPUTING, 2018, 311 : 291 - 304
  • [3] Barata C., 2019, DEEP LEARNING SKIN C
  • [4] Barata C., 2019, COMP VIS PATT REC WO
  • [5] A Survey of Feature Extraction in Dermoscopy Image Analysis of Skin Cancer
    Barata, Catarina
    Celebi, M. Emre
    Marques, Jorge S.
    [J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2019, 23 (03) : 1096 - 1109
  • [6] Improving Dermoscopy Image Classification Using Color Constancy
    Barata, Catarina
    Celebi, M. Emre
    Marques, Jorge S.
    [J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2015, 19 (03) : 1146 - 1152
  • [7] Dermoscopy Image Analysis: Overview and Future Directions
    Celebi, M. Emre
    Codella, Noel
    Halpern, Allan
    [J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2019, 23 (02) : 474 - 478
  • [8] SCA-CNN: Spatial and Channel-wise Attention in Convolutional Networks for Image Captioning
    Chen, Long
    Zhang, Hanwang
    Xiao, Jun
    Nie, Liqiang
    Shao, Jian
    Liu, Wei
    Chua, Tat-Seng
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 6298 - 6306
  • [9] Chorowski J. K., 2015, Advances in neural information processing systems, DOI DOI 10.1016/0167-739X(94)90007-8
  • [10] Codella Noel CF, 2018, 2018 IEEE 15 INT S B, P168, DOI DOI 10.1109/ISBI.2018.8363547