An Attention Mechanism and Ensemble Learning based on Dermoscopic Image Classification

被引:0
作者
Huang, Shanchuan [1 ]
Lei, Hongwei [2 ]
Yang, Jinzhu [3 ]
Jiang, Tao [4 ]
Jin, Liuhan [1 ]
Yao, Yudong [5 ]
Grzegorzek, Marcin [6 ,7 ]
Li, Chen [1 ,3 ]
机构
[1] Northeastern Univ, Coll Med & Biol Informat Engn, Microscop Image & Med Image Anal Grp, Shenyang, Peoples R China
[2] Northeastern Univ, Coll Informat Sci & Engn, Shenyang, Peoples R China
[3] Minist Educ, Key Lab Intelligent Comp Med Image, Shenyang, Liaoning, Peoples R China
[4] Chengdu Univ Tradit Chinese Med, Sch Intelligent Med, Chengdu, Peoples R China
[5] Stevens Inst Technol, Dept Elect & Comp Engn, Hoboken, NJ USA
[6] Univ Lubeck, Inst Med Informat, Lubeck, Germany
[7] German Res Ctr Artificial Intelligence, Lubeck, Germany
基金
中国国家自然科学基金;
关键词
Skin cancer; Image classification; Attention mechanism; Ensemble learning; Late fusion; MELANOMA; MUTATIONS; FREQUENCY; DIAGNOSIS; NEVI;
D O I
10.2352/J.ImagingSci.Technol.2024.68.4.040403
中图分类号
TB8 [摄影技术];
学科分类号
0804 ;
摘要
Skin tumors have become one of the most common diseases worldwide. Usually, benign skin tumors are not harmful to human health, but malignant skin tumors are highly likely to develop into skin cancer, which is life-threatening. Dermoscopy is currently the most effective method of diagnosing skin tumors. However, the complexity of skin tumor cells makes doctors' diagnoses subject to error. Therefore, it is essential to use computers for assisted diagnosis, thereby improving the diagnostic accuracy of skin tumors. In this paper, we propose Deep-skin, a model for dermoscopic image classification, which is based on both attention mechanism and ensemble learning. Considering the characteristics of dermoscopic images, we suggest embedding different attention mechanisms on top of Inception-V3 to obtain more potential features. We then improve the classification performance by late fusion of the different models. To demonstrate the effectiveness of Deep-skin, we conduct experiments and evaluations on the publicly available dataset Skin Cancer: Malignant vs. Benign and compare the performance of Deep-skin with other classification models. The experimental results indicate that Deep-skin performs well on the dataset in comparison to other models, achieving a maximum accuracy of 87.8%. In the future, we intend to investigate better classification models for automatic diagnosis of skin tumors. Such models can potentially assist physicians and patients in clinical settings.
引用
收藏
页数:14
相关论文
共 81 条
  • [1] ATTENTION SWIN U-NET: CROSS-CONTEXTUAL ATTENTION MECHANISM FOR SKIN LESION SEGMENTATION
    Aghdam, Ehsan Khodapanah
    Azad, Reza
    Zarvani, Maral
    Merhof, Dorit
    [J]. 2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [2] Alexander Rachel Louise, 2012, Nurs Times, V108, P18
  • [3] Ballester P, 2016, AAAI CONF ARTIF INTE, P1124
  • [4] Combinations of Radiation Therapy and Immunotherapy for Melanoma: A Review of Clinical Outcomes
    Barker, Christopher A.
    Postow, Michael A.
    [J]. INTERNATIONAL JOURNAL OF RADIATION ONCOLOGY BIOLOGY PHYSICS, 2014, 88 (05): : 986 - 997
  • [5] Bagging predictors for estimation of software project effort
    Braga, Petronio L.
    Oliveira, Adriano L. I.
    Ribeiro, Gustavo H. T.
    Meira, Silvio R. L.
    [J]. 2007 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-6, 2007, : 1595 - +
  • [6] SVIA dataset: A new dataset of microscopic videos and images for computer-aided sperm analysis
    Chen, Ao
    Li, Chen
    Zou, Shuojia
    Rahaman, Md Mamunur
    Yao, Yudong
    Chen, Haoyuan
    Yang, Hechen
    Zhao, Peng
    Hu, Weiming
    Liu, Wanli
    Grzegorzek, Marcin
    [J]. BIOCYBERNETICS AND BIOMEDICAL ENGINEERING, 2022, 42 (01) : 204 - 214
  • [7] What can machine vision do for lymphatic histopathology image analysis: a comprehensive review
    Chen, Haoyuan
    Li, Xiaoqi
    Li, Chen
    Rahaman, Md. Mamunur
    Li, Xintong
    Wu, Jian
    Sun, Hongzan
    Grzegorzek, Marcin
    Li, Xiaoyan
    [J]. ARTIFICIAL INTELLIGENCE REVIEW, 2024, 57 (03)
  • [8] GasHis-Transformer: A multi-scale visual transformer approach for gastric histopathological image detection
    Chen, Haoyuan
    Li, Chen
    Wang, Ge
    Li, Xiaoyan
    Rahaman, Md Mamunur
    Sun, Hongzan
    Hu, Weiming
    Li, Yixin
    Liu, Wanli
    Sun, Changhao
    Ai, Shiliang
    Grzegorzek, Marcin
    [J]. PATTERN RECOGNITION, 2022, 130
  • [9] IL-MCAM: An interactive learning and multi-channel attention mechanism-based weakly supervised colorectal histopathology image classification approach
    Chen, Haoyuan
    Li, Chen
    Li, Xiaoyan
    Rahaman, Md Mamunur
    Hu, Weiming
    Li, Yixin
    Liu, Wanli
    Sun, Changhao
    Sun, Hongzan
    Huang, Xinyu
    Grzegorzek, Marcin
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 143
  • [10] Oncogenic Braf Induces Melanocyte Senescence and Melanoma in Mice
    Dhomen, Nathalie
    Reis-Filho, Jorge S.
    Dias, Silvy da Rocha
    Hayward, Robert
    Savage, Kay
    Delmas, Veronique
    Larue, Lionel
    Pritchard, Catrin
    Marais, Richard
    [J]. CANCER CELL, 2009, 15 (04) : 294 - 303