Multi-view compression and collaboration for skin disease diagnosis

被引:4
作者
Gao, Geng [1 ]
He, Yunfei [1 ]
Meng, Li [1 ]
Huang, Hequn [2 ,3 ]
Zhang, Dong [1 ]
Zhang, Yiwen [4 ]
Xiao, Fengli [2 ,3 ]
Yang, Fei [1 ]
机构
[1] Anhui Med Univ, Sch Biomed Engn, Hefei, Peoples R China
[2] Anhui Med Univ, Dept Dermatol, Affiliated Hosp 1, Hefei, Peoples R China
[3] Anhui Med Univ, Key Lab Dermatol, Minist Educ, Hefei, Peoples R China
[4] Anhui Univ, Sch Comp Sci & Technol, Hefei, Peoples R China
基金
中国国家自然科学基金;
关键词
Skin disease; Convolutional neural network; Multi-view; Information bottleneck; NETWORK;
D O I
10.1016/j.eswa.2024.123395
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the field of skin disease diagnosis based on Convolutional Neural Networks (CNNs), there are currently two challenges. Firstly, there is a significant amount of label -independent information present in skin disease images. This information significantly affects the CNN's ability to recognize skin disease. Finding an effective way to remove this label -independence is a challenging problem. Secondly, most research focuses solely on information -limited RGB images. It is imperative to introduce additional color space views. Hence, there is a need to investigate which combinations of views are most effective for skin disease diagnosis. To address these two issues, this study first employs the information bottleneck theory to guide convolution operations, retaining relevant skin lesion information while filtering out irrelevant details. Secondly, through a view selection method, a combination of RGB, HSL, and YCbCr was chosen from seven views, which exhibited the best performance. A multi -view compression and collaboration (MCC) framework was constructed based on these two approaches. MCC assists CNNs in removing label -independent information while enriching image views, ultimately enhancing the diagnosis of skin diseases. To validate the effectiveness of MCC, experiments were conducted by using ResNet-50, DensNet-169, Inception -v4, and ConvNeXt-B on both a self -collected hyperpigmented skin disease dataset and a public ISIC2018 dataset. The experimental results show that MCC can effectively improve the accuracy, precision, recall, and F1 -score of CNNs. Thus, MCC has the potential to assist medical professionals in more accurately diagnosing skin diseases in clinical practice, thereby improving healthcare services and patients' quality of life.
引用
收藏
页数:14
相关论文
共 59 条
[1]  
[Anonymous], 2018, Celal Bayar Univ J Sci
[2]   Multiclass skin lesion classification in dermoscopic images using swin transformer model [J].
Ayas, Selen .
NEURAL COMPUTING & APPLICATIONS, 2023, 35 (09) :6713-6722
[3]   Convolutional neural network assistance significantly improves dermatologists' diagnosis of cutaneous tumours using clinical images [J].
Ba, Wei ;
Wu, Huan ;
Chen, Wei W. ;
Wang, Shu H. ;
Zhang, Zi Y. ;
Wei, Xuan J. ;
Wang, Wen J. ;
Yang, Lei ;
Zhou, Dong M. ;
Zhuang, Yi X. ;
Zhong, Qin ;
Song, Zhi G. ;
Li, Cheng X. .
EUROPEAN JOURNAL OF CANCER, 2022, 169 :156-165
[4]   Light-Dermo: A Lightweight Pretrained Convolution Neural Network for the Diagnosis of Multiclass Skin Lesions [J].
Baig, Abdul Rauf ;
Abbas, Qaisar ;
Almakki, Riyad ;
Ibrahim, Mostafa E. A. ;
AlSuwaidan, Lulwah ;
Ahmed, Alaa E. S. .
DIAGNOSTICS, 2023, 13 (03)
[5]   Final Version of 2009 AJCC Melanoma Staging and Classification [J].
Balch, Charles M. ;
Gershenwald, Jeffrey E. ;
Soong, Seng-jaw ;
Thompson, John F. ;
Atkins, Michael B. ;
Byrd, David R. ;
Buzaid, Antonio C. ;
Cochran, Alistair J. ;
Coit, Daniel G. ;
Ding, Shouluan ;
Eggermont, Alexander M. ;
Flaherty, Keith T. ;
Gimotty, Phyllis A. ;
Kirkwood, John M. ;
McMasters, Kelly M. ;
Mihm, Martin C., Jr. ;
Morton, Donald L. ;
Ross, Merrick I. ;
Sober, Arthur J. ;
Sondak, Vernon K. .
JOURNAL OF CLINICAL ONCOLOGY, 2009, 27 (36) :6199-6206
[6]   Practical Training Approaches for Discordant Atopic Dermatitis Severity Datasets: Merging Methods With Soft-Label and Train-Set Pruning [J].
Cho, Soo Ick ;
Lee, Dongheon ;
Han, Byeol ;
Lee, Ji Su ;
Hong, Ji Yeon ;
Chung, Jin Ho ;
Lee, Dong Hun ;
Na, Jung-Im .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (01) :166-175
[7]  
Codella N, 2019, Arxiv, DOI arXiv:1902.03368
[8]   Deep convolutional neural network for face skin diseases identification [J].
El Saleh, Rola ;
Bakhshi, Sambit ;
Nait-Ali, Amine .
2019 FIFTH INTERNATIONAL CONFERENCE ON ADVANCES IN BIOMEDICAL ENGINEERING (ICABME), 2019, :112-115
[9]   Vitiligo: A comprehensive overview Part II: Treatment options and approach to treatment [J].
Felsten, Lesley M. ;
Alikhan, Ali ;
Petronic-Rosic, Vesna .
JOURNAL OF THE AMERICAN ACADEMY OF DERMATOLOGY, 2011, 65 (03) :493-514
[10]   The Mathematical Structure of Information Bottleneck Methods [J].
Gedeon, Tomas ;
Parker, Albert E. ;
Dimitrov, Alexander G. .
ENTROPY, 2012, 14 (03) :456-479