DM-CNN: Dynamic Multi-scale Convolutional Neural Network with uncertainty quantification for medical image classification

被引:27
作者
Han, Qi [1 ]
Qian, Xin [1 ]
Xu, Hongxiang [1 ]
Wu, Kepeng [1 ]
Meng, Lun [1 ]
Qiu, Zicheng [1 ]
Weng, Tengfei [2 ]
Zhou, Baoping [3 ]
Gao, Xianqiang [3 ]
机构
[1] Chongqing Univ Sci & Technol, Sch Intelligent Technol & Engn, Chongqing 401331, Peoples R China
[2] Chongqing Univ Sci & Technol, Sch Elect Engn, Chongqing 401331, Peoples R China
[3] Tarim Univ, Sch Informat Engn, Alar City 843300, Peoples R China
关键词
Deep learning; Dynamic convolution; Medical image classification; Multi-scale fusion; Uncertainty quantification; DEEP; DISEASES;
D O I
10.1016/j.compbiomed.2023.107758
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Convolutional neural network (CNN) has promoted the development of diagnosis technology of medical images. However, the performance of CNN is limited by insufficient feature information and inaccurate attention weight. Previous works have improved the accuracy and speed of CNN but ignored the uncertainty of the prediction, that is to say, uncertainty of CNN has not received enough attention. Therefore, it is still a great challenge for extracting effective features and uncertainty quantification of medical deep learning models In order to solve the above problems, this paper proposes a novel convolutional neural network model named DM -CNN, which mainly contains the four proposed sub -modules : dynamic multi -scale feature fusion module (DMFF), hierarchical dynamic uncertainty quantifies attention (HDUQ-Attention) and multi -scale fusion pooling method (MF Pooling) and multi -objective loss (MO loss). DMFF select different convolution kernels according to the feature maps at different levels, extract different -scale feature information, and make the feature information of each layer have stronger representation ability for information fusion HDUQ-Attention includes a tuning block that adjust the attention weight according to the different information of each layer, and a Monte -Carlo (MC) dropout structure for quantifying uncertainty MF Pooling is a pooling method designed for multi -scale models, which can speed up the calculation and prevent overfitting while retaining the main important information Because the number of parameters in the backbone part of DM -CNN is different from other modules, MO loss is proposed, which has a fast optimization speed and good classification effect DM -CNN conducts experiments on publicly available datasets in four areas of medicine (Dermatology, Histopathology, Respirology, Ophthalmology), achieving state-of-the-art classification performance on all datasets. DM -CNN can not only maintain excellent performance, but also solve the problem of quantification of uncertainty, which is a very important task for the medical field. The code is available: https://github.com/QIANXIN22/DM-CNN.
引用
收藏
页数:23
相关论文
共 80 条
[1]   DenMune: Density peak based clustering using mutual nearest neighbors [J].
Abbas, Mohamed ;
El-Zoghabi, Adel ;
Shoukry, Amin .
PATTERN RECOGNITION, 2021, 109
[2]   An Efficient Artificial Rabbits Optimization Based on Mutation Strategy For Skin Cancer Prediction [J].
Abd Elaziz, Mohamed ;
Dahou, Abdelghani ;
Mabrouk, Alhassan ;
El-Sappagh, Shaker ;
Aseeri, Ahmad O. .
COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 163
[3]   Hercules: Deep Hierarchical Attentive Multilevel Fusion Model With Uncertainty Quantification for Medical Image Classification [J].
Abdar, Moloud ;
Fahami, Mohammad Amin ;
Rundo, Leonardo ;
Radeva, Petia ;
Frangi, Alejandro F. ;
Acharya, U. Rajendra ;
Khosravi, Abbas ;
Lam, Hak-Keung ;
Jung, Alexander ;
Nahavandi, Saeid .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (01) :274-285
[4]   BARF: A new direct and cross-based binary residual feature fusion with uncertainty-aware module for medical image classification [J].
Abdar, Moloud ;
Fahami, Mohammad Amin ;
Chakrabarti, Satarupa ;
Khosravi, Abbas ;
Plawiak, Pawel ;
Acharya, U. Rajendra ;
Tadeusiewicz, Ryszard ;
Nahavandi, Saeid .
INFORMATION SCIENCES, 2021, 577 (577) :353-378
[5]   A novel nonlinear automated multi-class skin lesion detection system using soft-attention based convolutional neural networks [J].
Alhudhaif, Adi ;
Almaslukh, Bandar ;
Aseeri, Ahmad O. ;
Guler, Osman ;
Polat, Kemal .
CHAOS SOLITONS & FRACTALS, 2023, 170
[6]   A deep learning architecture for multi-class lung diseases classification using chest X-ray (CXR) images [J].
Alshmrani, Goram Mufarah M. ;
Ni, Qiang ;
Jiang, Richard ;
Pervaiz, Haris ;
Elshennawy, Nada M. .
ALEXANDRIA ENGINEERING JOURNAL, 2023, 64 :923-935
[7]  
Annisa Fitria Nurjannah, 2022, Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi), V6, P330, DOI [10.29207/resti.v6i2.4001, 10.29207/resti.v6i2.4001, DOI 10.29207/RESTI.V6I2.4001]
[8]  
[Anonymous], 2023, Patent application titled, Patent No. 20220414837
[9]   A two-stream deep neural network-based intelligent system for complex skin cancer types classification [J].
Attique Khan, Muhammad ;
Sharif, Muhammad ;
Akram, Tallha ;
Kadry, Seifedine ;
Hsu, Ching-Hsien .
INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2022, 37 (12) :10621-10649
[10]   Weakly Supervised Learning using Attention gates for colon cancer histopathological image segmentation [J].
Ben Hamida, A. ;
Devanne, M. ;
Weber, J. ;
Truntzer, C. ;
Derangere, V ;
Ghiringhelli, F. ;
Forestier, G. ;
Wemmert, C. .
ARTIFICIAL INTELLIGENCE IN MEDICINE, 2022, 133