DCDS-Net: Deep transfer network based on depth-wise separable convolution with residual connection for diagnosing gastrointestinal diseases

被引:6
|
作者
Asif, Sohaib [1 ]
Zhao, Ming [1 ]
Tang, Fengxiao [1 ]
Zhu, Yusen [2 ]
机构
[1] Cent South Univ, Sch Comp Sci & Engn, Changsha, Peoples R China
[2] Hunan Univ, Sch Math, Changsha, Peoples R China
基金
中国国家自然科学基金;
关键词
Gastrointestinal diseases; Endoscopy; Block-wise fine-tuning; Deep learning; Depth-wise separable convolution; WIRELESS CAPSULE ENDOSCOPY; FEATURE-EXTRACTION; GASTRIC-CANCER; NEURAL-NETWORK; BRAIN-TUMORS; IMAGES; MODEL;
D O I
10.1016/j.bspc.2023.105866
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Gastrointestinal (GI) diseases are the most common in the human digestive system and has a significantly higher mortality rate. Accurate evaluation of endoscopic images plays an important role in decision making regarding patient treatment. Recently, convolutional neural networks (CNNs) have been introduced for the diagnosis of GI diseases. However, achieving high accuracy is still a challenging task. To overcome these limitations, we propose the "Densely Connected Depth-wise Separable Convolution-Based Network" (DCDS-Net) model, utilizing depth wise separable convolution (DWSC) with residual connections and densely connected blocks (DCB), to effectively diagnose various endoscopic images of GI diseases. In addition, we incorporate global average pooling (GAP), batch normalization, dropout and dense layers in DCB to learn rich discriminative features and improve the performance of the model. We explored the feasibility of block-wise fine-tuning using transfer learning on the proposed model to reduce overfitting, and experimentally explore the optimal level of fine-tuning, since transfer learning is well suited to medical data where labeled data is scarce. The proposed method has been evaluated on 6000 labeled endoscopic images containing 4 classes of GI diseases. In addition, data augmentation has been incorporated into the training pipeline to improve the performance of the model. Furthermore, a critical study was conducted to evaluate the generalizability of the proposed model on smaller training samples (e.g., 60 %, 70 %, 80 %, and 90 %). The study employed Grad-CAM to generate heatmaps that identify the regions in the GI tract that are indicative of the presence of different diseases. The results of extensive experiments show that the proposed model shows significant improvements and achieves the highest classification accuracy of 99.33 %, precision of 99.37 %, recall of 99.32 % and outperforms all pre-trained and existing models for the detection of GI diseases. In conclusion, DCDS-Net exhibits high classification performance and can help endoscopists in automatic GI disease diagnosis.
引用
收藏
页数:17
相关论文
共 34 条
  • [1] Depth-Wise Separable Convolution Neural Network with Residual Connection for Hyperspectral Image Classification
    Dang, Lanxue
    Pang, Peidong
    Lee, Jay
    REMOTE SENSING, 2020, 12 (20) : 1 - 20
  • [2] Efficient Weed Segmentation with Reduced Residual U-Net using Depth-wise Separable Convolution Network
    Arun, R. Arumuga
    Umamaheswari, S.
    JOURNAL OF SCIENTIFIC & INDUSTRIAL RESEARCH, 2022, 81 (05): : 482 - 494
  • [3] A Channel Pruning Algorithm Based on Depth-Wise Separable Convolution Unit
    Zhang, Ke
    Cheng, Ken
    Li, Jingjing
    Peng, Yuanyuan
    IEEE ACCESS, 2019, 7 : 173294 - 173309
  • [4] Transfer remaining useful life estimation of bearing using depth-wise separable convolution recurrent network
    Huang, Gangjin
    Zhang, Yuanliang
    Ou, Jiayu
    MEASUREMENT, 2021, 176
  • [5] OSVFuseNet: Online Signature Verification by feature fusion and depth-wise separable convolution based deep learning
    Vorugunti, Chandra Sekhar
    Pulabaigari, Viswanath
    Gorthi, Rama Krishna Sai Subrahmanyam
    Mukherjee, Prerana
    NEUROCOMPUTING, 2020, 409 (409) : 157 - 172
  • [6] EARDS: EfficientNet and attention-based residual depth-wise separable convolution for joint OD and OC segmentation
    Zhou, Wei
    Ji, Jianhang
    Jiang, Yan
    Wang, Jing
    Qi, Qi
    Yi, Yugen
    FRONTIERS IN NEUROSCIENCE, 2023, 17
  • [7] A Novel Deep Transfer Learning Approach Based on Depth-Wise Separable CNN for Human Posture Detection
    Ogundokun, Roseline Oluwaseun
    Maskeliunas, Rytis
    Misra, Sanjay
    Damasevicius, Robertas
    INFORMATION, 2022, 13 (11)
  • [8] PDS-Net: A novel point and depth-wise separable convolution for real-time object detection
    Junayed, Masum Shah
    Islam, Md Baharul
    Imani, Hassan
    Aydin, Tarkan
    INTERNATIONAL JOURNAL OF MULTIMEDIA INFORMATION RETRIEVAL, 2022,
  • [9] Plant Leaf Disease Recognition Using Depth-Wise Separable Convolution-Based Models
    Hossain, Syed Mohammad Minhaz
    Deb, Kaushik
    Dhar, Pranab Kumar
    Koshiba, Takeshi
    SYMMETRY-BASEL, 2021, 13 (03):
  • [10] PDS-Net: A novel point and depth-wise separable convolution for real-time object detection
    Junayed, Masum Shah
    Islam, Md Baharul
    Imani, Hassan
    Aydin, Tarkan
    INTERNATIONAL JOURNAL OF MULTIMEDIA INFORMATION RETRIEVAL, 2022, 11 (02) : 171 - 188