Building a DenseNet-Based Neural Network with Transformer and MBConv Blocks for Penile Cancer Classification

被引:1
作者
Lauande, Marcos Gabriel Mendes [1 ]
Braz Junior, Geraldo [1 ]
de Almeida, Joao Dallyson Sousa [1 ]
Silva, Aristofanes Correa [1 ]
da Costa, Rui Miguel Gil [2 ]
Teles, Amanda Mara [2 ]
da Silva, Leandro Lima [2 ]
Brito, Haissa Oliveira [2 ]
Vidal, Flavia Castello Branco [2 ]
do Vale, Joao Guilherme Araujo [1 ]
Rodrigues Junior, Jose Ribamar Durand [1 ]
Cunha, Antonio [3 ,4 ]
机构
[1] Univ Fed Maranhao, Appl Comp Grp NCA UFMA, BR-65080805 Sao Luis, MA, Brazil
[2] Univ Fed Maranhao, Postgrad Program Adult Hlth PPGSAD, BR-65080085 Sao Luis, MA, Brazil
[3] Univ Tras Os Montes & Alto Douro, Sch Sci & Technol, P-5000801 Quinta De Prados, Vila Real, Portugal
[4] Univ Minho, ALGORITMI Res Ctr, P-4800058 Guimaraes, Portugal
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 22期
关键词
attention mechanism; deep learning; densenet; histopathology; mbconv; penile cancer; transformer;
D O I
10.3390/app142210536
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Histopathological analysis is an essential exam for detecting various types of cancer. The process is traditionally time-consuming and laborious. Taking advantage of deep learning models, assisting the pathologist in the diagnosis process is possible. In this work, a study was carried out based on the DenseNet neural network. It consisted of changing its architecture through combinations of Transformer and MBConv blocks to investigate its impact on classifying histopathological images of penile cancer. Due to the limited number of samples in this dataset, pre-training is performed on another larger lung and colon cancer histopathological image dataset. Various combinations of these architectural components were systematically evaluated to compare their performance. The results indicate significant improvements in feature representation, demonstrating the effectiveness of these combined elements resulting in an F1-Score of up to 95.78%. Its diagnostic performance confirms the importance of deep learning techniques in men's health.
引用
收藏
页数:14
相关论文
共 50 条
[41]   MTSecurity: Privacy-Preserving Malicious Traffic Classification Using Graph Neural Network and Transformer [J].
Yang, Jin ;
Jiang, Xinyun ;
Lei, Yulin ;
Liang, Weiheng ;
Ma, Zicheng ;
Li, Siyu .
IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2024, 21 (03) :3583-3597
[42]   Vision transformer meets convolutional neural network for plant disease classification [J].
Thakur, Poornima Singh ;
Chaturvedi, Shubhangi ;
Khanna, Pritee ;
Sheorey, Tanuja ;
Ojha, Aparajita .
ECOLOGICAL INFORMATICS, 2023, 77
[43]   Classification of a nanocomposite using a combination between Recurrent Neural Network based on Transformer and Bayesian Network for testing the conductivity property [J].
Gazehi, Wejden ;
Loukil, Rania ;
Besbes, Mongi .
EXPERT SYSTEMS WITH APPLICATIONS, 2025, 270
[44]   A Transformer-Based Neural Network for Acoustic Scene Classification Using Potent Self-attention [J].
Zhang, Ya-Hu ;
Lin, Dong-Xu ;
Geng, Lin .
CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2025,
[45]   Fine grained image classification network based on transformer bilinear network [J].
Xiang X. ;
Liu Y. ;
Zheng B. ;
Tan Y. .
Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition), 2024, 52 (02) :84-89
[46]   A VISION TRANSFORMER NETWORK WITH WAVELET-BASED FEATURES FOR BREAST ULTRASOUND CLASSIFICATION [J].
He, Chenyang ;
Diao, Yan ;
Ma, Xingcong ;
Yu, Shuo ;
He, Xin ;
Mao, Guochao ;
Wei, Xinyu ;
Zhang, Yu ;
Zhao, Yang .
IMAGE ANALYSIS & STEREOLOGY, 2024, 43 (02) :185-194
[47]   A SAR Oil Spill Image Recognition Method Based on DenseNet Convolutional Neural Network [J].
Xiong Yaohua ;
Meng Xudong .
2019 INTERNATIONAL CONFERENCE ON ROBOTS & INTELLIGENT SYSTEM (ICRIS 2019), 2019, :78-81
[48]   Privacy Protection in Transformer-based Neural Network [J].
Lang, Jiaqi ;
Li, Linjing ;
Chen, Weiyun ;
Zeng, Daniel .
2019 IEEE INTERNATIONAL CONFERENCE ON INTELLIGENCE AND SECURITY INFORMATICS (ISI), 2019, :182-184
[49]   Neural network based generator-transformer protection [J].
Lu, YP ;
Lai, LL ;
Tang, GQ .
PROCEEDINGS OF THE 2004 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2004, :4295-4301
[50]   A lightweight convolutional transformer neural network for EEG-based depression recognition [J].
Hou, Pengfei ;
Li, Xiaowei ;
Zhu, Jing ;
Hu, Bin .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 100