WBC YOLO-ViT: 2 Way-2 stage white blood cell detection and classification with a combination of YOLOv5 and vision transformer

被引:22
作者
Tarimo, Servas Adolph [1 ]
Jang, Mi-Ae [2 ]
Ngasa, Emmanuel Edward [1 ]
Shin, Hee Bong [3 ]
Shin, Hyojin [4 ]
Woo, Jiyoung [4 ]
机构
[1] Soonchunhyang Univ, Dept Future Convergence Technol, Asan, South Korea
[2] Sungkyunkwan Univ, Sch Med, Samsung Med Ctr, Dept Lab Med & Genet, Seoul, South Korea
[3] Soonchunhyang Univ, Bucheon Hosp, Dept Lab Med, Bucheon, South Korea
[4] Soonchunhyang Univ, Dept ICT Convergence, Asan, South Korea
基金
新加坡国家研究基金会;
关键词
Disease detection; Disease monitoring; Hybrid model; Medical imaging; Object detection; Vision transformer models; White blood cell classification; White blood cell detection; Deep learning; IMAGE SEGMENTATION;
D O I
10.1016/j.compbiomed.2023.107875
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Accurate detection and classification of white blood cells, otherwise known as leukocytes, play a critical role in diagnosing and monitoring various illnesses. However, conventional methods, such as manual classification by trained professionals, must be revised in terms of accuracy, efficiency, and potential bias. Moreover, applying deep learning techniques to detect and classify white blood cells using microscopic images is challenging owing to limited data, resolution noise, irregular shapes, and varying colors from different sources. This study presents a novel approach integrating object detection and classification for numerous type-white blood cell. We designed a 2-way approach to use two types of images: WBC and nucleus. YOLO (fast object detection) and ViT (powerful image representation capabilities) are effectively integrated into 16 classes. The proposed model demonstrates an exceptional 96.449% accuracy rate in classification.
引用
收藏
页数:14
相关论文
共 67 条
[1]   Recognition of peripheral blood cell images using convolutional neural networks [J].
Acevedo, Andrea ;
Alferez, Santiago ;
Merino, Anna ;
Puigvi, Laura ;
Rodellar, Jose .
COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2019, 180
[2]   Detection and classification of white blood cells with an improved deep learning-based approach [J].
Akalin, Fatma ;
Yumusak, Nejat .
TURKISH JOURNAL OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCES, 2022, 30 (07) :2725-2739
[3]   Deep learning for cell image segmentation and ranking [J].
Araujo, Flavio H. D. ;
Silva, Romuere R. V. ;
Ushizima, Daniela M. ;
Rezende, Mariana T. ;
Carneiro, Claudia M. ;
Campos Bianchi, Andrea G. ;
Medeiros, Fatima N. S. .
COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2019, 72 :13-21
[4]   WBCs-Net: type identification of white blood cells using convolutional neural network [J].
Baghel, Neeraj ;
Verma, Upendra ;
Nagwanshi, Kapil Kumar .
MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (29) :42131-42147
[5]   An Automatic Nucleus Segmentation and CNN Model based Classification Method of White Blood Cell [J].
Banik, Partha Pratim ;
Saha, Rappy ;
Kim, Ki-Doo .
EXPERT SYSTEMS WITH APPLICATIONS, 2020, 149
[6]   Classification of white blood cells using capsule networks [J].
Baydilli, Yusuf Yargi ;
Atila, Umit .
COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2020, 80
[7]   Vision Transformers for Remote Sensing Image Classification [J].
Bazi, Yakoub ;
Bashmal, Laila ;
Rahhal, Mohamad M. Al ;
Dayil, Reham Al ;
Ajlan, Naif Al .
REMOTE SENSING, 2021, 13 (03) :1-20
[8]   End-to-End Object Detection with Transformers [J].
Carion, Nicolas ;
Massa, Francisco ;
Synnaeve, Gabriel ;
Usunier, Nicolas ;
Kirillov, Alexander ;
Zagoruyko, Sergey .
COMPUTER VISION - ECCV 2020, PT I, 2020, 12346 :213-229
[9]  
Chen S, 2018, I S BIOMED IMAGING, P1126, DOI 10.1109/ISBI.2018.8363769
[10]   IDENTIFICATION AND DETECTION OF IMMATURE WHITE BLOOD CELLS THROUGH DEEP LEARNING [J].
Chien, Ju-Huei ;
Chan, Siwa ;
Cheng, Shin ;
Ouyang, Yen-Chieh .
2021 IEEE 3RD GLOBAL CONFERENCE ON LIFE SCIENCES AND TECHNOLOGIES (IEEE LIFETECH 2021), 2021,