ENHANCING TONGUE REGION SEGMENTATION THROUGH SELF-ATTENTION AND TRANSFORMER BASED

被引:0
作者
Song, Yihua [1 ,2 ]
Li, Can [1 ,2 ]
Zhang, Xia [1 ,2 ]
Liu, Zhen [3 ]
Song, Ningning [4 ]
Zhou, Zuojian [1 ,2 ]
机构
[1] Nanjing Univ Chinese Med, Sch Articial Intelligence & Informat Technol, Nanjing 210003, Peoples R China
[2] Nanjing Univ Chinese Med, Jiangsu Prov Engn Res Ctr TCM Intelligence Hlth Se, Nanjing, Peoples R China
[3] Nanjing Univ Chinese Med, Sch Med Humanities, Nanjing 210003, Peoples R China
[4] Nanjing First Hosp, Nanjing 210003, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Deep learning; transformer; harnessing self-attention tongue segmentation; tongue segmentation;
D O I
10.1142/S0219519424400098
中图分类号
Q6 [生物物理学];
学科分类号
071011 ;
摘要
As an essential component of traditional Chinese medicine diagnosis, tongue diagnosis has faced limitations in clinical practice due to its subjectivity and reliance on the experience of physicians. Recent advancements in deep learning techniques have opened new possibilities for the automated analysis and diagnosis of tongue images. In this paper, we collected 500 tongue images from various patients. These images were initially preprocessed and annotated, resulting in the dataset used for this experiment. This project is based on the previously proposed segmentation method using Harnessing Self-Attention and Transformer, which is divided into three key stages: feature extraction, feature fusion, and segmentation prediction. By organically combining these three key stages, our tongue region segmentation model is better equipped to handle complex tongue images and provides accurate segmentation results. The segmentation DICE coefficient reaches 0.953, which is of significant importance for the automation and objectivity of tongue diagnosis in traditional Chinese medicine.
引用
收藏
页数:11
相关论文
共 19 条
[11]   Encoder-decoder network with RMP for tongue segmentation [J].
Kusakunniran, Worapan ;
Borwarnginn, Punyanuch ;
Karnjanapreechakorn, Sarattha ;
Thongkanchorn, Kittikhun ;
Ritthipravat, Panrasee ;
Tuakta, Pimchanok ;
Benjapornlert, Paitoon .
MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2023, 61 (05) :1193-1207
[12]   An iterative transfer learning framework for cross-domain tongue segmentation [J].
Li, Lei ;
Luo, Zhiming ;
Zhang, Mengting ;
Cai, Yuanzheng ;
Li, Candong ;
Li, Shaozi .
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2020, 32 (14)
[13]  
Liu W., 2022, Digit. Chin. Med, V5, P253, DOI [10.1016/j.dcmed.2022.10.002, DOI 10.1016/J.DCMED.2022.10.002]
[14]   LAIU-Net: A learning-to-augment incorporated robust U-Net for depressed humans? tongue segmentation [J].
Marhamati, Mahmoud ;
Zadeh, Ali Asghar Latifi ;
Fard, Masoud Mozhdehi ;
Hussain, Mohammad Arafat ;
Jafarnezhad, Khalegh ;
Jafarnezhad, Ahad ;
Bakhtoor, Mahdi ;
Momeny, Mohammad .
DISPLAYS, 2023, 76
[15]   Automatic tongue image segmentation based on gradient vector flow and region merging [J].
Ning, Jifeng ;
Zhang, David ;
Wu, Chengke ;
Yue, Feng .
NEURAL COMPUTING & APPLICATIONS, 2012, 21 (08) :1819-1826
[16]   Tongue Segmentation Using Active Contour Model [J].
Saparudin ;
Erwin ;
Fachrurrozi, Muhammad .
IAES INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING, COMPUTER SCIENCE AND INFORMATICS, 2017, 190
[17]  
Yuan W, 2019, 2019 4TH IEEE INTERNATIONAL CONFERENCE ON BIG DATA ANALYTICS (ICBDA 2019), P303, DOI [10.1109/icbda.2019.8712834, 10.1109/ICBDA.2019.8712834]
[18]   Reconstruction enhanced probabilistic model for semisupervised tongue image segmentation [J].
Zhou, Changen ;
Fan, Haoyi ;
Zhao, Wen ;
Xu, Hongben ;
Lei, Huangwei ;
Yang, Zhaoyang ;
Li, Zuoyong ;
Li, Candong .
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2020, 32 (22)
[19]   Tonguenet: Accurate Localization and Segmentation for Tongue Images Using Deep Neural Networks [J].
Zhou, Changen ;
Fan, Haoyi ;
Li, Zuoyong .
IEEE ACCESS, 2019, 7 :148779-148789