ENHANCING TONGUE REGION SEGMENTATION THROUGH SELF-ATTENTION AND TRANSFORMER BASED

被引:0
作者
Song, Yihua [1 ,2 ]
Li, Can [1 ,2 ]
Zhang, Xia [1 ,2 ]
Liu, Zhen [3 ]
Song, Ningning [4 ]
Zhou, Zuojian [1 ,2 ]
机构
[1] Nanjing Univ Chinese Med, Sch Articial Intelligence & Informat Technol, Nanjing 210003, Peoples R China
[2] Nanjing Univ Chinese Med, Jiangsu Prov Engn Res Ctr TCM Intelligence Hlth Se, Nanjing, Peoples R China
[3] Nanjing Univ Chinese Med, Sch Med Humanities, Nanjing 210003, Peoples R China
[4] Nanjing First Hosp, Nanjing 210003, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Deep learning; transformer; harnessing self-attention tongue segmentation; tongue segmentation;
D O I
10.1142/S0219519424400098
中图分类号
Q6 [生物物理学];
学科分类号
071011 ;
摘要
As an essential component of traditional Chinese medicine diagnosis, tongue diagnosis has faced limitations in clinical practice due to its subjectivity and reliance on the experience of physicians. Recent advancements in deep learning techniques have opened new possibilities for the automated analysis and diagnosis of tongue images. In this paper, we collected 500 tongue images from various patients. These images were initially preprocessed and annotated, resulting in the dataset used for this experiment. This project is based on the previously proposed segmentation method using Harnessing Self-Attention and Transformer, which is divided into three key stages: feature extraction, feature fusion, and segmentation prediction. By organically combining these three key stages, our tongue region segmentation model is better equipped to handle complex tongue images and provides accurate segmentation results. The segmentation DICE coefficient reaches 0.953, which is of significant importance for the automation and objectivity of tongue diagnosis in traditional Chinese medicine.
引用
收藏
页数:11
相关论文
共 19 条
[1]   A robust interclass and intraclass loss function for deep learning based tongue segmentation [J].
Cai, Yuanzheng ;
Wang, Tao ;
Liu, Wei ;
Luo, Zhiming .
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2020, 32 (22)
[2]  
Chen M, 2023, Patent No. [US202117179061, 2022005200]
[3]  
Chen Z., 2021, TMR MOD TRADIT CHIN, V4, P24
[4]   LSM-SEC: Tongue Segmentation by the Level Set Model with Symmetry and Edge Constraints [J].
Gao, Shanshan ;
Guo, Ningning ;
Mao, Deqian .
COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2021, 2021
[5]   Segmentation Head Networks with Harnessing Self-Attention and Transformer for Insulator Surface Defect Detection [J].
Guo, Jun ;
Li, Tiancheng ;
Du, Baigang .
APPLIED SCIENCES-BASEL, 2023, 13 (16)
[6]   TongueMobile: automated tongue segmentation and diagnosis on smartphones [J].
Huang, Zih-Hao ;
Huang, Wei-Cheng ;
Wu, Hsien-Chang ;
Fang, Wen-Chieh .
NEURAL COMPUTING & APPLICATIONS, 2023, 35 (28) :21259-21274
[7]   A novel tongue segmentation method based on improved U-Net [J].
Huang, Zonghai ;
Miao, Jiaqing ;
Song, Haibei ;
Yang, Simin ;
Zhong, Yanmei ;
Xu, Qiang ;
Tan, Ying ;
Wen, Chuanbiao ;
Guo, Jinhong .
NEUROCOMPUTING, 2022, 500 :73-89
[8]  
Jiang ZQ., 2021, SOFTW GUIDE, V20, P186
[9]   SNAKES - ACTIVE CONTOUR MODELS [J].
KASS, M ;
WITKIN, A ;
TERZOPOULOS, D .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 1987, 1 (04) :321-331
[10]   Automated tongue segmentation using deep encoder-decoder model [J].
Kusakunniran, Worapan ;
Borwarnginn, Punyanuch ;
Imaromkul, Thanandon ;
Aukkapinyo, Kittinun ;
Thongkanchorn, Kittikhun ;
Wattanadhirach, Disathon ;
Mongkolluksamee, Sophon ;
Thammasudjarit, Ratchainant ;
Ritthipravat, Panrasee ;
Tuakta, Pimchanok ;
Benjapornlert, Paitoon .
MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (24) :37661-37686