ENHANCING TONGUE REGION SEGMENTATION THROUGH SELF-ATTENTION AND TRANSFORMER BASED

被引:0
|
作者
Song, Yihua [1 ,2 ]
Li, Can [1 ,2 ]
Zhang, Xia [1 ,2 ]
Liu, Zhen [3 ]
Song, Ningning [4 ]
Zhou, Zuojian [1 ,2 ]
机构
[1] Nanjing Univ Chinese Med, Sch Articial Intelligence & Informat Technol, Nanjing 210003, Peoples R China
[2] Nanjing Univ Chinese Med, Jiangsu Prov Engn Res Ctr TCM Intelligence Hlth Se, Nanjing, Peoples R China
[3] Nanjing Univ Chinese Med, Sch Med Humanities, Nanjing 210003, Peoples R China
[4] Nanjing First Hosp, Nanjing 210003, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Deep learning; transformer; harnessing self-attention tongue segmentation; tongue segmentation;
D O I
10.1142/S0219519424400098
中图分类号
Q6 [生物物理学];
学科分类号
071011 ;
摘要
As an essential component of traditional Chinese medicine diagnosis, tongue diagnosis has faced limitations in clinical practice due to its subjectivity and reliance on the experience of physicians. Recent advancements in deep learning techniques have opened new possibilities for the automated analysis and diagnosis of tongue images. In this paper, we collected 500 tongue images from various patients. These images were initially preprocessed and annotated, resulting in the dataset used for this experiment. This project is based on the previously proposed segmentation method using Harnessing Self-Attention and Transformer, which is divided into three key stages: feature extraction, feature fusion, and segmentation prediction. By organically combining these three key stages, our tongue region segmentation model is better equipped to handle complex tongue images and provides accurate segmentation results. The segmentation DICE coefficient reaches 0.953, which is of significant importance for the automation and objectivity of tongue diagnosis in traditional Chinese medicine.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] RSAFormer: A method of polyp segmentation with region self-attention transformer
    Yin X.
    Zeng J.
    Hou T.
    Tang C.
    Gan C.
    Jain D.K.
    García S.
    Computers in Biology and Medicine, 2024, 172
  • [2] Vision Transformer Based on Reconfigurable Gaussian Self-attention
    Zhao L.
    Zhou J.-K.
    Zidonghua Xuebao/Acta Automatica Sinica, 2023, 49 (09): : 1976 - 1988
  • [3] A transformer-based approach empowered by a self-attention technique for semantic segmentation in remote sensing
    Boulila, Wadii
    Ghandorh, Hamza
    Masood, Sharjeel
    Alzahem, Ayyub
    Koubaa, Anis
    Ahmed, Fawad
    Khan, Zahid
    Ahmad, Jawad
    HELIYON, 2024, 10 (08)
  • [4] Relative molecule self-attention transformer
    Łukasz Maziarka
    Dawid Majchrowski
    Tomasz Danel
    Piotr Gaiński
    Jacek Tabor
    Igor Podolak
    Paweł Morkisz
    Stanisław Jastrzębski
    Journal of Cheminformatics, 16
  • [5] Relative molecule self-attention transformer
    Maziarka, Lukasz
    Majchrowski, Dawid
    Danel, Tomasz
    Gainski, Piotr
    Tabor, Jacek
    Podolak, Igor
    Morkisz, Pawel
    Jastrzebski, Stanislaw
    JOURNAL OF CHEMINFORMATICS, 2024, 16 (01)
  • [6] Progressive Scene Segmentation Based on Self-Attention Mechanism
    Pan, Yunyi
    Gan, Yuan
    Liu, Kun
    Zhang, Yan
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 3985 - 3992
  • [7] Enhancing Skin Lesion Classification: A Self-Attention Fusion Approach with Vision Transformer
    Heroza, Rahmat Izwan
    Gan, John Q.
    Raza, Haider
    MEDICAL IMAGE UNDERSTANDING AND ANALYSIS, PT II, MIUA 2024, 2024, 14860 : 309 - 322
  • [8] A self-attention armed optronic transformer in imaging through scattering media
    Huang, Zicheng
    Shi, Mengyang
    Ma, Jiahui
    Gao, Yesheng
    Liu, Xingzhao
    OPTICS COMMUNICATIONS, 2024, 571
  • [9] Research of Self-Attention in Image Segmentation
    Cao, Fude
    Zheng, Chunguang
    Huang, Limin
    Wang, Aihua
    Zhang, Jiong
    Zhou, Feng
    Ju, Haoxue
    Guo, Haitao
    Du, Yuxia
    JOURNAL OF INFORMATION TECHNOLOGY RESEARCH, 2022, 15 (01)
  • [10] Pyramid Self-attention for Semantic Segmentation
    Qi, Jiyang
    Wang, Xinggang
    Hu, Yao
    Tang, Xu
    Liu, Wenyu
    PATTERN RECOGNITION AND COMPUTER VISION, PT I, 2021, 13019 : 480 - 492