An Attention Network With Self-Supervised Learning for Rheumatoid Arthritis Scoring

被引:0
|
作者
Ling, Deyu [1 ]
Yu, Wenxin [1 ]
Zhang, Zhiqiang [1 ]
Zou, Jinmei [2 ]
机构
[1] Southwest Univ Sci & Technol, Sch Comp Sci & Technol, Mianyang, Sichuan, Peoples R China
[2] Mianyang Cent Hosp, Mianyang, Sichuan, Peoples R China
来源
2024 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS 2024 | 2024年
关键词
Rheumatoid arthritis; Hand X-ray images; Deep learning; Attention mechanisms; Self-supervised learning;
D O I
10.1109/ISCAS58744.2024.10558434
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Rheumatoid arthritis (RA) is a chronic disease causing joint pain and disability. Early treatment can prevent irreversible bone damage. The Sharp/van der Heijde (SvH) method, a common clinical standard for assessing RA progression, is manual and subjective, leading to inconsistent measurements. To overcome this, we propose a deep learning model based on the SvH scoring criteria to predict SvH scores of RA patients' hands. Our efficient attention network, ECBANet, merges supervised and self-supervised learning to generate attentional weights without losing feature dimensionality. It effectively captures the local features of the RA hand and enhances the model's focus on crucial cues like joint position and gap. Extensive experiments on the only public dataset of hand X-ray images of RA patients labeled with SvH scores show that our model surpasses the current optimal model for this dataset, reducing MAE by 2% and RMSE by 7.4%.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Guiding Attention for Self-Supervised Learning with Transformers
    Deshpande, Ameet
    Narasimhan, Karthik
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2020, 2020, : 4676 - 4686
  • [2] Self-supervised Attention Learning for Robot Control
    Cong, Lin
    Shi, Yunlei
    Zhang, Jianwei
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (IEEE-ROBIO 2021), 2021, : 1153 - 1158
  • [3] Reinforcement Learning with Attention that Works: A Self-Supervised Approach
    Manchin, Anthony
    Abbasnejad, Ehsan
    van den Hengel, Anton
    NEURAL INFORMATION PROCESSING, ICONIP 2019, PT V, 2019, 1143 : 223 - 230
  • [4] Graph Multihead Attention Pooling with Self-Supervised Learning
    Wang, Yu
    Hu, Liang
    Wu, Yang
    Gao, Wanfu
    ENTROPY, 2022, 24 (12)
  • [5] Heuristic Attention Representation Learning for Self-Supervised Pretraining
    Van Nhiem Tran
    Liu, Shen-Hsuan
    Li, Yung-Hui
    Wang, Jia-Ching
    SENSORS, 2022, 22 (14)
  • [6] Self-Supervised Attention-Aware Reinforcement Learning
    Wu, Haiping
    Khetarpa, Khimya
    Precup, Doina
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 10311 - 10319
  • [7] Exploring Attention and Self-Supervised Learning Mechanism for Graph Similarity Learning
    Wen, Guangqi
    Gao, Xin
    Tan, Wenhui
    Cao, Peng
    Yang, Jinzhu
    Li, Weiping
    Zaiane, Osmar R.
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024,
  • [8] Self-Supervised Signed Graph Attention Network for Social Recommendation
    Zhao, Qin
    Liu, Gang
    Yang, Fuli
    Yang, Ru
    Kou, Zuliang
    Wang, Dong
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [9] Improving BERT With Self-Supervised Attention
    Chen, Yiren
    Kou, Xiaoyu
    Bai, Jiangang
    Tong, Yunhai
    IEEE ACCESS, 2021, 9 : 144129 - 144139
  • [10] Targeted self-supervised attention network for coronavirus disease 2019 detection
    Ding, Weixin
    Yu, Wenbo
    JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (03)