Deep Attention Fusion Hashing (DAFH) Model for Medical Image Retrieval

被引:1
作者
Wu, Gangao [1 ,2 ,3 ,6 ]
Jin, Enhui [1 ,2 ,3 ]
Sun, Yanling [1 ,2 ,4 ,5 ]
Tang, Bixia [1 ,2 ,4 ,5 ]
Zhao, Wenming [1 ,2 ,3 ,4 ,5 ]
机构
[1] China Natl Ctr Bioinformat, Natl Genom Data Ctr, Beijing 100101, Peoples R China
[2] Chinese Acad Sci, Beijing Inst Genom, Beijing 100101, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[4] Chinese Acad Sci, CAS Key Lab Genome Sci & Informat, Beijing Inst Genom, Beijing 100101, Peoples R China
[5] China Natl Ctr Bioinformat, Beijing 100101, Peoples R China
[6] Zhejiang Univ, Coll Comp Sci, Zhejiang Prov Key Lab Serv Robot, Hangzhou 310013, Peoples R China
来源
BIOENGINEERING-BASEL | 2024年 / 11卷 / 07期
基金
国家重点研发计划;
关键词
medical image retrieval; deep learning; deep hashing;
D O I
10.3390/bioengineering11070673
中图分类号
Q81 [生物工程学(生物技术)]; Q93 [微生物学];
学科分类号
071005 ; 0836 ; 090102 ; 100705 ;
摘要
In medical image retrieval, accurately retrieving relevant images significantly impacts clinical decision making and diagnostics. Traditional image-retrieval systems primarily rely on single-dimensional image data, while current deep-hashing methods are capable of learning complex feature representations. However, retrieval accuracy and efficiency are hindered by diverse modalities and limited sample sizes. Objective: To address this, we propose a novel deep learning-based hashing model, the Deep Attention Fusion Hashing (DAFH) model, which integrates advanced attention mechanisms with medical imaging data. Methods: The DAFH model enhances retrieval performance by integrating multi-modality medical imaging data and employing attention mechanisms to optimize the feature extraction process. Utilizing multimodal medical image data from the Cancer Imaging Archive (TCIA), this study constructed and trained a deep hashing network that achieves high-precision classification of various cancer types. Results: At hash code lengths of 16, 32, and 48 bits, the model respectively attained Mean Average Precision (MAP@10) values of 0.711, 0.754, and 0.762, highlighting the potential and advantage of the DAFH model in medical image retrieval. Conclusions: The DAFH model demonstrates significant improvements in the efficiency and accuracy of medical image retrieval, proving to be a valuable tool in clinical settings.
引用
收藏
页数:15
相关论文
共 45 条
  • [1] Scanning the Future of Medical Imaging
    Alexander, Alan
    McGill, Megan
    Tarasova, Anna
    Ferreira, Cara
    Zurkiya, Delphine
    [J]. JOURNAL OF THE AMERICAN COLLEGE OF RADIOLOGY, 2019, 16 (04) : 501 - 507
  • [2] Medical Image Analysis using Convolutional Neural Networks: A Review
    Anwar, Syed Muhammad
    Majid, Muhammad
    Qayyum, Adnan
    Awais, Muhammad
    Alnowami, Majdi
    Khan, Muhammad Khurram
    [J]. JOURNAL OF MEDICAL SYSTEMS, 2018, 42 (11)
  • [3] Balntas V., 2016, Bmvc
  • [4] Bhosle Nilesh, 2020, International Journal of Intelligent Information and Database Systems, V13, P72
  • [5] Medical Image Retrieval: A Multimodal Approach
    Cao, Yu
    Steffey, Shawn
    He, Jianbiao
    Xiao, Degui
    Tao, Cui
    Chen, Ping
    Mueller, Henning
    [J]. CANCER INFORMATICS, 2014, 13 : 125 - 136
  • [6] HashNet: Deep Learning to Hash by Continuation
    Cao, Zhangjie
    Long, Mingsheng
    Wang, Jianmin
    Yu, Philip S.
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 5609 - 5618
  • [7] The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository
    Clark, Kenneth
    Vendt, Bruce
    Smith, Kirk
    Freymann, John
    Kirby, Justin
    Koppel, Paul
    Moore, Stephen
    Phillips, Stanley
    Maffitt, David
    Pringle, Michael
    Tarbox, Lawrence
    Prior, Fred
    [J]. JOURNAL OF DIGITAL IMAGING, 2013, 26 (06) : 1045 - 1057
  • [8] Image retrieval: Ideas, influences, and trends of the new age
    Datta, Ritendra
    Joshi, Dhiraj
    Li, Jia
    Wang, James Z.
    [J]. ACM COMPUTING SURVEYS, 2008, 40 (02)
  • [9] Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929
  • [10] Fan LX, 2020, PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P825