AS-Net: Fast Photoacoustic Reconstruction With Multi-Feature Fusion From Sparse Data

被引:18
|
作者
Guo, Mengjie [1 ]
Lan, Hengrong [1 ,2 ,3 ]
Yang, Changchun [1 ]
Liu, Jiang [4 ,5 ]
Gao, Fei [1 ,6 ]
机构
[1] ShanghaiTech Univ, Sch Informat Sci & Technol, Hybrid Imaging Syst Lab, Shanghai 201210, Peoples R China
[2] Chinese Acad Sci, Shanghai Inst Microsyst & Informat Technol, Shanghai 200050, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[4] Southern Univ Sci & Technol, Dept Comp Sci & Engn, Shenzhen 518055, Guangdong, Peoples R China
[5] Chinese Acad Sci, Cixi Inst Biomed Engn, Shanghai 200050, Peoples R China
[6] Shanghai Engn Res Ctr Energy Efficient & Custom A, Shanghai 201210, Peoples R China
基金
中国国家自然科学基金;
关键词
Attention; deep learning; photoacoustic tomography; reconstruction; sparse sampling; IMAGE-RECONSTRUCTION;
D O I
10.1109/TCI.2022.3155379
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Photoacoustic (PA) imaging is a biomedical imaging modality capable of acquiring high-contrast images of optical absorption at depths much greater than traditional optical imaging techniques. However, practical instrumentation and geometry limit the number of available acoustic sensors surrounding the imaging target, which results in the sparsity of sensor data. Conventional PA image reconstruction methods give severe artifacts when they are applied directly to the sparse PA data. In this paper, we firstly propose to employ a novel signal processing method to make sparse PA raw data more suitable for the neural network, concurrently speeding up image reconstruction. Then we propose Attention Steered Network (AS-Net) for PA reconstruction with multi-feature fusion. AS-Net is validated on different datasets, including simulated photoacoustic data from fundus vasculature phantoms and experimental data from in vivo fish and mice. Notably, the method is also able to eliminate some artifacts present in the ground truth for in vivo data. Results demonstrated that our method provides superior reconstructions at a faster speed.
引用
收藏
页码:215 / 223
页数:9
相关论文
共 50 条
  • [1] A jointed feature fusion framework for photoacoustic image reconstruction
    Lan, Hengrong
    Yang, Changchun
    Gao, Fei
    PHOTOACOUSTICS, 2023, 29
  • [2] Sparse-View Photoacoustic Reconstruction Method for Diabetic Retinopathy Using Feature Fusion Network
    Chang, Xiaohan
    Cai, Lingbo
    Wang, Jianlei
    Dong, Hongyang
    Han, Jing
    Wang, Chun
    JOURNAL OF BIOPHOTONICS, 2024, 17 (11)
  • [3] Deep learning for photoacoustic tomography from sparse data
    Antholzer, Stephan
    Haltmeier, Markus
    Schwab, Johannes
    INVERSE PROBLEMS IN SCIENCE AND ENGINEERING, 2019, 27 (07) : 987 - 1005
  • [4] MFF-Net: Deepfake Detection Network Based on Multi-Feature Fusion
    Zhao, Lei
    Zhang, Mingcheng
    Ding, Hongwei
    Cui, Xiaohui
    ENTROPY, 2021, 23 (12)
  • [5] Multi-feature Data Fusion Method of Greenhouse Based on WDNN
    Sun Y.
    Cai Y.
    Zhang X.
    Xue X.
    Zheng W.
    Qiao X.
    Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery, 2019, 50 (02): : 273 - 280and296
  • [6] Convolutional Residual Learning with Sparse Robust Samples and Multi-feature Fusion for Object Tracking
    Gao, Huiling
    Liu, Jie
    Liu, Chaorong
    Li, Binshan
    Zhao, Zhengtian
    Liu, Weirong
    TENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING (ICGIP 2018), 2019, 11069
  • [7] MFHSformer: Hierarchical sparse transformer based on multi-feature fusion for soil pore segmentation
    Bai, Hao
    Han, Qiaoling
    Zhao, Yandong
    Zhao, Yue
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 272
  • [8] MSD-Net: Multi-scale dense convolutional neural network for photoacoustic image reconstruction with sparse data
    Wang, Liangjie
    Meng, Yi-Chao
    Qian, Yiming
    PHOTOACOUSTICS, 2025, 41
  • [9] Multi-feature fusion network for person reidentification
    Wang, Xihe
    Zhang, Yongjun
    Xu, Yujie
    Cui, Zhongwei
    JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (02)
  • [10] Knowledge tracing based on multi-feature fusion
    Yongkang Xiao
    Rong Xiao
    Ning Huang
    Yixin Hu
    Huan Li
    Bo Sun
    Neural Computing and Applications, 2023, 35 : 1819 - 1833