AS-Net: Fast Photoacoustic Reconstruction With Multi-Feature Fusion From Sparse Data

被引:21
作者
Guo, Mengjie [1 ]
Lan, Hengrong [1 ,2 ,3 ]
Yang, Changchun [1 ]
Liu, Jiang [4 ,5 ]
Gao, Fei [1 ,6 ]
机构
[1] ShanghaiTech Univ, Sch Informat Sci & Technol, Hybrid Imaging Syst Lab, Shanghai 201210, Peoples R China
[2] Chinese Acad Sci, Shanghai Inst Microsyst & Informat Technol, Shanghai 200050, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[4] Southern Univ Sci & Technol, Dept Comp Sci & Engn, Shenzhen 518055, Guangdong, Peoples R China
[5] Chinese Acad Sci, Cixi Inst Biomed Engn, Shanghai 200050, Peoples R China
[6] Shanghai Engn Res Ctr Energy Efficient & Custom A, Shanghai 201210, Peoples R China
基金
中国国家自然科学基金;
关键词
Attention; deep learning; photoacoustic tomography; reconstruction; sparse sampling; IMAGE-RECONSTRUCTION;
D O I
10.1109/TCI.2022.3155379
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Photoacoustic (PA) imaging is a biomedical imaging modality capable of acquiring high-contrast images of optical absorption at depths much greater than traditional optical imaging techniques. However, practical instrumentation and geometry limit the number of available acoustic sensors surrounding the imaging target, which results in the sparsity of sensor data. Conventional PA image reconstruction methods give severe artifacts when they are applied directly to the sparse PA data. In this paper, we firstly propose to employ a novel signal processing method to make sparse PA raw data more suitable for the neural network, concurrently speeding up image reconstruction. Then we propose Attention Steered Network (AS-Net) for PA reconstruction with multi-feature fusion. AS-Net is validated on different datasets, including simulated photoacoustic data from fundus vasculature phantoms and experimental data from in vivo fish and mice. Notably, the method is also able to eliminate some artifacts present in the ground truth for in vivo data. Results demonstrated that our method provides superior reconstructions at a faster speed.
引用
收藏
页码:215 / 223
页数:9
相关论文
共 44 条
[1]   Photoacoustic Source Detection and Reflection Artifact Removal Enabled by Deep Learning [J].
Allman, Derek ;
Reiter, Austin ;
Bell, Muyinatu A. Lediju .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (06) :1464-1477
[2]  
Antholzer S., 2019, PHOTONS PLUS ULTRASO
[3]   Photoacoustic image reconstruction via deep learning [J].
Antholzer, Stephan ;
Haltmeier, Markus ;
Nuster, Robert ;
Schwab, Johannes .
PHOTONS PLUS ULTRASOUND: IMAGING AND SENSING 2018, 2018, 10494
[4]  
Awasthi N., 2020, ARXIV200106434
[5]   Deep Neural Network-Based Sinogram Super-Resolution and Bandwidth Enhancement for Limited-Data Photoacoustic Tomography [J].
Awasthi, Navchetan ;
Jain, Gaurav ;
Kalva, Sandeep Kumar ;
Pramanik, Manojit ;
Yalavarthy, Phaneendra K. .
IEEE TRANSACTIONS ON ULTRASONICS FERROELECTRICS AND FREQUENCY CONTROL, 2020, 67 (12) :2660-2673
[6]   GCNet: Non-local Networks Meet Squeeze-Excitation Networks and Beyond [J].
Cao, Yue ;
Xu, Jiarui ;
Lin, Stephen ;
Wei, Fangyun ;
Hu, Han .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, :1971-1980
[7]   An algorithm for total variation regularized photoacoustic imaging [J].
Dong, Yiqiu ;
Gorner, Torsten ;
Kunis, Stefan .
ADVANCES IN COMPUTATIONAL MATHEMATICS, 2015, 41 (02) :423-438
[8]   Single laser pulse generates dual photoacoustic signals for differential contrast photoacoustic imaging [J].
Gao, Fei ;
Feng, Xiaohua ;
Zhang, Ruochong ;
Liu, Siyu ;
Ding, Ran ;
Kishor, Rahul ;
Zheng, Yuanjin .
SCIENTIFIC REPORTS, 2017, 7
[9]   Single-Wavelength Blood Oxygen Saturation Sensing With Combined Optical Absorption and Scattering [J].
Gao, Fei ;
Peng, Qiwen ;
Feng, Xiaohua ;
Gao, Bo ;
Zheng, Yuanjin .
IEEE SENSORS JOURNAL, 2016, 16 (07) :1943-1948
[10]   Fast R-CNN [J].
Girshick, Ross .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1440-1448