Multi-domain integrative Swin transformer network for sparse-view tomographic reconstruction

被引:52
作者
Pan, Jiayi [1 ]
Zhang, Heye [1 ]
Wu, Weifei [2 ]
Gao, Zhifan [1 ]
Wu, Weiwen [1 ]
机构
[1] Sun Yat Sen Univ, Sch Biomed Engn, Shenzhen, Guangdong, Peoples R China
[2] China Three Gorges Univ, Peoples Hosp Yichang 1, Peoples Hosp China, Dept Orthoped, Yichang, Hubei, Peoples R China
来源
PATTERNS | 2022年 / 3卷 / 06期
基金
中国国家自然科学基金;
关键词
IMAGE-RECONSTRUCTION; INVERSE PROBLEMS; NEURAL-NETWORK; ALGORITHM;
D O I
10.1016/j.patter.2022.100498
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Decreasing projection views to a lower X-ray radiation dose usually leads to severe streak artifacts. To improve image quality from sparse-view data, a multi-domain integrative Swin transformer network (MIST-net) was developed and is reported in this article. First, MIST-net incorporated lavish domain features from data, residual data, image, and residual image using flexible network architectures, where a residual data and residual image sub-network was considered as a data consistency module to eliminate interpolation and reconstruction errors. Second, a trainable edge enhancement filter was incorporated to detect and protect image edges. Third, a high-quality reconstruction Swin transformer (i.e., Recformer) was designed to capture image global features. The experimental results on numerical and real cardiac clinical datasets with 48 views demonstrated that our proposed MIST-net provided better image quality with more small features and sharp edges than other competitors.
引用
收藏
页数:14
相关论文
共 56 条
[1]  
[Anonymous], 2015, AAPM CHALLENGE
[2]  
Arnab A., 2021, arXiv
[3]  
Bakator Mihalj, 2018, Multimodal Technologies and Interaction, V2, DOI 10.3390/mti2030047
[4]   Attention Augmented Convolutional Networks [J].
Bello, Irwan ;
Zoph, Barret ;
Vaswani, Ashish ;
Shlens, Jonathon ;
Le, Quoc V. .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :3285-3294
[5]  
Bertram M, 2004, 2004 2ND IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING: MACRO TO NANO, VOLS 1 and 2, P928
[6]   Optimization-based image reconstruction from sparse-view data in offset-detector CBCT [J].
Bian, Junguo ;
Wang, Jiong ;
Han, Xiao ;
Sidky, Emil Y. ;
Shao, Lingxiong ;
Pan, Xiaochuan .
PHYSICS IN MEDICINE AND BIOLOGY, 2013, 58 (02) :205-230
[7]   Evaluation of sparse-view reconstruction from flat-panel-detector cone-beam CT [J].
Bian, Junguo ;
Siewerdsen, Jeffrey H. ;
Han, Xiao ;
Sidky, Emil Y. ;
Prince, Jerry L. ;
Pelizzari, Charles A. ;
Pan, Xiaochuan .
PHYSICS IN MEDICINE AND BIOLOGY, 2010, 55 (22) :6575-6599
[8]   Current concepts - Computed tomography - An increasing source of radiation exposure [J].
Brenner, David J. ;
Hall, Eric J. .
NEW ENGLAND JOURNAL OF MEDICINE, 2007, 357 (22) :2277-2284
[9]   LEARN: Learned Experts' Assessment-Based Reconstruction Network for Sparse-Data CT [J].
Chen, Hu ;
Zhang, Yi ;
Chen, Yunjin ;
Zhang, Junfeng ;
Zhang, Weihua ;
Sun, Huaiqiang ;
Lv, Yang ;
Liao, Peixi ;
Zhou, Jiliu ;
Wang, Ge .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (06) :1333-1347
[10]   Low-Dose CT With a Residual Encoder-Decoder Convolutional Neural Network [J].
Chen, Hu ;
Zhang, Yi ;
Kalra, Mannudeep K. ;
Lin, Feng ;
Chen, Yang ;
Liao, Peixi ;
Zhou, Jiliu ;
Wang, Ge .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2017, 36 (12) :2524-2535