Transformer Encoder-Decoder with depth-wise separable convolution for Low-Dose CT Denoising

被引:0
作者
Guo, Weizhen [1 ]
Yuan, Huaqiang [1 ]
Li, Yakang [2 ,3 ]
Li, Jianfang [2 ]
机构
[1] Dongguan Univ Technol, Sch Comp, Dongguan, Peoples R China
[2] Chinese Acad Sci, Inst High Energy Phys, Beijing, Peoples R China
[3] Spallat Neutron Source Sci Ctr, Dongguan, Peoples R China
来源
2024 5TH INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING AND APPLICATION, ICCEA 2024 | 2024年
基金
中国国家自然科学基金;
关键词
LDCT; denoising; transformer; depth-wise separable convolution; encoder-decoder; IMAGE; NETWORK; DOMAIN; NOISE;
D O I
10.1109/ICCEA62105.2024.10604076
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Low-dose computed tomography ( LDCT) images frequently suffer from noise and artifacts due to diminished radiation doses, challenging the diagnostic integrity of the images. We introduce an innovative approach, the Transformer Encoder-Decoder with Depth-wise Separable Convolution (ECformer), which incorporates depth-wise separable convolution into the Transformer architecture. This synergistic fusion of convolutional neural network (CNN) and Transformer capabilities notably enhances spatial information capture while concurrently mitigating computational demands. Specifically, depth-wise separable convolution supplants traditional linear projection within the Transformer, facilitating efficient learning of local contextual dynamics. Further, the adoption of an encoder-decoder architecture bolsters the hierarchical feature representation, with shortcut connections ensuring the preservation of detail. Empirical evaluations on the AAPM-Mayo Clinic Low-Dose CT Grand Challenge Dataset confirm that ECformer outperforms existing denoising methods.
引用
收藏
页码:1693 / 1698
页数:6
相关论文
共 22 条
  • [1] Current concepts - Computed tomography - An increasing source of radiation exposure
    Brenner, David J.
    Hall, Eric J.
    [J]. NEW ENGLAND JOURNAL OF MEDICINE, 2007, 357 (22) : 2277 - 2284
  • [2] Buzug TM, 2011, SPRINGER HANDBOOK OF MEDICAL TECHNOLOGY, P311
  • [3] Low-Dose CT With a Residual Encoder-Decoder Convolutional Neural Network
    Chen, Hu
    Zhang, Yi
    Kalra, Mannudeep K.
    Lin, Feng
    Chen, Yang
    Liao, Peixi
    Zhou, Jiliu
    Wang, Ge
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2017, 36 (12) : 2524 - 2535
  • [4] A review on CT image noise and its denoising
    Diwakar, Manoj
    Kumar, Manoj
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2018, 42 : 73 - 88
  • [5] Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929
  • [6] Physician Knowledge of Radiation Exposure and Risk in Medical Imaging
    Hobbs, Jason B.
    Goldstein, Noah
    Lind, Kimberly E.
    Elder, Deirdre
    Dodd, Gerald D., III
    Borgstede, James P.
    [J]. JOURNAL OF THE AMERICAN COLLEGE OF RADIOLOGY, 2018, 15 (01) : 34 - 43
  • [7] A Methodology to Train a Convolutional Neural Network-Based Low-Dose CT Denoiser With an Accurate Image Domain Noise Insertion Technique
    Kim, Byeongjoon
    Divel, Sarah E.
    Pelc, Norbert J.
    Baek, Jongduk
    [J]. IEEE ACCESS, 2022, 10 : 86395 - 86407
  • [8] Transformer With Double Enhancement for Low-Dose CT Denoising
    Li, Haoran
    Yang, Xiaomin
    Yang, Sihan
    Wang, Daoyong
    Jeon, Gwanggil
    [J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (10) : 4660 - 4671
  • [9] DDPTransformer: Dual-Domain With Parallel Transformer Network for Sparse View CT Image Reconstruction
    Li, Runrui
    Li, Qing
    Wang, Hexi
    Li, Saize
    Zhao, Juanjuan
    Yan, Qiang
    Wang, Long
    [J]. IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2022, 8 : 1101 - 1116
  • [10] EDCNN: Edge enhancement-based Densely Connected Network with Compound Loss for Low-Dose CT Denoising
    Liang, Tengfei
    Jin, Yi
    Li, Yidong
    Wang, Tao
    [J]. PROCEEDINGS OF 2020 IEEE 15TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP 2020), 2020, : 193 - 198