Deep learning in medical image super resolution: a review

被引：21
作者：
Yang, Hujun [1 ]
Wang, Zhongyang [2 ,3 ]
Liu, Xinyao [1 ]
Li, Chuangang [1 ]
Xin, Junchang [2 ,3 ]
Wang, Zhiqiong [1 ]
机构：
[1] Northeastern Univ, Coll Med & Biol Informat Engn, Shenyang 110169, Peoples R China
[2] Northeastern Univ, Sch Comp Sci & Engn, Shenyang 110169, Peoples R China
[3] Northeastern Univ, Key Lab Big Data Management & Analyt, Shenyang 110169, Peoples R China
来源：
APPLIED INTELLIGENCE | 2023年 / 53卷 / 18期
基金：
中国国家自然科学基金;
关键词：
Super-resolution; Medical image; Deep learning; Assessment metrics; Review; MULTI-CONTRAST SUPERRESOLUTION; QUALITY ASSESSMENT; MRI; NETWORK; SINGLE; ATTENTION; CT;
D O I：
10.1007/s10489-023-04566-9
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
Super-resolution (SR) reconstruction is a hot topic in medical image processing. SR implies reconstructing corresponding high-resolution (HR) images from observed low-resolution (LR) images or image sequences. In recent years, significant breakthroughs in SR based on deep learning have been made, and many advanced results have been achieved. However, there is a lack of review literature that summarizes the field's current state and provides an outlook on future developments. Therefore, we provide a comprehensive summary of the literature on medical image SR (MedSR) based on deep learning since 2018 in five aspects: (1) The SR problem of medical images is described, and the methods of image degradation are summarized. (2) We divide the existing studies into three categories: two-dimensional image SR (2DISR), three-dimensional image SR (3DISR), and video SR (VSR). Each category is subdivided. We analyze the network structure and method characteristics of typical methods. (3) Existing SR reconstruction quality evaluation metrics are presented in detail. (4) The application of MedSR methods based on deep learning is discussed. (5) We discuss the challenges of this phase and point out valuable research directions.
引用
收藏
页码：20891 / 20916
页数：26
相关论文
共 148 条
  • [61] SwinIR: Image Restoration Using Swin Transformer
    Liang, Jingyun
    Cao, Jiezhang
    Sun, Guolei
    Zhang, Kai
    Van Gool, Luc
    Timofte, Radu
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, : 1833 - 1844
  • [62] Enhanced Deep Residual Networks for Single Image Super-Resolution
    Lim, Bee
    Son, Sanghyun
    Kim, Heewon
    Nah, Seungjun
    Lee, Kyoung Mu
    [J]. 2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 1132 - 1140
  • [63] Fundamental limits of reconstruction-based superresolution algorithms under local translation
    Lin, ZC
    Shum, HY
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2004, 26 (01) : 83 - 97
  • [64] Liu HY, 2021, AAAI CONF ARTIF INTE, V35, P2127
  • [65] Video super-resolution based on deep learning: a comprehensive survey
    Liu, Hongying
    Ruan, Zhubo
    Zhao, Peng
    Dong, Chao
    Shang, Fanhua
    Liu, Yuanyuan
    Yang, Linlin
    Timofte, Radu
    [J]. ARTIFICIAL INTELLIGENCE REVIEW, 2022, 55 (08) : 5981 - 6035
  • [66] Residual Feature Aggregation Network for Image Super-Resolution
    Liu, Jie
    Zhang, Wenjie
    Tang, Yuting
    Tang, Jie
    Wu, Gangshan
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 2356 - 2365
  • [67] Progressive face super-resolution with cascaded recurrent convolutional network
    Liu, Shuang
    Xiong, Chengyi
    Shi, Xiaodi
    Gao, Zhirong
    [J]. NEUROCOMPUTING, 2021, 449 : 357 - 367
  • [68] Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
    Liu, Ze
    Lin, Yutong
    Cao, Yue
    Hu, Han
    Wei, Yixuan
    Zhang, Zheng
    Lin, Stephen
    Guo, Baining
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 9992 - 10002
  • [69] MASA-SR: Matching Acceleration and Spatial Adaptation for Reference-Based Image Super-Resolution
    Lu, Liying
    Li, Wenbo
    Tao, Xin
    Lu, Jiangbo
    Jia, Jiaya
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 6364 - 6373
  • [70] Two-Stage Self-supervised Cycle-Consistency Network for Reconstruction of Thin-Slice MR Images
    Lu, Zhiyang
    Li, Zheng
    Wang, Jun
    Shi, Jun
    Shen, Dinggang
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT VI, 2021, 12906 : 3 - 12
234567891011