Hybrid Single Image Super-Resolution Algorithm for Medical Images

被引:8
作者
El-Shafai, Walid [1 ,2 ]
Mohamed, Ehab Mahmoud [3 ,4 ]
Zeghid, Medien [3 ,5 ]
Ali, Anas M. [1 ,6 ]
Aly, Moustafa H. [7 ]
机构
[1] Menoufia Univ, Dept Elect & Elect Commun Engn, Fac Elect Engn, Menoufia 32952, Egypt
[2] Prince Sultan Univ, Dept Comp Sci, Secur Engn Lab, Riyadh 11586, Saudi Arabia
[3] Prince Sattam Bin Abdulaziz Univ, Dept Elect Engn, Coll Engn, Wadi Addwasir 11991, Saudi Arabia
[4] Aswan Univ, Dept Elect Engn, Aswan 81542, Egypt
[5] Univ Monastir, Elect & Microelect Lab E m E L, Fac Sci, Monastir 5000, Tunisia
[6] Alexandria Higher Inst Engn & Technol AIET, Alexandria, Egypt
[7] Arab Acad Sci Technol & Maritime Transport, Elect & Commun Engn Dept, Coll Engn & Technol, Alexandria 1029, Egypt
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2022年 / 72卷 / 03期
关键词
GAN; medical images; SSIM; MS-SSIM; PSNR; SISR;
D O I
10.32604/cmc.2022.028364
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
High-quality medical microscopic images used for diseases detection are expensive and difficult to store. Therefore, low-resolution images are favorable due to their low storage space and ease of sharing, where the images can be enlarged when needed using Super-Resolution (SR) techniques. However, it is important to maintain the shape and size of the medical images while enlarging them. One of the problems facing SR is that the performance of medical image diagnosis is very poor due to the deterioration of the reconstructed image resolution. Consequently, this paper suggests a multi-SR and classification framework based on Generative Adversarial Network (GAN) to generate high-resolution images with higher quality and finer details to reduce blurring. The proposed framework comprises five GAN models: Enhanced SR Generative Adversarial Networks (ESRGAN), Enhanced deep SR GAN (EDSRGAN), Sub-Pixel-GAN, SRGAN, and Efficient Wider Activation-B GAN (WDSR-b-GAN). To train the proposed models, we have employed images from the famous BreakHis dataset and enlarged them by 4x and 16x upscale factors with the ground truth of the size of 256 x 256 x 3. Moreover, several evaluation metrics like Peak Signal-to-Noise Ratio (PSNR), Mean Squared Error (MSE), Structural Similarity Index (SSIM), Multiscale Structural Similarity Index (MS-SSIM), and histogram are applied to make comprehensive and objective comparisons to determine the best methods in terms of efficiency, training time, and storage space. The obtained results reveal the superiority of the proposed models over traditional and benchmark models in terms of color and texture restoration and detection by achieving an accuracy of 99.7433%.
引用
收藏
页码:4879 / 4896
页数:18
相关论文
共 50 条
[31]   PRED: A PARALLEL NETWORK FOR HANDLING MULTIPLE DEGRADATIONS VIA SINGLE MODEL IN SINGLE IMAGE SUPER-RESOLUTION [J].
Wu, Guangyang ;
Zhao, Lili ;
Wang, Wenyi ;
Zeng, Liaoyuan ;
Chen, Jianwen .
2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, :2881-2885
[32]   Deep Learning for Remote Sensing Image Super-Resolution [J].
Ul Hoque, Md Reshad ;
Burks, Roland, III ;
Kwan, Chiman ;
Li, Jiang .
2019 IEEE 10TH ANNUAL UBIQUITOUS COMPUTING, ELECTRONICS & MOBILE COMMUNICATION CONFERENCE (UEMCON), 2019, :286-292
[33]   Image super resolution using fusion of images [J].
Garg, Chirag ;
Kasana, Singara Singh .
INTERNATIONAL JOURNAL OF IMAGE AND DATA FUSION, 2015, 6 (04) :366-376
[34]   MEDICAL IMAGE SUPER-RESOLUTION VIA GRANULAR MULTI-SCALE NETWORK IN NSCT DOMAIN [J].
Sang, Yu ;
Sun, Jinguang ;
Wang, Simiao ;
Li, Keqiu ;
Qi, Heng .
2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
[35]   A super-resolution reconstruction algorithm based on feature fusion [J].
Wang, Lin ;
Yang, Siqi ;
Jia, Jingqian .
PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, :3060-3065
[36]   Single Image Super-Resolution Restoration of TGO CaSSIS Colour Images: Demonstration with Perseverance Rover Landing Site and Mars Science Targets [J].
Tao, Yu ;
Conway, Susan J. ;
Muller, Jan-Peter ;
Putri, Alfiah R. D. ;
Thomas, Nicolas ;
Cremonese, Gabriele .
REMOTE SENSING, 2021, 13 (09)
[37]   FG-SRGAN: A Feature-Guided Super-Resolution Generative Adversarial Network for Unpaired Image Super-Resolution [J].
Lian, Shuailong ;
Zhou, Hejian ;
Sun, Yi .
ADVANCES IN NEURAL NETWORKS - ISNN 2019, PT I, 2019, 11554 :151-161
[38]   Comparative Evaluation of Super-Resolution Processed Image Quality of Lingual Mucosal Images by Generative Adversarial Network [J].
Yoshimura, Ken ;
Tsuchida, Satoko ;
Asanuma, Naoki ;
Iwasaki, Shin-ichi ;
Yamagiwa, Shinichi .
JOURNAL OF HARD TISSUE BIOLOGY, 2024, 33 (04) :219-232
[39]   Satellite Image Super-Resolution Using Overlapping Blocks via Sparse Representation [J].
Alvarez-Ramos, Valentin ;
Ponomaryov, Volodymyr ;
Reyes-Reyes, Rogelio ;
Gallegos-Funes, Francisco .
2016 9TH INTERNATIONAL KHARKIV SYMPOSIUM ON PHYSICS AND ENGINEERING OF MICROWAVES, MILLIMETER AND SUBMILLIMETER WAVES (MSMW), 2016,
[40]   PTSRGAN: Power transmission lines single image super-resolution using a generative adversarial network [J].
Falahatnejad, Shahrzad ;
Karami, Azam ;
Nezamabadi-pour, Hossein .
INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2024, 155