A novel fuzzy hierarchical fusion attention convolution neural network for medical image super-resolution reconstruction

被引:59
作者
Wang, Changzhong [1 ]
Lv, Xiang [1 ]
Shao, Mingwen [2 ]
Qian, Yuhua [3 ]
Zhang, Yang [1 ]
机构
[1] Bohai Univ, Dept Math, Jinzhou 121000, Peoples R China
[2] Chinese Univ Petr, Coll Comp & Commun Engn, Qingdao 266580, Peoples R China
[3] Shanxi Univ, Sch Comp & Informat Technol, Shanxi 030006, Peoples R China
基金
中国国家自然科学基金;
关键词
Super; -resolution; Fuzzy neural networks; Pyramidal hierarchical attention; COVID-19; Uncertainty metric; FACE SUPERRESOLUTION; SINGLE; INTERPOLATION;
D O I
10.1016/j.ins.2022.11.140
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The clarity of medical images is crucial for doctors to identify and diagnose different dis-eases. High-resolution images have more detailed information and clearer content than low-resolution images. It is well known that medical images can frequently have some blurred object boundaries, and that traditional deep learning models cannot adequately describe the uncertainty of these blurred boundaries. This paper proposes a new fuzzy metric to characterize the uncertainty of pixels and designs a fuzzy hierarchical fusion attention neural network based on multiscale guided learning. Specifically, a fuzzy neural information-processing block is proposed, which converts an input image into a fuzzy domain using fuzzy membership functions. The uncertainty of the pixels is processed using the proposed fuzzy rules, and then the output of the fuzzy rule layer is fused with the result of the convolution in the neural network. Simultaneously, a multiscale guided-learning dense residual block and pyramidal hierarchical attention module are designed to extract more effective hierarchical image information. Finally, a recurrent memory module with a residual structure is used to process the output features of the hierarchical attention mod-ules. A recursive sub-pixel reconstruction module is used at the tail of the network to reconstruct the images. Compared with existing super-resolution methods using the public COVID-CT dataset, the proposed method demonstrated superior performance in high -resolution medical image reconstruction and reduced the number of parameters and anal-ysis time of the models.(c) 2022 Elsevier Inc. All rights reserved.
引用
收藏
页码:424 / 436
页数:13
相关论文
共 47 条
[1]   NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study [J].
Agustsson, Eirikur ;
Timofte, Radu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1122-1131
[2]   Single-Image Super-Resolution via Linear Mapping of Interpolated Self-Examples [J].
Bevilacqua, Marco ;
Roumy, Aline ;
Guillemot, Christine ;
Morel, Marie-Line Alberi .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2014, 23 (12) :5334-5347
[3]   Single image super-resolution via multi-scale residual channel attention network [J].
Cao, Feilong ;
Liu, Huan .
NEUROCOMPUTING, 2019, 358 :424-436
[4]   Image Interpolation via Low-Rank Matrix Completion and Recovery [J].
Cao, Feilong ;
Cai, Miaomiao ;
Tan, Yuanpeng .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2015, 25 (08) :1261-1270
[5]   Double paths network with residual information distillation for improving lung CT image super resolution [J].
Chen, Yihan ;
Zheng, Qianying ;
Chen, Jiansen .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2022, 73
[6]   A Hierarchical Fused Fuzzy Deep Neural Network for Data Classification [J].
Deng, Yue ;
Ren, Zhiquan ;
Kong, Youyong ;
Bao, Feng ;
Dai, Qionghai .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2017, 25 (04) :1006-1012
[7]   Accelerating the Super-Resolution Convolutional Neural Network [J].
Dong, Chao ;
Loy, Chen Change ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :391-407
[8]   Learning a Deep Convolutional Network for Image Super-Resolution [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 :184-199
[9]   HR-PrGAN: High-resolution story visualization with progressive generative adversarial networks [J].
Dong, Pei ;
Wu, Lei ;
Meng, Lei ;
Meng, Xiangxu .
INFORMATION SCIENCES, 2022, 614 :548-562
[10]   Deconv-transformer (DecT): A histopathological image classification model for breast cancer based on color deconvolution and transformer architecture [J].
He, Zhu ;
Lin, Mingwei ;
Xu, Zeshui ;
Yao, Zhiqiang ;
Chen, Hong ;
Alhudhaif, Adi ;
Alenezi, Fayadh .
INFORMATION SCIENCES, 2022, 608 :1093-1112