PW-CM: A Medical Image Segmentation Based on Consistency Model by Using Patches and Wavelet Transforms

被引:1
作者
Zhang, Lan [1 ]
Zhang, Kejia [1 ]
Pan, Haiwei [1 ]
机构
[1] Harbin Engn Univ, 145 Nantong St, Harbin, Heilongjiang, Peoples R China
来源
WEB AND BIG DATA, APWEB-WAIM 2024, PT I | 2024年 / 14961卷
关键词
Consistency models; Image patches; Wavelet transformations;
D O I
10.1007/978-981-97-7232-2_28
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As a new trend, generative consistency models are becoming increasingly popular, and some works have used consistency generative models for image segmentation tasks, achieving good results. However, consistency generative models are large in scale and slow in training, occupying a lot of computational resources when training large image datasets. A straightforward idea is to crop the images into patches before inputting them into the model, but this approach loses the global information of an image. This paper aims to use the low-frequency features obtained from wavelet transformations to preserve global information and produce an image patch of the same size as the others. These image patches are then encoded and inputted into the consistency model for training, which significantly reduces the parameter scale of the consistency model. Additionally, experiments have validated that the PW-CM model can also achieve good results in medical image segmentation.
引用
收藏
页码:422 / 434
页数:13
相关论文
共 23 条
[1]   Diffusion-Based Data Augmentation for Skin Disease Classification: Impact Across Original Medical Datasets to Fully Synthetic Images [J].
Akrout, Mohamed ;
Gyepesi, Balint ;
Hollo, Peter ;
Poor, Adrienn ;
Kineso, Blaga ;
Solis, Stephen ;
Cirone, Katrina ;
Kawahara, Jeremy ;
Slade, Dekker ;
Abid, Latif ;
Kovacs, Mate ;
Fazekas, Istvan .
DEEP GENERATIVE MODELS, DGM4MICCAI 2023, 2024, 14533 :99-109
[2]   Contextual Attention Network: Transformer Meets U-Net [J].
Azad, Reza ;
Heidari, Moein ;
Wu, Yuli ;
Merhof, Dorit .
MACHINE LEARNING IN MEDICAL IMAGING, MLMI 2022, 2022, 13583 :377-386
[3]  
Badrinarayanan V., 2015, COMPUT SCI
[4]  
Baid U, 2021, Arxiv, DOI [arXiv:2107.02314, DOI 10.48550/ARXIV.2107.02314]
[5]   Engineering of Electron Confinement through Defect-Based Localized Polarization on SrTiO3 Surface [J].
Chen, Junyan ;
Liu, Wei ;
Eul, Tobias ;
Chen, Mingjing ;
Hu, Xiaoyong ;
Wang, Shufang ;
Jiang, Anquan ;
Yang, Hong ;
Aeschlimann, Martin ;
Gong, Qihuang .
ADVANCED ELECTRONIC MATERIALS, 2021, 7 (03)
[6]  
Chen T, 2023, Arxiv, DOI arXiv:2208.04202
[7]  
Dhariwal P, 2021, ADV NEUR IN, V34
[8]   Empirical Wavelet Transform [J].
Gilles, Jerome .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2013, 61 (16) :3999-4010
[9]   HiFormer: Hierarchical Multi-scale Representations Using Transformers for Medical Image Segmentation [J].
Heidari, Moein ;
Kazerouni, Amirhossein ;
Soltany, Milad ;
Azad, Reza ;
Aghdam, Ehsan Khodapanah ;
Cohen-Adad, Julien ;
Merhof, Dorit .
2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, :6191-6201
[10]  
Ho JAT, 2022, Arxiv, DOI arXiv:2210.02303