Recursive reservoir concatenation for salt-and-pepper denoising

被引:1
作者
Lee, In-mo [1 ]
Kim, Yoojeung [1 ]
Kim, Taehoon [1 ]
Choi, Hayoung [2 ]
Yang, Seung Yeop [2 ]
Kim, Yunho [1 ]
机构
[1] Ulsan Natl Inst Sci & Technol, Dept Math Sci, Ulsan, South Korea
[2] Kyungpook Natl Univ, Dept Math, Daegu, South Korea
基金
新加坡国家研究基金会;
关键词
Reservoir computing; Image restoration; Small data; ECHO STATE NETWORKS; DEEP CNN; IMAGE; BACKPROPAGATION; REMOVAL;
D O I
10.1016/j.patcog.2024.111196
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a recursive reservoir concatenation architecture in reservoir computing for salt-and-pepper noise removal. The recursive algorithm consists of two components. One is the initial network training for the recursion. Since the standard reservoir computing does not appreciate images as input data, we designed a nonlinear image-specific forward operator that can extract image features from noisy input images, which are to be mapped into a reservoir for training. The other is the recursive reservoir concatenation to further improve the reconstruction quality. Training errors decrease as more reservoirs are concatenated due to the hierarchical structure of the recursive reservoir concatenation. The proposed method outperformed most analytic or machine-learning based denoising models for salt-and-pepper noise with a training cost much lower than other neural network-based models. Reconstruction is completely parallel, in that noise indifferent pixels can be removed in parallel.
引用
收藏
页数:11
相关论文
共 33 条
[1]   A review of image denoising algorithms, with a new one [J].
Buades, A ;
Coll, B ;
Morel, JM .
MULTISCALE MODELING & SIMULATION, 2005, 4 (02) :490-530
[2]   Aspects of total variation regularized L1 function approximation [J].
Chan, TF ;
Esedoglu, S .
SIAM JOURNAL ON APPLIED MATHEMATICS, 2005, 65 (05) :1817-1837
[3]   Proper choice of hyperparameters in reservoir computing of chaotic maps [J].
Chen, Wei ;
Gao, Jian ;
Yan, Zixiang ;
Xiao, Jinghua .
JOURNAL OF PHYSICS A-MATHEMATICAL AND THEORETICAL, 2023, 56 (41)
[4]  
Choi J., 2023, AIP Adv., V13
[5]   Image denoising by sparse 3-D transform-domain collaborative filtering [J].
Dabov, Kostadin ;
Foi, Alessandro ;
Katkovnik, Vladimir ;
Egiazarian, Karen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (08) :2080-2095
[6]  
Elad Michael., 2023, Image Denoising: The Deep Learning Revolution and Beyond-A Survey Paper
[7]  
Gonzalez R., 2008, Woods 3rd, Digital Image Processing
[8]   Echo state networks are universal [J].
Grigoryeva, Lyudmila ;
Ortega, Juan-Pablo .
NEURAL NETWORKS, 2018, 108 :495-508
[9]  
Jaeger: H., 2001, GMD Report 148, DOI DOI 10.1385/1-59259-208-2:013
[10]  
Jaeger Herbert., 2002, Tutorial on training recurrent neural networks, covering BPPT, RTRL, EKF and the echo state network approach