STOCHASTIC NEURAL NETWORKS

被引:0
作者
WONG, E
机构
关键词
NEURAL NETWORK; SIMULATED ANNEALING; DIFFUSION;
D O I
暂无
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The first purpose of this paper is to present a class of algorithms for finding the global minimum of a continuous-variable function defined on a hypercube. These algorithms, based on both diffusion processes and simulated annealing, are implementable as analog integrated circuits. Such circuits can be viewed as generalizations of neural networks of the Hopfield type, and are called "diffusion machines." Our second objective is to show that "learning" in these networks can be achieved by a set of three interconnected diffusion machines: one that learns, one to model the desired behavior, and one to compute the weight changes.
引用
收藏
页码:466 / 478
页数:13
相关论文
共 50 条
[31]   Overparametrized Multi-layer Neural Networks: Uniform Concentration of Neural Tangent Kernel and Convergence of Stochastic Gradient Descent [J].
Xu, Jiaming ;
Zhu, Hanjing .
JOURNAL OF MACHINE LEARNING RESEARCH, 2024, 25 :1-83
[32]   ADAPTIVE PROJECTIVE SYNCHRONIZATION OF MEMRISTIVE NEURAL NETWORKS WITH TIME-VARYING DELAYS AND STOCHASTIC PERTURBATION [J].
Li, Ruoxia ;
Wu, Huaiqin ;
Zhang, Xiaowei ;
Yao, Rong .
MATHEMATICAL CONTROL AND RELATED FIELDS, 2015, 5 (04) :827-844
[33]   Aperiodic Event-Triggered Synchronization Control for Neural Networks With Stochastic Perturbations and Time Delay [J].
Gong, Shuqing ;
Guo, Zhenyuan ;
Liu, Min ;
Wen, Shiping ;
Huang, Tingwen .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2023, 70 (06) :1986-1990
[34]   A Power and Area Efficient CMOS Stochastic Neuron for Neural Networks Employing Resistive Crossbar Array [J].
Yeo, Injune ;
Chu, Myonglae ;
Lee, Byung-Geun .
IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS, 2019, 13 (06) :1678-1689
[35]   The Stochastic generative model for cost effective OADM using the neural network in WDM access networks [J].
Hwang, IS ;
Lee, SN ;
Lin, YS .
PROCEEDINGS OF THE 6TH JOINT CONFERENCE ON INFORMATION SCIENCES, 2002, :1314-1317
[36]   Rule extraction: Using neural networks or for neural networks? [J].
Zhou, ZH .
JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2004, 19 (02) :249-253
[37]   Rule extraction: Using neural networks or for neural networks? [J].
Zhi-Hua Zhou .
Journal of Computer Science and Technology, 2004, 19 :249-253
[38]   NEURAL NETWORKS [J].
Magenreuter, Reinhard .
MATHEMATICS AND INFORMATICS, 2016, 59 (05) :526-538
[39]   Global asymptotic stability of stochastic reaction-diffusion neural networks with time delays in the leakage terms [J].
Li, Zhe ;
Xu, Rui .
COMMUNICATIONS IN NONLINEAR SCIENCE AND NUMERICAL SIMULATION, 2012, 17 (04) :1681-1689
[40]   Combining Deep Convolutional Neural Networks With Stochastic Ensemble Weight Optimization for Facial Expression Recognition in the Wild [J].
Choi, Jae Young ;
Lee, Bumshik .
IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 :100-111