Exact Implementation of Closed-Form Liquid Neural Networks With Arbitrary Precision

被引:1
作者
Cantini, Clotilde [1 ,2 ]
Rolland-Piegue, Emilie [1 ]
Schmitter, Daniel [1 ]
机构
[1] Swiss Life Machine Learning & AI Grp, CH-8022 Zurich, Switzerland
[2] Ecole Ponts ParisTech, F-77420 Champs sur Marne, France
关键词
Neurons; Synapses; Biological neural networks; Mathematical models; Electrocardiography; Training; Liquids; Data models; Computational modeling; Biological system modeling; Closed-form; continuous domain; deep learning; liquid time constant; neural networks; ordinary differential equation; sampling;
D O I
10.1109/LSP.2025.3539578
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Continuous-time liquid neural networks constitute a novel class of machine learning models that emulate the dynamics of biological neurons and synapses using ordinary differential equations. Despite their promising applications in predicting spatiotemporal dynamics, the adoption of these models has been constrained by their reliance on computationally expensive numerical differential equation solvers or approximate solutions. In this work, we propose a redefinition of the network's core neuron that accommodates for multiple presynaptic connections. We then derive a closed-form solution and present an implementation through a computationally efficient recursive algorithm. Our solution is validated both at the level of individual neurons and within a deep neural network architecture. Experimental results on sequential modeling tasks with image, sensor or medical data, demonstrate improved performance compared to state-of-the-art numerical and approximate methods.
引用
收藏
页码:921 / 925
页数:5
相关论文
共 27 条
[21]  
Salvi Cristopher, 2021, PR MACH LEARN RES, V139
[22]   A New Method for Solving Nonlinear Partial Differential Equations Based on Liquid Time-Constant Networks [J].
Sun, Jiuyun ;
Dong, Huanhe ;
Fang, Yong .
JOURNAL OF SYSTEMS SCIENCE & COMPLEXITY, 2024, 37 (02) :480-493
[23]   Interpolation revisited [J].
Thévenaz, P ;
Blu, T ;
Unser, M .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2000, 19 (07) :739-758
[24]   Sampling - 50 years after Shannon [J].
Unser, M .
PROCEEDINGS OF THE IEEE, 2000, 88 (04) :569-587
[25]   Splines Are Universal Solutions of Linear Inverse Problems with Generalized TV Regularization [J].
Unser, Michael ;
Fageot, Julien ;
Ward, John Paul .
SIAM REVIEW, 2017, 59 (04) :769-793
[26]  
Vidulin V, 2010, UCI Mach. Learn. Repository, DOI [10.24432/C57G8X, DOI 10.24432/C57G8X]
[27]  
Wicks SR, 1996, J NEUROSCI, V16, P4017