Exact Implementation of Closed-Form Liquid Neural Networks With Arbitrary Precision

被引:1
作者
Cantini, Clotilde [1 ,2 ]
Rolland-Piegue, Emilie [1 ]
Schmitter, Daniel [1 ]
机构
[1] Swiss Life Machine Learning & AI Grp, CH-8022 Zurich, Switzerland
[2] Ecole Ponts ParisTech, F-77420 Champs sur Marne, France
关键词
Neurons; Synapses; Biological neural networks; Mathematical models; Electrocardiography; Training; Liquids; Data models; Computational modeling; Biological system modeling; Closed-form; continuous domain; deep learning; liquid time constant; neural networks; ordinary differential equation; sampling;
D O I
10.1109/LSP.2025.3539578
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Continuous-time liquid neural networks constitute a novel class of machine learning models that emulate the dynamics of biological neurons and synapses using ordinary differential equations. Despite their promising applications in predicting spatiotemporal dynamics, the adoption of these models has been constrained by their reliance on computationally expensive numerical differential equation solvers or approximate solutions. In this work, we propose a redefinition of the network's core neuron that accommodates for multiple presynaptic connections. We then derive a closed-form solution and present an implementation through a computationally efficient recursive algorithm. Our solution is validated both at the level of individual neurons and within a deep neural network architecture. Experimental results on sequential modeling tasks with image, sensor or medical data, demonstrate improved performance compared to state-of-the-art numerical and approximate methods.
引用
收藏
页码:921 / 925
页数:5
相关论文
共 27 条
[1]  
Bidollahkhani M, 2023, Arxiv, DOI arXiv:2304.08691
[2]  
Chen RTQ, 2018, ADV NEURAL INFORM PR, V31, DOI DOI 10.48550/ARXIV.1806.07366
[3]  
Dai Yimin, 2024, 2024 23rd ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN), P14, DOI 10.1109/IPSN61024.2024.00006
[4]  
Euler L., 1913, Opera Omnia, V11, P424
[5]   APPROXIMATION OF DYNAMICAL-SYSTEMS BY CONTINUOUS-TIME RECURRENT NEURAL NETWORKS [J].
FUNAHASHI, K ;
NAKAMURA, Y .
NEURAL NETWORKS, 1993, 6 (06) :801-806
[6]   A Public Domain Dataset for Real-Life Human Activity Recognition Using Smartphone Sensors [J].
Garcia-Gonzalez, Daniel ;
Rivero, Daniel ;
Fernandez-Blanco, Enrique ;
Luaces, Miguel R. .
SENSORS, 2020, 20 (08)
[7]  
Gu A., 2022, ICLR, P8
[8]   Closed-form continuous-time neural networks [J].
Hasani, Ramin ;
Lechner, Mathias ;
Amini, Alexander ;
Liebenwein, Lucas ;
Ray, Aaron ;
Tschaikowski, Max ;
Teschl, Gerald ;
Rus, Daniela .
NATURE MACHINE INTELLIGENCE, 2022, 4 (11) :992-+
[9]  
Hasani R, 2021, AAAI CONF ARTIF INTE, V35, P7657
[10]  
Hindmarsh A. C., 2005, LSODA, Ordinary Differential Equation Solver for Stiff or NonStiff System,