Machine learning at the mesoscale: A computation-dissipation bottleneck

被引:1
|
作者
Ingrosso, Alessandro [1 ]
Panizon, Emanuele [1 ]
机构
[1] Abdus Salam Int Ctr Theoret Phys, Quantitat Life Sci, I-34151 Trieste, Italy
关键词
RANDOMLY ASYMMETRIC BONDS; LANDAUERS PRINCIPLE; SPIN SYSTEMS; THERMODYNAMICS; IRREVERSIBILITY; INFORMATION; DYNAMICS; STATE;
D O I
10.1103/PhysRevE.109.014132
中图分类号
O35 [流体力学]; O53 [等离子体物理学];
学科分类号
070204 ; 080103 ; 080704 ;
摘要
The cost of information processing in physical systems calls for a trade-off between performance and energetic expenditure. Here we formulate and study a computation-dissipation bottleneck in mesoscopic systems used as input-output devices. Using both real data sets and synthetic tasks, we show how nonequilibrium leads to enhanced performance. Our framework sheds light on a crucial compromise between information compression, input-output computation and dynamic irreversibility induced by nonreciprocal interactions.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Application of machine learning approaches in the computation of energy dissipation over rectangular stepped spillway
    Pujari, Saurabh
    Kaushik, Vijay
    Awasthi, Noopur
    Gupta, Shailesh Kumar
    Kumar, S. Anbu
    H2OPEN JOURNAL, 2023, 6 (03) : 433 - 448
  • [2] Dissipation in mesoscale superfluids
    Del Maestro, Adrian
    Rosenow, Bernd
    PHYSICAL REVIEW B, 2017, 95 (14)
  • [3] Finding Bottleneck in Machine Learning Model Life Cycle
    Meena, Chandra Mohan
    Suman, Sarwesh
    Agneeswaran, Vijay
    PROCEEDINGS OF THE 2020 USENIX CONFERENCE ON OPERATIONAL MACHINE LEARNING (OPML '20), 2020, : 5 - 7
  • [4] The information bottleneck problem and its applications in machine learning
    Goldfeld Z.
    Polyanskiy Y.
    IEEE Journal on Selected Areas in Information Theory, 2020, 1 (01): : 19 - 38
  • [5] Evolutionary Computation and Machine Learning in Security
    Picek, Stjepan
    Jakobovic, Domagoj
    PROCEEDINGS OF THE 2022 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE COMPANION, GECCO 2022, 2022, : 1572 - 1601
  • [6] Bridging machine learning and evolutionary computation
    Kwong, Sam
    Zhang, Qingfu
    NEUROCOMPUTING, 2014, 146 : 1 - 1
  • [7] DISSIPATION IN COMPUTATION
    BIEDERMANN, E
    NATURE, 1989, 340 (6236) : 681 - 681
  • [8] DISSIPATION IN COMPUTATION
    POROD, W
    GRONDIN, RO
    FERRY, DK
    POROD, G
    PHYSICAL REVIEW LETTERS, 1984, 52 (03) : 232 - 235
  • [9] Mesoscale Machine Learning Analytics for Electrode Property Estimation
    Kabra, Venkatesh
    Birn, Brennan
    Kamboj, Ishita
    Augustyn, Veronica
    Mukherjee, Partha P.
    JOURNAL OF PHYSICAL CHEMISTRY C, 2022, 126 (34): : 14413 - 14429
  • [10] Fighting Knowledge Acquisition Bottleneck with Argument Based Machine Learning
    Mozina, Martin
    Guid, Matej
    Krivec, Jana
    Sadikov, Aleksander
    Bratko, Ivan
    ECAI 2008, PROCEEDINGS, 2008, 178 : 234 - +