Bridging the Gap between Transformer-Based Neural Networks and Tensor Networks for Quantum Chemistry

被引:0
|
作者
Kan, Bowen [1 ,2 ]
Tian, Yingqi [1 ]
Wu, Yangjun [3 ]
Zhang, Yunquan [1 ]
Shang, Honghui [3 ]
机构
[1] Chinese Acad Sci, Inst Comp Technol, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100190, Peoples R China
[3] Univ Sci & Technol China, Key Lab Precis & Intelligent Chem, Hefei 230026, Peoples R China
基金
中国国家自然科学基金;
关键词
WAVE-FUNCTIONS; STATE;
D O I
10.1021/acs.jctc.4c01703
中图分类号
O64 [物理化学(理论化学)、化学物理学];
学科分类号
070304 ; 081704 ;
摘要
The neural network quantum state (NNQS) method has demonstrated promising results in ab initio quantum chemistry, achieving remarkable accuracy in molecular systems. However, efficient calculation of systems with large active spaces remains challenging. This study introduces a novel approach that bridges tensor network states with the transformer-based NNQS-Transformer (QiankunNet) to enhance accuracy and convergence for systems with relatively large active spaces. By transforming tensor network states into active space configuration interaction type wave functions, QiankunNet achieves accuracy surpassing both the pretraining density matrix renormalization group (DMRG) results and traditional coupled cluster methods, particularly in strongly correlated regimes. We investigate two configuration transformation methods: the sweep-based direct conversion (Conv.) method and the entanglement-driven genetic algorithm (EDGA) method, with Conv. showing superior efficiency. The effectiveness of this approach is validated on H2O with a large active space (10e, 24o) in the cc-pVDZ basis set, demonstrating an efficient routine between DMRG and QiankunNet and also offering a promising direction for advancing quantum state representation in complex molecular systems.
引用
收藏
页码:3426 / 3439
页数:14
相关论文
共 50 条
  • [41] SparseProp: Efficient Event-Based Simulation and Training of Sparse Recurrent Spiking Neural Networks
    Engelken, Rainer
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [42] Remaining Useful Life Prediction for a Roller in a Hot Strip Mill Based on Deep Recurrent Neural Networks
    Jiao, Ruihua
    Peng, Kaixiang
    Dong, Jie
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2021, 8 (07) : 1345 - 1354
  • [43] Discovery of Spin-Crossover Materials with Equivariant Graph Neural Networks and Relevance-Based Classification
    Albavera-Mata, Angel
    Prakash, Pawan
    Gibson, Jason B.
    Fonseca, Eric
    Ren, Sijin
    Zhang, Xiao-Guang
    Cheng, Hai-Ping
    Shatruk, Michael
    Trickey, S. B.
    Hennig, Richard G.
    JOURNAL OF CHEMICAL THEORY AND COMPUTATION, 2025,
  • [44] Extended Dissipativity Performance for the Delayed Discrete-Time Neural Networks with Observer-Based Control
    Adhira, B.
    Nagamani, G.
    NEURAL PROCESSING LETTERS, 2023, 55 (02) : 927 - 947
  • [45] Global exponential synchronization of memristor-based recurrent neural networks with time-varying delays
    Wen, Shiping
    Bao, Gang
    Zeng, Zhigang
    Chen, Yiran
    Huang, Tingwen
    NEURAL NETWORKS, 2013, 48 : 195 - 203
  • [46] Machine fault diagnosis using a cluster-based wavelet feature extraction and probabilistic neural networks
    Yu, Gang
    Li, Changning
    Kamarthi, Sagar
    INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2009, 42 (1-2) : 145 - 151
  • [47] Secure Communication Based on Quantized Synchronization of Chaotic Neural Networks Under an Event-Triggered Strategy
    He, Wangli
    Luo, Tinghui
    Tang, Yang
    Du, Wenli
    Tian, Yu-Chu
    Qian, Feng
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (09) : 3334 - 3345
  • [48] DRM-ETP: A Dynamic Rate Matching-Based Entanglement Transport Protocol in Quantum Networks
    Li, Jian
    Wang, Zhaoying
    Xue, Kaiping
    Li, Zhonghui
    Li, Ruidong
    Yu, Nenghai
    Sun, Qibin
    Lu, Jun
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2024,
  • [49] Decision support system for water distribution systems based on neural networks and graphs theory for leakage detection
    Arsene, Corneliu T. C.
    Gabrys, Bogdan
    Al-Dabass, David
    EXPERT SYSTEMS WITH APPLICATIONS, 2012, 39 (18) : 13214 - 13224
  • [50] A data-driven approach based on deep neural networks for lithium-ion battery prognostics
    Kara, Ahmet
    NEURAL COMPUTING & APPLICATIONS, 2021, 33 (20) : 13525 - 13538