Recurrent neural network based on attention mechanism in prediction of glass forming ability by element proportion

被引:0
|
作者
Xie, Ji-xing [1 ]
Liang, Yong-chao [1 ]
Sun, Bo [1 ]
Pu, Yuan-wei [1 ]
Wang, Meng-qi [1 ]
Qin, Zhi-fa [1 ]
机构
[1] Guizhou Univ, Inst Adv Optoelect Mat & Technol, Sch Big Data & informat Engn, Guiyang 550025, Peoples R China
来源
MATERIALS TODAY COMMUNICATIONS | 2024年 / 38卷
基金
中国国家自然科学基金;
关键词
Glass forming ability; Amorphous alloy; Attention mechanism; Recurrent neural network; Element combination; METALLIC GLASSES; TEMPERATURE; CRITERION; LIQUID;
D O I
10.1016/j.mtcomm.2023.107853
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
The traditional trial and error method is time-consuming and laborious to study glass forming ability (GFA), so it is necessary to design a fast and accurate method to predict GFA. In this paper, four deep learning models of BidiRNN, BidiLSTM, Attention-BidiRNN and Attention-BidiLSTM are constructed by using recurrent neural network (RNN) and Attention mechanism, and the GFA of alloys is directly predicted by element proportion. After model selection and model evaluation through cross-validation, the prediction accuracy of the four models on the test set is 0.727, 0.796, 0.822 and 0.843, respectively, which has good generalization performance. Since amorphous alloys usually have high similarity to similar alloy systems, the attention mechanism can dynamically identify alloys with high similarity to the current prediction task. By weight matching, the feature extraction ability of the model is enhanced, and the prediction accuracy of Attention-BidiRNN and Attention-BidiLSTM is 9.05% and 4.7% higher than that of BidiRNN and BidiLSTM, respectively. Finally, two systems of CuZrAl and CuCeGa are predicted in this paper, and the reliability of the model is verified by experimental data. This realization of predicting GFA only by combination of elements is expected to provide important guidance for the development and preparation of novel amorphous alloys.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Prediction of amorphous forming ability based on artificial neural network and convolutional neural network
    Lu, Fei
    Liang, Yongchao
    Wang, Xingying
    Gao, Tinghong
    Chen, Qian
    Liu, Yunchun
    Zhou, Yu
    Yuan, Yongkai
    Liu, Yutao
    COMPUTATIONAL MATERIALS SCIENCE, 2022, 210
  • [2] Optimization of convolutional neural network for glass-forming ability prediction based on particle swarm optimization
    Wang, Meng-qi
    Liang, Yong-chao
    Sun, Bo
    Pu, Yuan-wei
    Xie, Ji-xing
    MATERIALS TODAY COMMUNICATIONS, 2023, 36
  • [3] Gesture Class Prediction by Recurrent Neural Network and Attention Mechanism
    Yunus, Fajrian
    Clavel, Chloe
    Pelachaud, Catherine
    PROCEEDINGS OF THE 19TH ACM INTERNATIONAL CONFERENCE ON INTELLIGENT VIRTUAL AGENTS (IVA' 19), 2019, : 233 - 235
  • [4] Prediction of glass forming ability of bulk metallic glasses based on convolutional neural network
    Zhang, Ting
    Long, Zhilin
    Peng, Li
    Li, Zhuang
    JOURNAL OF NON-CRYSTALLINE SOLIDS, 2022, 595
  • [5] Attention-based Recurrent Neural Network for Traffic Flow Prediction
    Chen, Qi
    Wang, Wei
    Huang, Xin
    Liang, Hai-ning
    JOURNAL OF INTERNET TECHNOLOGY, 2020, 21 (03): : 831 - 839
  • [6] Prediction of glass forming ability in amorphous alloys based on different machine learning algorithms
    Liu, Xiaowei
    Long, Zhilin
    Yang, Lingming
    Zhang, Wei
    Li, Zhuang
    JOURNAL OF NON-CRYSTALLINE SOLIDS, 2021, 570
  • [7] Recurrent neural network with attention mechanism for language model
    Chen, Mu-Yen
    Chiang, Hsiu-Sen
    Sangaiah, Arun Kumar
    Hsieh, Tsung-Che
    NEURAL COMPUTING & APPLICATIONS, 2020, 32 (12) : 7915 - 7923
  • [8] Recurrent neural network with attention mechanism for language model
    Mu-Yen Chen
    Hsiu-Sen Chiang
    Arun Kumar Sangaiah
    Tsung-Che Hsieh
    Neural Computing and Applications, 2020, 32 : 7915 - 7923
  • [9] Attention-based Recurrent Neural Network for Urban Vehicle Trajectory Prediction
    Choi, Seongjin
    Kim, Jiwon
    Yeo, Hwasoo
    10TH INTERNATIONAL CONFERENCE ON AMBIENT SYSTEMS, NETWORKS AND TECHNOLOGIES (ANT 2019) / THE 2ND INTERNATIONAL CONFERENCE ON EMERGING DATA AND INDUSTRY 4.0 (EDI40 2019) / AFFILIATED WORKSHOPS, 2019, 151 : 327 - 334
  • [10] Prediction of Network Security Situation Based on Attention Mechanism and Convolutional Neural Network-Gated Recurrent Unit
    Feng, Yuan
    Zhao, Hongying
    Zhang, Jianwei
    Cai, Zengyu
    Zhu, Liang
    Zhang, Ran
    APPLIED SCIENCES-BASEL, 2024, 14 (15):