DiskTransformer: A Transformer Network for Hard Disk Failure Prediction

被引:0
|
作者
Ge, Wenqiang [1 ]
Liu, Peishun [1 ]
Zhang, Mingyu [1 ]
Zhang, Zhen [1 ]
Lai, Yiwan [1 ]
机构
[1] Ocean Univ China, Fac Informat Sci & Engn, Qingdao, Peoples R China
来源
2024 7TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND BIG DATA, ICAIBD 2024 | 2024年
基金
国家重点研发计划;
关键词
hard disk drive; failure prediction; time-series feature extraction; Transformer; feature fusion;
D O I
10.1109/ICAIBD62003.2024.10604547
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The hard disk drive is one of the most commonly damaged components in data centers, which can cause a lot of losses such as unexpected shutdowns and data loss. Therefore, the prediction of hard disk drive failures has received widespread attention in data center management. Existing work has made remarkable progress in the accuracy of failure prediction. However, the prediction performance for long-term failure and small-sample disks is not satisfactory. To address this issue, we propose a new method for hard disk failure prediction. The framework consists of a time-series feature extraction network and a prediction network. The time-series feature extraction network is composed of a Temporal Convolutional Network used to extract different dimensional relationships and a set of Long Short Term Memory networks used to extract independent dimensional time-series features. The prediction network uses a Transformer model, which can fully utilize the high-quality fused features extracted by the time-series feature extraction network for disk drive failure prediction. Experimental results on public datasets have demonstrated that our proposed method can not only predict long-term failure but also has reliable prediction performance when facing small-sample disk data.
引用
收藏
页码:327 / 332
页数:6
相关论文
共 50 条
  • [1] Hard disk drive reliability modeling and failure prediction
    Strom, Brian D.
    Lee, SungChang
    Tyndall, George W.
    Khurshudov, Andrei
    IEEE TRANSACTIONS ON MAGNETICS, 2007, 43 (09) : 3676 - 3684
  • [2] Machine Learning Model Update Strategies for Hard Disk Drive Failure Prediction
    Zufle, Marwin
    Erhard, Florian
    Kounev, Samuel
    20TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA 2021), 2021, : 1379 - 1386
  • [3] Hard Disk Failure Prediction Based on Blending Ensemble Learning
    Zhang, Mingyu
    Ge, Wenqiang
    Tang, Ruichun
    Liu, Peishun
    APPLIED SCIENCES-BASEL, 2023, 13 (05):
  • [4] Hard Disk Drive Failure Analysis and Prediction: An Industry View
    Miller, Zach
    Medaiyese, Olusiji
    Ravi, Madhavan
    Beatty, Alex
    Lin, Fred
    2023 53RD ANNUAL IEEE/IFIP INTERNATIONAL CONFERENCE ON DEPENDABLE SYSTEMS AND NETWORKS - SUPPLEMENTAL VOLUME, DSN-S, 2023, : 21 - 27
  • [5] Thermal network model for temperature prediction in hard disk drive
    Yee Leong Low
    B. L. Ibrahim See
    C. P. H. Tan
    J. Q. Mou
    E. H. Ong
    Microsystem Technologies, 2009, 15 : 1653 - 1656
  • [6] Evaluation of Recurrent Neural Networks for Hard Disk Drives Failure Prediction
    Lima, Fernando Dione S.
    Pereira, Francisco Lucas F.
    Chaves, Iago C.
    Gomes, Joao Paulo P.
    Machado, Javam C.
    2018 7TH BRAZILIAN CONFERENCE ON INTELLIGENT SYSTEMS (BRACIS), 2018, : 85 - 90
  • [7] Random-forest-based failure prediction for hard disk drives
    Shen, Jing
    Wan, Jian
    Lim, Se-Jung
    Yu, Lifeng
    INTERNATIONAL JOURNAL OF DISTRIBUTED SENSOR NETWORKS, 2018, 14 (11):
  • [8] A Two-Step Parametric Method for Failure Prediction in Hard Disk Drives
    Wang, Yu
    Ma, Eden W. M.
    Chow, Tommy W. S.
    Tsui, Kwok-Leung
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2014, 10 (01) : 419 - 430
  • [9] Hard Disk Drive Failure Mode Prediction based on Industrial Standard using Decision Tree Learning
    Suchatpong, Thanadon
    Bhumkittipich, Krischonme
    2014 11TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING/ELECTRONICS, COMPUTER, TELECOMMUNICATIONS AND INFORMATION TECHNOLOGY (ECTI-CON), 2014,
  • [10] Disk Failure Prediction in Data Centers via Online Learning
    Xiao, Jiang
    Xiong, Zhuang
    Wu, Song
    Yi, Yusheng
    Jin, Hai
    Hu, Kan
    PROCEEDINGS OF THE 47TH INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING, 2018,