BearingFM: Towards a foundation model for bearing fault diagnosis by domain knowledge and contrastive learning

被引:6
作者
Lai, Zou [1 ]
Yang, Chen [2 ]
Lan, Shulin [3 ]
Wang, Lihui [4 ]
Shen, Weiming [5 ]
Zhu, Liehuang [2 ]
机构
[1] Beijing Inst Technol, Sch Comp Sci & Technol, Beijing, Peoples R China
[2] Beijing Inst Technol, Sch Cyberspace Sci & Technol, Beijing, Peoples R China
[3] Univ Chinese Acad Sci, Sch Econ & Management, Beijing, Peoples R China
[4] KTH Royal Inst Technol, Dept Prod Engn, Stockholm, Sweden
[5] Huazhong Univ Sci & Technol, State Key Lab Digital Mfg Equipment & Technol, Wuhan, Peoples R China
基金
国家重点研发计划;
关键词
Fault diagnosis; Foundation model; Semi-supervised learning; Cloud-edge-end collaboration; Contrastive learning;
D O I
10.1016/j.ijpe.2024.109319
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Monitoring bearing failures in production equipment can effectively prevent finished product quality issues and unplanned factory downtime, thereby reducing supply chain uncertainties and risk. Therefore, monitoring bearing failures in production equipment is important for improving supply chain sustainability. Due to the generalization limitations of neural network models, specific models must be trained for specific tasks. However, in real industrial scenarios, there is a severe lack of labeled samples, making it difficult to deploy fault diagnosis models across massive amounts of equipment in workshops. In order to solve the above issue, this paper proposes a cloud-edge-end collaborative semi-supervised learning framework, which provides multilevel computing power and data support for building a foundation model. A data augmentation method based on the bearing fault mechanism is proposed, which effectively preserves the inherent essential characteristics in vibration signals by normalizing frequency and adding noise in specific frequency bands. A novel contrastive learning model is designed, which narrows the distances between positive samples and widens the distances between negative samples in the high-dimensional space through cross comparisons in the time dimension and knowledge dimension, thereby extracting the most essential characteristics from the unlabeled signals. Multiple sets of experiments conducted on four datasets demonstrate that the proposed approach achieves an approximately 98% fault classification accuracy with only 1.2% labeled samples.
引用
收藏
页数:10
相关论文
共 46 条
[1]   A Survey on Mobility of Edge Computing Networks in IoT: State-of-the-Art, Architectures, and Challenges [J].
Abkenar, Forough Shirin ;
Ramezani, Parisa ;
Iranmanesh, Saeid ;
Murali, Sarumathi ;
Chulerttiyawong, Donpiti ;
Wan, Xinyu ;
Jamalipour, Abbas ;
Raad, Raad .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2022, 24 (04) :2329-2365
[2]  
Achiam J., 2024, Gpt-4 technical report, DOI 10.48550/arXiv.2303.08774
[3]  
Chang C, 2023, Arxiv, DOI [arXiv:2308.08469, 10.1145/3719207]
[4]  
Chen T, 2020, PR MACH LEARN RES, V119
[5]   Self-Supervised Contrastive Representation Learning for Semi-Supervised Time-Series Classification [J].
Eldele, Emadeldeen ;
Ragab, Mohamed ;
Chen, Zhenghua ;
Wu, Min ;
Kwoh, Chee-Keong ;
Li, Xiaoli ;
Guan, Cuntai .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (12) :15604-15618
[6]   Machine learning-based predictive maintenance: A cost-oriented model for implementation [J].
Florian, Eleonora ;
Sgarbossa, Fabio ;
Zennaro, Ilenia .
INTERNATIONAL JOURNAL OF PRODUCTION ECONOMICS, 2021, 236
[7]   A Survey on Vision Transformer [J].
Han, Kai ;
Wang, Yunhe ;
Chen, Hanting ;
Chen, Xinghao ;
Guo, Jianyuan ;
Liu, Zhenhua ;
Tang, Yehui ;
Xiao, An ;
Xu, Chunjing ;
Xu, Yixing ;
Yang, Zhaohui ;
Zhang, Yiman ;
Tao, Dacheng .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (01) :87-110
[8]   Interinstance and Intratemporal Self-Supervised Learning With Few Labeled Data for Fault Diagnosis [J].
Hu, Chenye ;
Wu, Jingyao ;
Sun, Chuang ;
Yan, Ruqiang ;
Chen, Xuefeng .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (05) :6502-6512
[9]   A Survey of Self-Supervised and Few-Shot Object Detection [J].
Huang, Gabriel ;
Laradji, Issam ;
Vazquez, David ;
Lacoste-Julien, Simon ;
Rodriguez, Pau .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (04) :4071-4089
[10]   Classifier Inconsistency-Based Domain Adaptation Network for Partial Transfer Intelligent Diagnosis [J].
Jiao, Jinyang ;
Zhao, Ming ;
Lin, Jing ;
Ding, Chuancang .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2020, 16 (09) :5965-5974