Multitask fatigue crack recognition network based on task similarity analysis

被引:2
作者
Gao, Tian [1 ]
Yuanzhou, Zhiyuan [1 ,2 ]
Ji, Bohai [1 ]
Xia, Junyuan [1 ]
机构
[1] Hohai Univ, Coll Civil & Transportat Engn, Nanjing 210098, Peoples R China
[2] Coll Civil & Transportat Engn, 1 Xikang Rd, Nanjing, Peoples R China
关键词
Fatigue cracks; Multitask learning; Task similarity analysis; Anti-attention mechanism; STEEL BRIDGES; JOINTS;
D O I
10.1016/j.ijfatigue.2023.107864
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
For fatigue cracks in steel box girder bridges, comprehensive perception is urgent and practical since it provides diverse damage information. Multitask learning networks, which learn multiple tasks jointly, could realize various detection tasks simultaneously. However, multitask networks are hard to avoid task conflicts, thus limiting recognition performance. In this study, the representational similarity analysis method was introduced to quantify task similarity, which helps decouple the parameters of unrelated tasks. Considering task correlation, a multitask network called CrackFormer was developed to recognize the initiation location, repair scene, and region morphology of fatigue cracks. From the perspective of learning difficulty, multiple tasks were trained and coordinated dynamically. Finally, the trained model was evaluated by comparative tests. Results showed that task similarity analysis was verified to be reasonable by transfer learning test. Compared with isolated tasks, CrackFormer demonstrated superior accuracy, efficiency, and robustness by mutual complementation of task knowledge. After optimizing the parameter sharing design, detection performance was further improved.
引用
收藏
页数:13
相关论文
共 42 条
[11]   Representation Similarity Analysis for Efficient Task Taxonomy & Transfer Learning [J].
Dwivedi, Kshitij ;
Roig, Gemma .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :12379-12388
[12]   Deep Multitask Learning for Railway Track Inspection [J].
Gibert, Xavier ;
Patel, VishalM. ;
Chellappa, Rama .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2017, 18 (01) :153-164
[13]   Pavement crack detection based on transformer network [J].
Guo, Feng ;
Qian, Yu ;
Liu, Jian ;
Yu, Huayang .
AUTOMATION IN CONSTRUCTION, 2023, 145
[14]   Dynamic Task Prioritization for Multitask Learning [J].
Guo, Michelle ;
Haque, Albert ;
Huang, De-An ;
Yeung, Serena ;
Li Fei-Fei .
COMPUTER VISION - ECCV 2018, PT XVI, 2018, 11220 :282-299
[15]  
Hendrycks D., 2016, ARXIV
[16]   Fatigue Performance of Rib-to-Deck Joints in Orthotropic Steel Decks with Thickened Edge U-Ribs [J].
Heng, Junlin ;
Zheng, Kaifeng ;
Gou, Chao ;
Zhang, Yu ;
Bao, Yi .
JOURNAL OF BRIDGE ENGINEERING, 2017, 22 (09)
[17]   Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics [J].
Kendall, Alex ;
Gal, Yarin ;
Cipolla, Roberto .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :7482-7491
[18]   Representational similarity analysis - connecting the branches of systems neuroscience [J].
Kriegeskorte, Nikolaus ;
Mur, Marieke ;
Bandettini, Peter .
FRONTIERS IN SYSTEMS NEUROSCIENCE, 2008, 2
[19]   Experimental Study on Fatigue Resistance of Rib-to-Deck Joint in Orthotropic Steel Bridge Deck [J].
Li, Ming ;
Suzuki, Yasuo ;
Hashimoto, Kunitaro ;
Sugiura, Kunitomo .
JOURNAL OF BRIDGE ENGINEERING, 2018, 23 (02)
[20]   Focal Loss for Dense Object Detection [J].
Lin, Tsung-Yi ;
Goyal, Priya ;
Girshick, Ross ;
He, Kaiming ;
Dollar, Piotr .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (02) :318-327