Multi-modal sensor fusion with machine learning for data-driven process monitoring for additive manufacturing

被引:69
|
作者
Petrich, Jan [1 ]
Snow, Zack [1 ]
Corbin, David [1 ]
Reutzel, Edward W. [1 ]
机构
[1] Penn State Univ, Appl Res Lab, University Pk, PA 16804 USA
关键词
LASER; EMISSION; QUALITY;
D O I
10.1016/j.addma.2021.102364
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
This paper presents a complete concept and validation scheme for potential inter-layer flaw detection from in-situ process monitoring for powder bed fusion additive manufacturing (PBFAM) using supervised machine learning. Specifically, the presented work establishes a meaningful statistical correlation between (i) the multi-modal sensor footprint acquired during the build process, and (ii) the existence of flaws as indicated by post-build X-ray Computed Tomography (CT) scans. Multiple sensor modalities, such as layerwise imagery (both pre and post laser scan), acoustic and multi-spectral emissions, and information derived from the scan vector trajectories, contribute to the process footprint. Data registration techniques to properly merge spatial and temporal information are presented in detail. As a proofof-concept, a neural network is used to fuse all available modalities, and discriminate flaws from nominal build conditions using only in-situ data. Experimental validation was carried out using a PBFAM sensor testbed available at PSU/ARL. Using four-fold cross-validation on a voxel-by-voxel basis, the null hypothesis, i.e. absence of a defect, was rejected at a rate corresponding to 98.5% accuracy for binary classification. Additionally, a sensitivity study was conducted to assess the information content contributed by the individual sensor modalities. Information content was assessed by evaluating the resulting correlation as classification performance when using only a single modality or a subset of modalities. Although optical imagery contains the highest amount of information for flaw detection, additional information content observed in other modalities significantly improved classification performance.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] A MULTI-MODAL DATA-DRIVEN DECISION FUSION METHOD FOR PROCESS MONITORING IN METAL POWDER BED FUSION ADDITIVE MANUFACTURING
    Yang, Zhuo
    Kim, Jaehyuk
    Lu, Yan
    Yeung, Ho
    Lane, Brandon
    Jones, Albert
    Ndiaye, Yande
    PROCEEDINGS OF 2022 INTERNATIONAL ADDITIVE MANUFACTURING CONFERENCE, IAM2022, 2022,
  • [2] Monitoring Canopy Height in the Hainan Tropical Rainforest Using Machine Learning and Multi-Modal Data Fusion
    Ling, Qingping
    Chen, Yingtan
    Feng, Zhongke
    Pei, Huiqing
    Wang, Cai
    Yin, Zhaode
    Qiu, Zixuan
    REMOTE SENSING, 2025, 17 (06)
  • [3] Recent advances in data-driven fusion of multi-modal imaging and genomics for precision medicine
    Wang, Shuo
    Liu, Meng
    Li, Yan
    Zhang, Xinyu
    Sun, Mengting
    Wang, Zian
    Li, Ruokun
    Li, Qirong
    Li, Qing
    He, Yili
    Hu, Xumei
    Sun, Longyu
    Yan, Fuhua
    Yu, Mengyao
    Ding, Weiping
    Wang, Chengyan
    INFORMATION FUSION, 2025, 115
  • [4] Multi-modal man-machine data-driven service design for check-in experience
    Lu W.
    Jiang G.
    Xue Y.
    Guo Q.
    Tian W.
    Jisuanji Jicheng Zhizao Xitong/Computer Integrated Manufacturing Systems, CIMS, 2022, 28 (03): : 907 - 917
  • [5] Quantum Machine Learning for Additive Manufacturing Process Monitoring
    Choi, Eunsik
    Sul, Jinhwan
    Kim, Jungin E.
    Hong, Sungjin
    Gonzalez, Beatriz Izquierdo
    Cembellin, Pablo
    Wang, Yan
    MANUFACTURING LETTERS, 2024, 41 : 1415 - 1422
  • [6] Quantum machine learning for additive manufacturing process monitoring
    Choi, Eunsik
    Sul, Jinhwan
    Kim, Jungin E.
    Hong, Sungjin
    Gonzalez, Beatriz Izquierdo
    Cembellin, Pablo
    Wang, Yan
    Manufacturing Letters, 2024, 41 : 1415 - 1422
  • [7] Fusion Machine Learning Strategies for Multi-modal Sensor-based Hand Gesture Recognition
    Huong-Giang Doan
    Ngoc-Trung Nguyen
    ENGINEERING TECHNOLOGY & APPLIED SCIENCE RESEARCH, 2022, 12 (03) : 8628 - 8633
  • [8] Multi phenomena melt pool sensor data fusion for enhanced process monitoring of laser powder bed fusion additive manufacturing
    Gaikwad, Aniruddha
    Williams, Richard J.
    de Winton, Harry
    Bevans, Benjamin D.
    Smoqi, Ziyad
    Rao, Prahalada
    Hooper, Paul A.
    MATERIALS & DESIGN, 2022, 221
  • [9] A novel solution for data uncertainty and insufficient in data-driven chiller fault diagnosis based on multi-modal data fusion
    You, Yuwen
    Zhao, Yuan
    Ke, Yan
    Tang, Junhao
    Yang, Bin
    ENERGY AND BUILDINGS, 2025, 328
  • [10] Data-driven planning of reliable itineraries in multi-modal transit networks
    Redmond, Michael
    Campbell, Ann Melissa
    Ehmke, Jan Fabian
    PUBLIC TRANSPORT, 2020, 12 (01) : 171 - 205