Generation of 3D LWIR thermal maps based on deep learning SLAM: feasibility and evaluation

被引:0
|
作者
Kim, Donyung [1 ]
Kim, Sungho [1 ]
机构
[1] Yeungnam Univ, Dept Elect Engn, Gyongsan, Gyeongsangbuk D, South Korea
来源
ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING FOR MULTI-DOMAIN OPERATIONS APPLICATIONS VI | 2024年 / 13051卷
基金
新加坡国家研究基金会;
关键词
Multi-Modal image processing; Vis-Lwir; SLAM; Thermal Map; Deep-Learning; 3D mapping; CNN; Multispectral;
D O I
10.1117/12.3013365
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Machine Learning has played a major role in various applications including Visual Slam and themal image process. In this paper, we discussed the possibility of generating a thermal map using LWIR images and a deep learning-based visual slam network and the value that the thermal map can create. We summarized the advantages and applicability of various deep learning-based visual slams and confirmed the results of nice slam, which generates the most curious Dense map. In order to apply Visual SLAM technology, time series, scene repetition, and images from various angles for one scene are required. However, most LWIR data sets consist of one shot for each scene or are unidirectional driving data. To solve this, we created a scenario using the LWIR driving dataset and created a repetitive route through repetition. RGB-Depth SLAM Mapping was performed on the constructed data set, and the results were evaluated and the limitations of the current approach were discussed. Finally, we summarized future directions for creating stable 3D thermal maps in indoor and outdoor environments by resolving the limitations.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] A survey of deep learning-based 3D shape generation
    Xu, Qun-Ce
    Mu, Tai-Jiang
    Yang, Yong-Liang
    COMPUTATIONAL VISUAL MEDIA, 2023, 9 (03) : 407 - 442
  • [2] 3D Ship Model Generation Algorithm Based on Deep Learning
    Wang X.
    Zhao Y.
    Zhang J.
    Wang S.
    Binggong Xuebao/Acta Armamentarii, 2022, 43 : 115 - 119
  • [3] A survey of deep learning-based 3D shape generation
    Qun-Ce Xu
    Tai-Jiang Mu
    Yong-Liang Yang
    Computational Visual Media, 2023, 9 : 407 - 442
  • [4] Expression dynamic capture and 3D animation generation method based on deep learning
    Wang, Baoqing
    Shi, Yujie
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (12) : 8797 - 8808
  • [5] Expression dynamic capture and 3D animation generation method based on deep learning
    Baoqing Wang
    Yujie Shi
    Neural Computing and Applications, 2023, 35 : 8797 - 8808
  • [6] A feasibility study on deep learning-based individualized 3D dose distribution prediction
    Ma, Jianhui
    Nguyen, Dan
    Bai, Ti
    Folkerts, Michael
    Jia, Xun
    Lu, Weiguo
    Zhou, Linghong
    Jiang, Steve
    MEDICAL PHYSICS, 2021, 48 (08) : 4438 - 4447
  • [7] DEEP LEARNING FOR 3D SHAPE CLASSIFICATION FROM MULTIPLE DEPTH MAPS
    Zanuttigh, Pietro
    Minto, Ludovico
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 3615 - 3619
  • [8] Spatial Signal Strength Prediction using 3D Maps and Deep Learning
    Krijestorac, Enes
    Hanna, Samer
    Cabric, Danijela
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2021), 2021,
  • [9] 3D Face Recognition Based on Deep Learning
    Luo, Jing
    Hu, Fei
    Wang, Ruihuan
    2019 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION (ICMA), 2019, : 1576 - 1581
  • [10] Evaluation of Lidar-based 3D SLAM algorithms in SubT environment
    Koval, Anton
    Kanellakis, Christoforos
    Nikolakopoulos, George
    IFAC PAPERSONLINE, 2022, 55 (38): : 126 - 131