Generation of 3D LWIR thermal maps based on deep learning SLAM: feasibility and evaluation

被引:0
|
作者
Kim, Donyung [1 ]
Kim, Sungho [1 ]
机构
[1] Yeungnam Univ, Dept Elect Engn, Gyongsan, Gyeongsangbuk D, South Korea
来源
ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING FOR MULTI-DOMAIN OPERATIONS APPLICATIONS VI | 2024年 / 13051卷
基金
新加坡国家研究基金会;
关键词
Multi-Modal image processing; Vis-Lwir; SLAM; Thermal Map; Deep-Learning; 3D mapping; CNN; Multispectral;
D O I
10.1117/12.3013365
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Machine Learning has played a major role in various applications including Visual Slam and themal image process. In this paper, we discussed the possibility of generating a thermal map using LWIR images and a deep learning-based visual slam network and the value that the thermal map can create. We summarized the advantages and applicability of various deep learning-based visual slams and confirmed the results of nice slam, which generates the most curious Dense map. In order to apply Visual SLAM technology, time series, scene repetition, and images from various angles for one scene are required. However, most LWIR data sets consist of one shot for each scene or are unidirectional driving data. To solve this, we created a scenario using the LWIR driving dataset and created a repetitive route through repetition. RGB-Depth SLAM Mapping was performed on the constructed data set, and the results were evaluated and the limitations of the current approach were discussed. Finally, we summarized future directions for creating stable 3D thermal maps in indoor and outdoor environments by resolving the limitations.
引用
收藏
页数:5
相关论文
共 50 条
  • [41] Monocular thermal SLAM with neural radiance fields for 3D scene reconstruction
    Wu, Yuzhen
    Wang, Lingxue
    Zhang, Lian
    Chen, Mingkun
    Zhao, Wenqu
    Zheng, Dezhi
    Cai, Yi
    NEUROCOMPUTING, 2025, 617
  • [42] Deep Learning 3D Shape Surfaces Using Geometry Images
    Sinha, Ayan
    Bai, Jing
    Ramani, Karthik
    COMPUTER VISION - ECCV 2016, PT VI, 2016, 9910 : 223 - 240
  • [43] Automated evaluation of tumor spheroid behavior in 3D culture using deep learning-based recognition
    Chen, Zaozao
    Ma, Ning
    Sun, Xiaowei
    Li, Qiwei
    Zeng, Yi
    Chen, Fei
    Sun, Shiqi
    Xu, Jun
    Zhang, Jing
    Ye, Huan
    Ge, Jianjun
    Zhang, Zheng
    Cui, Xingran
    Leong, Kam
    Chen, Yang
    Gu, Zhongze
    BIOMATERIALS, 2021, 272
  • [44] Proposal of UAV-SLAM-Based 3D Point Cloud Map Generation Method for Orchards Measurements
    Nishiwaki, Soki
    Kondo, Haruki
    Yoshida, Shuhei
    Emaru, Takanori
    JOURNAL OF ROBOTICS AND MECHATRONICS, 2024, 36 (05) : 1001 - 1009
  • [45] Effective automated pipeline for 3D reconstruction of synapses based on deep learning
    Chi Xiao
    Weifu Li
    Hao Deng
    Xi Chen
    Yang Yang
    Qiwei Xie
    Hua Han
    BMC Bioinformatics, 19
  • [46] Single image 3D object reconstruction based on deep learning: A review
    Kui Fu
    Jiansheng Peng
    Qiwen He
    Hanxiao Zhang
    Multimedia Tools and Applications, 2021, 80 : 463 - 498
  • [47] Single image 3D object reconstruction based on deep learning: A review
    Fu, Kui
    Peng, Jiansheng
    He, Qiwen
    Zhang, Hanxiao
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (01) : 463 - 498
  • [48] 3D UNSUPERVISED KIDNEY GRAFT SEGMENTATION BASED ON DEEP LEARNING AND MULTI-SEQUENCE MRI
    Milecki, Leo
    Bodard, Sylvain
    Correas, Jean-Michel
    Timsit, Marc-Olivier
    Vakalopoulou, Maria
    2021 IEEE 18TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2021, : 1781 - 1785
  • [49] Steel surface defect detection based on deep learning 3D reconstruction
    Lan H.
    Yu J.-B.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2023, 57 (03): : 466 - 476+561
  • [50] Colorful 3D Reconstruction from Single Image Based on Deep Learning
    Zhu Yuzheng
    Zhang Yaping
    Feng Qiaosheng
    LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (14)