Generation of 3D LWIR thermal maps based on deep learning SLAM: feasibility and evaluation

被引:0
|
作者
Kim, Donyung [1 ]
Kim, Sungho [1 ]
机构
[1] Yeungnam Univ, Dept Elect Engn, Gyongsan, Gyeongsangbuk D, South Korea
来源
ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING FOR MULTI-DOMAIN OPERATIONS APPLICATIONS VI | 2024年 / 13051卷
基金
新加坡国家研究基金会;
关键词
Multi-Modal image processing; Vis-Lwir; SLAM; Thermal Map; Deep-Learning; 3D mapping; CNN; Multispectral;
D O I
10.1117/12.3013365
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Machine Learning has played a major role in various applications including Visual Slam and themal image process. In this paper, we discussed the possibility of generating a thermal map using LWIR images and a deep learning-based visual slam network and the value that the thermal map can create. We summarized the advantages and applicability of various deep learning-based visual slams and confirmed the results of nice slam, which generates the most curious Dense map. In order to apply Visual SLAM technology, time series, scene repetition, and images from various angles for one scene are required. However, most LWIR data sets consist of one shot for each scene or are unidirectional driving data. To solve this, we created a scenario using the LWIR driving dataset and created a repetitive route through repetition. RGB-Depth SLAM Mapping was performed on the constructed data set, and the results were evaluated and the limitations of the current approach were discussed. Finally, we summarized future directions for creating stable 3D thermal maps in indoor and outdoor environments by resolving the limitations.
引用
收藏
页数:5
相关论文
共 50 条
  • [31] A Freehand 3D Ultrasound Reconstruction Method Based on Deep Learning
    Chen, Xin
    Chen, Houjin
    Peng, Yahui
    Liu, Liu
    Huang, Chang
    ELECTRONICS, 2023, 12 (07)
  • [32] Calorie detection in dishes based on deep learning and 3D reconstruction
    Shi, Yongqiang
    Gao, Wenjian
    Shen, Tingting
    Li, Wenting
    Li, Zhihua
    Huang, Xiaowei
    Li, Chuang
    Chen, Hongzhou
    Zou, Xiaobo
    Shi, Jiyong
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2025, 229
  • [33] Deep learning based object tracking for 3D microstructure reconstruction
    Ma, Boyuan
    Xu, Yuting
    Chen, Jiahao
    Puquan, Pan
    Ban, Xiaojuan
    Wang, Hao
    Xue, Weihua
    METHODS, 2022, 204 : 172 - 178
  • [34] UAV-Based SLAM and 3D Reconstruction System
    Li, Tianwei
    Hailes, Steve
    Julier, Simon
    Liu, Ming
    2017 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (IEEE ROBIO 2017), 2017, : 2496 - 2501
  • [35] Deep learning based 3D segmentation in computer vision: A survey
    He, Yong
    Yu, Hongshan
    Liu, Xiaoyan
    Yang, Zhengeng
    Sun, Wei
    Anwar, Saeed
    Mian, Ajmal
    INFORMATION FUSION, 2025, 115
  • [36] Structural light 3D reconstruction algorithm based on deep learning
    Niu, Haibin
    Hu, Limin
    Shi, Yan
    Ning, Lei
    Yang, Yang
    Liang, Hongyao
    Song, Tengbiao
    OPTOELECTRONIC IMAGING AND MULTIMEDIA TECHNOLOGY VI, 2019, 11187
  • [37] LiDAR-Based 3D SLAM for Indoor Mapping
    Teng Hooi Chan
    Hesse, Henrik
    Song Guang Ho
    2021 7TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTICS (ICCAR), 2021, : 285 - 289
  • [38] 3D Image Annotation using Deep Learning and View-based Image Features
    Hosseinnia, Mohammadiman
    Behrad, Alireza
    2023 6TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION AND IMAGE ANALYSIS, IPRIA, 2023,
  • [39] Review of multi-view 3D object recognition methods based on deep learning
    Qi, Shaohua
    Ning, Xin
    Yang, Guowei
    Zhang, Liping
    Long, Peng
    Cai, Weiwei
    Li, Weijun
    DISPLAYS, 2021, 69
  • [40] Generating Thermal Image Data Samples using 3D Facial Modelling Techniques and Deep Learning Methodologies
    Farooq, Muhammad Ali
    Corcoran, Peter
    2020 TWELFTH INTERNATIONAL CONFERENCE ON QUALITY OF MULTIMEDIA EXPERIENCE (QOMEX), 2020,