Experiments on detecting and monitoring objects based on thermal imaging

被引:1
作者
Brassai, Sandor Tihamer [1 ]
Ambarus, Robert Bela [2 ]
Hammas, Attila [3 ]
Nemeth, Andras [3 ]
机构
[1] Sapientia Hungarian Univ Transylvania, Dept Elect Engn, Corunca, Romania
[2] Sapientia Hungarian Univ Transylvania, Informat, Corunca, Romania
[3] Natl Univ Publ Serv, Dept Elect Warfare, Budapest, Hungary
来源
2024 25TH INTERNATIONAL CARPATHIAN CONTROL CONFERENCE, ICCC 2024 | 2024年
关键词
Object detection; Thermal imaging; Convolutional Neural Networks; Aerial Imagery;
D O I
10.1109/ICCC62069.2024.10569733
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Object detection and tracking on RGB and thermal imaging is getting increasingly more advanced and important in the field of computer vision. The increasing image quality combined with decreasing camera prices during recent years, created new opportunities to gather data. They are now used in many different fields, for example: medical, military, law enforcement or industrial applications. Thermal cameras are useful in darkness and in situations when there is not enough light for cameras that operate in the visual spectrum to function properly. Leveraging the information provided by colored images for labeling, this paper approach aims to enhance the accuracy and efficiency of object recognition in thermal imagery. The synergy between thermal and colored imagery offers a comprehensive solution, addressing challenges posed by limited thermal resolution and ambiguity in object boundaries. By harnessing the complementary strengths of colored and thermal imaging, this paper opens avenues for applications in surveillance, autonomous systems, and other fields where reliable object detection and tracking under challenging thermal conditions are paramount. For this experiment different models were trained using MMDetection and MMRotate modules from MMLab framework. We explored and compared multiple models like: Rotated Faster R-CNN (two-stage anchor-based detection), Single Shot Alignment Network (S2ANET one stage anchor detector), and FCOSR (one-stage anchor-free detector)
引用
收藏
页数:6
相关论文
共 12 条
  • [1] Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
  • [2] Dataset of thermal and visible aerial images for multi -modal and multi -spectral image registration and fusion
    Garcia-Moreno, Lina M.
    Diaz-Paz, Jean P.
    Loaiza-Correa, Humberto
    Restrepo-Giron, Andres D.
    [J]. DATA IN BRIEF, 2020, 29
  • [3] Fast R-CNN
    Girshick, Ross
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 1440 - 1448
  • [4] Align Deep Features for Oriented Object Detection
    Han, Jiaming
    Ding, Jian
    Li, Jie
    Xia, Gui-Song
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [5] Li W., 2012, 2012 8 INT C NAT COM
  • [6] Microsoft COCO: Common Objects in Context
    Lin, Tsung-Yi
    Maire, Michael
    Belongie, Serge
    Hays, James
    Perona, Pietro
    Ramanan, Deva
    Dollar, Piotr
    Zitnick, C. Lawrence
    [J]. COMPUTER VISION - ECCV 2014, PT V, 2014, 8693 : 740 - 755
  • [7] Sekachev B., 2020, opencv/ cvat: v1.1.0
  • [8] Deep learning with RGB and thermal images onboard a drone for monitoring operations
    Speth, Simon
    Goncalves, Artur
    Rigault, Bastien
    Suzuki, Satoshi
    Bouazizi, Mondher
    Matsuo, Yutaka
    Prendinger, Helmut
    [J]. JOURNAL OF FIELD ROBOTICS, 2022, 39 (06) : 840 - 868
  • [9] Tian Z, 2019, Arxiv, DOI arXiv:1904.01355
  • [10] Detecting and tracking vehicles in traffic by unmanned aerial vehicles
    Wang, Liang
    Chen, Fangliang
    Yin, Huiming
    [J]. AUTOMATION IN CONSTRUCTION, 2016, 72 : 294 - 308