Remote sensing traffic scene retrieval based on learning control algorithm for robot multimodal sensing information fusion and human-machine interaction and collaboration

被引:2
作者
Peng, Huiling [1 ]
Shi, Nianfeng [1 ]
Wang, Guoqiang [1 ]
机构
[1] Luoyang Inst Sci & Technol, Sch Comp & Informat Engn, Luoyang, Peoples R China
关键词
remote sensing image processing (RSIP); multimodal sensing; robot multimodality; sensor integration and fusion; multimodal information fusion; EXTRACTION; NETWORK; IMAGES;
D O I
10.3389/fnbot.2023.1267231
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In light of advancing socio-economic development and urban infrastructure, urban traffic congestion and accidents have become pressing issues. High-resolution remote sensing images are crucial for supporting urban geographic information systems (GIS), road planning, and vehicle navigation. Additionally, the emergence of robotics presents new possibilities for traffic management and road safety. This study introduces an innovative approach that combines attention mechanisms and robotic multimodal information fusion for retrieving traffic scenes from remote sensing images. Attention mechanisms focus on specific road and traffic features, reducing computation and enhancing detail capture. Graph neural algorithms improve scene retrieval accuracy. To achieve efficient traffic scene retrieval, a robot equipped with advanced sensing technology autonomously navigates urban environments, capturing high-accuracy, wide-coverage images. This facilitates comprehensive traffic databases and real-time traffic information retrieval for precise traffic management. Extensive experiments on large-scale remote sensing datasets demonstrate the feasibility and effectiveness of this approach. The integration of attention mechanisms, graph neural algorithms, and robotic multimodal information fusion enhances traffic scene retrieval, promising improved information extraction accuracy for more effective traffic management, road safety, and intelligent transportation systems. In conclusion, this interdisciplinary approach, combining attention mechanisms, graph neural algorithms, and robotic technology, represents significant progress in traffic scene retrieval from remote sensing images, with potential applications in traffic management, road safety, and urban planning.
引用
收藏
页数:15
相关论文
共 49 条
  • [1] Beyond RGB: Very high resolution urban remote sensing with multimodal deep networks
    Audebert, Nicolas
    Le Saux, Bertrand
    Lefevre, Sebastien
    [J]. ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2018, 140 : 20 - 32
  • [2] Ben-Younes H, 2019, AAAI CONF ARTIF INTE, P8102
  • [3] Building Footprint Extraction From VHR Remote Sensing Images Combined With Normalized DSMs Using Fused Fully Convolutional Networks
    Bittner, Ksenia
    Adam, Fathalrahman
    Cui, Shiyong
    Koerner, Marco
    Reinartz, Peter
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2018, 11 (08) : 2615 - 2629
  • [4] Semantic segmentation of clouds in satellite images based on U-Net plus plus architecture and attention mechanism
    Buttar, Preetpal Kaur
    Sachan, Manoj Kumar
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2022, 209
  • [5] On the Co-Selection of Vision Transformer Features and Images for Very High-Resolution Image Scene Classification
    Chaib, Souleyman
    Mansouri, Dou El Kefel
    Omara, Ibrahim
    Hagag, Ahmed
    Dhelim, Sahraoui
    Bensaber, Djamel Amar
    [J]. REMOTE SENSING, 2022, 14 (22)
  • [6] Summary of current radiometric calibration coefficients for Landsat MSS, TM, ETM+, and EO-1 ALI sensors
    Chander, Gyanesh
    Markham, Brian L.
    Helder, Dennis L.
    [J]. REMOTE SENSING OF ENVIRONMENT, 2009, 113 (05) : 893 - 903
  • [7] Semi-Automated Road Detection From High Resolution Satellite Images by Directional Morphological Enhancement and Segmentation Techniques
    Chaudhuri, D.
    Kushwaha, N. K.
    Samal, A.
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2012, 5 (05) : 1538 - 1544
  • [8] Chen C, 2019, AAAI CONF ARTIF INTE, P485
  • [9] Sea Ice Extent Prediction with Machine Learning Methods and Subregional Analysis in the Arctic
    Chen, Siwen
    Li, Kehan
    Fu, Hongpeng
    Wu, Ying Cheng
    Huang, Yiyi
    [J]. ATMOSPHERE, 2023, 14 (06)
  • [10] RELAX: Reinforcement Learning Agent Explainer for Arbitrary Predictive Models
    Chen, Ziheng
    Silvestri, Fabrizio
    Wang, Jia
    Zhu, He
    Ahn, Hongshik
    Tolomei, Gabriele
    [J]. PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 252 - 261