Underwater target detection and recognition based on cross-modal fusion of flow and electric information

被引:0
|
作者
Fu, Tongqiang [1 ]
Hu, Qiao [1 ,2 ]
Zhao, Jiawei [1 ]
Jiang, Guangyu [1 ]
Shan, Liuhao [1 ]
Rong, Yi [1 ]
机构
[1] Xi An Jiao Tong Univ, Sch Mech Engn, Xian 710000, Peoples R China
[2] Xi An Jiao Tong Univ, Shaanxi Key Lab Intelligent Robots, Xian 710000, Peoples R China
基金
中国国家自然科学基金;
关键词
Cross-modal information fusion; Underwater detection and recognition; Artificial lateral line; Active electric sense; ARTIFICIAL LATERAL-LINE;
D O I
10.1016/j.measurement.2025.116681
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Drawing inspiration from the natural sensing mechanisms of fish, this paper proposes, for the first time, a fusion method that combines the flow and electric modalities to perceive underwater moving targets through crossmodal information fusion, thereby overcoming the challenges of detection uncertainty and limited recognition accuracy. We present an array that can simultaneously measure the disturbance of both the flow and electric fields induced by the underwater target. Our approach introduces principal component analysis to enhance the robustness of detection and a dual-physics fusion algorithm that integrates tri-type artificial neural networks with Dempster-Shafer evidence theory to improve recognition accuracy. Experimental results show an 8% improvement over single-modal detection, achieving 97.5% recognition accuracy under varying conditions. This work provides a promising framework for leveraging cross-modal underwater information, significantly advancing target detection and recognition capabilities.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Cross-modal information fusion for voice spoofing detection
    Xue, Junxiao
    Zhou, Hao
    Song, Huawei
    Wu, Bin
    Shi, Lei
    SPEECH COMMUNICATION, 2023, 147 : 41 - 50
  • [2] A Sign Language Recognition Framework Based on Cross-Modal Complementary Information Fusion
    Zhang, Jiangtao
    Wang, Qingshan
    Wang, Qi
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 8131 - 8144
  • [3] Metaphor recognition based on cross-modal multi-level information fusion
    Yang, Qimeng
    Yan, Yuanbo
    He, Xiaoyu
    Guo, Shisong
    COMPLEX & INTELLIGENT SYSTEMS, 2025, 11 (01)
  • [4] CMAF: Cross-modal Augmentation via Fusion for Underwater Acoustic Image Recognition
    Yang, Shih-Wei
    Shen, Li-Hsiang
    Shuai, Hong-Han
    Feng, Kai-Ten
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (05)
  • [5] Cross-Modal Commentator: Automatic Machine Commenting Based on Cross-Modal Information
    Yang, Pengcheng
    Zhang, Zhihan
    Luo, Fuli
    Li, Lei
    Huang, Chengyang
    Sun, Xu
    57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), 2019, : 2680 - 2686
  • [6] Kernel Cross-Modal Factor Analysis for Information Fusion With Application to Bimodal Emotion Recognition
    Wang, Yongjin
    Guan, Ling
    Venetsanopoulos, Anastasios N.
    IEEE TRANSACTIONS ON MULTIMEDIA, 2012, 14 (03) : 597 - 607
  • [7] Cross-modal source information and spoken word recognition
    Lachs, L
    Pisoni, DB
    JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE, 2004, 30 (02) : 378 - 396
  • [8] Transformer-Based Cross-Modal Information Fusion Network for Semantic Segmentation
    Duan, Zaipeng
    Huang, Xiao
    Ma, Jie
    NEURAL PROCESSING LETTERS, 2023, 55 (05) : 6361 - 6375
  • [9] Transformer-Based Cross-Modal Information Fusion Network for Semantic Segmentation
    Zaipeng Duan
    Xiao Huang
    Jie Ma
    Neural Processing Letters, 2023, 55 : 6361 - 6375
  • [10] Neural Machine Translation Method Based on Cross-modal Entity Information Fusion
    Huang X.
    Zhang J.-J.
    Zong C.-Q.
    Zidonghua Xuebao/Acta Automatica Sinica, 2023, 49 (06): : 1170 - 1180