TSOM: Small object motion detection neural network inspired by avian visual circuit

被引:0
|
作者
Hu, Pingge [1 ,5 ]
Zhang, Xiaoteng [1 ]
Li, Mengmeng [2 ,3 ]
Zhu, Yingjie [4 ]
Shi, Li [1 ,3 ]
机构
[1] Tsinghua Univ, Dept Automat, Beijing 100084, Peoples R China
[2] Zhengzhou Univ, Sch Elect & Informat Engn, Zhengzhou 450001, Peoples R China
[3] Henan Key Lab Brain Sci & Brain Comp Interface Tec, Zhengzhou 450001, Peoples R China
[4] Chinese Acad Sci, Shenzhen Key Lab Drug Addict, Shenzhen Neher Neural Plast Lab, Brain Cognit & Brain Dis Inst,Shenzhen Inst Adv Te, Shenzhen 518055, Peoples R China
[5] China Acad Informat & Commun Technol, Beijing 100191, Peoples R China
关键词
Neural networks; Bio-inspiration; Avian visual circuit; Small object motion detection; OPTIC TECTUM; STIMULUS; ORGANIZATION; NEURONS; FIELDS;
D O I
10.1016/j.neunet.2024.106881
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Detecting small moving objects in complex backgrounds from an overhead perspective is a highly challenging task for machine vision systems. As an inspiration from nature, the avian visual system is capable of processing motion information in various complex aerial scenes, and the Retina-OT-Rt visual circuit of birds is highly sensitive to capturing the motion information of small objects from high altitudes. However, more needs to be done on small object motion detection algorithms based on the avian visual system. In this paper, we conducted mathematical description based on extensive studies of the biological mechanisms of the Retina-OT-Rt visual circuit. Based on this, we proposed a novel tectum small object motion detection neural network (TSOM). The TSOM neural network includes the retina, SGC dendritic, SGC Soma, and Rt layers, each corresponding to neurons in the visual pathway for precise topographic projection, spatial-temporal encoding, motion feature selection, and multi-directional motion integration. Extensive experiments on pigeon neurophysiological experiments and image sequence data showed that the TSOM is biologically interpretable and effective in extracting reliable small object motion features from complex high-altitude backgrounds.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] OTNet: A Small Object Detection Algorithm for Video Inspired by Avian Visual System
    Hu, Pingge
    Wang, Xingtong
    Zhang, Xiaoteng
    Cang, Yueyang
    Shi, Li
    MATHEMATICS, 2022, 10 (21)
  • [2] VSTDet: A lightweight small object detection network inspired by the ventral visual pathway
    Niu, Yansong
    Lin, Chuan
    Jiang, Xintong
    Qu, Zhenshen
    APPLIED SOFT COMPUTING, 2025, 171
  • [3] LPNet: Retina Inspired Neural Network for Object Detection and Recognition
    Cao, Jie
    Bao, Chun
    Hao, Qun
    Cheng, Yang
    Chen, Chenglin
    ELECTRONICS, 2021, 10 (22)
  • [4] Panoramic Motion Perception Inspired Fly Visual Brain Joint Neural Network on Omnidirectional Collision Detection
    Li, Lun
    Zhang, Zhuhong
    Jia, Wensheng
    Lu, Jiaxuan
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2023, 2023
  • [5] EVMNet: Eagle visual mechanism-inspired lightweight network for small object detection in UAV aerial images
    Chen, Xi
    Lin, Chuan
    DIGITAL SIGNAL PROCESSING, 2025, 158
  • [6] Fly visual system inspired artificial neural network for collision detection
    Zhang, Zhuhong
    Yue, Shigang
    Zhang, Guopeng
    NEUROCOMPUTING, 2015, 153 : 221 - 234
  • [7] SODNet: small object detection using deconvolutional neural network
    Zhang, Xinpeng
    Wu, Jigang
    Peng, Zhihao
    Meng, Min
    IET IMAGE PROCESSING, 2020, 14 (08) : 1662 - 1669
  • [8] Small object detection by Edge-aware Neural Network
    Zhang, Xianhong
    Lu, Tao
    Wang, Jiaming
    Fu, Shichang
    Gao, Fangqun
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 138
  • [9] A visual circuit for lateral motion detection
    Song, Kai-Tai
    Shen, Sung-Chih
    IECON 2007: 33RD ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, VOLS 1-3, CONFERENCE PROCEEDINGS, 2007, : 2278 - 2283
  • [10] Analog Integrated Circuit for Motion Detection of Approaching Object Based on the Insect Visual System
    Kimihiro Nishio
    Hiroo Yonezu
    Masahiro Ohtani
    Hitoshi Yamada
    Yuzo Furukawa
    Optical Review, 2004, 11 : 38 - 47