Drosophila-Vision-Inspired Motion Perception Model and Its Application in Saliency Detection

被引:3
作者
Chen, Zhe [1 ]
Mu, Qi [1 ]
Han, Guangjie [1 ]
Lu, Huimin [2 ]
机构
[1] Hohai Univ, Coll Informat Sci & Engn, Changzhou 213200, Peoples R China
[2] Southeast Univ, Sch Automat, Nanjing 210096, Peoples R China
关键词
Computational modeling; Biological system modeling; Saliency detection; Feature extraction; Task analysis; Sensitivity; Visualization; Drosophila vision; motion perception; saliency; computational model; OBJECT DETECTION; OPTIMIZATION; SELECTIVITY; MECHANISMS; PATHWAYS;
D O I
10.1109/TCE.2024.3355512
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Vision in Drosophila has been the subject of extensive behavioral, physiological, and anatomical studies. However, our understanding of its underlying neural computations remains incomplete due to the gap in computational biology. Drosophila vision has been proven to be considerably more sensitive in response to object motion, approaching approximately 10 times the speed of humans. Hence, modeling Drosophila vision is desired for advancing computer vision for consumer electronics. Applying the Drosophila vision model may achieve an optimal tradeoff between accuracy and efficiency in vision tasks. This study proposes a Drosophila-vision-inspired motion perception (DVMP) model that integrates successive computational layers from the superficial retina with the central complex. This bio-inspired model can efficiently extract motion saliency in dynamic scenes. Ablation studies and the final evaluation results of our DVMP model provide an intuitive paradigm for gaining better insight into the neural mechanisms involved in Drosophila vision. Also, extensive experimental comparisons using both data-independent and learning-based saliency detection methods demonstrate the potential performance and speed of our DVMP model, implying that it can be easily applied in consumer electronics, e.g., mobile phones and robots.
引用
收藏
页码:819 / 830
页数:12
相关论文
共 53 条
  • [1] SLIC Superpixels Compared to State-of-the-Art Superpixel Methods
    Achanta, Radhakrishna
    Shaji, Appu
    Smith, Kevin
    Lucchi, Aurelien
    Fua, Pascal
    Suesstrunk, Sabine
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) : 2274 - 2281
  • [2] Achanta R, 2009, PROC CVPR IEEE, P1597, DOI 10.1109/CVPRW.2009.5206596
  • [3] Arbib M.A., 2008, Springer handbook of robotics, P1453, DOI [DOI 10.1007/978-3-540-30301-5_63, 10.1007/978-3-540-30301-5_63]
  • [4] Non-Linear Neuronal Responses as an Emergent Property of Afferent Networks: A Case Study of the Locust Lobula Giant Movement Detector
    Bermudez i Badia, Sergi
    Bernardet, Ulysses
    Verschure, Paul F. M. J.
    [J]. PLOS COMPUTATIONAL BIOLOGY, 2010, 6 (03)
  • [5] Brox T, 2010, LECT NOTES COMPUT SC, V6315, P282, DOI 10.1007/978-3-642-15555-0_21
  • [6] SCOM: Spatiotemporal Constrained Optimization for Salient Object Detection
    Chen, Yuhuan
    Zou, Wenbin
    Tang, Yi
    Li, Xia
    Xu, Chen
    Komodakis, Nikos
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (07) : 3345 - 3357
  • [7] Neuromodulation of insect motion vision
    Cheng, Karen Y.
    Frye, Mark A.
    [J]. JOURNAL OF COMPARATIVE PHYSIOLOGY A-NEUROETHOLOGY SENSORY NEURAL AND BEHAVIORAL PHYSIOLOGY, 2020, 206 (02): : 125 - 137
  • [8] Defining the Computational Structure of the Motion Detector in Drosophila
    Clark, Damon A.
    Bursztyn, Limor
    Horowitz, Mark A.
    Schnitzer, Mark J.
    Clandinin, Thomas R.
    [J]. NEURON, 2011, 70 (06) : 1165 - 1177
  • [9] Loom-Sensitive Neurons Link Computation to Action in the Drosophila Visual System
    de Vries, Saskia E. J.
    Clandinin, Thomas R.
    [J]. CURRENT BIOLOGY, 2012, 22 (05) : 353 - 362
  • [10] Structure-measure: A New Way to Evaluate Foreground Maps
    Fan, Deng-Ping
    Cheng, Ming-Ming
    Liu, Yun
    Li, Tao
    Borji, Ali
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 4558 - 4567