Binocular Matching Model Based on Hierarchical V1 and V2 Receptive Fields With Color, Orientation, and Region Feature Information

被引:1
作者
Wei, Hui [1 ]
Xu, Cheng [1 ]
Jin, Zifeng [1 ]
机构
[1] Fudan Univ, Lab Algorithms Cognit Models, Shanghai Key Lab Data Sci, Sch Comp Sci & Technol, Shanghai 201203, Peoples R China
关键词
Visualization; Image color analysis; Neurons; Mathematical model; Radio frequency; Computational modeling; Biological system modeling; Biomedical engineering; stereo vision; visual cortex; FUNCTIONAL ARCHITECTURE; VISUAL-CORTEX; DISPARITY; NEURONS; PHASE;
D O I
10.1109/TBME.2020.2977350
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Binocular matching models serve as the core component in most stereo visual aid systems developed for people with visual impairments. However, purely computational models lack a neuro-biological basis for explaining the phenomena observed in neuro-biology, and therefore offer no support for the development of bioengineering applications, and are overly complex for hardware implementation. In contrast, existing neurobiological models suffer from low matching calculation accuracy. Therefore, the present work proposes a novel binocular matching model based on the receptive field of simple cells rather than on image pixels, and thereby incorporates neurobiological structure, reduces hardware complexity, has enough accuracy and can be used in visual aid system. The proposed model is employed to calculate and optimize the binocular disparity via a cost function. Specifically, we simulate the functions and structures of V1 and V2 neurons according to the discoveries of modern neurobiology. Accordingly, the receptive fields of V1 layer neurons are aggregated to obtain the receptive fields of the V2 layer, and the disparity is obtained in the V2 layer. The accuracy of the proposed model is verified by comparisons of the disparity results obtained using the proposed model with those obtained using other neurobiological model, and thereby demonstrates that the model can guide the design of visual aid systems.
引用
收藏
页码:3141 / 3150
页数:10
相关论文
共 41 条
  • [1] Orientation tuning of input conductance, excitation, and inhibition in cat primary visual cortex
    Anderson, JS
    Carandini, M
    Ferster, D
    [J]. JOURNAL OF NEUROPHYSIOLOGY, 2000, 84 (02) : 909 - 926
  • [2] A database and evaluation methodology for optical flow
    Baker, Simon
    Scharstein, Daniel
    Lewis, J. P.
    Roth, Stefan
    Black, Michael J.
    Szeliski, Richard
    [J]. 2007 IEEE 11TH INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOLS 1-6, 2007, : 588 - 595
  • [3] A coarse-to-fine disparity energy model with both phase-shift and position-shift receptive field mechanisms
    Chen, YH
    Qian, N
    [J]. NEURAL COMPUTATION, 2004, 16 (08) : 1545 - 1577
  • [4] Cheng X., 2018, IEEE T PATTERN ANAL
  • [5] Responses of primary visual cortical neurons to binocular disparity without depth perception
    Cumming, BG
    Parker, AJ
    [J]. NATURE, 1997, 389 (6648) : 280 - 283
  • [6] SPATIAL-FREQUENCY SELECTIVITY OF CELLS IN MACAQUE VISUAL-CORTEX
    DEVALOIS, RL
    ALBRECHT, DG
    THORELL, LG
    [J]. VISION RESEARCH, 1982, 22 (05) : 545 - 559
  • [7] Stereoscopic Depth Perception Using a Model Based on the Primary Visual Cortex
    Faria, Fernanda da C. e C.
    Batista, Jorge
    Araujo, Helder
    [J]. PLOS ONE, 2013, 8 (12):
  • [8] Faria FDEC, 2010, IFIP ADV INF COMM TE, V314, P351
  • [9] Vision meets robotics: The KITTI dataset
    Geiger, A.
    Lenz, P.
    Stiller, C.
    Urtasun, R.
    [J]. INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2013, 32 (11) : 1231 - 1237
  • [10] Geiger A, 2012, PROC CVPR IEEE, P3354, DOI 10.1109/CVPR.2012.6248074