Finding any Waldo with zero-shot invariant and efficient visual search

被引:42
|
作者
Zhang, Mengmi [1 ,2 ,3 ,4 ]
Feng, Jiashi [3 ]
Ma, Keng Teck [5 ]
Lim, Joo Hwee [4 ]
Zhao, Qi [6 ]
Kreiman, Gabriel [1 ]
机构
[1] Harvard Med Sch, Childrens Hosp, Boston, MA 02115 USA
[2] Natl Univ Singapore, Grad Sch Integrat Sci & Engn, Singapore 138632, Singapore
[3] Natl Univ Singapore, Dept Elect & Comp Engn, Singapore 138632, Singapore
[4] ASTAR, Image Video Analyt Dept, Visual Intelligence Unit, Singapore 138632, Singapore
[5] Agcy Sci Technol & Res, Artificial Intelligence Program, Singapore 138632, Singapore
[6] Univ Minnesota Twin Cities, Dept Comp Sci & Engn, Minneapolis, MN 55455 USA
关键词
FEATURE-BASED ATTENTION; OBJECT RECOGNITION; PREFRONTAL CORTEX; NEURAL MECHANISMS; EYE-MOVEMENTS; MODEL; GUIDANCE; SALIENCY; EXPERT; FACE;
D O I
10.1038/s41467-018-06217-x
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Searching for a target object in a cluttered scene constitutes a fundamental challenge in daily vision. Visual search must be selective enough to discriminate the target from distractors, invariant to changes in the appearance of the target, efficient to avoid exhaustive exploration of the image, and must generalize to locate novel target objects with zero-shot training. Previous work on visual search has focused on searching for perfect matches of a target after extensive category-specific training. Here, we show for the first time that humans can efficiently and invariantly search for natural objects in complex scenes. To gain insight into the mechanisms that guide visual search, we propose a biologically inspired computational model that can locate targets without exhaustive sampling and which can generalize to novel objects. The model provides an approximation to the mechanisms integrating bottom-up and top-down signals during search in natural scenes.
引用
收藏
页数:15
相关论文
共 4 条
  • [1] Zero-Shot Visual Recognition via Bidirectional Latent Embedding
    Qian Wang
    Ke Chen
    International Journal of Computer Vision, 2017, 124 : 356 - 383
  • [2] Zero-Shot Visual Recognition via Bidirectional Latent Embedding
    Wang, Qian
    Chen, Ke
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2017, 124 (03) : 356 - 383
  • [3] Attribute-Based Classification for Zero-Shot Visual Object Categorization
    Lampert, Christoph H.
    Nickisch, Hannes
    Harmeling, Stefan
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2014, 36 (03) : 453 - 465
  • [4] Zero-Shot Learning Using Synthesised Unseen Visual Data with Diffusion Regularisation
    Long, Yang
    Liu, Li
    Shen, Fumin
    Shao, Ling
    Li, Xuelong
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (10) : 2498 - 2512