Object Memorability Prediction using Deep Learning: Location and Size Bias

被引:8
作者
Basavaraju, Sathisha [1 ]
Gaj, Sibaji [1 ]
Sur, Arijit [1 ]
机构
[1] Indian Inst Technol Guwahati, Gauhati, India
关键词
Object Memorability; Deep Learning; Transfer Learning;
D O I
10.1016/j.jvcir.2019.01.008
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Object memorability prediction is a task of estimating the probability that a human recognises the recurrence of an object after a single view. Initial research on object memorability showed that it is possible to predict the object memorability scores from the intrinsic features of an object. Though the existing works proposed some of the features for object memorability prediction task, the influence of Spatial-location and Spatial-size of an object to its memorability have not been explored yet. In this work, the importance of these two characteristics in determining object memorability prediction is investigated and the same is demonstrated by building a baseline model. Further, a deep learning model is devised for automatic feature learning on these two object characteristics. Experimental results highlight that the Spatial-location and Spatial-size of an object play a significant role in object memorability prediction and the proposed models outperformed the existing methods. (C) 2019 Elsevier Inc. All rights reserved.
引用
收藏
页码:117 / 127
页数:11
相关论文
共 20 条
  • [11] The Intrinsic Memorability of Face Photographs
    Bainbridge, Wilma A.
    Isola, Phillip
    Oliva, Aude
    [J]. JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL, 2013, 142 (04) : 1323 - 1334
  • [12] Deep Learning for Image Memorability Prediction: the Emotional Bias
    Baveye, Yoann
    Cohendet, Romain
    Da Silva, Matthieu Perreira
    Le Callet, Patrick
    [J]. MM'16: PROCEEDINGS OF THE 2016 ACM MULTIMEDIA CONFERENCE, 2016, : 491 - 495
  • [13] Berg AC, 2012, PROC CVPR IEEE, P3562, DOI 10.1109/CVPR.2012.6248100
  • [14] What makes an object memorable?
    Dubey, Rachit
    Peterson, Joshua
    Khosla, Aditya
    Yang, Ming-Hsuan
    Ghanem, Bernard
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 1089 - 1097
  • [15] What Makes a Photograph Memorable?
    Isola, Phillip
    Xiao, Jianxiong
    Parikh, Devi
    Torralba, Antonio
    Oliva, Aude
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2014, 36 (07) : 1469 - 1482
  • [16] Isola P, 2011, PROC CVPR IEEE, P145, DOI 10.1109/CVPR.2011.5995721
  • [17] Khosla A., 2012, SIGGRAPH Asia 2012 Technical Briefs
  • [18] The Secrets of Salient Object Segmentation
    Li, Yin
    Hou, Xiaodi
    Koch, Christof
    Rehg, James M.
    Yuille, Alan L.
    [J]. 2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 280 - 287
  • [19] ImageNet Large Scale Visual Recognition Challenge
    Russakovsky, Olga
    Deng, Jia
    Su, Hao
    Krause, Jonathan
    Satheesh, Sanjeev
    Ma, Sean
    Huang, Zhiheng
    Karpathy, Andrej
    Khosla, Aditya
    Bernstein, Michael
    Berg, Alexander C.
    Fei-Fei, Li
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2015, 115 (03) : 211 - 252
  • [20] Williams C. K. I., 2010, INT J COMPUT VISION, V88, P303, DOI DOI 10.1007/s11263-009-0275-4