Understanding Objects in Detail with Fine-grained Attributes

被引:47
|
作者
Vedaldi, Andrea [1 ]
Mahendran, Siddharth [2 ]
Tsogkas, Stavros [3 ]
Maji, Subhransu [4 ]
Girshick, Ross [5 ]
Kannala, Juho [6 ]
Rahtu, Esa [6 ]
Kokkinos, Iasonas [3 ]
Blaschko, Matthew B. [3 ]
Weiss, David [7 ]
Taskar, Ben [8 ]
Simonyan, Karen [1 ]
Saphra, Naomi [2 ]
Mohamed, Sammy [9 ]
机构
[1] Univ Oxford, Oxford OX1 2JD, England
[2] Johns Hopkins Univ, Baltimore, MD 21218 USA
[3] Ecole Cent Paris, INRIA Saclay, Paris, France
[4] Toyota Res Inst Chicago, Chicago, IL USA
[5] Univ Calif Berkeley, Berkeley, CA 94720 USA
[6] Univ Oulu, SF-90100 Oulu, Finland
[7] Google Res, Mountain View, CA USA
[8] Univ Washington, Seattle, WA 98195 USA
[9] SUNY Stony Brook, Stony Brook, NY USA
基金
美国国家科学基金会;
关键词
D O I
10.1109/CVPR.2014.463
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We study the problem of understanding objects in detail, intended as recognizing a wide array of fine-grained object attributes. To this end, we introduce a dataset of 7,413 air-planes annotated in detail with parts and their attributes, leveraging images donated by airplane spotters and crowd-sourcing both the design and collection of the detailed annotations. We provide a number of insights that should help researchers interested in designing fine-grained datasets for other basic level categories. We show that the collected data can be used to study the relation between part detection and attribute prediction by diagnosing the performance of classifiers that pool information from different parts of an object. We note that the prediction of certain attributes can benefit substantially from accurate part detection. We also show that, differently from previous results in object detection, employing a large number of part templates can improve detection accuracy at the expenses of detection speed. We finally propose a coarse-to-fine approach to speed up detection through a hierarchical cascade algorithm.
引用
收藏
页码:3622 / 3629
页数:8
相关论文
共 50 条
  • [41] A Fine-grained Access Control Scheme for Big Data Based on Classification Attributes
    Yang, Tengfei
    Shen, Peisong
    Tian, Xue
    Chen, Chi
    2017 IEEE 37TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS WORKSHOPS (ICDCSW), 2017, : 238 - 245
  • [42] Learning to Parameterize Visual Attributes for Open-set Fine-grained Retrieval
    Wang, Shijie
    Chang, Jianlong
    Li, Haojie
    Wang, Zhihui
    Ouyang, Wanli
    Tian, Qi
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [43] Towards Fine-Grained Recognition: Joint Learning for Object Detection and Fine-Grained Classification
    Wang, Qiaosong
    Rasmussen, Christopher
    ADVANCES IN VISUAL COMPUTING, ISVC 2019, PT II, 2019, 11845 : 332 - 344
  • [44] Taming CLIP for Fine-Grained and Structured Visual Understanding of Museum Exhibits
    Balauca, Ada-Astrid
    Paudel, Danda Pani
    Toutanova, Kristina
    Van Gool, Luc
    COMPUTER VISION - ECCV 2024, PT LXXVI, 2025, 15134 : 377 - 394
  • [45] Fine-Grained 3D Model Classification Based on Deep Ensemble and Detail Awareness
    Bai J.
    Ji H.
    Shao H.
    Wu R.
    Qin F.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2022, 34 (10): : 1580 - 1589
  • [46] fine-grained comparison of pragmatic language understanding in humans and language models
    Hu, Jennifer
    Floyd, Sammy
    Jouravlev, Olessia
    Fedorenko, Evelina
    Gibson, Edward
    PROCEEDINGS OF THE 61ST ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL 2023, VOL 1, 2023, : 4194 - 4213
  • [47] SpyHammer: Understanding and Exploiting RowHammer Under Fine-Grained Temperature Variations
    Orosa, Lois
    Ruehrmair, Ulrich
    Giray Yaglikci, A.
    Luo, Haocong
    Olgun, Ataberk
    Jattke, Patrick
    Patel, Minesh
    Kim, Jeremie S.
    Razavi, Kaveh
    Mutlu, Onur
    IEEE ACCESS, 2024, 12 : 80986 - 81003
  • [48] Understanding fine-grained river-sediment dispersal on continental margins
    Walsh, J. P.
    Nittrouer, C. A.
    MARINE GEOLOGY, 2009, 263 (1-4) : 34 - 45
  • [49] Ordered Atomic Activity for Fine-grained Interactive Traffic Scenario Understanding
    Agarwal, Nakul
    Chen, Yi-Ting
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 8590 - 8602
  • [50] Fine-Grained Visual Entailment
    Thomas, Christopher
    Zhang, Yipeng
    Chang, Shih-Fu
    COMPUTER VISION, ECCV 2022, PT XXXVI, 2022, 13696 : 398 - 416