Understanding Objects in Detail with Fine-grained Attributes

被引:47
|
作者
Vedaldi, Andrea [1 ]
Mahendran, Siddharth [2 ]
Tsogkas, Stavros [3 ]
Maji, Subhransu [4 ]
Girshick, Ross [5 ]
Kannala, Juho [6 ]
Rahtu, Esa [6 ]
Kokkinos, Iasonas [3 ]
Blaschko, Matthew B. [3 ]
Weiss, David [7 ]
Taskar, Ben [8 ]
Simonyan, Karen [1 ]
Saphra, Naomi [2 ]
Mohamed, Sammy [9 ]
机构
[1] Univ Oxford, Oxford OX1 2JD, England
[2] Johns Hopkins Univ, Baltimore, MD 21218 USA
[3] Ecole Cent Paris, INRIA Saclay, Paris, France
[4] Toyota Res Inst Chicago, Chicago, IL USA
[5] Univ Calif Berkeley, Berkeley, CA 94720 USA
[6] Univ Oulu, SF-90100 Oulu, Finland
[7] Google Res, Mountain View, CA USA
[8] Univ Washington, Seattle, WA 98195 USA
[9] SUNY Stony Brook, Stony Brook, NY USA
基金
美国国家科学基金会;
关键词
D O I
10.1109/CVPR.2014.463
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We study the problem of understanding objects in detail, intended as recognizing a wide array of fine-grained object attributes. To this end, we introduce a dataset of 7,413 air-planes annotated in detail with parts and their attributes, leveraging images donated by airplane spotters and crowd-sourcing both the design and collection of the detailed annotations. We provide a number of insights that should help researchers interested in designing fine-grained datasets for other basic level categories. We show that the collected data can be used to study the relation between part detection and attribute prediction by diagnosing the performance of classifiers that pool information from different parts of an object. We note that the prediction of certain attributes can benefit substantially from accurate part detection. We also show that, differently from previous results in object detection, employing a large number of part templates can improve detection accuracy at the expenses of detection speed. We finally propose a coarse-to-fine approach to speed up detection through a hierarchical cascade algorithm.
引用
收藏
页码:3622 / 3629
页数:8
相关论文
共 50 条
  • [21] From the whole to detail: Progressively sampling discriminative parts for fine-grained recognition
    Guo, Chen
    Lin, Yaojin
    Chen, Shengyu
    Zeng, Zhichun
    Shao, Mingwen
    Li, Shaozi
    Knowledge-Based Systems, 2022, 235
  • [22] From the whole to detail: Progressively sampling discriminative parts for fine-grained recognition
    Guo, Chen
    Lin, Yaojin
    Chen, Shengyu
    Zeng, Zhichun
    Shao, Mingwen
    Li, Shaozi
    KNOWLEDGE-BASED SYSTEMS, 2022, 235
  • [23] Fine-grained emoji sentiment analysis based on attributes of Twitter users
    Sun, Xiaoyu
    Li, Huakang
    Sun, Guozi
    Zhu, Ming
    2020 IEEE INTERNATIONAL CONFERENCE ON SMART CLOUD (SMARTCLOUD 2020), 2020, : 134 - 139
  • [24] Improve Fine-Grained Feature Learning in Fine-Grained DataSet GAI
    Wang, Hai Peng
    Geng, Zhi Qing
    IEEE ACCESS, 2025, 13 : 12777 - 12788
  • [25] Leveraging Fine-Grained Labels to Regularize Fine-Grained Visual Classification
    Wu, Junfeng
    Yao, Li
    Liu, Bin
    Ding, Zheyuan
    PROCEEDINGS OF THE 11TH INTERNATIONAL CONFERENCE ON COMPUTER MODELING AND SIMULATION (ICCMS 2019) AND 8TH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING AND APPLICATIONS (ICICA 2019), 2019, : 133 - 136
  • [26] Novel Dataset for Fine-grained Abnormal Behavior Understanding in Crowd
    Rabiee, Hamidreza
    Haddadnia, Javad
    Mousavi, Hossein
    Kalantarzadeh, Maziyar
    Nabi, Moin
    Murino, Vittorio
    2016 13TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE (AVSS), 2016, : 95 - 101
  • [27] Understanding the evolution of fine-grained user opinions in product reviews
    Xia, Peike
    Jiang, Wenjun
    2018 IEEE SMARTWORLD, UBIQUITOUS INTELLIGENCE & COMPUTING, ADVANCED & TRUSTED COMPUTING, SCALABLE COMPUTING & COMMUNICATIONS, CLOUD & BIG DATA COMPUTING, INTERNET OF PEOPLE AND SMART CITY INNOVATION (SMARTWORLD/SCALCOM/UIC/ATC/CBDCOM/IOP/SCI), 2018, : 1335 - 1340
  • [28] Measuring Progress in Fine-grained Vision-and-Language Understanding
    Bugliarello, Emanuele
    Sartran, Laurent
    Agrawal, Aishwarya
    Hendricks, Lisa Anne
    Nematzadeh, Aida
    PROCEEDINGS OF THE 61ST ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL 2023, VOL 1, 2023, : 1559 - 1582
  • [29] FineGym: A Hierarchical Video Dataset for Fine-grained Action Understanding
    Shao, Dian
    Zhao, Yue
    Dai, Bo
    Lin, Dahua
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 2613 - 2622
  • [30] Understanding archetypes of fake news via fine-grained classification
    Wang, Liqiang
    Wang, Yafang
    de Melo, Gerard
    Weikum, Gerhard
    SOCIAL NETWORK ANALYSIS AND MINING, 2019, 9 (01)