Cross-media retrieval based on linear discriminant analysis

被引:5
作者
Qi, Yudan [1 ]
Zhang, Huaxiang [1 ,2 ]
Zhang, Bin [1 ]
Wang, Li [1 ]
Zheng, Shunxin [1 ]
机构
[1] Shandong Normal Univ, Sch Informat Sci & Engn, Jinan 250014, Shandong, Peoples R China
[2] Shandong Normal Univ, Inst Data Sci & Technol, Jinan 250014, Shandong, Peoples R China
基金
中国国家自然科学基金;
关键词
Cross-media retrieval; Correlation analysis; Semantic information; Linear discriminant analysis;
D O I
10.1007/s11042-018-6994-1
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Existing cross-media retrieval approaches usually project low-level features from different modalities of data into a common subspace, in which the similarity of multi-modal data can be measured directly. However, most of the previous subspace learning methods ignore the discriminative property of multi-modal data which may lead to suboptimal cross-media retrieval performance. To address this problem, we propose a novel approach to cross-media retrieval framework based on Linear Discriminant Analysis (LDA), which integrates the correlation between textual features and visual features to learn a pair of projection matrices so that we can project the low-level heterogeneous features into a shared feature space by the transformation matrices. Thus the discriminative characteristic of textual modality is transferred to the corresponding visual features via the correlation analysis process. Experiments on three benchmark datasets show the effectiveness of our approach.
引用
收藏
页码:24249 / 24268
页数:20
相关论文
共 42 条
  • [1] Andrienko G., 2013, Introduction, P1
  • [2] [Anonymous], 2003, P ACM INT C MULT ACM
  • [3] [Anonymous], 2016, P 25 INT JOINT C ART
  • [4] [Anonymous], MULTIMED TOOLS APPL
  • [5] [Anonymous], 2010, LEARNING SIMILARITY
  • [6] [Anonymous], ENCY MEASUREMENT STA
  • [7] [Anonymous], 2005, P INT C MUS INF RETR
  • [8] Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection
    Belhumeur, PN
    Hespanha, JP
    Kriegman, DJ
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1997, 19 (07) : 711 - 720
  • [9] Correlational spectral clustering
    Blaschko, Matthew B.
    Lampert, Christoph H.
    [J]. 2008 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOLS 1-12, 2008, : 93 - +
  • [10] On the Role of Correlation and Abstraction in Cross-Modal Multimedia Retrieval
    Costa Pereira, Jose
    Coviello, Emanuele
    Doyle, Gabriel
    Rasiwasia, Nikhil
    Lanckriet, Gert R. G.
    Levy, Roger
    Vasconcelos, Nuno
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2014, 36 (03) : 521 - 535