A Learning to Rank framework applied to text-image retrieval

被引:0
作者
David Buffoni
Sabrina Tollari
Patrick Gallinari
机构
[1] Université Pierre et Marie CURIE - Paris 6 / LIP6,
来源
Multimedia Tools and Applications | 2012年 / 60卷
关键词
Learning to Rank; Text-image retrieval; OWPC; Visuo-textual fusion; Pooling for Learning to Rank;
D O I
暂无
中图分类号
学科分类号
摘要
We present a framework based on a Learning to Rank setting for a text-image retrieval task. In Information Retrieval, the goal is to compute the similarity between a document and an user query. In the context of text-image retrieval where several similarities exist, human intervention is often needed to decide on the way to combine them. On the other hand, with the Learning to Rank approach the combination of the similarities is done automatically. Learning to Rank is a paradigm where the learnt objective function is able to produce a ranked list of images when a user query is given. These score functions are generally a combination of similarities between a document and a query. In the past, Learning to Rank algorithms were successfully applied to text retrieval where they outperformed baselines such as BM25 or TFIDF. This inspired us to apply our state-of-the-art algorithm, called OWPC (Usunier et al. 2009), to the text-image retrieval task. At this time, no benchmarks are available, therefore we present a framework for building one. The empirical validation of this algorithm is done on the dataset constructed through comparison of typical text-image retrieval similarities. In both cases, visual only and text and visual, our algorithm performs better than a simple baseline.
引用
收藏
页码:161 / 180
页数:19
相关论文
共 50 条
[41]   A Simple yet Effective Framework for Active Learning to Rank [J].
Qingzhong Wang ;
Haifang Li ;
Haoyi Xiong ;
Wen Wang ;
Jiang Bian ;
Yu Lu ;
Shuaiqiang Wang ;
Zhicong Cheng ;
Dejing Dou ;
Dawei Yin .
Machine Intelligence Research, 2024, 21 :169-183
[42]   Large-Scale Adversarial Sports Play Retrieval with Learning to Rank [J].
Di, Mingyang ;
Klabjan, Diego ;
Sha, Long ;
Lucey, Patrick .
ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2018, 12 (06)
[43]   Face Image Quality Assessment Based on Learning to Rank [J].
Chen, Jiansheng ;
Deng, Yu ;
Bai, Gaocheng ;
Su, Guangda .
IEEE SIGNAL PROCESSING LETTERS, 2015, 22 (01) :90-94
[44]   A Structured Listwise Approach to Learning to Rank for Image Tagging [J].
Sanchez, Jorge ;
Luque, Franco ;
Lichtensztein, Leandro .
COMPUTER VISION - ECCV 2018 WORKSHOPS, PT VI, 2019, 11134 :545-559
[45]   Learning to Rank for Information Retrieval and Natural Language Processing, Second Edition [J].
Li, Hang .
Synthesis Lectures on Human Language Technologies, 2015, 7 (03) :1-123
[46]   A Self-Distilled Learning to Rank Model for Ad Hoc Retrieval [J].
Keshvari, Sanaz ;
Saeedi, Farzan ;
Yazdi, Hadi sadoghi ;
Ensan, Faezeh .
ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2024, 42 (06)
[47]   Rank-order-correlation-based feature vector context transformation for learning to rank for information retrieval [J].
Yeh, Jen-Yuan .
COMPUTER SYSTEMS SCIENCE AND ENGINEERING, 2018, 33 (01) :41-52
[48]   Learning to Rank Short Text Pairs with Convolutional Deep Neural Networks [J].
Severyn, Aliaksei ;
Moschitti, Alessandro .
SIGIR 2015: PROCEEDINGS OF THE 38TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2015, :373-382
[49]   RankViz: A visualization framework to assist interpretation of Learning to Rank algorithms [J].
Pereira, Mateus M. ;
Paulovich, Fernando, V .
COMPUTERS & GRAPHICS-UK, 2020, 93 :25-38
[50]   RankEval: An Evaluation and Analysis Framework for Learning-to-Rank Solutions [J].
Lucchese, Claudio ;
Muntean, Cristina Ioana ;
Nardini, Franco Maria ;
Perego, Raffaele ;
Trani, Salvatore .
SIGIR'17: PROCEEDINGS OF THE 40TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2017, :1281-1284