An Information Visualization Tool for the Interactive Component-Based Evaluation of Search Engines

被引：1

作者：

Rocco, Giacomo ^{[1
]}

Silvello, Gianmaria ^{[1
]}

机构：

[1] Univ Padua, Dept Informat Engn, Padua, Italy

来源：

DIGITAL LIBRARIES: THE ERA OF BIG DATA AND DATA SCIENCE, IRCDL 2020 | 2020年 / 1177卷

关键词：

Information Retrieval; Evaluation; Grid of Points; Information visualization; Sankey; RETRIEVAL;

D O I：

10.1007/978-3-030-39905-4_3

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

In this paper, we present an InfoVis tool based on SanKey diagrams for the exploration of large combinatorial combinations of IR components - the Grid of Points (GoP). The goal of this tool is to ease the comprehension of the behavior of single IR components within fully functioning off-the-shelf IR systems without recurring to complex statistical tools. In order to assess the quality of the proposed SanKey-based InfoVis tool we conduceted an initial user study that led to interesting conclusions, yet to be validated in a future and more comprehensive study.

引用

页码：15 / 25

页数：11

共 16 条

[1]

Angelini M., 2018, IN PRESS, DOI [10.1016/j.jvlc.2013.12.003, DOI 10.1016/J.JVLC.2013.12.003]

[2] A Visual Analytics Approach for What-If Analysis of Information Retrieval Systems [J].

Angelini, Marco ;

Ferro, Nicola ;

Santucci, Giuseppe ;

Silvello, Gianmaria .

SIGIR'16: PROCEEDINGS OF THE 39TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2016, :1081-1084

[3] VIRTUE: A visual tool for information retrieval performance evaluation and failure analysis [J].

Angelini, Marco ;

Ferro, Nicola ;

Santucci, Giuseppe ;

Silvello, Gianmaria .

JOURNAL OF VISUAL LANGUAGES AND COMPUTING, 2014, 25 (04) :394-413

[4]

[Anonymous], 1991, P 14 ANN INT ACM SIG

[5] A graphical user interface for the retrieval of hierarchically structured documents [J].

Crestani, F ;

Vegas, J ;

de la Fuente, P .

INFORMATION PROCESSING & MANAGEMENT, 2004, 40 (02) :269-289

[6] A MULTIPLE COMPARISON PROCEDURE FOR COMPARING SEVERAL TREATMENTS WITH A CONTROL [J].

DUNNETT, CW .

JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1955, 50 (272) :1096-1121

[7] Toward an Anatomy of IR System Component Performances [J].

Ferro, Nicola ;

Silvello, Gianmaria .

JOURNAL OF THE ASSOCIATION FOR INFORMATION SCIENCE AND TECHNOLOGY, 2018, 69 (02) :187-200

[8] A General Linear Mixed Models Approach to Study System Component Effects [J].

Ferro, Nicola ;

Silvello, Gianmaria .

SIGIR'16: PROCEEDINGS OF THE 39TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2016, :25-34

[9] 3.5K runs, 5K topics, 3M assessments and 70M measures: What trends in 10 years of Adhoc-ish CLEF? [J].

Ferro, Nicola ;

Silvello, Gianmaria .

INFORMATION PROCESSING & MANAGEMENT, 2017, 53 (01) :175-202

[10]

Hearst MA, 2011, COMMUN ACM, V54, P60, DOI [10.1145/2018396.2018114, 10.1145/2018396.2018414]

← 1 2 →