Evaluating Retrieval for Multi-domain Scientific Publications

被引：0

作者：

Ide, Nancy ^{[1
]}

Suderman, Keith ^{[2
]}

Tu, Jingxuan ^{[1
]}

Verhagen, Marc ^{[1
]}

Peters, Shanan E. ^{[3
]}

Ross, Ian ^{[3
]}

Lawson, John ^{[1
]}

Borg, Andrew ^{[1
]}

Pustejovsky, James ^{[1
]}

机构：

[1] Brandeis Univ, Waltham, MA USA

[2] Johns Hopkins Univ, Baltimore, MD USA

[3] Univ Wisconsin Madison, Madison, WI USA

来源：

LREC 2022: THIRTEEN INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION | 2022年

基金：

美国国家科学基金会;

关键词：

document retrieval; evaluation; retrieval benchmarks;

D O I：

暂无

中图分类号：

TP39 [计算机的应用];

学科分类号：

081203 ; 0835 ;

摘要：

This paper provides an overview of the xDD/LAPPS Grid framework and provides results of evaluating the AskMe retrieval engine using datasets included in the BEIR benchmark. Our primary goal is to determine a solid baseline of performance to guide further development of our retrieval capabilities. Beyond this, we aim to dig deeper to determine when and why certain approaches perform well (or badly) on both in-domain and out-of-domain data, an issue that has to date received relatively little attention.

引用

页码：4569 / 4576

页数：8

共 39 条

[1]

Boteva Vera, 2016, Advances in Information Retrieval. 38th European Conference on IR Research, ECIR 2016. Proceedings

[2]

LNCS 9626, P716, DOI 10.1007/978-3-319-30671-1_58

[3] Context-Aware Term Weighting For First Stage Passage Retrieval [J].

Dai, Zhuyun ;

Callan, Jamie .

PROCEEDINGS OF THE 43RD INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '20), 2020, :1533-1536

[4]

Devlin J, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P4171

[5] Galaxy: a comprehensive approach for supporting accessible, reproducible, and transparent computational research in the life sciences [J].

Goecks, Jeremy ;

Nekrutenko, Anton ;

Taylor, James .

GENOME BIOLOGY, 2010, 11 (08)

[6]

Guo M., 2020, MULTIREQA CROSS DOMA

[7]

Hall M., 2009, ACM SIGKDD Explor. Newslett., V11, P10, DOI [10.1145/1656274.1656278, DOI 10.1145/1656274.1656278]

[8]

Hinrichs E, 2018, PROCEEDINGS OF THE ELEVENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION (LREC 2018), P1294

[9]

Hofstatter S., 2021, ABS210406967 CORR

[10]

Honnibal M., 2017, SPACY 2 NATURAL LANG

← 1 2 3 4 →