Overview of the CLEF-2022 CheckThat! Lab on Fighting the COVID-19 Infodemic and Fake News Detection

被引：14

作者：

Nakov, Preslav ^{[1
]}

Barron-Cedeno, Alberto ^{[2
]}

Martino, Giovanni da San ^{[3
]}

Alam, Firoj ^{[4
]}

Struss, Julia Maria ^{[5
]}

Mandl, Thomas ^{[6
]}

Miguez, Ruben ^{[7
]}

Caselli, Tommaso ^{[8
]}

Kutlu, Mucahid ^{[9
]}

Zaghouani, Wajdi ^{[10
]}

Li, Chengkai ^{[11
]}

Shaar, Shaden ^{[12
]}

Shahi, Gautam Kishore ^{[13
]}

Mubarak, Hamdy ^{[4
]}

Nikolov, Alex ^{[14
]}

Babulkov, Nikolay ^{[15
]}

Kartal, Yavuz Selim ^{[16
]}

Wiegand, Michael ^{[17
]}

Siegel, Melanie ^{[18
]}

Kohler, Juliane ^{[5
]}

机构：

[1] Mohamed Bin Zayed Univ Artificial Intelligence, Abu Dhabi, U Arab Emirates

[2] Univ Bologna, Forli, Italy

[3] Univ Padua, Padua, Italy

[4] HBKU, Qatar Comp Res Inst, Ar Rayyan, Qatar

[5] Univ Appl Sci Potsdam, Potsdam, Germany

[6] Univ Hildesheim, Hildesheim, Germany

[7] Newtral Media Audiovisual, Madrid, Spain

[8] Univ Groningen, Groningen, Netherlands

[9] TOBB Univ Econ & Technol, Ankara, Turkey

[10] Hamad Bin Khalifa Univ, Ar Rayyan, Qatar

[11] Univ Texas Arlington, Arlington, TX 76019 USA

[12] Cornell Univ, Ithaca, NY USA

[13] Univ Duisburg Essen, Duisburg, Germany

[14] CheckStep, London, England

[15] Sofia Univ, Sofia, Bulgaria

[16] GESIS Leibniz Inst Social Sci, Mannheim, Germany

[17] Univ Klagenfurt, Klagenfurt, Austria

[18] Darmstadt Univ Appl Sci, Darmstadt, Germany

来源：

EXPERIMENTAL IR MEETS MULTILINGUALITY, MULTIMODALITY, AND INTERACTION (CLEF 2022) | 2022年 / 13390卷

关键词：

Fact-Checking; Disinformation; Misinformation; Check-Worthiness; Verified Claim Retrieval; Fake News; COVID-19;

D O I：

10.1007/978-3-031-13643-6_29

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

We describe the fifth edition of the CheckThat! lab, part of the 2022 Conference and Labs of the Evaluation Forum (CLEF). The lab evaluates technology supporting tasks related to factuality in multiple languages: Arabic, Bulgarian, Dutch, English, German, Spanish, and Turkish. Task 1 asks to identify relevant claims in tweets in terms of check-worthiness, verifiability, harmfullness, and attention-worthiness. Task 2 asks to detect previously fact-checked claims that could be relevant to fact-check a new claim. It targets both tweets and political debates/speeches. Task 3 asks to predict the veracity of the main claim in a news article. CheckThat! was the most popular lab at CLEF-2022 in terms of team registrations: 137 teams. More than one-third (37%) of them actually participated: 18, 7, and 26 teams submitted 210, 37, and 126 official runs for tasks 1, 2, and 3, respectively.

引用

页码：495 / 520

页数：26

共 99 条

[1] Agirre Eneko, 2016, P 10 INT WORKSH SEM, P497, DOI DOI 10.18653/V1/S16-1081
[2] Agrestia S., 2022, WORKING NOTES CLEF 2
[3] Alam F., 2021, P INT AAAI C WEB SOC, P913
[4] Alam F, 2021, FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2021, P611
[5] Ali Z.S., 2021, P 6 AR NAT LANG PROC, P231
[6] Althabiti S, 2022, WORKING NOTES CLEF
[7] Arif M., 2022, P WORKSH NOT CLEF, P434
[8] VERA: A Platform for Veracity Estimation over Web Data
Ba, Mouhamadou Lamine
Berti-Equille, Laure
Shah, Kushal
Hammady, Hossam M.
[J]. PROCEEDINGS OF THE 25TH INTERNATIONAL CONFERENCE ON WORLD WIDE WEB (WWW'16 COMPANION), 2016, : 159 - 162
[9] Balouchzahi F., 2021, CLEF WORKING NOTES, P455
[10] Baly R, 2020, 58TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2020), P3364

← 1 2 3 4 5 6 7 8 9 10 →