DDoD: Dual Denial of Decision Attacks on Human-AI Teams

被引:1
作者
Tag, Benjamin [1 ]
van Berkel, Niels [2 ]
Verma, Sunny [3 ]
Zhao, Benjamin Zi Hao [3 ]
Berkovsky, Shlomo [3 ]
Kaafar, Dali [3 ]
Kostakos, Vassilis [1 ]
Ohrimenko, Olga [1 ]
机构
[1] Univ Melbourne, Parkville, Vic 3010, Australia
[2] Aalborg Univ, DK-9220 Aalborg, Denmark
[3] Macquarie Univ, Macquarie Pk, NSW 2109, Australia
关键词
Artificial intelligence; Task analysis; Data models; Predictive models; Uncertainty; Training; Training data;
D O I
10.1109/MPRV.2022.3218773
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Artificial intelligence (AI) systems have been increasingly used to make decision-making processes faster, more accurate, and more efficient. However, such systems are also at constant risk of being attacked. While the majority of attacks targeting AI-based applications aim to manipulate classifiers or training data and alter the output of an AI model, recently proposed sponge attacks against AI models aim to impede the classifier's execution by consuming substantial resources. In this work, we propose dual denial of decision (DDoD) attacks against collaborative human-AI teams. We discuss how such attacks aim to deplete both computational and human resources, and significantly impair decision-making capabilities. We describe DDoD on human and computational resources and present potential risk scenarios in a series of exemplary domains.
引用
收藏
页码:77 / 84
页数:8
相关论文
共 21 条
  • [1] Anderson R., 2020, Security Engineering: A Guide to Building Dependable Distributed Systems
  • [2] Balasubramanian Ramnath., 2018, Insurance 2030-the impact of AI on the future of insurance
  • [3] Biggio B., 2012, P 29 INT C MACHINE L
  • [4] Boucher N, 2022, P IEEE S SECUR PRIV, P1987, DOI [10.1109/SP46214.2022.9833641, 10.1109/SP46214.2022.00045]
  • [5] Chen XY, 2017, Arxiv, DOI [arXiv:1712.05526, DOI 10.48550/ARXIV.1712.05526]
  • [6] Human-AI collaboration in data science: Exploring data scientists’ perceptions of automated AI
    Wang D.
    Weisz J.D.
    Muller M.
    Ram P.
    Geyer W.
    Dugan C.
    Tausczik Y.
    Samulowitz H.
    Gray A.
    [J]. Proceedings of the ACM on Human-Computer Interaction, 2019, 3 (CSCW):
  • [7] Fundamentals of physiological computing
    Fairclough, Stephen H.
    [J]. INTERACTING WITH COMPUTERS, 2009, 21 (1-2) : 133 - 145
  • [8] Goodfellow IJ, 2015, Arxiv, DOI [arXiv:1412.6572, DOI 10.48550/ARXIV.1412.6572]
  • [9] Jacovi A., 2021, P 2021 ACM C FAIRNES, P624, DOI DOI 10.1145/3442188.3445923
  • [10] Human Cognition Through the Lens of Social Engineering Cyberattacks
    Montanez, Rosana
    Golob, Edward
    Xu, Shouhuai
    [J]. FRONTIERS IN PSYCHOLOGY, 2020, 11