Robustness evaluation of trust and reputation systems using a deep reinforcement learning approach

被引:2
|
作者
Bidgoly, Amir Jalaly [1 ]
Arabi, Fereshteh [1 ]
机构
[1] Univ Qom, Dept Informat Technol & Comp Engn, Qom, Iran
关键词
Trust and reputation; Robustness; Attacks; Deep reinforcement learning; QUANTITATIVE VERIFICATION; MODEL; MANAGEMENT; FRAMEWORK;
D O I
10.1016/j.cor.2023.106250
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
One of the biggest challenges facing trust and reputation systems (TRSs) is evaluating their ability to withstand various attacks, as these systems are vulnerable to multiple types of attacks. While simulation methods have been used to evaluate TRSs, they are limited because they cannot detect new attacks and do not ensure the system's overall robustness. To address this limitation, verification methods have been proposed that can examine the entire state space and detect all possible attacks. However, these methods are not always practical for large models and real environments because they suffer from the state space explosion problem. To tackle this issue, we propose a deep reinforcement learning approach for evaluating the robustness of TRSs. In this approach, an agent can learn how to attack a system and find the best attack plan without prior knowledge. Additionally, our method avoids the state space explosion problem because it uses a deep Q-network instead of storing and examining the entire state space. We tested our proposed method on five well-known reputation models, assessing various attack goals such as selfishness, maliciousness, competition, and slandering. The results showed that our method was successful in identifying the best attack plan and executing it successfully in the system, demonstrating its effectiveness in evaluating the robustness of TRSs.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Improving Robustness of Deep Reinforcement Learning Agents: Environment Attack based on the Critic Network
    Schott, Lucas
    Hajri, Hatem
    Lamprier, Sylvain
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [32] Multi-echelon inventory optimization using deep reinforcement learning
    Geevers, Kevin
    van Hezewijk, Lotte
    Mes, Martijn R. K.
    CENTRAL EUROPEAN JOURNAL OF OPERATIONS RESEARCH, 2024, 32 (03) : 653 - 683
  • [33] Trust-Based Social Networks with Computing, Caching and Communications: A Deep Reinforcement Learning Approach
    He, Ying
    Liang, Chengchao
    Yu, F. Richard
    Han, Zhu
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2020, 7 (01): : 66 - 79
  • [34] Deep Reinforcement Learning for Swarm Systems
    Huettenrauch, Maximilian
    Sosic, Adrian
    Neumann, Gerhard
    JOURNAL OF MACHINE LEARNING RESEARCH, 2019, 20
  • [35] A deep reinforcement learning approach for repair-based maintenance of multi-unit systems using proportional hazards model
    Najafi, Seyedvahid
    Lee, Chi-Guhn
    RELIABILITY ENGINEERING & SYSTEM SAFETY, 2023, 234
  • [36] Equipment Health Indicator Learning Using Deep Reinforcement Learning
    Zhang, Chi
    Gupta, Chetan
    Farahat, Ahmed
    Ristovski, Kosta
    Ghosh, Dipanjan
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2018, PT III, 2019, 11053 : 488 - 504
  • [37] Decision Making in Monopoly Using a Hybrid Deep Reinforcement Learning Approach
    Bonjour, Trevor
    Haliem, Marina
    Alsalem, Aala
    Thomas, Shilpa
    Li, Hongyu
    Aggarwal, Vaneet
    Kejriwal, Mayank
    Bhargava, Bharat
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2022, 6 (06): : 1335 - 1344
  • [38] A Trust Evaluation Model for E-Learning Systems
    Tan, Wenan
    Chen, Senbo
    Li, Jingxian
    Li, Lingxia
    Wang, Tong
    Hu, Xiaoming
    SYSTEMS RESEARCH AND BEHAVIORAL SCIENCE, 2014, 31 (03) : 353 - 365
  • [39] Using Information Theory to Improve the Robustness of Trust Systems
    Wang, Dongxia
    Muller, Tim
    Irissappane, Athirai A.
    Zhang, Jie
    Liu, Yang
    PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS & MULTIAGENT SYSTEMS (AAMAS'15), 2015, : 791 - 799
  • [40] Trust-Augmented Deep Reinforcement Learning for Federated Learning Client Selection
    Rjoub, Gaith
    Wahab, Omar Abdel
    Bentahar, Jamal
    Cohen, Robin
    Bataineh, Ahmed Saleh
    INFORMATION SYSTEMS FRONTIERS, 2024, 26 (04) : 1261 - 1278