Robustness evaluation of trust and reputation systems using a deep reinforcement learning approach

被引:2
|
作者
Bidgoly, Amir Jalaly [1 ]
Arabi, Fereshteh [1 ]
机构
[1] Univ Qom, Dept Informat Technol & Comp Engn, Qom, Iran
关键词
Trust and reputation; Robustness; Attacks; Deep reinforcement learning; QUANTITATIVE VERIFICATION; MODEL; MANAGEMENT; FRAMEWORK;
D O I
10.1016/j.cor.2023.106250
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
One of the biggest challenges facing trust and reputation systems (TRSs) is evaluating their ability to withstand various attacks, as these systems are vulnerable to multiple types of attacks. While simulation methods have been used to evaluate TRSs, they are limited because they cannot detect new attacks and do not ensure the system's overall robustness. To address this limitation, verification methods have been proposed that can examine the entire state space and detect all possible attacks. However, these methods are not always practical for large models and real environments because they suffer from the state space explosion problem. To tackle this issue, we propose a deep reinforcement learning approach for evaluating the robustness of TRSs. In this approach, an agent can learn how to attack a system and find the best attack plan without prior knowledge. Additionally, our method avoids the state space explosion problem because it uses a deep Q-network instead of storing and examining the entire state space. We tested our proposed method on five well-known reputation models, assessing various attack goals such as selfishness, maliciousness, competition, and slandering. The results showed that our method was successful in identifying the best attack plan and executing it successfully in the system, demonstrating its effectiveness in evaluating the robustness of TRSs.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Model checking of robustness properties in trust and reputation systems
    Ghasempouri, Seyed Asgary
    Ladani, Behrouz Tork
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2020, 108 : 302 - 319
  • [2] Methods for reliability evaluation of trust and reputation systems
    Janiszewski, Marek B.
    PHOTONICS APPLICATIONS IN ASTRONOMY, COMMUNICATIONS, INDUSTRY, AND HIGH-ENERGY PHYSICS EXPERIMENTS 2016, 2016, 10031
  • [3] Investigating the Robustness and Generalizability of Deep Reinforcement Learning Based Optimal Trade Execution Systems
    Lin, Siyu
    Beling, Peter A.
    INTELLIGENT COMPUTING, VOL 2, 2021, 284 : 912 - 926
  • [4] Robustness and performance of Deep Reinforcement Learning
    Al-Nima, Raid Rafi Omar
    Han, Tingting
    Al-Sumaidaee, Saadoon Awad Mohammed
    Chen, Taolue
    Woo, Wai Lok
    APPLIED SOFT COMPUTING, 2021, 105
  • [5] On the Robustness of Controlled Deep Reinforcement Learning for Slice Placement
    Esteves, Jose Jurandir Alves
    Boubendir, Amina
    Guillemin, Fabrice
    Sens, Pierre
    JOURNAL OF NETWORK AND SYSTEMS MANAGEMENT, 2022, 30 (03)
  • [6] On the Robustness of Controlled Deep Reinforcement Learning for Slice Placement
    Jose Jurandir Alves Esteves
    Amina Boubendir
    Fabrice Guillemin
    Pierre Sens
    Journal of Network and Systems Management, 2022, 30
  • [7] Adversarial Robustness of Deep Reinforcement Learning Based Dynamic Recommender Systems
    Wang, Siyu
    Cao, Yuanjiang
    Chen, Xiaocong
    Yao, Lina
    Wang, Xianzhi
    Sheng, Quan Z.
    FRONTIERS IN BIG DATA, 2022, 5
  • [8] Optimization of the Operation and Maintenance of renewable energy systems by Deep Reinforcement Learning
    Pinciroli, Luca
    Baraldi, Piero
    Ballabio, Guido
    Compare, Michele
    Zio, Enrico
    RENEWABLE ENERGY, 2022, 183 : 752 - 763
  • [9] Deep learning and reinforcement learning approach on microgrid
    Chandrasekaran, Kumar
    Kandasamy, Prabaakaran
    Ramanathan, Srividhya
    INTERNATIONAL TRANSACTIONS ON ELECTRICAL ENERGY SYSTEMS, 2020, 30 (10):
  • [10] An approach for automatic parameters evaluation in unconventional oil reservoirs with deep reinforcement learning
    Dong, Peng
    Liao, Xinwei
    Chen, Zhiming
    JOURNAL OF PETROLEUM SCIENCE AND ENGINEERING, 2022, 209