MARR: A Multi-Agent Reinforcement Resetter for Redirected Walking

被引:0
作者
Lee, Ho Jung [1 ]
Jeon, Sang-Bin [1 ]
Cho, Yong-Hun [2 ]
Lee, In-Kwon [1 ]
机构
[1] Yonsei Univ, Dept Comp Sci, Seoul 03722, South Korea
[2] Korea Univ, Digital EXPerience Lab, Seoul 03722, South Korea
基金
新加坡国家研究基金会;
关键词
Legged locomotion; Reinforcement learning; Aerospace electronics; Resists; Training; Optimization; Space exploration; Redirected walking; reinforcement learning; resetting; virtual reality;
D O I
10.1109/TVCG.2024.3368043
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The reset technique of Redirected Walking (RDW) forcibly reorients the user's direction overtly to avoid collisions with boundaries, obstacles, or other users in the physical space. However, excessive resetting can decrease the user's sense of immersion and presence. Several RDW studies have been conducted to address this issue. Among them, much research has been done on reset techniques that reduce the number of resets by devising reset direction rules or optimizing them for a given environment. However, existing optimization studies on reset techniques have mainly focused on a single-user environment. In a multi-user environment, the dynamic movement of other users and static obstacles in the physical space increase the possibility of resetting. In this study, we propose Multi-Agent Reinforcement Resetter (MARR), which resets the user taking into account both physical obstacles and multi-user movement to minimize the number of resets. MARR is trained using multi-agent reinforcement learning to determine the optimal reset direction in different environments. This approach allows MARR to effectively account for different environmental contexts, including arbitrary physical obstacles and the dynamic movements of other users in the same physical space. We compared MARR to other reset technologies through simulation tests and user studies, and found that MARR outperformed the existing methods. MARR improved performance by learning the optimal reset direction for each subtle technique used in training. MARR has the potential to be applied to new subtle techniques proposed in the future. Overall, our study confirmed that MARR is an effective reset technique in multi-user environments.
引用
收藏
页码:1664 / 1676
页数:13
相关论文
共 50 条
  • [31] Reinforcement learning of multi-agent communicative acts
    Hoet S.
    Sabouret N.
    Revue d'Intelligence Artificielle, 2010, 24 (02) : 159 - 188
  • [32] Multi-agent Reinforcement Learning for Service Composition
    Lei, Yu
    Yu, Philip S.
    PROCEEDINGS 2016 IEEE INTERNATIONAL CONFERENCE ON SERVICES COMPUTING (SCC 2016), 2016, : 790 - 793
  • [33] Reinforcement Learning-Based Redirection Controller for Efficient Redirected Walking in Virtual Maze Environment
    Shibayama, Wataru
    Shirakawa, Shinichi
    ADVANCES IN COMPUTER GRAPHICS, CGI 2020, 2020, 12221 : 33 - 45
  • [34] Discovering Latent Variables for the Tasks With Confounders in Multi-Agent Reinforcement Learning
    Jiang, Kun
    Liu, Wenzhang
    Wang, Yuanda
    Dong, Lu
    Sun, Changyin
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2024, 11 (07) : 1591 - 1604
  • [35] Applications of Multi-Agent Reinforcement Learning in Future Internet: A Comprehensive Survey
    Li, Tianxu
    Zhu, Kun
    Nguyen Cong Luong
    Niyato, Dusit
    Wu, Qihui
    Zhang, Yang
    Chen, Bing
    IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2022, 24 (02): : 1240 - 1279
  • [36] A Cooperative Multi-Agent Reinforcement Learning Method Based on Coordination Degree
    Cui, Haoyan
    Zhang, Zhen
    IEEE ACCESS, 2021, 9 : 123805 - 123814
  • [37] Trustable Policy Collaboration Scheme for Multi-Agent Stigmergic Reinforcement Learning
    Xu, Xing
    Li, Rongpeng
    Zhao, Zhifeng
    Zhang, Honggang
    IEEE COMMUNICATIONS LETTERS, 2022, 26 (04) : 823 - 827
  • [38] Scalable Autonomous Separation Assurance With Heterogeneous Multi-Agent Reinforcement Learning
    Brittain, Marc
    Wei, Peng
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2022, 19 (04) : 2837 - 2848
  • [39] Consensus Multi-Agent Reinforcement Learning for Volt-VAR Control in Power Distribution Networks
    Gao, Yuanqi
    Wang, Wei
    Yu, Nanpeng
    IEEE TRANSACTIONS ON SMART GRID, 2021, 12 (04) : 3594 - 3604
  • [40] PowerNet: Multi-Agent Deep Reinforcement Learning for Scalable Powergrid Control
    Chen, Dong
    Chen, Kaian
    Li, Zhaojian
    Chu, Tianshu
    Yao, Rui
    Qiu, Feng
    Lin, Kaixiang
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2022, 37 (02) : 1007 - 1017