MARR: A Multi-Agent Reinforcement Resetter for Redirected Walking

被引:0
作者
Lee, Ho Jung [1 ]
Jeon, Sang-Bin [1 ]
Cho, Yong-Hun [2 ]
Lee, In-Kwon [1 ]
机构
[1] Yonsei Univ, Dept Comp Sci, Seoul 03722, South Korea
[2] Korea Univ, Digital EXPerience Lab, Seoul 03722, South Korea
基金
新加坡国家研究基金会;
关键词
Legged locomotion; Reinforcement learning; Aerospace electronics; Resists; Training; Optimization; Space exploration; Redirected walking; reinforcement learning; resetting; virtual reality;
D O I
10.1109/TVCG.2024.3368043
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The reset technique of Redirected Walking (RDW) forcibly reorients the user's direction overtly to avoid collisions with boundaries, obstacles, or other users in the physical space. However, excessive resetting can decrease the user's sense of immersion and presence. Several RDW studies have been conducted to address this issue. Among them, much research has been done on reset techniques that reduce the number of resets by devising reset direction rules or optimizing them for a given environment. However, existing optimization studies on reset techniques have mainly focused on a single-user environment. In a multi-user environment, the dynamic movement of other users and static obstacles in the physical space increase the possibility of resetting. In this study, we propose Multi-Agent Reinforcement Resetter (MARR), which resets the user taking into account both physical obstacles and multi-user movement to minimize the number of resets. MARR is trained using multi-agent reinforcement learning to determine the optimal reset direction in different environments. This approach allows MARR to effectively account for different environmental contexts, including arbitrary physical obstacles and the dynamic movements of other users in the same physical space. We compared MARR to other reset technologies through simulation tests and user studies, and found that MARR outperformed the existing methods. MARR improved performance by learning the optimal reset direction for each subtle technique used in training. MARR has the potential to be applied to new subtle techniques proposed in the future. Overall, our study confirmed that MARR is an effective reset technique in multi-user environments.
引用
收藏
页码:1664 / 1676
页数:13
相关论文
共 50 条
  • [21] Hierarchical Multi-Agent Meta-Reinforcement Learning for Cross-Channel Bidding
    He, Shenghong
    Yu, Chao
    Lin, Qian
    Mao, Shangqin
    Tang, Bo
    Xie, Qianlong
    Wang, Xingxing
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2025, 37 (03) : 1241 - 1254
  • [22] Safe and Efficient Multi-Agent Collision Avoidance With Physics-Informed Reinforcement Learning
    Feng, Pu
    Shi, Rongye
    Wang, Size
    Liang, Junkang
    Yu, Xin
    Li, Simin
    Wu, Wenjun
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (12): : 11138 - 11145
  • [23] Automatic partitioning for multi-agent reinforcement learning
    Sun, R
    Peterson, T
    ICONIP'98: THE FIFTH INTERNATIONAL CONFERENCE ON NEURAL INFORMATION PROCESSING JOINTLY WITH JNNS'98: THE 1998 ANNUAL CONFERENCE OF THE JAPANESE NEURAL NETWORK SOCIETY - PROCEEDINGS, VOLS 1-3, 1998, : 268 - 271
  • [24] Distributed reinforcement learning in multi-agent networks
    Kar, Soummya
    Moura, Jose M. F.
    Poor, H. Vincent
    2013 IEEE 5TH INTERNATIONAL WORKSHOP ON COMPUTATIONAL ADVANCES IN MULTI-SENSOR ADAPTIVE PROCESSING (CAMSAP 2013), 2013, : 296 - +
  • [25] Reinforcement Learning for Multi-Agent Competitive Scenarios
    Coutinho, Manuel
    Reis, Luis Paulo
    2022 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS (ICARSC), 2022, : 130 - 135
  • [26] Specification Aware Multi-Agent Reinforcement Learning
    Ritz, Fabian
    Phan, Thomy
    Mueller, Robert
    Gabor, Thomas
    Sedlmeier, Andreas
    Zeller, Marc
    Wieghardt, Jan
    Schmid, Reiner
    Sauer, Horst
    Klein, Cornel
    Linnhoff-Popien, Claudia
    AGENTS AND ARTIFICIAL INTELLIGENCE, ICAART 2021, 2022, 13251 : 3 - 21
  • [27] Multi-agent deep reinforcement learning: a survey
    Sven Gronauer
    Klaus Diepold
    Artificial Intelligence Review, 2022, 55 : 895 - 943
  • [28] A Review of Multi-Agent Reinforcement Learning Algorithms
    Liang, Jiaxin
    Miao, Haotian
    Li, Kai
    Tan, Jianheng
    Wang, Xi
    Luo, Rui
    Jiang, Yueqiu
    ELECTRONICS, 2025, 14 (04):
  • [29] SCM network with multi-agent reinforcement learning
    Zhao, Gang
    Sun, Ruoying
    FIFTH WUHAN INTERNATIONAL CONFERENCE ON E-BUSINESS, VOLS 1-3, 2006, : 1294 - 1300
  • [30] Multi-Agent Reinforcement Learning for Highway Platooning
    Kolat, Mate
    Becsi, Tamas
    ELECTRONICS, 2023, 12 (24)