MARR: A Multi-Agent Reinforcement Resetter for Redirected Walking

被引:0
作者
Lee, Ho Jung [1 ]
Jeon, Sang-Bin [1 ]
Cho, Yong-Hun [2 ]
Lee, In-Kwon [1 ]
机构
[1] Yonsei Univ, Dept Comp Sci, Seoul 03722, South Korea
[2] Korea Univ, Digital EXPerience Lab, Seoul 03722, South Korea
基金
新加坡国家研究基金会;
关键词
Legged locomotion; Reinforcement learning; Aerospace electronics; Resists; Training; Optimization; Space exploration; Redirected walking; reinforcement learning; resetting; virtual reality;
D O I
10.1109/TVCG.2024.3368043
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The reset technique of Redirected Walking (RDW) forcibly reorients the user's direction overtly to avoid collisions with boundaries, obstacles, or other users in the physical space. However, excessive resetting can decrease the user's sense of immersion and presence. Several RDW studies have been conducted to address this issue. Among them, much research has been done on reset techniques that reduce the number of resets by devising reset direction rules or optimizing them for a given environment. However, existing optimization studies on reset techniques have mainly focused on a single-user environment. In a multi-user environment, the dynamic movement of other users and static obstacles in the physical space increase the possibility of resetting. In this study, we propose Multi-Agent Reinforcement Resetter (MARR), which resets the user taking into account both physical obstacles and multi-user movement to minimize the number of resets. MARR is trained using multi-agent reinforcement learning to determine the optimal reset direction in different environments. This approach allows MARR to effectively account for different environmental contexts, including arbitrary physical obstacles and the dynamic movements of other users in the same physical space. We compared MARR to other reset technologies through simulation tests and user studies, and found that MARR outperformed the existing methods. MARR improved performance by learning the optimal reset direction for each subtle technique used in training. MARR has the potential to be applied to new subtle techniques proposed in the future. Overall, our study confirmed that MARR is an effective reset technique in multi-user environments.
引用
收藏
页码:1664 / 1676
页数:13
相关论文
共 50 条
  • [1] A Steering Algorithm for Redirected Walking Using Reinforcement Learning
    Strauss, Ryan R.
    Ramanujan, Raghuram
    Becker, Andrew
    Peck, Tabitha C.
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2020, 26 (05) : 1955 - 1963
  • [2] Multi-Agent Deep Reinforcement Learning for Sectional AGC Dispatch
    Li, Jiawen
    Yu, Tao
    Zhu, Hanxin
    Li, Fusheng
    Lin, Dan
    Li, Zhuohuan
    IEEE ACCESS, 2020, 8 : 158067 - 158081
  • [3] Noise Distribution Decomposition Based Multi-Agent Distributional Reinforcement Learning
    Geng, Wei
    Xiao, Baidi
    Li, Rongpeng
    Wei, Ning
    Wang, Dong
    Zhao, Zhifeng
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2025, 24 (03) : 2301 - 2314
  • [4] Feudal Latent Space Exploration for Coordinated Multi-Agent Reinforcement Learning
    Liu, Xiangyu
    Tan, Ying
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (10) : 7775 - 7783
  • [5] QSOD: Hybrid Policy Gradient for Deep Multi-agent Reinforcement Learning
    Rehman, Hafiz Muhammad Raza Ur
    On, Byung-Won
    Ningombam, Devarani Devi
    Yi, Sungwon
    Choi, Gyu Sang
    IEEE ACCESS, 2021, 9 : 129728 - 129741
  • [6] Optimal Planning for Redirected Walking Based on Reinforcement Learning in Multi-user Environment with Irregularly Shaped Physical Space
    Lee, Dong-Yong
    Cho, Yong-Hun
    Min, Dae-Hong
    Lee, In-Kwon
    2020 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES (VR 2020), 2020, : 155 - 163
  • [7] Multi-Agent Reinforcement Learning for Microgrids
    Dimeas, A. L.
    Hatziargyriou, N. D.
    IEEE POWER AND ENERGY SOCIETY GENERAL MEETING 2010, 2010,
  • [8] Multi-agent reinforcement learning: A survey
    Busoniu, Lucian
    Babuska, Robert
    De Schutter, Bart
    2006 9TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS AND VISION, VOLS 1- 5, 2006, : 1133 - +
  • [9] Multi-Technique Redirected Walking Method
    Mayor, Jesus
    Raya, Laura
    Bayona, Sofia
    Sanchez, Alberto
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2022, 10 (02) : 997 - 1008
  • [10] A Reinforcement Learning Approach to Redirected Walking with Passive Haptic Feedback
    Chen, Ze-Yin
    Li, Yi-Jun
    Wang, Miao
    Steinicke, Frank
    Zhao, Qinping
    2021 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR 2021), 2021, : 184 - 192