MARR: A Multi-Agent Reinforcement Resetter for Redirected Walking

被引:0
作者
Lee, Ho Jung [1 ]
Jeon, Sang-Bin [1 ]
Cho, Yong-Hun [2 ]
Lee, In-Kwon [1 ]
机构
[1] Yonsei Univ, Dept Comp Sci, Seoul 03722, South Korea
[2] Korea Univ, Digital EXPerience Lab, Seoul 03722, South Korea
基金
新加坡国家研究基金会;
关键词
Legged locomotion; Reinforcement learning; Aerospace electronics; Resists; Training; Optimization; Space exploration; Redirected walking; reinforcement learning; resetting; virtual reality;
D O I
10.1109/TVCG.2024.3368043
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
The reset technique of Redirected Walking (RDW) forcibly reorients the user's direction overtly to avoid collisions with boundaries, obstacles, or other users in the physical space. However, excessive resetting can decrease the user's sense of immersion and presence. Several RDW studies have been conducted to address this issue. Among them, much research has been done on reset techniques that reduce the number of resets by devising reset direction rules or optimizing them for a given environment. However, existing optimization studies on reset techniques have mainly focused on a single-user environment. In a multi-user environment, the dynamic movement of other users and static obstacles in the physical space increase the possibility of resetting. In this study, we propose Multi-Agent Reinforcement Resetter (MARR), which resets the user taking into account both physical obstacles and multi-user movement to minimize the number of resets. MARR is trained using multi-agent reinforcement learning to determine the optimal reset direction in different environments. This approach allows MARR to effectively account for different environmental contexts, including arbitrary physical obstacles and the dynamic movements of other users in the same physical space. We compared MARR to other reset technologies through simulation tests and user studies, and found that MARR outperformed the existing methods. MARR improved performance by learning the optimal reset direction for each subtle technique used in training. MARR has the potential to be applied to new subtle techniques proposed in the future. Overall, our study confirmed that MARR is an effective reset technique in multi-user environments.
引用
收藏
页码:1664 / 1676
页数:13
相关论文
共 50 条
  • [41] RLCharge: Imitative Multi-Agent Spatiotemporal Reinforcement Learning for Electric Vehicle Charging Station Recommendation
    Zhang, Weijia
    Liu, Hao
    Xiong, Hui
    Xu, Tong
    Wang, Fan
    Xin, Haoran
    Wu, Hua
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (06) : 6290 - 6304
  • [42] A review of cooperative multi-agent deep reinforcement learning
    Oroojlooy, Afshin
    Hajinezhad, Davood
    APPLIED INTELLIGENCE, 2023, 53 (11) : 13677 - 13722
  • [43] A Hybrid Interaction Model for Multi-Agent Reinforcement Learning
    Guisi, Douglas M.
    Ribeiro, Richardson
    Teixeira, Marcelo
    Borges, Andre P.
    Dosciatti, Eden R.
    Enembreck, Fabricio
    PROCEEDINGS OF THE 18TH INTERNATIONAL CONFERENCE ON ENTERPRISE INFORMATION SYSTEMS, VOL 2 (ICEIS), 2016, : 54 - 61
  • [44] Evaluating the Coordination of Agents in Multi-agent Reinforcement Learning
    Barton, Sean L.
    Zaroukian, Erin
    Asher, Derrik E.
    Waytowich, Nicholas R.
    INTELLIGENT HUMAN SYSTEMS INTEGRATION 2019, 2019, 903 : 765 - 770
  • [45] Rationality of reward sharing in multi-agent reinforcement learning
    Kazuteru Miyazaki
    Shigenobu Kobayashi
    New Generation Computing, 2001, 19 : 157 - 172
  • [46] Multi-Agent Reinforcement Learning: A Review of Challenges and Applications
    Canese, Lorenzo
    Cardarilli, Gian Carlo
    Di Nunzio, Luca
    Fazzolari, Rocco
    Giardino, Daniele
    Re, Marco
    Spano, Sergio
    APPLIED SCIENCES-BASEL, 2021, 11 (11):
  • [47] A review of cooperative multi-agent deep reinforcement learning
    Afshin Oroojlooy
    Davood Hajinezhad
    Applied Intelligence, 2023, 53 : 13677 - 13722
  • [48] The Cooperative Reinforcement Learning in a Multi-Agent Design System
    Liu, Hong
    Wang, Jihua
    PROCEEDINGS OF THE 2013 IEEE 17TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN (CSCWD), 2013, : 139 - 144
  • [49] A multi-agent reinforcement learning approach to robot soccer
    Yong Duan
    Bao Xia Cui
    Xin He Xu
    Artificial Intelligence Review, 2012, 38 : 193 - 211
  • [50] Multi-agent Reinforcement Learning for Urban Projects Planning
    Khelifa, Boudjemaa
    Laouar, Mohamed Ridda
    PROCEEDINGS OF THE 7TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND NEW TECHNOLOGIES (ICSENT '18), 2018,