Optimal Robot Motion Planning in Constrained Workspaces Using Reinforcement Learning

被引:15
作者
Rousseas, Panagiotis [1 ]
Bechlioulis, Charalampos P. [1 ]
Kyriakopoulos, Kostas J. [1 ]
机构
[1] Natl Tech Univ Athens, Sch Mech Engn, Control Syst Lab, Athens, Greece
来源
2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS) | 2020年
关键词
TIME OBSTACLE AVOIDANCE; PIANO MOVERS PROBLEM; NAVIGATION;
D O I
10.1109/IROS45743.2020.9341148
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this work, a novel solution to the optimal motion planning problem is proposed, through a continuous, deterministic and provably correct approach, with guaranteed safety and which is based on a parametrized Artificial Potential Field (APF). In particular, Reinforcement Learning (RL) is applied to adjust appropriately the parameters of the underlying potential field towards minimizing the Hamilton-Jacobi-Bellman (HJB) error. The proposed method, outperforms consistently a Rapidly-exploring Random Trees (RRT*) method and consists a fertile advancement in the optimal motion planning problem.
引用
收藏
页码:6917 / 6922
页数:6
相关论文
共 23 条
[1]  
Abu-Khalaf M., 1990, NEARLY OPTIMAL CONTR
[2]   Path homotopy invariants and their application to optimal trajectory planning [J].
Bhattacharya, Subhrajit ;
Ghrist, Robert .
ANNALS OF MATHEMATICS AND ARTIFICIAL INTELLIGENCE, 2018, 84 (3-4) :139-160
[3]  
Bohlin R., 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065), P521, DOI 10.1109/ROBOT.2000.844107
[4]  
Canny J., 1988, Restricted Fragments of Numeric Planning-a Complexity
[5]   Locally-optimal multi-robot navigation under delaying disturbances using homotopy constraints [J].
Gregoire, Jean ;
Cap, Michal ;
Frazzoli, Emilio .
AUTONOMOUS ROBOTS, 2018, 42 (04) :895-907
[6]   Sampling-based algorithms for optimal motion planning [J].
Karaman, Sertac ;
Frazzoli, Emilio .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2011, 30 (07) :846-894
[7]   Probabilistic roadmaps for path planning in high-dimensional configuration spaces [J].
Kavraki, LE ;
Svestka, P ;
Latombe, JC ;
Overmars, MH .
IEEE TRANSACTIONS ON ROBOTICS AND AUTOMATION, 1996, 12 (04) :566-580
[9]   REAL-TIME OBSTACLE AVOIDANCE USING HARMONIC POTENTIAL FUNCTIONS [J].
KIM, JO ;
KHOSLA, PK .
IEEE TRANSACTIONS ON ROBOTICS AND AUTOMATION, 1992, 8 (03) :338-349
[10]   Sampling-Based Methods for Motion Planning with Constraints [J].
Kingston, Zachary ;
Moll, Mark ;
Kavraki, Lydia E. .
ANNUAL REVIEW OF CONTROL, ROBOTICS, AND AUTONOMOUS SYSTEMS, VOL 1, 2018, 1 :159-185