Adaptive Navigation in Collaborative Robots: A Reinforcement Learning and Sensor Fusion Approach

被引:0
|
作者
Tiwari, Rohit [1 ]
Srinivaas, A. [2 ]
Velamati, Ratna Kishore [2 ]
机构
[1] Amrita Vishwa Vidyapeetham, Amrita Sch Engn, Dept Elect & Commun Engn, Coimbatore 641112, India
[2] Amrita Vishwa Vidyapeetham, Amrita Sch Engn, Dept Mech Engn, Coimbatore 641112, India
关键词
obstacle avoidance; reinforcement learning; dynamic environments; autonomous vehicle navigation; ALGORITHMS;
D O I
10.3390/asi8010009
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper presents a new approach for enhancing autonomous vehicle navigation and obstacle avoidance based on the integration of reinforcement learning with multiple sensors for navigation. The proposed system is designed to enable a reinforcement learning decision algorithm capable of making real-time decisions in aiding the adaptive capability of a vehicle. This method was tested on a prototype vehicle with navigation based on a Ublox Neo 6M GPS and a three-axis magnetometer, while for obstacle detection, this system uses three ultrasonic sensors. The use of a model-free reinforcement learning algorithm and use of an effective sensor for obstacle avoidance (instead of LiDAR and a camera) provides the proposed system advantage in terms of computational requirements, adaptability, and overall cost. Our experiments show that the proposed method improves navigation accuracy substantially and significantly advances the ability to avoid obstacles. The prototype vehicle adapts very well to the conditions of the testing track. Further, the data logs from the vehicle were analyzed to check the performance. It is this cost-effective and adaptable nature of the system that holds some promise toward a solution in situations where human intervention is not feasible, or even possible, due to either danger or remoteness. In general, this research showed how the application of reinforcement learning combined with sensor fusion enhances autonomous navigation and makes vehicles perform more reliably and intelligently in dynamic environments.
引用
收藏
页数:20
相关论文
共 50 条
  • [41] Adaptive Hybrid Synchronization Primitives: A Reinforcement Learning Approach
    Ganjaliyev, Fadai
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2020, 11 (05) : 51 - 57
  • [42] Adaptive state construction for reinforcement learning and its application to robot navigation problems
    Handa, H
    Ninomiya, A
    Horiuchi, T
    Konishi, T
    Baba, M
    2001 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS, VOLS 1-5: E-SYSTEMS AND E-MAN FOR CYBERNETICS IN CYBERSPACE, 2002, : 1436 - 1441
  • [43] Reactive navigation under a fuzzy rules-based scheme and reinforcement learning for mobile robots
    Lopez-Lozada, Elizabeth
    Rubio-Espino, Elsa
    Sossa-Azuela, J. Humberto
    Ponce-Ponce, Victor H.
    PEERJ COMPUTER SCIENCE, 2021,
  • [44] Vision-Based Autonomous Navigation Approach for a Tracked Robot Using Deep Reinforcement Learning
    Ejaz, Muhammad Mudassir
    Tang, Tong Boon
    Lu, Cheng-Kai
    IEEE SENSORS JOURNAL, 2021, 21 (02) : 2230 - 2240
  • [45] Reactive Navigation under a Fuzzy Rules- Based Scheme and Reinforcement Learning for Mobile Robots
    López-Lozada E.
    Rubio-Espino E.
    Humberto Sossa-Azuela J.H.
    Ponce-Ponce V.H.
    PeerJ Computer Science, 2021, 7 : 1 - 25
  • [46] An Improvement on Mapless Navigation with Deep Reinforcement Learning: A Reward Shaping Approach
    Alipanah, Arezoo
    Moosavian, S. Ali A.
    2022 10TH RSI INTERNATIONAL CONFERENCE ON ROBOTICS AND MECHATRONICS (ICROM), 2022, : 261 - 266
  • [47] SSRL: A Safe and Smooth Reinforcement Learning Approach for Collision Avoidance in Navigation
    Zhang, Ruixian
    Yang, Jianan
    Liang, Ye
    Lu, Shengao
    Zhang, Lixian
    2023 2ND CONFERENCE ON FULLY ACTUATED SYSTEM THEORY AND APPLICATIONS, CFASTA, 2023, : 681 - 686
  • [48] Nonstrict Hierarchical Reinforcement Learning for Interactive Systems and Robots
    Cuayahuitl, Heriberto
    Kruijff-Korbayova, Ivana
    Dethlefs, Nina
    ACM TRANSACTIONS ON INTERACTIVE INTELLIGENT SYSTEMS, 2014, 4 (03)
  • [49] UAV navigation in high dynamic environments: A deep reinforcement learning approach
    Guo, Tong
    Jiang, Nan
    Li, Biyue
    Zhu, Xi
    Wang, Ya
    Du, Wenbo
    CHINESE JOURNAL OF AERONAUTICS, 2021, 34 (02) : 479 - 489
  • [50] Adaptive Control and Intersections with Reinforcement Learning
    Annaswamy, Anuradha M.
    ANNUAL REVIEW OF CONTROL ROBOTICS AND AUTONOMOUS SYSTEMS, 2023, 6 : 65 - 93