Progress in artificial intelligence-based visual servoing of autonomous unmanned aerial vehicles (UAVs)

被引：3
作者：
Al Radi M. [1 ]
AlMallahi M.N. [2 ]
Al-Sumaiti A.S. [1 ,6 ]
Semeraro C. [3 ,4 ]
Abdelkareem M.A. [3 ,5 ]
Olabi A.G. [3 ]
机构：
[1] Department of Electrical Engineering and Computer Science, Khalifa University, Abu Dhabi
[2] Department of Mechanical and Aerospace Engineering, United Arab Emirates University, P.O. Box 15551, Al Ain City
[3] Sustainable Energy & Power Systems Research Centre, RISE, University of Sharjah, P.O. Box 27272, Sharjah
[4] Department of Industrial and Management Engineering, University of Sharjah, PO Box 27272, Sharjah
[5] Chemical Engineering Department, Minia University, Elminia
[6] Advanced Power and Energy Center, Department of Electrical Engineering and Computer Science, Khalifa University, Abu Dhabi
来源：
International Journal of Thermofluids | 2024年 / 21卷
关键词：
Artificial intelligence; Artificial neural networks; Fuzzy logic; Reinforcement learning; Unmanned aerial vehicles; Visual servoing;
D O I：
10.1016/j.ijft.2024.100590
中图分类号：
学科分类号：
摘要：
Unmanned aerial vehicles (UAVs) have attracted massive attention in many engineering and practical applications in the last years for their characteristics and operation flexibility. For the UAV system, suitable control systems are required to operate appropriately and efficiently. An emerging control technique is visual servoing utilizing the onboard camera systems for inspecting the UAV's environment and autonomously controlling the UAV's operation. Artificial intelligence (AI) techniques are widely deployed in the visual servoing of autonomous UAV applications. Despite the increasing research in the field of AI-based visual control of UAV systems, comprehensive review articles that showcase the general trends and future directions in this field of research are limited. This work comprehensively examines the application and advancements of AI-enhanced visual servoing in autonomous UAV systems, covering critical control tasks and offering insights into future research directions for enhancing performance and applicability which is limited in the current literature. The paper first reviews the application of intelligent visual servoing systems for autonomously executing various UAV control tasks, including 3D UAV positioning, aerial and ground object following, obstacle avoidance, and autonomous landing. Second, the research progresses in applying AI techniques in the visual servoing of autonomous UAV systems are discussed and analyzed. Finally, future directions and critical research gaps for further improving the performance and applicability of intelligent visual servoing systems are included. © 2024
引用
收藏
相关论文
共 133 条
  • [41] Sun X., Zhu X., Wang P., Chen H., A review of robot control with visual servoing, 2018 IEEE 8th Annual International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER), pp. 116-121, (2018)
  • [42] Chaumette F., Hutchinson S., Visual servo control. II. Advanced approaches [Tutorial], IEEE Robot. Autom. Mag., 14, 1, pp. 109-118, (2007)
  • [43] Haviland J., Dayoub F., Corke P., Control of the final-phase of closed-loop visual grasping using image-based visual servoing, arXiv preprint, (2020)
  • [44] Thuilot B., Martinet P., Cordesses L., Gallice J., Position based visual servoing: keeping the object in the field of vision, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No. 02CH37292), 2, pp. 1624-1629, (2002)
  • [45] Akinlar C., Topal C., EDLines: a real-time line segment detector with a false detection control, Pattern Recognit. Lett., 32, 13, pp. 1633-1642, (2011)
  • [46] Nguyen V.N., Jenssen R., Roverso D., LS-Net: fast single-shot line-segment detector, Mach. Vis. Appl., 32, 1, pp. 1-16, (2021)
  • [47] Harris C., Stephens M., A combined corner and edge detector, Alvey vision conference, 15, pp. 10-5244, (1988)
  • [48] Zecca R., Marks D.L., Smith D.R., Symphotic design of an edge detector for autonomous navigation, IEEE Access, 7, pp. 144836-144844, (2019)
  • [49] Gu J., Et al., Recent advances in convolutional neural networks, Pattern Recognit., 77, pp. 354-377, (2018)
  • [50] Fathian K., Jin J., Wee S.-G., Lee D.-H., Kim Y.-G., Gans N.R., Camera relative pose estimation for visual servoing using quaternions, Rob. Auton. Syst., 107, pp. 45-62, (2018)
12345678910