Improved YOLOv5 lightweight binocular vision UAV obstacle avoidance algorithm based on Ghost module

被引:0
作者
Jia, Yifan [1 ,2 ]
Cao, Tianyi [3 ]
Bai, Yue [1 ]
机构
[1] Chinese Acad Sci, Changchun Inst Opt Fine Mech & Phys, Changchun 130033, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] SWJTU Leeds Joint Sch, Chengdu 610097, Peoples R China
基金
中国国家自然科学基金;
关键词
object detection; lightweight; feature matching; obstacle avoidance unmanned aerial vehicles;
D O I
10.37188/CJLCD.2023-0069
中图分类号
O7 [晶体学];
学科分类号
0702 ; 070205 ; 0703 ; 080501 ;
摘要
To address the issue of autonomous obstacle avoidance during unmanned aerial vehicle (UAV) flight in outdoor environments, a lightweight binocular vision -based UAV obstacle avoidance algorithm was proposed utilizing Ghost module to improve YOLOv5. Firstly, the Ghost module was introduced to enhance the CBL and CSP_X units of YOLOv5, while utilizing CIOUloss as the regression loss function, and optimizing the loss function by modifying the non -maximum suppression from CIOUnms to DIOUnms. Secondly, the stereo cameras were calibrated and corrected,and the ORB feature point extraction and sliding window matching algorithm was utilized to obtain the disparity value of the detected targets, and the distance information of the obstacle was solved based on the disparity value and camera intrinsic parameters. Finally, autonomous obstacle avoidance of the UAV was achieved based on the position and distance of the obstacle. The obstacle avoidance algorithm was implemented on an embedded system, an average FPS of 14. 3 was achieved, and the feasibility of the algorithm was verified through UAV flight testing. The improved network had an average detection accuracy of 76. 88%, which was 0. 37% lower than that of YOLOv5, but the detection time and parameter quantity were reduced by 22% and 25%, respectively. This algorithm has significant value for the autonomous obstacle avoidance of UAVs.
引用
收藏
页码:111 / 119
页数:9
相关论文
共 19 条
[1]  
Boyer RobertS., 2014, COMPUTATIONAL LOGIC
[2]   GhostNet: More Features from Cheap Operations [J].
Han, Kai ;
Wang, Yunhe ;
Tian, Qi ;
Guo, Jianyuan ;
Xu, Chunjing ;
Xu, Chang .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :1577-1586
[3]  
Hirschmüller H, 2008, IEEE T PATTERN ANAL, V30, P328, DOI 10.1109/TPAMl.2007.1166
[4]   农用无人机自主飞行技术研究与趋势 [J].
黄传鹏 ;
毛鹏军 ;
李鹏举 ;
耿乾 ;
方骞 ;
张家瑞 .
中国农机化学报, 2020, (11) :162-170
[5]   Detection of a Moving UAV Based on Deep Learning-Based Distance Estimation [J].
Lai, Ying-Chih ;
Huang, Zong-Ying .
REMOTE SENSING, 2020, 12 (18)
[6]  
LI L, Tactical Missile Technology
[7]   Distinctive image features from scale-invariant keypoints [J].
Lowe, DG .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2004, 60 (02) :91-110
[8]  
Martull S., 2012, Sci. Program, V111, P117
[9]   You Only Look Once: Unified, Real-Time Object Detection [J].
Redmon, Joseph ;
Divvala, Santosh ;
Girshick, Ross ;
Farhadi, Ali .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :779-788
[10]   Deep learning in holography and coherent imaging [J].
Rivenson, Yair ;
Wu, Yichen ;
Ozcan, Aydogan .
LIGHT-SCIENCE & APPLICATIONS, 2019, 8 (1)