Vision-based environmental perception for autonomous driving

被引:0
作者
Liu, Fei [1 ]
Lu, Zihao [1 ]
Lin, Xianke [1 ]
机构
[1] Ontario Tech Univ, Dept Automot & Mechatron Engn, 2000 Simcoe St North, Oshawa, ON L1G 0C5, Canada
关键词
Vision sensor; vision SLAM; environmental perception; deep learning; autonomous driving; VEHICLE DETECTION; DEPTH ESTIMATION; SLAM; EFFICIENT; ACQUISITION; TRANSFORM; NETWORK; CAMERA;
D O I
暂无
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
Visual perception plays an important role in autonomous driving. One of the primary tasks is object detection and identification. Since the vision sensor is rich in color and texture information, it can quickly and accurately identify various road information. The commonly used technique is based on extracting and calculating various features of the image. The recent development of deep learning-based method has better reliability and processing speed and has a greater advantage in recognizing complex elements. For depth estimation, vision sensor is also used for ranging due to their small size and low cost. Monocular camera uses image data from a single viewpoint as input to estimate object depth. In contrast, stereo vision is based on parallax and matching feature points of different views, and the application of Deep learning also further improves the accuracy. In addition, Simultaneous Location and Mapping (SLAM) can establish a model of the road environment, thus helping the vehicle perceive the surrounding environment and complete the tasks. In this paper, we introduce and compare various methods of object detection and identification, then explain the development of depth estimation and compare various methods based on monocular, stereo, and RGB-D sensors, next review and compare various methods of SLAM, and finally summarize the current problems and present the future development trends of vision technologies.
引用
收藏
页码:39 / 69
页数:31
相关论文
共 50 条
[21]   Review of Vision-Based Environmental Perception for Lower-Limb Exoskeleton Robots [J].
Wang, Chen ;
Pei, Zhongcai ;
Fan, Yanan ;
Qiu, Shuang ;
Tang, Zhiyong .
BIOMIMETICS, 2024, 9 (04)
[22]   Vision-based Autonomous Vehicle Recognition: A New Challenge for Deep Learning-based Systems [J].
Boukerche, Azzedine ;
Ma, Xiren .
ACM COMPUTING SURVEYS, 2021, 54 (04)
[23]   Machine vision-based autonomous road hazard avoidance system for self-driving vehicles [J].
Qiu, Chengqun ;
Tang, Hao ;
Yang, Yuchen ;
Wan, Xinshan ;
Xu, Xixi ;
Lin, Shengqiang ;
Lin, Ziheng ;
Meng, Mingyu ;
Zha, Changli .
SCIENTIFIC REPORTS, 2024, 14 (01)
[24]   Vision-Based Localization and Autonomous Homing for UAVs [J].
Perumalla, Aniruddha ;
Khamvilai, Thanakorn ;
Johnson, Eric .
2024 AIAA DATC/IEEE 43RD DIGITAL AVIONICS SYSTEMS CONFERENCE, DASC, 2024,
[25]   Towards Deep Radar Perception for Autonomous Driving: Datasets, Methods, and Challenges [J].
Zhou, Yi ;
Liu, Lulu ;
Zhao, Haocheng ;
Lopez-Benitez, Miguel ;
Yu, Limin ;
Yue, Yutao .
SENSORS, 2022, 22 (11)
[26]   Geo-Context Aware Study of Vision-Based Autonomous Driving Models and Spatial Video Data [J].
Jamonnak, Suphanut ;
Zhao, Ye ;
Huang, Xinyi ;
Amiruzzaman, Md .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2022, 28 (01) :1019-1029
[27]   Vision-based Large-scale 3D Semantic Mapping for Autonomous Driving Applications [J].
Cheng, Qing ;
Zeller, Niclas ;
Cremers, Daniel .
2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA 2022, 2022, :9235-9242
[28]   Vision-based Navigation Solution for Autonomous Underwater Vehicles [J].
Alves, Tiago ;
Hormigo, Tiago ;
Ventura, Rodrigo .
2022 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS (ICARSC), 2022, :226-231
[29]   Vision-Based Autonomous Landing of a Hybrid Robot on a Powerline [J].
Li, Zhishuo ;
Tian, Yunong ;
Yang, Guodong ;
Li, En ;
Zhang, Yanfeng ;
Chen, Minghao ;
Liang, Zize ;
Tan, Min .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
[30]   Vision-Based Autonomous Landing of a Hybrid Robot on a Powerline [J].
Li, Zhishuo ;
Tian, Yunong ;
Yang, Guodong ;
Li, En ;
Zhang, Yanfeng ;
Chen, Minghao ;
Liang, Zize ;
Tan, Min .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72