Moving Obstacle Segmentation with an Optical Flow-based DNN: an Implementation Case Study

被引:0
作者
Karoly, Artur, I [1 ,2 ]
Elek, Renata Nagyne [1 ,2 ]
Haidegger, Tamas [1 ,3 ]
Galambos, Peter [1 ,3 ]
机构
[1] Obuda Univ, Antal Bejczy Ctr Intelligent Robot, EKIK, Budapest, Hungary
[2] Obuda Univ, Doctoral Sch Appl Informat, Budapest, Hungary
[3] Obuda Univ, John von Neumann Fac Informat, Budapest, Hungary
来源
INES 2021: 2021 IEEE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT ENGINEERING SYSTEMS | 2021年
关键词
self-driving systems; warehouse automation; object detection; optical flow; deep neural network; VEHICLES;
D O I
10.1109/INES52918.2021.9512898
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Moving object detection is a crucial component of automotive systems' safety functions. AI-based approaches for object detection are the most common solutions in the case of self-driving vehicles. For autonomous navigation in an industrial setting, a deep learning model that relies on stronger assumptions regarding the environment, can be implemented. This is due to the fact that an industrial environment is more strictly controlled than an urban area. However, the detection of moving obstacles is still a challenging task and its solution can serve as the basis for more advanced models. In this paper, we introduce an optical flow-based deep neural network approach for moving object segmentation and state of motion estimation in industrial environment as an implementation case study. The algorithm is based on our earlier optical flow egomotion filtering method and optical flow-based Deep Neural Network, called OFSNet. The aim of this paper is to introduce the main hardware and software modules of the moving object segmentation system, the integration process, the communication considerations and the logistics management system. The proposed system was installed and tested on a mobile robot platform in a mock warehouse environment. All of the program codes, documentations and installation steps are publicly available at GitHub.
引用
收藏
页数:6
相关论文
共 17 条
[1]   A Survey on 3D Object Detection Methods for Autonomous Driving Applications [J].
Arnold, Eduardo ;
Al-Jarrah, Omar Y. ;
Dianati, Mehrdad ;
Fallah, Saber ;
Oxtoby, David ;
Mouzakitis, Alex .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2019, 20 (10) :3782-3795
[2]   Self-driving cars: A survey [J].
Badue, Claudine ;
Guidolini, Ranik ;
Carneiro, Raphael Vivacqua ;
Azevedo, Pedro ;
Cardoso, Vinicius B. ;
Forechi, Avelino ;
Jesus, Luan ;
Berriel, Rodrigo ;
Paixao, Thiago M. ;
Mutz, Filipe ;
Veronese, Lucas de Paula ;
Oliveira-Santos, Thiago ;
De Souza, Alberto F. .
EXPERT SYSTEMS WITH APPLICATIONS, 2021, 165
[3]   Monocular 3D Object Detection for Autonomous Driving [J].
Chen, Xiaozhi ;
Kundu, Kaustav ;
Zhang, Ziyu ;
Ma, Huimin ;
Fidler, Sanja ;
Urtasun, Raquel .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :2147-2156
[4]   SegFlow: Joint Learning for Video Object Segmentation and Optical Flow [J].
Cheng, Jingchun ;
Tsai, Yi-Hsuan ;
Wang, Shengjin ;
Yang, Ming-Hsuan .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :686-695
[5]   Handover Process of Autonomous Vehicles - Technology and Application Challenges [J].
Drexler, Daniel A. ;
Takacs, Arpad ;
Nagy, Tamas D. ;
Haidegger, Tamas .
ACTA POLYTECHNICA HUNGARICA, 2019, 16 (09) :235-255
[6]  
Elek R., 2021, INT C ROB COMP VIS I, P114
[7]  
Károly AI, 2019, IEEE SYS MAN CYBERN, P3080, DOI [10.1109/smc.2019.8914359, 10.1109/SMC.2019.8914359]
[8]  
Klappstein J, 2009, LECT NOTES COMPUT SC, V5414, P611, DOI 10.1007/978-3-540-92957-4_53
[9]   Decreasing the Computational Demand of Unscented Kalman Filter based Methods [J].
Kuti, Jozsef ;
Galambos, Peter .
IEEE 15TH INTERNATIONAL SYMPOSIUM ON APPLIED COMPUTATIONAL INTELLIGENCE AND INFORMATICS (SACI 2021), 2021, :181-185
[10]  
Kuti J, 2019, IEEE INT CONF INTELL, P257, DOI [10.1109/ines46365.2019.9109444, 10.1109/INES46365.2019.9109444]