Recognition and Location Algorithm for Pallets in Warehouses Using RGB-D Sensor

被引:3
作者
Zhao, Junhong [1 ,2 ]
Li, Bin [1 ,2 ]
Wei, Xinyu [1 ,2 ]
Lu, Huazhong [2 ,3 ]
Lu, Enli [4 ]
Zhou, Xingxing [1 ,2 ]
机构
[1] Guangdong Acad Agr Sci, Inst Facil Agr, Guangzhou 510640, Peoples R China
[2] Guangdong Lab Lingnan Modern Agr, Guangzhou 510642, Peoples R China
[3] Guangdong Acad Agr Sci, Guangzhou 510640, Peoples R China
[4] South China Agr Univ, Key Lab Key Technol Agr Machine & Equipment, Minist Educ, Guangzhou 510642, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2022年 / 12卷 / 20期
关键词
pallet recognition; autonomous forklift; labeled template; RGB-D sensor; FORKLIFT; VEHICLES;
D O I
10.3390/app122010331
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Featured Application A real-time approach based on an improved label template matching algorithm with an RGB-D sensor was proposed to recognize and locate pallets in a warehouse environment in this paper. The application of this technology can reduce labor and cost savings, as well as provide a level of warehouse automation. (1) Background: Forklifts are used widely in factories, but it shows the problem of large uncertainties when using an RGB-D sensor to recognize and locate pallets in warehouse environments. To enhance the flexibility of current autonomous forklifts in unstructured environments, the improved labeled template matching algorithm was proposed to recognize pallets. (2) Methods: The algorithm comprises four steps: (i) classifying each pixel of a color image with the color feature and obtaining the category matrix; (ii) building a labeled template containing the goods, pallet, and ground category information; (iii) compressing and matching the category matrix and template to determine the region of the pallet; and (iv) extracting the pallet pose from information in respect of the pallet feet. (3) Results: The results show that the proposed algorithm is robust against environmental influences and obstacles and that it can precisely recognize and segment multiple pallets in a warehouse with a 92.6% detection rate. The time consumptions were 72.44, 85.45, 117.63, and 182.84 ms for detection distances of 1000, 2000, 3000, and 4000 mm, respectively. (4) Conclusions: Both static and dynamic experiments were conducted, and the results demonstrate that the detection accuracy is directly related to the detection angle and distance.
引用
收藏
页数:19
相关论文
共 49 条
[1]  
An Y., 2021, RES STRUCTURE DESIGN
[2]  
[Anonymous], 2022, FORKLIFT TRUCKS MARK
[3]  
Aref MM, 2016, IEEE INT CONF ROBOT, P2535, DOI 10.1109/ICRA.2016.7487408
[4]   Autonomous pallet localization and picking for industrial forklifts: a robust range and look method [J].
Baglivo, L. ;
Biasi, N. ;
Biral, F. ;
Bellomo, N. ;
Bertolazzi, E. ;
Da Lio, M. ;
De Cecco, M. .
MEASUREMENT SCIENCE AND TECHNOLOGY, 2011, 22 (08)
[5]  
Baglivo L, 2009, Pallet Pose Estimation with LIDAR and Vision for Autonomous ForkliftsJ
[6]   Visualization of pallets [J].
Bostelman, Roger ;
Hong, Tsai ;
Chang, Tommy .
INTELLIGENT ROBOTS AND COMPUTER VISION XXIV: ALGORITHMS, TECHNIQUES, AND ACTIVE VISION, 2006, 6384
[7]   Real-Time Positioning and Orienting of Pallets Based on Monocular Vision [J].
Byun, Sungmin ;
Kim, Minhwan .
20TH IEEE INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, VOL 2, PROCEEDINGS, 2008, :505-508
[8]   VR-Based investigation of forklift operator situation awareness for preventing collision accidents [J].
Choi, Minji ;
Ahn, Seungjun ;
Seo, JoonOh .
ACCIDENT ANALYSIS AND PREVENTION, 2020, 136 (136)
[9]  
Cintas R., 2011, J PHYS AGENTS, V5, P35, DOI [10.14198/JoPha.2011.5.1.05, DOI 10.14198/JOPHA.2011.5.1.05]
[10]   Coordination of multiple AGVs: a quadratic optimization method [J].
Digani, Valerio ;
Hsieh, M. Ani ;
Sabattini, Lorenzo ;
Secchi, Cristian .
AUTONOMOUS ROBOTS, 2019, 43 (03) :539-555