Next best measurement posture determination based on depth image and density clustering

被引:0
作者
Lin J. [1 ,2 ]
Zhang J. [1 ,2 ]
Li L. [1 ,2 ]
Xiao Q. [1 ,2 ]
Jiang K. [1 ,2 ]
机构
[1] Xiamen Key Laboratory of Digital Vision Measurement, Huaqiao University, Xiamen
[2] Fujian Provincial Key Laboratory of Special Energy Manufacturing, Huaqiao University, Xiamen
来源
Jisuanji Jicheng Zhizao Xitong/Computer Integrated Manufacturing Systems, CIMS | 2021年 / 27卷 / 11期
关键词
Automatic measurement; Density clustering; Depth image; Next best measurement posture; Robot vision;
D O I
10.13196/j.cims.2021.11.008
中图分类号
学科分类号
摘要
According to the problem of determining the next best measurement posture in automatic measurement of robot vision, a method of fusion depth image and density clustering was proposed. The depth image and 3D point clouds of the object under the initial view were obtained by using the structured light binocular vision measurement technology. Then the edge and density clustering area of the object could be gained quickly by depth image. The complexity of each edge region of the object was determined based on density clustering, and the weight of each sub-region was calculated in combination with the size of the field of view, so the best moving direction of the next field of view was estimated. Furthermore, trend surface analysis was adopted to predict the spatial range of the next best measurement position. Using the depth image information, the global area of the trend surface analysis and the spatial data of the central trend line could be quickly obtained to determine the next best measurement posture. The Universal Robot 5 (UR5) robot and the vision measurement platform was established to carry out the measurement experiment on the Huba and rabbit models, and the effectiveness of the proposed method was proved. © 2021, Editorial Department of CIMS. All right reserved.
引用
收藏
页码:3138 / 3147
页数:9
相关论文
共 23 条
[1]  
WANG Tianmiao, TAO Yong, Research status and industrialization development strategy of Chinese industrial robot, Journal of Mechanical Engineering, 50, 9, pp. 1-13, (2014)
[2]  
DAUDELIN J, CAMPBELL M., An adaptable, probabilistic, next-best view algorithm for reconstruction of unknown 3-D objects, IEEE Robotics and Automation Letters, 2, 3, pp. 1540-1547, (2017)
[3]  
WANG Y, JAMES S, STATHOPOULOU E K, Et al., Autonomous 3-D reconstruction, mapping, and exploration of indoor environments with a robotic arm, IEEE Robotics and Automation Letters, 4, 4, pp. 3340-3347, (2019)
[4]  
WANG Zheng, ZHAO Xiao, SHE Hongjie, Et al., Obstacle detection and obstacle avoidance of AGV based on binocular vision, Computer Integrated Manufacturing Systems, 24, 2, pp. 400-409, (2018)
[5]  
ZHANG Guoliang, YAO Erliang, LIN Zhilin, Et al., Fast binocular SLAM algorithm combining thedirect method and the fearure-based method, Robot, 39, 6, pp. 879-888, (2017)
[6]  
WU Yingnian, YANG Qi, Visual servo grab system and its digital twin system, Computer Integrated Manufacturing Systems, 25, 6, pp. 1528-1535, (2019)
[7]  
WANG Jiajie, WANG Lei, FAN Xiumin, Et al., Vision based intelligent and assembly guidance of aero-space electrical connectors, Computer Integrated Manufacturing Systems, 23, 11, pp. 92-99, (2017)
[8]  
ZHU Fukang, CONG Ming, LIU Yi, Et al., Uncalibrated visual positioning method of robot based on RGB-D image, Computer Integrated Manufacturing Systems, 25, 8, pp. 2007-2015, (2019)
[9]  
PITO R., A solution to the next best view problem for automated surface acquisition, IEEE Transactions on Pattern Analysis and Machine Intelligence, 21, 10, pp. 1016-1030, (1999)
[10]  
PINTILIE G D, STUERZLINGER W., An evaluation of interactive and automated next best view methods in 3D scanning, Computer-Aided Design and Applications, 10, 2, pp. 279-291, (2013)