Hardware Module for Low-resource and Real-Time Stereo Vision Engine Using Semi-Global Matching Approach

被引:20
作者
Cambuim, Lucas F. S. [1 ]
Barbosa, Joao P. F. [1 ]
Barros, Edna N. S. [1 ]
机构
[1] Univ Fed Pernambuco, Ctr Informat CIn, Av Jornalista Anibal Fernandes S-N,Cidade Univ, BR-50740560 Recife, PE, Brazil
来源
2017 30TH SYMPOSIUM ON INTEGRATED CIRCUITS AND SYSTEMS DESIGN (SBCCI 2017): CHOP ON SANDS | 2017年
关键词
D O I
10.1145/3109984.3109992
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Stereo matching systems that generate dense, accurate, robust and real-time disparity maps are quite attractive for a variety of applications. Most of the existing stereo matching systems that fulfill to all of these requirements adopt the Semi-Global Matching (SGM) technique. Thiswork proposes a scalable architecture based on a systolic array, fully pipeline. The design builds on a combination of multi-level parallelisms such as image line processing (two-dimensional processing) and disparity. The implementation of the SGM technique combined with the gradiente filter sobel as a pre-processing step and absolute differences as a local similarity method is a very robust approach to both high-quality images from the latest version of the Middlebury image database (22.7% of bad pixels) and lowquality images from our stereo camera system. This whole system was implemented in the FPGA platform Cyclone IV generating images of disparity in HD resolution (1024x768 pixel), with the range of 128 levels of disparities values and using four directions of paths for the SGM method. The proposed approach provided an operating frequency of 100Mhz, delivering images at a rate of 127 frames per second, using 70% of its resource in logical elements for processing and 63% of internal memory for intermediate data storage. So the proposed architecture fills the demands of real world applications regarding frame rate, depth resolution, low resource usage and accuracy.
引用
收藏
页码:53 / 58
页数:6
相关论文
共 20 条
[1]  
Banz Christian, 2010, Proceedings of the 2010 International Conference on Embedded Computer Systems: Architectures, Modeling, and Simulation (IC-SAMOS 2010), P93, DOI 10.1109/ICSAMOS.2010.5642077
[2]   The Fast Bilateral Solver [J].
Barron, Jonathan T. ;
Poole, Ben .
COMPUTER VISION - ECCV 2016, PT III, 2016, 9907 :617-632
[3]  
Gehrig S.K., 2010, Computer Vision and Pattern Recognition Workshops (CVPRW), P85
[4]  
Gehrig SK, 2009, LECT NOTES COMPUT SC, V5815, P134, DOI 10.1007/978-3-642-04667-4_14
[5]  
Hartley R., 2003, Multiple view geometry in computer vision
[6]  
Hirschmüller H, 2008, IEEE T PATTERN ANAL, V30, P328, DOI 10.1109/TPAMl.2007.1166
[7]   Evaluation of Stereo Matching Costs on Images with Radiometric Differences [J].
Hirschmueller, Heiko ;
Scharstein, Daniel .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2009, 31 (09) :1582-1599
[8]  
Honegger D, 2014, IEEE INT C INT ROBOT, P4930, DOI 10.1109/IROS.2014.6943263
[9]  
Kim KR, 2016, IEEE IMAGE PROC, P3429, DOI 10.1109/ICIP.2016.7532996
[10]   Real-Time Stereo Matching on CUDA Using an Iterative Refinement Method for Adaptive Support-Weight Correspondences [J].
Kowalczuk, Jedrzej ;
Psota, Eric T. ;
Perez, Lance C. .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2013, 23 (01) :94-104