Real-time 2D to 3D Image Conversion Algorithm and VLSI Architecture for Natural Scene

被引:2
作者
Hsia, Shih-Chang [1 ]
Wang, Szu-Hong [1 ]
Tsai, Ho-Cheng [1 ]
机构
[1] Natl Yunlin Univ Sci & Technol, Dept Elect Engn, Touliu, Yunlin, Taiwan
关键词
2D; 3D conversion; Depth perception; 3D images; FPGA; VLSI; 2D-TO-3D CONVERSION; VIDEO CONVERSION; SYSTEM; GENERATION;
D O I
10.1007/s00034-022-01983-y
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper presents a high-performance 2D-to-3D conversion algorithm technique and its VLSI architecture design for natural scenes. In this study, the depth map was generated based on the horizontal dividing line concept. Also, the dividing line was estimated by obvious color difference on the local region, and the current dividing line was a demarcation from the maximum value to the minimum one for the depth map. A Depth Based Image Rendering technology was employed to generate stereoscopic images according to the image channel of the depth map. Based on the proposed algorithm, a real-time VLSI architecture is presented. Also, for the purpose of cost efficiency, a module-based hardware consisting of a timing schedule control should be designed. The multiplications and divisions of the algorithm can be minimized by circuit design, and so this helps reduce the complexity of this system. Only one frame memory is required to generate real-time 3D images using the depth map. The depth map can be immediately calculated by referring to the location of dividing lines, which can reduce the storage size and I/O bandwidth. The circuit is simulated and verified by one FPGA chip. The critical path is at the multiplex and one flip-flop, and the maximum clock rate can achieve 205 MHz. To be VGA compatible, the stereoscopic RGB pixels can be outputted in parallel per clock to the interface. The overall maximum data rates of the proposed 3D conversion chip can achieve 610 M bytes per second. This can meet the real-time HD requirement.
引用
收藏
页码:4455 / 4478
页数:24
相关论文
共 27 条
[1]   A Novel 2D-to-3D Conversion System Using Edge Information [J].
Cheng, Chao-Chung ;
Li, Chung-Te ;
Chen, Liang-Gee .
IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2010, 56 (03) :1739-1745
[2]   Depth Analogy: Data-Driven Approach for Single Image Depth Estimation Using Gradient Samples [J].
Choi, Sunghwan ;
Min, Dongbo ;
Ham, Bumsub ;
Kim, Youngjung ;
Oh, Changjae ;
Sohn, Kwanghoon .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (12) :5953-5966
[3]   Vivid-DIBR Based 2D-3D Image Conversion System for 3D Display [J].
Fan, Yu-Cheng ;
Chen, Yi-Chun ;
Chou, Shih-Ying .
JOURNAL OF DISPLAY TECHNOLOGY, 2014, 10 (10) :859-870
[4]  
Fan YC, 2013, I SYMP CONSUM ELECTR, P111
[5]   Object-Based 2D-to-3D Video Conversion for Effective Stereoscopic Content Generation in 3D-TV Applications [J].
Feng, Yue ;
Ren, Jinchang ;
Jiang, Jianmin .
IEEE TRANSACTIONS ON BROADCASTING, 2011, 57 (02) :500-509
[6]   Automatic Depth Extraction from 2D Images Using a Cluster-Based Learning Framework [J].
Herrera, Jose L. ;
del-Blanco, Carlos R. ;
Garcia, Narciso .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (07) :3288-3299
[7]  
Herrera JL, 2016, IEEE T CONSUM ELECTR, V62, P429, DOI 10.1109/TCE.2016.7838096
[8]   VLSI Architecture for Real-Time HD1080p View Synthesis Engine [J].
Horng, Ying-Rung ;
Tseng, Yu-Cheng ;
Chang, Tian-Sheuan .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2011, 21 (09) :1329-1340
[9]   Toward Naturalistic 2D-to-3D Conversion [J].
Huang, Weicheng ;
Cao, Xun ;
Lu, Ke ;
Dai, Qionghai ;
Bovik, Alan Conrad .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (02) :724-733
[10]  
Kim M, 2014, INT SOC DESIGN CONF, P171, DOI 10.1109/ISOCC.2014.7087681