INTEGRATION OF 3D AUDIO AND 3D VIDEO FOR FTV

被引:0
作者
Tehrani, Mehrdad Panahpour [1 ]
Yendo, Tomohiro [1 ]
Fujii, Toshiaki [2 ]
Takeda, Kazuya [1 ]
Mase, Kenji [1 ]
Tanimoto, Masayuki [1 ]
机构
[1] Nagoya Univ, Nagoya, Aichi 4648601, Japan
[2] Tokyo Inst Technol, Tokyo, Japan
来源
2009 3DTV-CONFERENCE: THE TRUE VISION - CAPTURE, TRANSMISSION AND DISPLAY OF 3D VIDEO | 2009年
关键词
Free-viewpoint TV (FTV); free listening-point; free viewpoint; 3DAV integration;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We developed an FTV system to process, and display information of 3D scene in realtime, in which users freely control their own viewpoint/listening-point position. Free listening-point can be generated by either (i) ray-space representation of sound wave field (source sound independent), or (ii) by acoustic transfer function estimation (source sound dependent) and blind separation of sources of sounds. Free viewpoint generation is based on ray-space method, which is enhanced by using multipass dynamic programming. Integration is done by either (i) ray-space representation of sound wave and images together, or (ii) integrating each camera video signal and acoustic transfer function of the same location as integrated 3DAV data. The prototype system of integrated audio-visual viewer achieves both good image and sound qualities in realtime.
引用
收藏
页码:265 / +
页数:2
相关论文
共 18 条
[1]  
Bingham E, 2000, Int J Neural Syst, V10, P1, DOI 10.1142/S0129065700000028
[2]   A new flexible acquisition system of ray-space data for arbitrary objects [J].
Fujii, T ;
Kimoto, T ;
Tanimoto, M .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2000, 10 (02) :218-224
[3]  
FUJII T, 2002, FREE VIEWPOINT TELEV, P175
[4]  
FUKUSHIMA N, 2007, SPIE, V6490, P460
[5]  
ISHIKAWA A, 2008, FREE VIEWPOINT VIDEO, P1007
[6]   A MODEL OF HEAD-RELATED TRANSFER-FUNCTIONS BASED ON PRINCIPAL COMPONENTS-ANALYSIS AND MINIMUM-PHASE RECONSTRUCTION [J].
KISTLER, DJ ;
WIGHTMAN, FL .
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 1992, 91 (03) :1637-1647
[7]   Multiview imaging and 3DTV - Special issue overview and introduction [J].
Kubota, Akira ;
Smolic, Aljoscha ;
Magnor, Marcus ;
Tanirnoto, Masayuki ;
Chen, Tsuhan ;
Zhang, Cha .
IEEE SIGNAL PROCESSING MAGAZINE, 2007, 24 (06) :10-21
[8]  
Matsuoka K., 2001, P INDEPENDENT COMPON, P722
[9]  
NISHINO T, 1999, J ACOUST SOC JAPAN, V55, P1
[10]  
NIWA K, 2006, J ASA HAWAII NOV