SAFARI FROM VISUAL SIGNALS: RECOVERING VOLUMETRIC 3D SHAPES

被引:3
作者
Agudo, Antonio [1 ]
机构
[1] UPC, Inst Robbt & Informat Ind, CSIC, Barcelona, Spain
来源
2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP) | 2022年
关键词
Visual Signals; Mininal Surfaces; Image and Video Understanding; MOTION;
D O I
10.1109/ICASSP43922.2022.9746343
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
In this paper we propose a convex approach for recovering a detailed 3D volumetric geometry of several objects from visual signals. To this end, we first present a minimal detailed surface energy that is optimized together with a volume constraint by considering some geometrical priors, and without requiring neither additional training data nor templates in order to constrain the solution. Our problem can be efficiently solved by means of a gradient descent, and be applied for single RGB images or monocular videos even with very small rigid motions. Temporal-aware solutions and driven by point correspondences are incorporated without assuming any 2D tracking data over time. Thanks to this formulation, both rigid and non-rigid objects can be considered. We have extensively validated our approach in a wide variety of scenarios in the wild, recovering challenging type of shapes that have not been previously attempted without assuming any training data.
引用
收藏
页码:2495 / 2499
页数:5
相关论文
共 28 条
[1]   Unsupervised 3D Reconstruction and Grouping of Rigid and Non-Rigid Categories [J].
Agudo, Antonio .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (01) :519-532
[2]   Shape Basis Interpretation for Monocular Deformable 3-D Reconstruction [J].
Agudo, Antonio ;
Moreno-Noguer, Francesc .
IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (04) :821-834
[3]   Force-Based Representation for Non-Rigid Shape and Elastic Model Estimation [J].
Agudo, Antonio ;
Moreno-Noguer, Francesc .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (09) :2137-2150
[4]   Combining Local-Physical and Global-Statistical Models for Sequential Deformable Shape from Motion [J].
Agudo, Antonio ;
Moreno-Noguer, Francesc .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2017, 122 (02) :371-387
[5]   Modal Space: A Physics-Based Model for Sequential Estimation of Time-Varying Shape from Monocular Video [J].
Agudo, Antonio ;
Martinez Montiel, Jose M. ;
Agapito, Lourdes ;
Calvo, Begona .
JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2017, 57 (01) :75-98
[6]  
Akhter I., 2007, TPAMI, V33, P1442
[7]  
[Anonymous], 2009, IEEE I CONF COMP VIS, DOI DOI 10.1109/ICCV.2009.5459148
[8]  
[Anonymous], 2016, ECCVW
[9]  
[Anonymous], 2012, CVPR
[10]   What Shape Are Dolphins? Building 3D Morphable Models from 2D Images [J].
Cashman, Thomas J. ;
Fitzgibbon, Andrew W. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (01) :232-244