Applying Albedo Estimation and Implicit Neural Representations to Well-Posed Shape From Shading

被引:2
作者
Bao, Wanxin [1 ]
Komatsu, Ren [1 ]
Asama, Hajime [1 ]
Yamashita, Atsushi [2 ]
机构
[1] Univ Tokyo UTokyo, Grad Sch Engn, Dept Precis Engn, Tokyo 1138656, Japan
[2] Univ Tokyo UTokyo, Grad Sch Frontier Sci, Dept Human & Engn Environm Studies, Chiba 2770882, Japan
关键词
Depth estimation; intrinsic image decomposition; implicit neural representations; shape from shading; DEEP; ALGORITHM; IMAGE; MODEL;
D O I
10.1109/ACCESS.2023.3269286
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We present a method that improves the accuracy of depth maps by combining albedo estimation and implicit neural representations to the well-posed shape from shading. Because the estimation of depth information from a single image is an under-constrained problem, we apply certain physical constrains to convert the ill-posed shape from shading problem to a well-posed problem. Subsequently, we construct an image irradiance equation wherein the surface parameter representing albedo is estimated using a learning-based encoder-decoder network. By solving the equation using implicit neural representations, we can obtain a depth map of the original image. The proposed method achieves an accuracy of depth estimation from a single image with the mean absolute error (MAE) of 0.1510 and root mean square error (RMSE) of 0.1768, indicating superior performance to that of existing methods. Both simulation and real experiments have been carried out to verify the effectiveness of the proposed method.
引用
收藏
页码:40038 / 40048
页数:11
相关论文
共 39 条
[1]  
Ahmed A., 2007, 2007 IEEE INT C IM P, P525
[2]   Survey on Deep Neural Networks in Speech and Vision Systems [J].
Alam, M. ;
Samad, M. D. ;
Vidyaratne, L. ;
Glandon, A. ;
Iftekharuddin, K. M. .
NEUROCOMPUTING, 2020, 417 :302-321
[3]  
Bao W., 2022, PROC 2 INT C IMAGE P, P1
[4]   Joint Learning of Intrinsic Images and Semantic Segmentation [J].
Baslamisli, Anil S. ;
Groenestege, Thomas T. ;
Das, Partha ;
Le, Hoang-An ;
Karaoglu, Sezer ;
Gevers, Theo .
COMPUTER VISION - ECCV 2018, PT VI, 2018, 11210 :289-305
[5]   The bas-relief ambiguity [J].
Belhumeur, PN ;
Kriegman, DJ ;
Yuille, AL .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 1999, 35 (01) :33-44
[6]   Intrinsic Images in the Wild [J].
Bell, Sean ;
Bala, Kavita ;
Snavely, Noah .
ACM TRANSACTIONS ON GRAPHICS, 2014, 33 (04)
[7]  
Blender, About us
[8]   The algorithm of stereo vision and shape from shading based on endoscope imaging [J].
Cao, Ziyi ;
Wang, Yaxiang ;
Zheng, Wenfeng ;
Yin, Lirong ;
Tang, Yushan ;
Miao, Wang ;
Liu, Shan ;
Yang, Bo .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2022, 76
[9]   Variational formulation of a hybrid perspective shape from shading model [J].
Fan, Jiacheng ;
Chen, Min ;
Mo, Jinqiu ;
Wang, Shigang ;
Liang, Qinghua .
VISUAL COMPUTER, 2022, 38 (04) :1469-1482
[10]   A Survey on Intrinsic Images: Delving Deep into Lambert and Beyond [J].
Garces, Elena ;
Rodriguez-Pardo, Carlos ;
Casas, Dan ;
Lopez-Moreno, Jorge .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2022, 130 (03) :836-868