Novel Neural Networks for Camera Calibration in Underwater Environments

被引:0
作者
Sanchez-Saquin, Cristian H. [1 ]
Barriga-Rodriguez, Leonardo [1 ]
Baldenegro-Perez, Leonardo A. [1 ]
Ronquillo-Lomeli, Guillermo [1 ]
Rodriguez-Olivares, Noe A. [1 ]
机构
[1] Ctr Engn & Ind Dev CIDESI, Santiago De Queretaro 76125, Mexico
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Calibration; Cameras; Estimation; Image reconstruction; Three-dimensional displays; Robot vision systems; Convolutional neural networks; Training; Distortion; Solid modeling; Underwater calibration; calibration matrix; 3D reconstruction; Zhang; Bouguet; SELF-CALIBRATION; DEEP;
D O I
10.1109/ACCESS.2024.3509452
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A novel method for camera calibration in underwater environments using convolutional networks is presented. Two modified neural network architectures, ZCalibAquaNet and BCalibAquaNet, were developed for calibration matrix estimation from chessboard images in underwater environments. The process began with the training of the InceptionResNetV2 neural network from scratch, followed by the adjustment of the dense layers for regression and calibration matrix estimation. To ensure a suitable underwater environment, the dataset used in this work was created by the authors, using a ZED 2 stereo camera with a resolution of 1280 x 720 pixels and a baseline of 12 cm. A total of 2700 images were captured in an underwater environment. Three distinct scenes clean, green and blue waters were used to study the network performance under different lighting and color conditions. For network training, the Mean Squared Error (MSE) was used as the loss function, and the L 2 norm was applied to the dense layers for 256 epochs. Additionally, 3D reconstruction of objects with known geometry in underwater environments was performed. The results showed that both networks, ZCalibAquaNet and BCalibAquaNet, provided better camera calibration and improved the measurement quality in underwater environments compared to Zhang and Bouguet models.
引用
收藏
页码:181767 / 181786
页数:20
相关论文
共 81 条
[1]  
[Anonymous], 2008, Camera calibration toolbox for matlab.
[2]   Targeted Data Augmentation and Hierarchical Classification with Deep Learning for Fish Species Identification in Underwater Images [J].
Ben Tamou, Abdelouahid ;
Benzinou, Abdesslam ;
Nasreddine, Kamal .
JOURNAL OF IMAGING, 2022, 8 (08)
[3]   DeepCalib: A Deep Learning Approach for Automatic Intrinsic Calibration of Wide Field-of-View Cameras [J].
Bogdan, Oleksandr ;
Eckstein, Viktor ;
Rameau, Francois ;
Bazin, Jean-Charles .
PROCEEDINGS CVMP 2018: THE 15TH ACM SIGGRAPH EUROPEAN CONFERENCE ON VISUAL MEDIA PRODUCTION, 2018,
[4]   CAMERA CALIBRATION THROUGH CAMERA PROJECTION LOSS [J].
Butt, Talha Hanif ;
Taj, Murtaza .
2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, :2649-2653
[5]   The Cityscapes Dataset for Semantic Urban Scene Understanding [J].
Cordts, Marius ;
Omran, Mohamed ;
Ramos, Sebastian ;
Rehfeld, Timo ;
Enzweiler, Markus ;
Benenson, Rodrigo ;
Franke, Uwe ;
Roth, Stefan ;
Schiele, Bernt .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :3213-3223
[6]  
Cramariuc A, 2020, IEEE INT CONF ROBOT, P4997, DOI [10.1109/ICRA40945.2020.9197378, 10.1109/icra40945.2020.9197378]
[7]  
DeTone D, 2016, Arxiv, DOI [arXiv:1606.03798, DOI 10.48550/ARXIV.1606.03798]
[8]  
Dosovitskiy A, 2017, PR MACH LEARN RES, V78
[9]   Underwater Camera Calibration Method Based on Improved Slime Mold Algorithm [J].
Du, Shuai ;
Zhu, Yun ;
Wang, Jianyu ;
Yu, Jieping ;
Guo, Jia .
SUSTAINABILITY, 2022, 14 (10)
[10]   SIR: Self-Supervised Image Rectification via Seeing the Same Scene From Multiple Different Lenses [J].
Fan, Jinlong ;
Zhang, Jing ;
Tao, Dacheng .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 :865-877