Improving radial lens distortion correction with multi-task learning

被引:0
作者
Janos, Igor [1 ]
Benesova, Wanda [1 ]
机构
[1] Slovak Univ Technol Bratislava, Fac Informat & Informat Technol, Bratislava, Slovakia
关键词
Radial distortion; Camera calibration; Sports; Football; Multi-task learning;
D O I
10.1016/j.patrec.2024.05.008
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With computer vision and machine learning, sports image analysis can enhance viewer engagement and contribute to the overall understanding of sports events. However, beneath the apparent simplicity of sports images lies a complex challenge of radial distortion, which can impede their accurate interpretation. The need for high precision and real -time performance is paramount. We present a new regression-based method for radial distortion correction that improves the accuracy of distortion model coefficient prediction by introducing a secondary learning task that compares the distortion level of two random training samples. The secondary task requires no additional annotation, and because it is also related to radial distortion, it encourages the common feature extractor component to learn more general and robust features while preventing overfitting and improving the efficiency of training data. We have evaluated our proposed method using two public datasets and compared it against five other methods. Our method surpassed them all, both in the accuracy of the radial distortion correction and speed as well. You can find the source code and trained models at https://vgg.fiit.stuba.sk/improving-radial.
引用
收藏
页码:147 / 154
页数:8
相关论文
共 27 条
  • [1] Automatic Lens Distortion Correction Using One-Parameter Division Models
    Aleman-Flores, Miguel
    Alvarez, Luis
    Gomez, Luis
    Santana-Cedres, Daniel
    [J]. IMAGE PROCESSING ON LINE, 2014, 4 : 327 - 343
  • [2] Line detection in images showing significant lens distortion and application to distortion correction
    Aleman-Flores, Miguel
    Alvarez, Luis
    Gomez, Luis
    Santana-Cedres, Daniel
    [J]. PATTERN RECOGNITION LETTERS, 2014, 36 : 261 - 271
  • [3] BROWN DC, 1971, PHOTOGRAMM ENG, V37, P855
  • [4] Automatic Radial Distortion Estimation from a Single Image
    Bukhari, Faisal
    Dailey, Matthew N.
    [J]. JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2013, 45 (01) : 31 - 45
  • [5] Chao CH, 2020, INT CONF ACOUST SPEE, P2248, DOI [10.1109/ICASSP40776.2020.9054191, 10.1109/icassp40776.2020.9054191]
  • [6] Fitzgibbon AW, 2001, PROC CVPR IEEE, P125
  • [7] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778
  • [8] Sports Field Localization via Deep Structured Models
    Homayounfar, Namdar
    Fidler, Sanja
    Urtasun, Raquel
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 4012 - 4020
  • [9] Hore Alain, 2010, Proceedings of the 2010 20th International Conference on Pattern Recognition (ICPR 2010), P2366, DOI 10.1109/ICPR.2010.579
  • [10] Densely Connected Convolutional Networks
    Huang, Gao
    Liu, Zhuang
    van der Maaten, Laurens
    Weinberger, Kilian Q.
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 2261 - 2269