Absolute velocity estimation of UAVs based on phase correlation and monocular vision in unknown GNSS-denied environments

被引:0
作者
Deng, Heng [1 ,2 ]
Li, Duhao [1 ]
Shen, Boyang [1 ]
Zhao, Zhiyao [3 ]
Arif, Usman [4 ]
机构
[1] Beijing Univ Technol, Fac Informat Technol, Beijing, Peoples R China
[2] Minist Educ, Engn Res Ctr Intelligence Percept & Autonomous Con, Beijing, Peoples R China
[3] Beijing Technol & Business Univ, Key Lab Ind Internet & Big Data, China Natl Light Ind, Beijing, Peoples R China
[4] Beihang Univ, Sch Automat Sci & Elect Engn, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
cameras; Fourier transforms; image processing; Kalman filters; NAVIGATION; TRACKING; SYSTEM; IMAGE;
D O I
10.1049/ipr2.13167
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a novel approach for absolute velocity estimation of unmanned aerial vehicles in unknown and unmapped GNSS-denied environments. The proposed method leverages the advantages of Fourier-based image phase correlation and utilizes off-the-shelf onboard sensors, including a downward-facing monocular camera, an inertial sensor, and a sonar. The non-matching tracking approach is particularly appealing, offering accurate estimation while remaining robust against frequency-dependent noise, significant intensity variations, and time-varying illumination disturbances. In the proposed method, the first step involves computing global pixel motion from consecutive images using phase correlation, which utilizes the shift property of the Fourier transform. This pixel motion estimation serves as the basis for creating a closed-loop solution for absolute velocity estimation. To further enhance accuracy, a Kalman filter is implemented to fuse all available data and provide a reliable velocity estimate. Validation of the proposed visual-inertial technique is conducted through simulation experiments using AirSim and real-world flight tests. The results demonstrate the practicality and effectiveness of the approach across a range of challenging scenarios. This paper proposes a Fourier-based image phase correlation method for absolute velocity estimation of unmanned aerial vehicles using off-the-shelf onboard sensors, including a downward-facing monocular camera, an inertial sensor, and a sonar in unknown and unmapped GPS-denied environments. The non-matching tracking approach is attractive and promising, with the advantages of accurate estimation, robustness against frequency-dependent noise, significant intensity variations, and time-varying illumination disturbances. image
引用
收藏
页码:3218 / 3230
页数:13
相关论文
共 39 条
  • [1] Implementation and Performance Evaluation of Optical Flow Navigation System Under Specific Conditions for a Flying Robot
    Aminzadeh, Ali
    Atashgah, M. A. Amiri
    [J]. IEEE AEROSPACE AND ELECTRONIC SYSTEMS MAGAZINE, 2018, 33 (11) : 20 - 28
  • [2] A vision based ensemble approach to velocity estimation for miniature rotorcraft
    Andersh, Jonathan
    Cherian, Anoop
    Mettler, Berenice
    Papanikolopoulos, Nikolaos
    [J]. AUTONOMOUS ROBOTS, 2015, 39 (02) : 123 - 138
  • [3] Visual-inertial state estimation with camera and camera-IMU calibration
    Arbabmir, Mohammadvali
    Ebrahimi, Masoud
    [J]. ROBOTICS AND AUTONOMOUS SYSTEMS, 2019, 120
  • [4] Lucas-Kanade 20 years on: A unifying framework
    Baker, S
    Matthews, I
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2004, 56 (03) : 221 - 255
  • [5] A Novel Approach to Computationally Lighter GNSS-Denied UAV Navigation Using Monocular Camera
    Bhowmick, Joyraj
    Singh, Anurag
    Gupta, Harshit
    Nallanthighal, Raghava
    [J]. 2021 7TH INTERNATIONAL CONFERENCE ON AUTOMATION, ROBOTICS AND APPLICATIONS (ICARA 2021), 2021, : 114 - 121
  • [6] Visual odometry based on the Fourier transform using a monocular ground-facing camera
    Birem, Merwan
    Kleihorst, Richard
    El-Ghouti, Norddin
    [J]. JOURNAL OF REAL-TIME IMAGE PROCESSING, 2018, 14 (03) : 637 - 646
  • [7] Globally stable velocity estimation using normalized velocity measurement
    Bjorne, Elias
    Brekke, Edmund F.
    Bryne, Torleiv H.
    Delaune, Jeff
    Johansen, Tor Arne
    [J]. INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2020, 39 (01) : 143 - 157
  • [8] Bouguet J., 2000, PYRAMIDAL IMPLEMENTA
  • [9] An End-to-End UAV Simulation Platform for Visual SLAM and Navigation
    Chen, Shengyang
    Zhou, Weifeng
    Yang, An-Shik
    Chen, Han
    Li, Boyang
    Wen, Chih-Yung
    [J]. AEROSPACE, 2022, 9 (02)
  • [10] Improvement of angular velocity and position estimation in gyro-free inertial navigation based on vision aid equipment
    Dehghani, Mehdi
    Kharrati, Hamed
    Seyedarabi, Hadi
    Baradarannia, Mahdi
    [J]. IET COMPUTER VISION, 2018, 12 (03) : 261 - 275