Visual Expansion and Real-Time Calibration for Pan-Tilt-Zoom Cameras Assisted by Panoramic Models

被引:0
|
作者
Cai, Liangliang [1 ]
Zhou, Zhong [1 ,2 ]
机构
[1] Beihang Univ, State Key Lab Virtual Real Technol & Syst, Beijing, Peoples R China
[2] Zhongguancun Lab, Dept Math & Basic Res, Beijing, Peoples R China
关键词
augmented virtual environment; camera calibration; key-ray collection; panorama; PTZ camera; SELF-CALIBRATION; IMAGE;
D O I
10.1002/cav.70015
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Pan-tilt-zoom (PTZ) cameras, which dynamically adjust their field of view (FOV), are pervasive in large-scale scenes, such as train stations, squares, and airports. In real scenarios, PTZ cameras are required to quickly judge their directions using contextual clues from the surrounding environment. To achieve this goal, some research projects camera videos into three-dimensional (3D) models or panoramas and allows operators to establish spatial relationships. However, these works face several challenges in terms of real-time processing, localization accuracy, and realistic reference. To address this problem, a visual expansion and real-time calibration for PTZ cameras assisted by panoramic models is proposed. The calibration method consists of three parts: Providing a real environment background by building a panoramic model, meeting the needs of real-time processing by establishing a PTZ camera motion estimation model and achieving high-precision alignment between PTZ images and panoramic models using only two feature point pairs. Our methods were validated using both the public and our Scene dataset. The experimental results indicate that our method outperforms other state-of-the-art methods in terms of real-time processing, accuracy, and robustness.
引用
收藏
页数:20
相关论文
共 14 条
  • [1] Implementation and Evaluation of Real-Time Pan-Tilt-Zoom Camera Calibration
    Fung, Nicholas
    David, Philip
    APPLICATIONS OF DIGITAL IMAGE PROCESSING XXXI, 2008, 7073
  • [2] Dynamic calibration of pan-tilt-zoom cameras for traffic monitoring
    Song, Kai-Tai
    Tai, Jen-Chao
    IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2006, 36 (05): : 1091 - 1103
  • [3] Accurate and Practical Calibration of Multiple Pan-Tilt-Zoom Cameras for Live Broadcasts
    Kano, Masanori
    Okubo, Hidehiko
    Takahashi, Masaki
    Ikeya, Kensuke
    Hisatomi, Kensuke
    Mishina, Tomoyuki
    IEEE ACCESS, 2020, 8 (08): : 153993 - 154006
  • [4] Neural Background Subtraction for Pan-Tilt-Zoom Cameras
    Ferone, Alessio
    Maddalena, Lucia
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2014, 44 (05): : 571 - 579
  • [5] ROBUST AND INCREMENTAL STITCHING AND CALIBRATION WITH KNOWN ROTATION ON PAN-TILT-ZOOM CAMERA
    Kim, Minsoo
    Kim, Sunjung
    Choi, Jinyoung
    2013 20TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2013), 2013, : 2247 - 2251
  • [6] Achieving Subpixel Platform Accuracy With Pan-Tilt-Zoom Cameras in Uncertain Times
    Larsen, Martin Vonheim
    Mathiassen, Kim
    IEEE TRANSACTIONS ON ROBOTICS, 2025, 41 : 628 - 646
  • [7] Auto-Calibration of Pan-Tilt Cameras Including Radial Distortion and Zoom
    Galego, Ricardo
    Bernardino, Alexandre
    Gaspar, Jose
    ADVANCES IN VISUAL COMPUTING, ISVC 2012, PT I, 2012, 7431 : 169 - 178
  • [8] Real Time Target Tracking with Pan Tilt Zoom Camera
    Kumar, Pankaj
    Dick, Anthony
    Sheng, Tan Soo
    2009 DIGITAL IMAGE COMPUTING: TECHNIQUES AND APPLICATIONS (DICTA 2009), 2009, : 492 - +
  • [9] Aligning windows of live video from an imprecise pan-tilt-zoom camera into a remote panoramic display for remote nature observation
    Song, Dezhen
    Xu, Yiliang
    Qin, Ni
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2010, 5 (01) : 57 - 70
  • [10] Research on Design, Calibration and Real-Time Image Expansion Technology of Unmanned System Variable-Scale Panoramic Vision System
    Guo, Xiaodong
    Wang, Zhoubo
    Zhou, Wei
    Zhang, Zhenhai
    SENSORS, 2021, 21 (14)