Real-Time Semantic Segmentation of 3D LiDAR Point Clouds for Aircraft Engine Detection in Autonomous Jetbridge Operations

被引:0
|
作者
Weon, Ihnsik [1 ]
Lee, Soongeul [2 ]
Yoo, Juhan [3 ]
机构
[1] Incheon Int Airport Corp, Airport Ind Technol Res Inst, Incheon Jung Gu Airport Rd 424 47, Incheon 22382, South Korea
[2] Kyung Hee Univ, Dept Mech Engn, Yongin 17104, South Korea
[3] Semyung Univ, Dept Comp Engn, Jecheon 02468, South Korea
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 21期
基金
新加坡国家研究基金会;
关键词
semantic segmentation; 3D LiDAR; point clouds; real time; PointNet; object detection; jet bridge;
D O I
10.3390/app14219685
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
This paper presents a study on aircraft engine identification using real-time 3D LiDAR point cloud segmentation technology, a key element for the development of automated docking systems in airport boarding facilities, known as jetbridges. To achieve this, 3D LiDAR sensors utilizing a spinning method were employed to gather surrounding environmental 3D point cloud data. The raw 3D environmental data were then filtered using the 3D RANSAC technique, excluding ground data and irrelevant apron areas. Segmentation was subsequently conducted based on the filtered data, focusing on aircraft sections. For the segmented aircraft engine parts, the centroid of the grouped data was computed to determine the 3D position of the aircraft engine. Additionally, PointNet was applied to identify aircraft engines from the segmented data. Dynamic tests were conducted in various weather and environmental conditions, evaluating the detection performance across different jetbridge movement speeds and object-to-object distances. The study achieved a mean intersection over union (mIoU) of 81.25% in detecting aircraft engines, despite experiencing challenging conditions such as low-frequency vibrations and changes in the field of view during jetbridge maneuvers. This research provides a strong foundation for enhancing the robustness of jetbridge autonomous docking systems by reducing the sensor noise and distortion in real-time applications. Our future research will focus on optimizing sensor configurations, especially in environments where sea fog, snow, and rain are frequent, by combining RGB image data with 3D LiDAR information. The ultimate goal is to further improve the system's reliability and efficiency, not only in jetbridge operations but also in broader autonomous vehicle and robotics applications, where precision and reliability are critical. The methodologies and findings of this study hold the potential to significantly advance the development of autonomous technologies across various industrial sectors.
引用
收藏
页数:17
相关论文
共 50 条
  • [11] Complexer-YOLO: Real-Time 3D Object Detection and Tracking on Semantic Point Clouds
    Simon, Martin
    Amende, Karl
    Kraus, Andrea
    Honer, Jens
    Saemann, Timo
    Kaulbersch, Hauke
    Milz, Stefan
    Gross, Horst Michael
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, : 1190 - 1199
  • [12] A Staged Real-Time Ground Segmentation Algorithm of 3D LiDAR Point Cloud
    Deng, Weiye
    Chen, Xiaoping
    Jiang, Jingwei
    ELECTRONICS, 2024, 13 (05)
  • [13] PIXOR: Real-time 3D Object Detection from Point Clouds
    Yang, Bin
    Luo, Wenjie
    Urtasun, Raquel
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 7652 - 7660
  • [14] Real-time 3D LiDAR Flow for Autonomous Vehicles
    Baur, Stefan A.
    Moosmann, Frank
    Wirges, Sascha
    Rist, Christoph B.
    2019 30TH IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV19), 2019, : 1288 - 1295
  • [15] SEGCloud: Semantic Segmentation of 3D Point Clouds
    Tchapmi, Lyne P.
    Choy, Christopher B.
    Armeni, Iro
    Gwak, JunYoung
    Savarese, Silvio
    PROCEEDINGS 2017 INTERNATIONAL CONFERENCE ON 3D VISION (3DV), 2017, : 537 - 547
  • [16] Real-Time Road Curb and Lane Detection for Autonomous Driving Using LiDAR Point Clouds
    Huang, Jing
    Choudhury, Pallab K.
    Yin, Song
    Zhu, Lingyun
    IEEE ACCESS, 2021, 9 : 144940 - 144951
  • [17] Boosting Lidar 3D Object Detection with Point Cloud Semantic Segmentation
    Zhang, Xuchong
    Min, Chong
    Jia, Yijie
    Chen, Liming
    Zhang, Jingmin
    Sun, Hongbin
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 7614 - 7621
  • [18] Real-time Object Detection and Semantic Segmentation for Autonomous Driving
    Li, Baojun
    Liu, Shun
    Xu, Weichao
    Qiu, Wei
    MIPPR 2017: AUTOMATIC TARGET RECOGNITION AND NAVIGATION, 2018, 10608
  • [19] Point attention network for semantic segmentation of 3D point clouds
    Feng, Mingtao
    Zhang, Liang
    Lin, Xuefei
    Gilani, Syed Zulqarnain
    Mian, Ajmal
    PATTERN RECOGNITION, 2020, 107 (107)
  • [20] GrowSP: Unsupervised Semantic Segmentation of 3D Point Clouds
    Zhang, Zihui
    Yang, Bo
    Wang, Bing
    Li, Bo
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 17619 - 17629