AdverseNet: A LiDAR Point Cloud Denoising Network for Autonomous Driving in Rainy, Snowy, and Foggy Weather

被引:0
|
作者
Yan, Xinyuan [1 ]
Yang, Junxing [1 ]
Liang, Yu [1 ]
Ma, Yanjie [1 ]
Li, Yida [1 ]
Huang, He [1 ]
机构
[1] Beijing Univ Civil Engn & Architecture, Sch Geomat & Urban Spatial Informat, Beijing 102616, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Meteorology; Point cloud compression; Noise reduction; Training; Snow; Laser radar; Noise; Sensors; Rain; Clouds; Adverse weather; autonomous driving; LiDAR; point cloud denoising; point cloud semantic segmentation; FILTER;
D O I
10.1109/JSEN.2024.3505234
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In the field of autonomous driving, a pressing issue is how to enable LiDAR to accurately perceive the 3-D environment around the vehicle without being affected by rain, snow, and fog. Specifically, rain, snow, and fog can be present within the LiDAR's detection range and create noise points. To address this problem, we propose a unified denoising network, AdverseNet, for adverse weather point clouds, which is capable of removing noise points caused by rain, snow, and fog from LiDAR point clouds. In AdverseNet, we adopt the cylindrical triperspective view (CTPV) representation for point clouds and employ a two-stage training strategy. In the first training stage, generic features of rain, snow, and fog noise points are learned. In the second training stage, specific weather features are learned. We conducted comparative experiments on the DENSE dataset and the SnowyKITTI dataset, and the results show that the performance of our method on both datasets is significantly improved compared to other methods, with the Mean Intersection over Union (MIoU) reaching 94.67% and 99.33%, respectively. Our proposed AdverseNet enhances the LiDAR sensing capability in rain, snow, and fog, ensuring the safe operation of autonomous vehicles in adverse weather conditions. The source code is available at https://github.com/Naclzno/AdverseNet.
引用
收藏
页码:8950 / 8961
页数:12
相关论文
共 50 条
  • [1] Denoising Framework Based on Multiframe Continuous Point Clouds for Autonomous Driving LiDAR in Snowy Weather
    Yan, Xinyuan
    Yang, Junxing
    Zhu, Xinyu
    Liang, Yu
    Huang, He
    IEEE SENSORS JOURNAL, 2024, 24 (07) : 10515 - 10527
  • [2] Research on Lidar filtering algorithm for rainy and snowy weather
    Chen X.
    Ge M.
    Yao Z.
    Zhou Y.
    Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument, 2023, 44 (07): : 172 - 181
  • [3] GAN Inversion Based Point Clouds Denoising in Foggy Scenarios for Autonomous Driving
    Chai, Ru
    Li, Bin
    Liu, Zhengfa
    Li, Zhijun
    Chen, Guang
    Knoll, Alois
    2023 IEEE INTERNATIONAL CONFERENCE ON DEVELOPMENT AND LEARNING, ICDL, 2023, : 107 - 112
  • [4] Lidar Point Cloud Compression, Processing and Learning for Autonomous Driving
    Abbasi, Rashid
    Bashir, Ali Kashif
    Alyamani, Hasan J.
    Amin, Farhan
    Doh, Jaehyeok
    Chen, Jianwen
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (01) : 962 - 979
  • [5] Tracking Assisted LiDAR Target Detection Method During Rainy and Foggy Weather
    Du, Wenfeng
    Xu, Hua
    She, Sizhen
    Zhang, Cong
    Cen, Ming
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 207 - 212
  • [6] LIDSOR: A FILTER FOR REMOVING RAIN AND SNOW NOISE POINTS FROM LIDAR POINT CLOUDS IN RAINY AND SNOWY WEATHER
    Huang, He
    Yan, Xinyuan
    Yang, Junxing
    Cao, Yuming
    Zhang, Xin
    GEOSPATIAL WEEK 2023, VOL. 48-1, 2023, : 733 - 740
  • [7] A LiDAR Point Cloud Generator: from a Virtual World to Autonomous Driving
    Yue, Xiangyu
    Wu, Bichen
    Seshia, Sanjit A.
    Keutzer, Kurt
    Sangiovanni-Vincentelli, Alberto L.
    ICMR '18: PROCEEDINGS OF THE 2018 ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, 2018, : 458 - 464
  • [8] An Advanced LiDAR Point Cloud Sequence Coding Scheme for Autonomous Driving
    Sun, Xuebin
    Wang, Sukai
    Wang, Miaohui
    Cheng, Shing Shin
    Liu, Ming
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 2793 - 2801
  • [9] Bilateral filter denoising of Lidar point cloud data in automatic driving scene
    Wen, Guoqiang
    Zhang, Hongxia
    Guan, Zhiwei
    Su, Wei
    Jia, Dagong
    INFRARED PHYSICS & TECHNOLOGY, 2023, 131
  • [10] DENOISING POINT CLOUDS WITH INTENSITY AND SPATIAL FEATURES IN RAINY WEATHER
    Han, Haozheng
    Jin, Xin
    Li, Zhiheng
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 3015 - 3019