REAL-TIME DENOISING AND DEREVERBERATION WTIH TINY RECURRENT U-NET

被引:37
|
作者
Choi, Hyeong-Seok [1 ,2 ]
Park, Sungjin [1 ]
Lee, Jie Hwan [2 ]
Heo, Hoon [2 ]
Jeon, Dongsuk [1 ]
Lee, Kyogu [1 ,2 ]
机构
[1] Seoul Natl Univ, Artificial Intelligence Inst, Dept Intelligence & Informat, Seoul, South Korea
[2] Supertone Inc, Canoga Pk, CA 91307 USA
关键词
real-time speech enhancement; lightweight network; denoising; dereverberation;
D O I
10.1109/ICASSP39728.2021.9414852
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Modern deep learning-based models have seen outstanding performance improvement with speech enhancement tasks. The number of parameters of state-of-the-art models, however, is often too large to be deployed on devices for real-world applications. To this end, we propose Tiny Recurrent U-Net (TRU-Net), a lightweight online inference model that matches the performance of current state-of-the-art models. The size of the quantized version of TRU-Net is 362 kilobytes, which is small enough to be deployed on edge devices. In addition, we combine the small-sized model with a new masking method called phase-aware beta-sigmoid mask, which enables simultaneous denoising and dereverberation. Results of both objective and subjective evaluations have shown that our model can achieve competitive performance with the current state-of-the-art models on benchmark datasets using fewer parameters by orders of magnitude.
引用
收藏
页码:5789 / 5793
页数:5
相关论文
共 50 条
  • [21] Underwater Color Restoration Using U-Net Denoising Autoencoder
    Hashisho, Yousif
    Albadawi, Mohamad
    Krause, Tom
    von Lukas, Uwe Freiherr
    PROCEEDINGS OF THE 2019 11TH INTERNATIONAL SYMPOSIUM ON IMAGE AND SIGNAL PROCESSING AND ANALYSIS (ISPA 2019), 2019, : 117 - 122
  • [22] DDUNet: Dense Dense U-Net with Applications in Image Denoising
    Jia, Fan
    Wong, Wing Hong
    Zeng, Tieyong
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, : 354 - 364
  • [23] Comparing U-Net Based Models for Denoising Color Images
    Komatsu, Rina
    Gonsalves, Tad
    AI, 2020, 1 (04) : 465 - 486
  • [24] Learning U-Net without forgetting for near real-time wildfire monitoring by the fusion of SAR and optical time series
    Zhang, Puzhao
    Ban, Yifang
    Nascetti, Andrea
    REMOTE SENSING OF ENVIRONMENT, 2021, 261
  • [25] U-Net based neural network for fringe pattern denoising
    Gurrola-Ramos, Javier
    Dalmau, Oscar
    Alarcon, Teresa
    OPTICS AND LASERS IN ENGINEERING, 2022, 149
  • [26] MSU-Net: Multiscale Statistical U-Net for Real-Time 3D Cardiac MRI Video Segmentation
    Wang, Tianchen
    Xiong, Jinjun
    Xu, Xiaowei
    Jiang, Meng
    Yuan, Haiyun
    Huang, Meiping
    Zhuang, Jian
    Shi, Yiyu
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT II, 2019, 11765 : 614 - 622
  • [27] Elevator vibration signal denoising by deep residual U-Net
    Xie, Pengdong
    Zhang, Linxuan
    Li, Minghong
    Lau, Shing Fung Sean
    Huang, Jinhui
    MEASUREMENT, 2024, 225
  • [28] Real-Time Streaming Point Cloud Compression for 3D LiDAR Sensor Using U-Net
    Tu, Chenxi
    Takeuchi, Eijiro
    Carballo, Alexander
    Takeda, Kazuya
    IEEE ACCESS, 2019, 7 : 113616 - 113625
  • [29] A Causal U-net based Neural Beamforming Network for Real-Time Multi-Channel Speech Enhancement
    Ren, Xinlei
    Zhang, Xu
    Chen, Lianwu
    Zheng, Xiguang
    Zhang, Chen
    Guo, Liang
    Yu, Bing
    INTERSPEECH 2021, 2021, : 1832 - 1836
  • [30] Improving near real-time precipitation estimation using a U-Net convolutional neural network and geographical information
    Sadeghi, Mojtaba
    Phu Nguyen
    Hsu, Kuolin
    Sorooshian, Soroosh
    ENVIRONMENTAL MODELLING & SOFTWARE, 2020, 134 (134)