MODELING QUASI-PERIODIC DEPENDENCY VIA SELF-SUPERVISED PRE-TRAINING FOR RESPIRATORY SOUND CLASSIFICATION

被引:1
作者
Song, Wenjie [1 ]
Li, Jianchen [1 ]
Zheng, Guibin [1 ]
Zheng, Tieran [1 ]
He, Yongjun [1 ]
机构
[1] Harbin Inst Technol, Sch Comp Sci & Technol, Harbin, Peoples R China
来源
2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024 | 2024年
基金
中国国家自然科学基金;
关键词
Respiratory sound classification; self-supervised learning; quasi-periodic dependency;
D O I
10.1109/ICASSP48485.2024.10447972
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Despite the success of self-supervised respiratory sound classification methods, they do not consider that respiratory sounds are quasi-periodic signals with repetitive patterns in successive breaths, which is vital for distinguishing respiratory sounds from non-quasi-periodic sounds like noises. Therefore, the existing methods may achieve limited improvement due to ignoring the quasi-periodic dependency. To this end, considering that the segments containing the same respiratory sound pattern should be similar in a sample, we extract the segment-wise representations and evaluate the similarity between the periodic-dependent representations via a sparse self-relation matrix. By defining a periodic consistency loss, we push the sparse self-relation matrixes of two clips of the same sample closer, encouraging a larger similarity between the representations. In this manner, the method can focus more on the respiratory sound-related quasi-periodic patterns that repeatedly recur in the periodic-dependent segments. Taking HF Lung V1 and COVID-19 Sounds as pre-training sets, the method exceeds the baseline by 7.67% on the ICBHI 2017 classification task.
引用
收藏
页码:1996 / 2000
页数:5
相关论文
共 23 条
[1]  
[Anonymous], 2017, ARXIV, DOI DOI 10.1109/ICCV.2017.545
[2]   Emerging Properties in Self-Supervised Vision Transformers [J].
Caron, Mathilde ;
Touvron, Hugo ;
Misra, Ishan ;
Jegou, Herve ;
Mairal, Julien ;
Bojanowski, Piotr ;
Joulin, Armand .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :9630-9640
[3]   Methyl jasmonate alleviates chilling injury and keeps intact pericarp structure of pomegranate during low temperature storage [J].
Chen, Lan ;
Pan, Yanfang ;
Li, Haideng ;
Jia, Xiaoyu ;
Guo, Yanli ;
Luo, Jinshan ;
Li, Xihong .
FOOD SCIENCE AND TECHNOLOGY INTERNATIONAL, 2021, 27 (01) :22-31
[4]  
Chen X., 2020, arXiv preprint arXiv:2003.04297
[5]   An Empirical Study of Training Self-Supervised Vision Transformers [J].
Chen, Xinlei ;
Xie, Saining ;
He, Kaiming .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :9620-9629
[6]  
Dosovitskiy A., 2020, arXiv, V2010, P11929, DOI [10.48550/arXiv.2010.11929Focustolearnmore, DOI 10.48550/ARXIV.2010.11929FOCUSTOLEARNMORE]
[7]  
Grill J-B, 2020, PROC ADV NEURAL INF, V33, P21271
[8]   Momentum Contrast for Unsupervised Visual Representation Learning [J].
He, Kaiming ;
Fan, Haoqi ;
Wu, Yuxin ;
Xie, Saining ;
Girshick, Ross .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :9726-9735
[9]   Benchmarking of eight recurrent neural network variants for breath phase and adventitious sound detection on a self-developed open-access lung sound database-HF_Lung_V1 [J].
Hsu, Fu-Shun ;
Huang, Shang-Ran ;
Huang, Chien-Wen ;
Huang, Chao-Jung ;
Cheng, Yuan-Ren ;
Chen, Chun-Chieh ;
Hsiao, Jack ;
Chen, Chung-Wei ;
Chen, Li-Chin ;
Lai, Yen-Chun ;
Hsu, Bi-Fang ;
Lin, Nian-Jhen ;
Tsai, Wan-Ling ;
Wu, Yi-Lin ;
Tseng, Tzu-Ling ;
Tseng, Ching-Ting ;
Chen, Yi-Tsun ;
Lai, Feipei .
PLOS ONE, 2021, 16 (07)
[10]   Characterization of Bacillus velezensis AK-0 as a biocontrol agent against apple bitter rot caused by Colletotrichum gloeosporioides [J].
Kim, Young Soo ;
Lee, Younmi ;
Cheon, Wonsu ;
Park, Jungwook ;
Kwon, Hyeok-Tae ;
Balaraju, Kotnala ;
Kim, Jungyeon ;
Yoon, Yeo Jun ;
Jeon, Yongho .
SCIENTIFIC REPORTS, 2021, 11 (01)