Privacy Enhanced Speech Emotion Communication using Deep Learning Aided Edge Computing

被引:9
作者
Ali, Hafiz Shehbaz [1 ]
ul Hassan, Fakhar [2 ]
Latif, Siddique [3 ]
Manzoor, Habib Ullah [4 ]
Qadir, Junaid [2 ]
机构
[1] EmulationAI, Brisbane, Qld, Australia
[2] Informat Technol Univ ITU, Lahore, Punjab, Pakistan
[3] Univ Southern Queensland, Brisbane, Qld, Australia
[4] Univ Engn & Technol, Lahore, Pakistan
来源
2021 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS) | 2021年
关键词
emotion communication system; speech emotion recognition; privacy enhanced features; deep learning; edge computing; REPRESENTATIONS; HEALTH;
D O I
10.1109/ICCWorkshops50388.2021.9473669
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Speech emotion sensing in communication networks has a wide range of applications in real life. In these applications, voice data are transmitted from the user to the central server for storage, processing, and decision making. However, speech data contain vulnerable information that can be used maliciously without the user's consent by an eavesdropping adversary. In this work, we present a privacy-enhanced emotion communication system for preserving the user personal information in emotion-sensing applications. We propose the use of an adversarial learning framework that can be deployed at the edge to unlearn the users' private information in the speech representations. These privacy-enhanced representations can be transmitted to the central server for decision making. We evaluate the proposed model on multiple speech emotion datasets and show that the proposed model can hide users' specific demographic information and improve the robustness of emotion identification without significantly impacting performance. To the best of our knowledge, this is the first work on a privacy-preserving framework for emotion sensing in the communication network.
引用
收藏
页数:5
相关论文
共 34 条
[31]   Emotion-awareness for intelligent Vehicle Assistants: a research agenda [J].
Voegel, Hans-Joerg ;
Suess, Christian ;
Hubregtsen, Thomas ;
Ghaderi, Viviane ;
Chadowitz, Ronee ;
Andre, Elisabeth ;
Cummins, Nicholas ;
Schuller, Bjoern ;
Harri, Jerome ;
Troncy, Raphael ;
Huet, Benoit ;
Onen, Melek ;
Ksentini, Adlen ;
Conradt, Joerg ;
Adi, Asaf ;
Zadorojniy, Alexander ;
Terken, Jacques ;
Beskow, Jonas ;
Morrison, Ann ;
Eng, Kynan ;
Eyben, Florian ;
Al Moubayed, Samer ;
Mueller, Susanne .
PROCEEDINGS 2018 IEEE/ACM 1ST INTERNATIONAL WORKSHOP ON SOFTWARE ENGINEERING FOR AI IN AUTONOMOUS SYSTEMS (SEFAIAS), 2018, :11-15
[32]   On the acoustics of emotion in audio: what speech, music, and sound have in common [J].
Weninger, Felix ;
Eyben, Florian ;
Schuller, Bjoern W. ;
Mortillaro, Marcello ;
Scherer, Klaus R. .
FRONTIERS IN PSYCHOLOGY, 2013, 4
[33]  
Xu B, 2015, Arxiv, DOI arXiv:1505.00853
[34]   Multi-task emotion communication system with dynamic resource allocations [J].
Zhou, Ping ;
Hossain, M. Shamim ;
Zong, Xiaofen ;
Muhammad, Ghulam ;
Amin, Syed Umar ;
Humar, Iztok .
INFORMATION FUSION, 2019, 52 :167-174