Multimedia-oriented action recognition in Smart City-based IoT using multilayer perceptron

被引:15
作者
AL Zamil, Mohammed G. H. [1 ]
Samarah, Samer [1 ]
Rawashdeh, Majdi [2 ]
Karime, Ali [3 ]
Hossain, M. Shamim [4 ,5 ]
机构
[1] Yarmouk Univ, Dept Comp Informat Syst, Irbid, Jordan
[2] Princess Sumaya Univ Technol, Dept Business Informat Technol, Amman, Jordan
[3] Univ Ottawa, Sch Elect Engn & Comp Sci EECS, Ottawa, ON, Canada
[4] King Saud Univ, Coll Comp & Informat Sci, Res Chair Pervas & Mobile Comp, Riyadh 11543, Saudi Arabia
[5] King Saud Univ, Dept Software Engn, Coll Comp & Informat Sci, Riyadh, Saudi Arabia
关键词
Internet of things; Multimedia big data; Multilayer perceptron neural networks; Smart City; HOME; MODELS; LIVE; FOG;
D O I
10.1007/s11042-018-6919-z
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The Internet of Things (IoT) devices and technologies for smart city applications produces a vast amount of multimedia data (e.g., audio, video, image, text and sensorial data), such big data are difficult to handle with traditional techniques and algorithms. The emerging machine learning techniques have the potential to facilitate the development of a new class of applications that can deal with such multimedia big data. Recently, Activity Recognition systems suggest using of multimedia data to detect daily actions, since it provides more accurate patterns; prevent the arising complain on privacy issues (in case of using audio-base data) and able to work on a big data. In this paper, we propose a Deep Learning (DL) methodology for classifying audio data that is based on multilayer perceptron neural networks. The contributions of our work are to propose an efficient design of the network topology including hidden layers, neurons, and the fitness function. In addition, the proposed methodology contributed in producing high performance classifier in terms of accuracy and f-measure. The experiments have been conducted on four large audio-datasets that have been collected to represent different modalities in a smart city. The results indicated that the proposed methodology achieved high performance as compared to the state-of-the-art machine learning techniques.
引用
收藏
页码:30315 / 30329
页数:15
相关论文
共 28 条
[1]   An ODT-based abstraction for mining closed sequential temporal patterns in IoT-cloud smart homes [J].
Al Zamil, Mohammed G. H. ;
Samarah, Samer M. J. ;
Rawashdeh, Majdi ;
Hossain, M. Anwar .
CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2017, 20 (02) :1815-1829
[2]   An Annotation Technique for In-Home Smart Monitoring Environments [J].
Al Zamil, Mohammed Gh. ;
Rawashdeh, Majdi ;
Samarah, Samer ;
Hossain, M. Shamim ;
Alnusair, Awny ;
Rahman, Sk Md Mizanur .
IEEE ACCESS, 2018, 6 :1471-1479
[3]   CIRDO: Smart companion for helping elderly to live at home for longer [J].
Bouakaz, S. ;
Vacher, M. ;
Chaumon, M. -E. Bobillier ;
Aman, F. ;
Bekkadja, S. ;
Portet, F. ;
Guillou, E. ;
Rossato, S. ;
Desseree, E. ;
Traineau, P. ;
Vimont, J. -P. ;
Chevalier, T. .
IRBM, 2014, 35 (02) :100-108
[4]   On-line human activity recognition from audio and home automation sensors: Comparison of sequential and non-sequential models in realistic Smart Homes [J].
Chahuara, Pedro ;
Fleury, Anthony ;
Portet, Francois ;
Vacher, Michel .
JOURNAL OF AMBIENT INTELLIGENCE AND SMART ENVIRONMENTS, 2016, 8 (04) :399-422
[5]   MavHome: An agent-based smart home [J].
Cook, DJ ;
Youngblood, M ;
Heierman, EO .
PROCEEDINGS OF THE FIRST IEEE INTERNATIONAL CONFERENCE ON PERVASIVE COMPUTING AND COMMUNICATIONS (PERCOM 2003), 2003, :521-524
[6]  
De Carolis B., 2004, INT J COMPUT INTELLI, V1, P1
[7]   Relational User Attribute Inference in Social Media [J].
Fang, Quan ;
Sang, Jitao ;
Xu, Changsheng ;
Hossain, M. Shamim .
IEEE TRANSACTIONS ON MULTIMEDIA, 2015, 17 (07) :1031-1044
[8]   Learning to live in a smart home [J].
Hargreaves, Tom ;
Wilson, Charlie ;
Hauxwell-Baldwin, Richard .
BUILDING RESEARCH AND INFORMATION, 2018, 46 (01) :127-139
[9]   Emotion recognition using deep learning approach from audio-visual emotional big data [J].
Hossain, M. Shamim ;
Muhammad, Ghulam .
INFORMATION FUSION, 2019, 49 :69-78
[10]   Cloud-assisted secure video transmission and sharing framework for smart cities [J].
Hossain, M. Shamim ;
Muhammad, Ghulam ;
Abdul, Wadood ;
Song, Biao ;
Gupta, B. B. .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2018, 83 :596-606