Spatially-distributed Federated Learning of Convolutional Recurrent Neural Networks for Air Pollution Prediction

被引:12
作者
Do-Van Nguyen [1 ]
Zettsu, Koji [1 ]
机构
[1] Natl Inst Informat & Commun Technol NICT, Big Data Integrat Res Ctr, Tokyo, Japan
来源
2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA) | 2021年
关键词
Internet of Things (IoT); Environmental Sensors; Spatial-Temporal Data; Federated Learning; Air Pollution Prediction;
D O I
10.1109/BigData52589.2021.9671336
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Air pollution prediction for smart city applications has been attracted in artificial intelligence research to overcome problems to the health of citizen. Conventionally, environmental IoT data is gathered from monitoring station sensors then is sent to servers for centralized predictive model training at a whole region. That causes latency issues in data transmission from IoT devices to cloud servers. This paper describes federated learning paradigm approach for air pollution prediction model training on environmental monitoring sensor data. In the research, we design distributed learning framework that assists cooperative training among participants from different spatial areas such as cities and prefectures. At each area, Convolutional Recurrent Neural Networks (CRNN) are trained locally aiming to predict local Oxidant warning level while aggregated global model enhances distilled knowledge from all areas of a region. The research illustrates that designed common parts of CRNN can be fused globally meanwhile adaptive structure at predictive part of the deep neural network model can capture different environmental monitoring stations configuration at local areas. Some experiment results also hint methods to keep balance between federated learning synchronous training rounds and local deep neural network training epochs to maximize accuracy of the whole federated learning system. The results also prove that new participating areas can train and quickly obtain optimized local models by using transferred common global model.
引用
收藏
页码:3601 / 3608
页数:8
相关论文
共 20 条
[1]  
Arcas Y. B. A., 2017, PMLR, V54, P1273, DOI DOI 10.48550/ARXIV.1602.05629
[2]  
Bonawitz Keith, 2002, ARXIV190201046V2
[3]  
Bui TC, 2020, STAR SPATIO TEMPORAL
[4]   Federated Region-Learning for Environment Sensing in Edge Computing System [J].
Gao, Yujia ;
Liu, Liang ;
Hu, Binxuan ;
Lei, Tianzi ;
Ma, Huadong .
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2020, 7 (04) :2192-2204
[5]  
Hochreiter S., 1997, Neural Computation, V9, P1735
[6]   Air Quality Prediction in Smart Cities Using Machine Learning Technologies Based on Sensor Data: A Review [J].
Iskandaryan, Ditsuhi ;
Ramos, Francisco ;
Trilles, Sergio .
APPLIED SCIENCES-BASEL, 2020, 10 (07)
[7]  
Kairouz P, 2021, Arxiv, DOI [arXiv:1912.04977, DOI 10.1561/2200000083]
[8]   ImageNet Classification with Deep Convolutional Neural Networks [J].
Krizhevsky, Alex ;
Sutskever, Ilya ;
Hinton, Geoffrey E. .
COMMUNICATIONS OF THE ACM, 2017, 60 (06) :84-90
[9]   Spatiotemporal Deep Learning Model for Citywide Air Pollution Interpolation and Prediction [J].
Le, Van-Duc ;
Bui, Tien-Cuong ;
Cha, Sang-Kyun .
2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP 2020), 2020, :55-62
[10]  
Li Zhuohang, 2007, ARXIV210701477V2 CSL